Response: Why Readability Testing is not Enough

The recent press coverage of the Bath University research paper "Readability Assessment of British Internet Information Resources on Diabetes Mellitus Targeting Laypersons" (including UN's own story: NHS Direct Website too complicated for Diabetes Sufferers) has raised interesting questions about some of the methodologies used to measure users' experience on the Web.

The research assessed the readability of 20 information resources on diabetes using Microsoft Word's automated testing feature, which gives a Flesch-Kincaid Grade (rates text on a US grade-school level; the lower the score, the easier it is to understand the document.) and Flesch Reading Ease level (rates text on a 100-point scale; the higher the score, the easier it is to understand the document) score. This was then compared against the 'average' reading age of the population giving the conclusion that a majority of the sites tested were 'too complicated' for their readers.

On the face of it, this conclusion and the methodology used is fine, but due to the indiscriminate nature of automated testing tools, it doesn’t present the entire picture and, at worst, can give the impression that the users of these websites can’t understand the content at all, which may not be the case.

For example;

• A health website which uses (and in most cases defines) medical terminology would score high when evaluated using 'Readability formulae that estimate the reading level of a document based on the words that are used and the lengths of sentences'.

• The readers of such information would most likely have a good understanding of the medical environment surrounding their condition, which would make the articles easier to understand.

It’s this lack of context in the research that gives the biggest cause for concern, as some of the sites tested may automatically try to lower the reading age of their articles. They would then run the risk of alienating their actual users, who might not need a simpler article!

I would forgive anyone reading this for thinking that I’m dismissing the research out of hand, but in fact I welcome any research that can help us to provide a better service to our users. This research has done that because it’s made the people in the healthcare community look at how readable their websites are. But the key message is, and should always be, know your users and test against them not just by using automated tools.

(In case you're wondering, the Flesch-Kincaid Grade and Flesch Reading Ease level of this article is 60.5 and 11.1. I hope you’ve managed to understand it okay!)

Matt Goddard

The views presented in this article are those of the author and not the opinion of NHS Direct.

Online videos: Engaging your users
Source: Webcredible, 6 September 2008
 
A guide to using online video on your site to offer more enticing content and provide a more compelling user experience.

The Office of the Future?
Source: Occupational Hazards via Ergonomics in the News, 5 September 2008
 
The office of the future is less about technology and more about physiology.

This year's 10 best-designed Application User Interfaces
Source: NNg, 4 September 2008
 
Nielsen Norman Group recently announced the winners in its inaugural competition to find the 10 best-designed application user interfaces of the Application Design Annual 2008.

Caroline's Corner: Buttons on Forms - where to put them, and what to call them
Source: Caroline Jarrett, 3 September 2008
 
Should you put the ‘OK’ button to the left or the right of the ‘Cancel’ button? Like so much in forms, the simple answer isn’t really appropriate. And yet, who needs another ‘it depends’?

Three Usability Gurus
Source: avangate blog, 2 September 2008
 
A personal view, but lots of good links, especially if you're new to usability.

Ofcom publishes report on Usability Event
Source: Ofcom, 1 September 2008
 
Independent regulator and competition authority for the UK communications industries, Ofcom, has published its report on usability issues.

Get Fit for Remote Working
Source: UN, 30 August 2008
 
BT Business has announced the launch of a practical guide 'Get fit for mobile working' designed to help mobile workers avoid back, neck and arm problems.

Site Visit Interviews: from Good to Great
Source: User Focus, 29 August 2008
 
For those of you for whom the Basic Introduction to User Interviews wasn't quite enough.

Six Metrics for Managing UI Design
Source: Russell Wilson, 28 August 2008
 
A proposal of six metrics to be used for managing a user interface design department.

Don't Judge a Form by its Cover
Source: Formulate Information Design, 27 August 2008
 
The saying "don't judge a book by its cover" reminds us that looks are deceptive. It turns out that this idiom applies to forms too.