Caroline's Corner - Good Headings help, bad Headings hurt

I've been on the road recently, teaching my 'Editing that Works' workshops to teams of web content providers in a government department. 'Choose what to say,' I urge them. 'And do it like this:

- apply headings to your text

- review the headings to see whether they're any use to your readers.

- cut out the bits that readers don't need

- and don't bother doing any editing until you've done your cutting.'

So we spend a lot of time in the workshop writing headings and cutting. Then writing more headings that reflect what we're left with. Do you see a bit of a heading theme developing here?

SOME RECENT RESEARCH ON HEADINGS
So I was brought up a bit short when a friend asked me my opinion about a recent article in 'Technical Communication', the journal of the Society for Technical Communication. Bartell, Schultz and Spyridakis, researchers at the University of Washington, tested the effects of headings in comparable print and online materials.

They chose similar articles on two types of arthritis, prepared four versions: no headings, low frequency (one heading approximately every 300 words), medium frequency (every 200 words) and high frequency (100 words). To give you a benchmark, we've just hit 204 words in this 'Corner'. So in the high frequency condition, we would have already had two headings. I've had one, which makes it 'medium frequency'.

The team chose to ask engineering students to read the articles, then answer questions on them without referring back. The task was deliberately set up as

(a) a reading task where the material would be both unfamiliar and not very interesting and

(b) a 'reading to learn' task, where the objective is to master and remember material.

Did you spot that reading to learn uninteresting material is rather unusual? Most of us are 'reading to do', trying to achieve something. Or, if we are 'reading to learn', then it's generally because we are somewhat interested in the topic. But let's not worry too much about that for the moment and continue with the research.

THE RESULTS: PAPER IS EASIER TO LEARN FROM
Overall, paper scored better. Not a great deal better. Students who used paper achieving a mean score of 9.70 whereas students who studied online achieved a mean of 8.88 - that's about 8% better on paper.

But if we look at the standard deviations (that is, the statistical measure of the spread of results), then it's noticeable that the results for paper were more tightly grouped: 1.84 versus 2.59. So the top end of the students studying from paper (one standard deviation above from the mean) was a score of 11.54. And the top end of students studying online was: 11.47. That's only 1% difference.

Now look at the 'low end'. One standard deviation below the mean for paper is 7.86, the same for online is 6.29. That's 40% difference.

So what I think is happening (my view, not taken from the paper) is that good students survive the transition from paper to web better than poorer students. The good ones get knocked back a tiny bit: the poor students take a big hit.

THE RESULTS: TOO MANY HEADINGS HURT AS MUCH AS NO HEADINGS
When the researchers analysed the findings for the impact of headings, they got mixed results.

On paper, the frequency of headings didn't make much difference. The researchers don't give us the actual figures but the graph they publish shows all four heading conditions grouped rather closely around that mean comprehension score of 9.70.

But online, the difference is quite obvious. The order is:

- Medium frequency headings (about every 200 words): the best

- Low frequency headings (about every 300 words): in the middle

- High frequency (about every 100 words) and No headings: tied for the worst, with 'No headings' slightly ahead.

BE CAREFUL WITH YOUR HEADINGS
So yet again, we find that unthinkingly following a guideline is no good.

It's not enough to say: 'Write headings'. They have to be good headings, and placed thoughtfully in the text.

TO BRUSH UP YOUR HEADINGS
1. Try Ginny Redish's short article on headings: http://www.plainlanguage.gov/howto/guidelines/headings.cfm

2. Or work through this online lesson: http://www.arconics.com/elearning/creating_effective_headings/overview.html

REFERENCE
Bartell, A, L., Schultz, L. D. and Spyridakis, J. H., (2006) "The Effect of Heading Frequency on Comprehension of Print Versus Online Information" Technical Communication, Volume 53 Number 4, November 2006

If you have any comments or suggestions about this article then please contact Caroline at:

Caroline.Jarrett@Effortmark.co.uk

Caroline Jarrett is a usability consultant specialising in forms, questionnaires and data capture.

© 2007 Caroline Jarrett, all rights reserved.

Associated Link: Effortmark

All change at the top for System Concepts
Source: System Concepts Ltd, 3 July 2009
 
Leslie Fountain has been promoted to joint Managing Director of leading usability consultancy System Concepts.

Life in UCD immortalised in fiction: you couldn't make it up
Source: UN, 2 July 2009
 
Sarah Herman's fictitious book on life in a user-centred design company has hit the shelves and The Guardian's book pages...

Interfaces Magazine - Issue 79: The Education Issue
Source: Interaction Group, 1 July 2009
 
The latest issue of Interfaces is now available as a free download from the Interaction Website.

Two new Behavioural research Tools from Noldus
Source: UN, 30 June 2009
 
Tool updates make on-site behavioural data collection easier.

Cell Phones that Listen and Learn
Source: MIT Technology Review, 29 June 2009
 
New software tracks a user's behavior by monitoring everyday sounds.

Top Six Don’ts for Usability Testing
Source: FutureNow Inc., 27 June 2009
 
Six tips for creating quality usability tests to ensure useful feedback from testers.

Usability: ‘Lovely software. But I can’t work it’
Source: FT.com, 26 June 2009
 
In a recent survey by Global Graphics, 77 per cent of office workers estimate they lose up to one hour a week because business software is difficult to use.

And what do you do?
Source: Dexo Design, 25 June 2009
 
How do you describe your job role? Here are the results of a recent 'Preferred UX/UI Title' Poll.

Most Doctors cite Usability as critical to Electronic Health Record Adoption
Source: TMCNet, 24 June 2009
 
It's all about 'meaningful use'.

Glossy monitors look good but can hurt
Source: QUT, 23 June 2009
 
A new advisory cites research which suggests high gloss monitors make users sit awkwardly.