Caroline's Corner - Good Headings help, bad Headings hurt

I've been on the road recently, teaching my 'Editing that Works' workshops to teams of web content providers in a government department. 'Choose what to say,' I urge them. 'And do it like this:

- apply headings to your text

- review the headings to see whether they're any use to your readers.

- cut out the bits that readers don't need

- and don't bother doing any editing until you've done your cutting.'

So we spend a lot of time in the workshop writing headings and cutting. Then writing more headings that reflect what we're left with. Do you see a bit of a heading theme developing here?

SOME RECENT RESEARCH ON HEADINGS
So I was brought up a bit short when a friend asked me my opinion about a recent article in 'Technical Communication', the journal of the Society for Technical Communication. Bartell, Schultz and Spyridakis, researchers at the University of Washington, tested the effects of headings in comparable print and online materials.

They chose similar articles on two types of arthritis, prepared four versions: no headings, low frequency (one heading approximately every 300 words), medium frequency (every 200 words) and high frequency (100 words). To give you a benchmark, we've just hit 204 words in this 'Corner'. So in the high frequency condition, we would have already had two headings. I've had one, which makes it 'medium frequency'.

The team chose to ask engineering students to read the articles, then answer questions on them without referring back. The task was deliberately set up as

(a) a reading task where the material would be both unfamiliar and not very interesting and

(b) a 'reading to learn' task, where the objective is to master and remember material.

Did you spot that reading to learn uninteresting material is rather unusual? Most of us are 'reading to do', trying to achieve something. Or, if we are 'reading to learn', then it's generally because we are somewhat interested in the topic. But let's not worry too much about that for the moment and continue with the research.

THE RESULTS: PAPER IS EASIER TO LEARN FROM
Overall, paper scored better. Not a great deal better. Students who used paper achieving a mean score of 9.70 whereas students who studied online achieved a mean of 8.88 - that's about 8% better on paper.

But if we look at the standard deviations (that is, the statistical measure of the spread of results), then it's noticeable that the results for paper were more tightly grouped: 1.84 versus 2.59. So the top end of the students studying from paper (one standard deviation above from the mean) was a score of 11.54. And the top end of students studying online was: 11.47. That's only 1% difference.

Now look at the 'low end'. One standard deviation below the mean for paper is 7.86, the same for online is 6.29. That's 40% difference.

So what I think is happening (my view, not taken from the paper) is that good students survive the transition from paper to web better than poorer students. The good ones get knocked back a tiny bit: the poor students take a big hit.

THE RESULTS: TOO MANY HEADINGS HURT AS MUCH AS NO HEADINGS
When the researchers analysed the findings for the impact of headings, they got mixed results.

On paper, the frequency of headings didn't make much difference. The researchers don't give us the actual figures but the graph they publish shows all four heading conditions grouped rather closely around that mean comprehension score of 9.70.

But online, the difference is quite obvious. The order is:

- Medium frequency headings (about every 200 words): the best

- Low frequency headings (about every 300 words): in the middle

- High frequency (about every 100 words) and No headings: tied for the worst, with 'No headings' slightly ahead.

BE CAREFUL WITH YOUR HEADINGS
So yet again, we find that unthinkingly following a guideline is no good.

It's not enough to say: 'Write headings'. They have to be good headings, and placed thoughtfully in the text.

TO BRUSH UP YOUR HEADINGS
1. Try Ginny Redish's short article on headings: http://www.plainlanguage.gov/howto/guidelines/headings.cfm

2. Or work through this online lesson: http://www.arconics.com/elearning/creating_effective_headings/overview.html

REFERENCE
Bartell, A, L., Schultz, L. D. and Spyridakis, J. H., (2006) "The Effect of Heading Frequency on Comprehension of Print Versus Online Information" Technical Communication, Volume 53 Number 4, November 2006

If you have any comments or suggestions about this article then please contact Caroline at:

Caroline.Jarrett@Effortmark.co.uk

Caroline Jarrett is a usability consultant specialising in forms, questionnaires and data capture.

© 2007 Caroline Jarrett, all rights reserved.

Associated Link: Effortmark

'Internet addiction' linked to Depression
Source: BBC, 9 February 2010
 
There is a strong link between heavy internet use and depression, UK psychologists have said.

Could *You* be more Usable?
Source: UN, 8 February 2010
 
Bet you could.

Stowe Boyd on 'Steampunk' thinking about the Future of Computing
Source: Stowe Boyd's blog via Experientia, 6 February 2010
 
Are established metaphors of user experience holding us back from new ways of structuring our interaction through computers?

Nokia's User Experience Programme
Source: UN, 5 February 2010
 
Nokia has put together a rich and informative website covering the key elements of user experience.

Interfaces magazine: latest issue available now
Source: HCI News Service, 4 February 2010
 
The latest issue of Interfaces is now available in pdf format, free from the Interaction Website.

A Lighter Brigade of Chargers
Source: UN, 3 February 2010
 
Lots of gadgets, one charger. At last.

Mobile Touch Screens could soon Feel the Pressure
Source: MIT Technology Review, 2 February 2010
 
A quantum switch could add pressure sensing to mobile screens.

Usability, Usability, Usability: why the iPad will Succeed
Source: Econsultancy, 1 February 2010
 
The tech critics love it, hate it, love it again, shrug it off. What do usability experts say?

British Airways - at last some good news
Source: Loop11, 30 January 2010
 
In a recent website usability study for the world's leading airlines, the British Airways website proved to be the most user friendly, with Malaysia Airlines and Virgin Atlantic having the lowest user experience rating.

Computation of Emotions in Man and Machine
Source: Royal Society, 29 January 2010
 
Advances in computer technology now allow machines to recognise and express emotions, paving the way for improved human-computer and human-human communications.