Caroline's Corner: Usability Test Reports - your Chance to influence a New Standard

What do you think about international standards such as ISO 13407 or ISO 9000? Necessary but dull? Expensive but important? Irrelevant to daily life?

I'm not going to pretend that these documents are ever going to compete with Harry Potter or the Da Vinci Code for the public's attention as light reading. But a standard can be really helpful in guiding us towards appropriate professional practice (that's 'doing things properly' in plain English). I've also found that certain clients with engineering or bureaucratic tendencies respond really well to the idea that 'we're following a standard'.

CIF FOR FORMATIVE

So I'm delighted to report on progress that's being made on a standard for usability test reports, to be precise 'a common industry format for reports of formative usability tests'.

Let's deconstruct that snappy little title.

'Common industry format': the idea is that we'll have a format that is accepted and used widely by usability practitioners.

'Reports': there are lots of ways of communicating the results of testing within teams and to clients. Many of us find that getting people along to view the test is one of the most effective methods, with video highlights a close runner up. But the written report is still crucial: for communicating results, for creating a record, and for demonstrating value in what we do. And, let's be honest: many of us get paid when we've delivered the report.

'Formative usability tests': why put in the word 'formative'? Because there is already a common industry format for 'summative' usability tests. Not sure of the difference between 'formative' and 'summative'? I think of them like this: the primary purpose of a 'summative' test is to find out how usable something is. Whereas the primary purpose of a 'formative' test is to create ideas for how to make it more usable. You might actually do similar things for either type of test but the purpose is different. (Arguments on this, as with anything else I write, are always welcome: email address below).

PROGRESS TOWARDS A STANDARD

I've always been a bit wary of the common industry format for summative usability tests (CIF). It's a good format, to be sure, but my work is almost always intended to help create change, preferably in the direction of better usability. My experience has been that the clients are mostly interested in what we found and what to do about it, whereas the CIF majors on what we did and doesn't have space for recommendations.

So I was pleased when, thanks to a bit of juggling of commitments in the USA, I was able to get to workshop in Boston that's started the work on the 'CIF for formative'. Over 30 highly opinionated usability specialists succeeded in working together and achieving consensus on things like a first version of a shopping list of items that could be included in the report, possible metrics, and some rules or suggestions for how you choose which things to put in the report.

WHAT HAPPENS NEXT

Now we get to the 'your chance to influence' bit. The workshop ended with a call for volunteers who will take the work so far, formalise it, and generally beat it into shape. I'm sure that some testing of the proposed format will be in there somewhere. So if you're interested in helping, now is your chance. Write to Mary Theofanos at the National Institute for Standards and Technology: mary.theofanos@nist.gov explaining why you'd like to help, what you can do and your background in the field. Let's give her plenty of options to choose from the best in the profession.

REFERENCES

Description of ISO 13407 http://www.usabilitynet.org/tools/13407stds.htm

Purchase ISO 13407 or ISO 9000 in UK through BSI www.bsi-global.com or internationally through ISO http://www.iso.org

More information on the common industry format for summative testing http://zing.ncsl.nist.gov/iusr/

If you have any comments or suggestions about this article then please contact Caroline at:

Caroline.Jarrett@Effortmark.co.uk

Caroline Jarrett is a usability consultant specialising in forms, questionnaires and data capture.

© 2004 Caroline Jarrett, all rights reserved.

Associated Link: Effortmark

'Internet addiction' linked to Depression
Source: BBC, 9 February 2010
 
There is a strong link between heavy internet use and depression, UK psychologists have said.

Could *You* be more Usable?
Source: UN, 8 February 2010
 
Bet you could.

Stowe Boyd on 'Steampunk' thinking about the Future of Computing
Source: Stowe Boyd's blog via Experientia, 6 February 2010
 
Are established metaphors of user experience holding us back from new ways of structuring our interaction through computers?

Nokia's User Experience Programme
Source: UN, 5 February 2010
 
Nokia has put together a rich and informative website covering the key elements of user experience.

Interfaces magazine: latest issue available now
Source: HCI News Service, 4 February 2010
 
The latest issue of Interfaces is now available in pdf format, free from the Interaction Website.

A Lighter Brigade of Chargers
Source: UN, 3 February 2010
 
Lots of gadgets, one charger. At last.

Mobile Touch Screens could soon Feel the Pressure
Source: MIT Technology Review, 2 February 2010
 
A quantum switch could add pressure sensing to mobile screens.

Usability, Usability, Usability: why the iPad will Succeed
Source: Econsultancy, 1 February 2010
 
The tech critics love it, hate it, love it again, shrug it off. What do usability experts say?

British Airways - at last some good news
Source: Loop11, 30 January 2010
 
In a recent website usability study for the world's leading airlines, the British Airways website proved to be the most user friendly, with Malaysia Airlines and Virgin Atlantic having the lowest user experience rating.

Computation of Emotions in Man and Machine
Source: Royal Society, 29 January 2010
 
Advances in computer technology now allow machines to recognise and express emotions, paving the way for improved human-computer and human-human communications.