Caroline's Corner: Persona-led Heuristic Inspection is Here

Last week, a sell-out crowd made their way to Oyster Partners to hear Ginny Redish talk about her recent work at a meeting of the UK chapter of the Usability Professionals’ Association. She’s kindly allowed us to put the slides on the UK UPA website: http://www.ukupa.org.uk

Ginny’s talk ranged widely across content and the web. Just picking out a few examples, we learned:
- about a linguistic perspective on how users react to content (including a fun exercise that challenged our artistic abilities).
- how blind users react to the "click here" style of linking (with frustration), and
- how using colour alone can flummox users with low vision who change those colours.

But the bit that I want to concentrate on here is the variation on heuristic inspection that she presented.

WHY DO WE NEED A NEW WAY OF DOING HEURISTIC INSPECTIONS?
‘Heuristics’, otherwise known as ‘rules of thumb’, are guidelines for good design. It’s always been attractive to think: why go to all that complication of recruiting users and getting them to test our products when we could just have a good look at it ourselves? And so the idea of ‘heuristic inspection’ was born, and popularised by Jakob Nielsen and Rolf Molich.

You select the heuristics of your choice (Ginny and Dana Chisnell have developed a set that is especially relevant to older web users: http://www.redish.net/content/handouts/Audience-Centered_Heuristics.pdf) and then you review your product to see if it breaks any of the rules.

The trouble is that heuristic inspection often isn’t very successful. For example, Rolf Molich now says: 'Heuristic inspections are cheap, simple to explain, and deceptively simple to execute. However, I don't use this method very often and I don't recommend it to my clients. In my opinion, the idea that anyone can conduct a useful heuristic inspection after a crash course is rubbish. The results from my studies showed that inexperienced inspectors working on their own often produce disastrous amounts of "false alarms".

'Another problem is that heuristic inspection is based solely on opinions. No one has given me a good answer to the question that I've heard several times from disbelieving designers: "Why are your opinions better than mine?" I think that's an excellent question, particularly knowing that users often prove me wrong whenever my heuristic predictions are put to a real usability test.'
http://www.webpronews.com/webdevelopment/sitedesign/wpn-26-20030730UsabilityTestingBestPracticesAnInterviewwithRolfMolich.html

But here’s the dilemma: sometimes we need to review a product for usability in circumstances where usability testing isn’t an option. Lack of time, lack of budget, unwilling client: you name it. So an improvement on the heuristic inspection would be a great idea.

PERSONA-LED HEURISTIC INSPECTION
Ginny introduced us to a new method of doing heuristic inspection that she has developed with Dana Chisnell (www.usabilityworks.com). They’d done a lot of usability testing for AARP, the USA organisation for people over 50. For example, see http://www.aarp.org/olderwiserwired/oww-features/Articles/a2004-03-03-comparison-studies.html.

But this time, AARP wanted a review of 50 sites, and they wanted it in time scales that made it impossible to run enough usability tests. So Ginny and Dana turned to personas for inspiration. Fortunately, AARP had a thoroughly-researched set of personas that described key segments of their audience. So Ginny and Dana chose two of them, and then visited the selected sites from the point of view of each of the personas.

They reviewed each site as one of the personas, and took notes as if the persona had performed a ‘think aloud’ commentary on it.

Then they went back and reviewed the pages visited and the comments to see if the site had conformed to or violated any of the heuristics.

WHY IS THE NEW METHOD BETTER?
Ginny explained that their method applies the heuristics more intensively than a simple check-list approach would do. 'Sometimes we found that some pages in a website did pretty well on a heuristic, while other pages did poorly. If you just looked at a couple of pages in the site to see if it conformed, you’d miss the issues.'

She also confirmed that usability testing is still her preferred technique. 'But if you need to get a lot of data quickly, then this is one way to get a start on it.'

If you have any comments or suggestions about this article then please contact Caroline Jarrett at:

Caroline.Jarrett@Effortmark.co.uk

Caroline Jarrett is a usability consultant specialising in forms, questionnaires and data capture.

© 2005 Caroline Jarrett, all rights reserved.

Associated Link: Effortmark

All change at the top for System Concepts
Source: System Concepts Ltd, 3 July 2009
 
Leslie Fountain has been promoted to joint Managing Director of leading usability consultancy System Concepts.

Life in UCD immortalised in fiction: you couldn't make it up
Source: UN, 2 July 2009
 
Sarah Herman's fictitious book on life in a user-centred design company has hit the shelves and The Guardian's book pages...

Interfaces Magazine - Issue 79: The Education Issue
Source: Interaction Group, 1 July 2009
 
The latest issue of Interfaces is now available as a free download from the Interaction Website.

Two new Behavioural research Tools from Noldus
Source: UN, 30 June 2009
 
Tool updates make on-site behavioural data collection easier.

Cell Phones that Listen and Learn
Source: MIT Technology Review, 29 June 2009
 
New software tracks a user's behavior by monitoring everyday sounds.

Top Six Don’ts for Usability Testing
Source: FutureNow Inc., 27 June 2009
 
Six tips for creating quality usability tests to ensure useful feedback from testers.

Usability: ‘Lovely software. But I can’t work it’
Source: FT.com, 26 June 2009
 
In a recent survey by Global Graphics, 77 per cent of office workers estimate they lose up to one hour a week because business software is difficult to use.

And what do you do?
Source: Dexo Design, 25 June 2009
 
How do you describe your job role? Here are the results of a recent 'Preferred UX/UI Title' Poll.

Most Doctors cite Usability as critical to Electronic Health Record Adoption
Source: TMCNet, 24 June 2009
 
It's all about 'meaningful use'.

Glossy monitors look good but can hurt
Source: QUT, 23 June 2009
 
A new advisory cites research which suggests high gloss monitors make users sit awkwardly.