Caroline's Corner: Persona-led Heuristic Inspection is Here

Last week, a sell-out crowd made their way to Oyster Partners to hear Ginny Redish talk about her recent work at a meeting of the UK chapter of the Usability Professionals’ Association. She’s kindly allowed us to put the slides on the UK UPA website: http://www.ukupa.org.uk

Ginny’s talk ranged widely across content and the web. Just picking out a few examples, we learned:
- about a linguistic perspective on how users react to content (including a fun exercise that challenged our artistic abilities).
- how blind users react to the "click here" style of linking (with frustration), and
- how using colour alone can flummox users with low vision who change those colours.

But the bit that I want to concentrate on here is the variation on heuristic inspection that she presented.

WHY DO WE NEED A NEW WAY OF DOING HEURISTIC INSPECTIONS?
‘Heuristics’, otherwise known as ‘rules of thumb’, are guidelines for good design. It’s always been attractive to think: why go to all that complication of recruiting users and getting them to test our products when we could just have a good look at it ourselves? And so the idea of ‘heuristic inspection’ was born, and popularised by Jakob Nielsen and Rolf Molich.

You select the heuristics of your choice (Ginny and Dana Chisnell have developed a set that is especially relevant to older web users: http://www.redish.net/content/handouts/Audience-Centered_Heuristics.pdf) and then you review your product to see if it breaks any of the rules.

The trouble is that heuristic inspection often isn’t very successful. For example, Rolf Molich now says: 'Heuristic inspections are cheap, simple to explain, and deceptively simple to execute. However, I don't use this method very often and I don't recommend it to my clients. In my opinion, the idea that anyone can conduct a useful heuristic inspection after a crash course is rubbish. The results from my studies showed that inexperienced inspectors working on their own often produce disastrous amounts of "false alarms".

'Another problem is that heuristic inspection is based solely on opinions. No one has given me a good answer to the question that I've heard several times from disbelieving designers: "Why are your opinions better than mine?" I think that's an excellent question, particularly knowing that users often prove me wrong whenever my heuristic predictions are put to a real usability test.'
http://www.webpronews.com/webdevelopment/sitedesign/wpn-26-20030730UsabilityTestingBestPracticesAnInterviewwithRolfMolich.html

But here’s the dilemma: sometimes we need to review a product for usability in circumstances where usability testing isn’t an option. Lack of time, lack of budget, unwilling client: you name it. So an improvement on the heuristic inspection would be a great idea.

PERSONA-LED HEURISTIC INSPECTION
Ginny introduced us to a new method of doing heuristic inspection that she has developed with Dana Chisnell (www.usabilityworks.com). They’d done a lot of usability testing for AARP, the USA organisation for people over 50. For example, see http://www.aarp.org/olderwiserwired/oww-features/Articles/a2004-03-03-comparison-studies.html.

But this time, AARP wanted a review of 50 sites, and they wanted it in time scales that made it impossible to run enough usability tests. So Ginny and Dana turned to personas for inspiration. Fortunately, AARP had a thoroughly-researched set of personas that described key segments of their audience. So Ginny and Dana chose two of them, and then visited the selected sites from the point of view of each of the personas.

They reviewed each site as one of the personas, and took notes as if the persona had performed a ‘think aloud’ commentary on it.

Then they went back and reviewed the pages visited and the comments to see if the site had conformed to or violated any of the heuristics.

WHY IS THE NEW METHOD BETTER?
Ginny explained that their method applies the heuristics more intensively than a simple check-list approach would do. 'Sometimes we found that some pages in a website did pretty well on a heuristic, while other pages did poorly. If you just looked at a couple of pages in the site to see if it conformed, you’d miss the issues.'

She also confirmed that usability testing is still her preferred technique. 'But if you need to get a lot of data quickly, then this is one way to get a start on it.'

If you have any comments or suggestions about this article then please contact Caroline Jarrett at:

Caroline.Jarrett@Effortmark.co.uk

Caroline Jarrett is a usability consultant specialising in forms, questionnaires and data capture.

© 2005 Caroline Jarrett, all rights reserved.

Associated Link: Effortmark

Six Metrics for Managing UI Design
Source: Russell Wilson, 28 August 2008
 
A proposal of six metrics to be used for managing a user interface design department.

Don't Judge a Form by its Cover
Source: Formulate Information Design, 27 August 2008
 
The saying "don't judge a book by its cover" reminds us that looks are deceptive. It turns out that this idiom applies to forms too.

Beijing Olympics - special State of the eNation report
Source: www.abilitynet.org.uk, 26 August 2008
 
In this special report AbilityNet asked disabled users to try out the Beijing Olympics website in our interaction lab.

It's Who You Know (Or Don't)
Source: Stanford Magazine, 23 August 2008
 
Online social networks are powerful and ineffectual all at once.

Winning Considerations for Interactive Content
Source: UXMatters, 22 August 2008
 
Rich options for interactively presenting content also come with a challenge.

Microsoft sees end of Windows era
Source: BBC, 20 August 2008
 
Microsoft has kicked off a research project to create software that will take over when it retires Windows.

News you can Use
Source: Gerry McGovern, 18 August 2008
 
When the homepage is dominated by news you are not necessarily communicating more.

Feeling Through your Computer
Source: Discoveries and Breakthroughs Inside Science, 16 August 2008
 
A newly designed device lets computer users feel the texture and movement of what they are seeing in front of them.

User interviews - A basic Introduction
Source: Webcredible, 15 August 2008
 
It's surprising how few people have a real understanding of who's using their site.

Helping Visitors find Information
Source: UN, 13 August 2008
 
A new report outlines the key findings from surveys that explored factors which influence the quality of online experience.