When Observing Users is not Enough - 10 Guidelines for getting more out of Users’ Verbal Comments

By Isabelle Peyrichoux

One of the principles underlying usability testing is that observing a user perform a task provides more reliable information than simply asking the user how easy it would be to perform the task. By observing users, you can assess whether they are actually able to use a product. By asking them, you simply cannot.

However, as you try to derive valid conclusions about how to design a user interface, relying only on — or even mostly on — observation can be:

* Misleading — because often user behaviors that you observe can have many different interpretations. For example, if a user did not click a link, perhaps the user did not see the link or did not understand it. You cannot know the reason with certainty without asking the user. Your assumptions might be biased.

* Limiting — because you lose the opportunity to gather valuable verbal data by relying only on observational data.

While some usability professionals might claim that you cannot rely on what users say — and there are some risks in relying on users’ comments — there are means of avoiding or minimizing those risks. To understand these means, we must leave the realm of objective science and enter the realm of human relationships and empathy.

A user interview — including one that occurs during usability testing or user observation — is a relationship between two people — the interviewer and the interviewee — in which emotions, fears, and judgments come into play. Thus, my training and practice in psychotherapy have greatly enriched my technique in doing user interviews, because they have helped me avoid or minimize certain biases when eliciting and interpreting users’ verbal comments.

To help you get more out of users’ verbal comments, this article will provide ten guidelines and various interviewing techniques I’ve learned from experience. These techniques work best if they are used with genuine empathy for users. If users feel that you are not genuine — even if you are not aware of it or try to hide it — these techniques won’t work. I’ve described most of these techniques within the context of usability testing, but some techniques are also applicable to other user research activities, such as field studies and task analyses, and to stakeholder interviews.


Follow the link to read the full article and see the ten guidelines:

Associated Link: UXMatters Full Article: When Observing Users is not Enough

All change at the top for System Concepts
Source: System Concepts Ltd, 3 July 2009
 
Leslie Fountain has been promoted to joint Managing Director of leading usability consultancy System Concepts.

Life in UCD immortalised in fiction: you couldn't make it up
Source: UN, 2 July 2009
 
Sarah Herman's fictitious book on life in a user-centred design company has hit the shelves and The Guardian's book pages...

Interfaces Magazine - Issue 79: The Education Issue
Source: Interaction Group, 1 July 2009
 
The latest issue of Interfaces is now available as a free download from the Interaction Website.

Two new Behavioural research Tools from Noldus
Source: UN, 30 June 2009
 
Tool updates make on-site behavioural data collection easier.

Cell Phones that Listen and Learn
Source: MIT Technology Review, 29 June 2009
 
New software tracks a user's behavior by monitoring everyday sounds.

Top Six Don’ts for Usability Testing
Source: FutureNow Inc., 27 June 2009
 
Six tips for creating quality usability tests to ensure useful feedback from testers.

Usability: ‘Lovely software. But I can’t work it’
Source: FT.com, 26 June 2009
 
In a recent survey by Global Graphics, 77 per cent of office workers estimate they lose up to one hour a week because business software is difficult to use.

And what do you do?
Source: Dexo Design, 25 June 2009
 
How do you describe your job role? Here are the results of a recent 'Preferred UX/UI Title' Poll.

Most Doctors cite Usability as critical to Electronic Health Record Adoption
Source: TMCNet, 24 June 2009
 
It's all about 'meaningful use'.

Glossy monitors look good but can hurt
Source: QUT, 23 June 2009
 
A new advisory cites research which suggests high gloss monitors make users sit awkwardly.