EUPA/HCI2002: Remote Evaluation gets Evaluated

Andy Smith of the University of Luton and director of optimum.web gives his perspective on the "Remote Evaluation" track at the HCI2002/EUPA conference:

The session focusing on Remote Evaluation was chaired by Martin Maguire as part of the EUPA track. There were two speakers: Ron Perkins had 30 minutes to address 'Remote usability evaluations using the Internet' whereas Gaby Wenneker had the luxury of a whole hour to talk about 'improving efficiency: conducting walkthroughs remotely'.

At the outset Ron Perkins from Design Perspectives in the US claimed not to be an expert in the subject of remote evaluation. By the end of his presentation I think it was fair to say that Ron was being rather modest. He provided a classification of remote evaluation methods (real time attended vs. instrumental vs. automated) and by discussing some examples of remote evaluation projects identified the pros and cons' of the various techniques. However I felt that there was limited comparative evaluation of the techniques. Which methods are best for which type of project and why?

Gaby Wenneker is based with Zuhlke Engineering in Germany. It was during her session that we found out the difference between HCI and EUPA sessions. Just as we were settling down about 20 minutes into her talk concerning a methodology for remote evaluation that could be implemented over the telephone, we suddenly found out that we had to do some work! The concept of the audience actually doing some evaluation work was certainly novel. In an HCI event, Gaby was being participative and user centred - bizarre or what?

In groups of two we were presented screen dumps from a web site and copies of an evaluation instrument. Sitting back to back (to mirror the remote concept) one member of the pair played the user role and the other the evaluator. For me the whole concept of working during a presentation was so alien that it took most of the available time to sort out what I was meant to do. However I just had time (thanks to the patience of my co-worker) to sort out the details of the approach.

Overall the session provided a fairly rich cultural mix - the session was held in the UK with speakers from USA and Germany. Given this, and the fact that the session following this one was provided by Aaron Marcus, I felt that a key issue that needed further exploration was the suitability of different remote evaluation methods for different countries / cultures. Gaby's method seemed to me to be highly structured, which may be OK for German usability professionals and their users, but how would it work in the UK? Remote evaluation methods are particularly necessary for international systems and the suitability of methods to address cross-cultural differences is important.

Overall I felt the sessions to be informative (particularly for usability folk new to the concept of remote evaluation) rather than innovative (in that I did not feel that key novel techniques were being disseminated). However, it was good fun!

Study: Mobile Web sites need Improvement
Source: CNET, 13 October 2008
 
A new study suggests that the usability of many mobile Web sites still needs improvement.

Better Usability makes Online Backup more Appealing
Source: UN, 11 October 2008
 
Repeat after me: "Backup via the Internet is for everybody."

IBM Task Modeler version 6 now Available
Source: Unknown, 10 October 2008
 
The latest release of IBM Task Modeler is now available for download. This includes many new features to support efficient and collaborative task analysis and synthesis.

Caroline's Corner: Design to Read - Designing for People who do not Read easily
Source: Caroline Jarrett, 9 October 2008
 
Reading is a skill many of us take for granted. Chances are that if you’re reading this, you’re one of the lucky ones who read easily.

Bill Buxton to change Microsoft from within
Source: The Register, 8 October 2008
 
"Last year Steve Ballmer said to 85,000 employees 'If you don’t change and you don’t go in this direction, we’re dead, and I don’t want to die.' I wanted to go hug him when he said that."

New Report: Innovative Marketing in the Digital World
Source: E-consultancy, 7 October 2008
 
A new report from E-consultancy provides a distillation of ideas and suggestions provided by digital marketing experts.

Linking Industry with Academia
Source: unknown, 6 October 2008
 
Customer experience research consultancy, fhios, based in London, has just launched an innovative internship programme, aimed primarily at postgraduate students.

Online Travel Booking: What influences Consumers?
Source: Webcredible, 4 October 2008
 
What influences consumers when booking a holiday? How can travel companies offer the best user experience?

Getting the Word out
Source: UN, 3 October 2008
 
I SAID, I'M ON THE TRAIN... Voice recognition technology can now translate all those pesky garbled voicemails into manageable text messages.

Mobile hardware outpaces Software and User Capabilities
Source: ComputerWorld, 2 October 2008
 
The main issue dissuading users from employing all the capabilities of their mobile devices is the complexity involved in operating them.