Study identifies baseline Usability Issues with iPhone

Chicago-based usability consultancy User Centric conducted a usability test with iPhone customers who purchased their iPhones on the first day of its US release. The goal of this study was to identify overall ease-of-use factors and general usability issues among motivated early adopters who had limited experience with the iPhone.

FIRST PART OF A LONG TERM STUDY
Six days after the iPhone was launched, User Centric tested the usability of the iPhone during 60-minute usability sessions with these iPhone customers. The participants, who had the same short-term exposure to their new iPhones, were asked to carry out the same set of tasks using their new iPhones. We also asked participants to compare text entry on their iPhone with their prior mobile phones (which used multi-tap text entry because their old phones did not have QWERTY keypads).

"While multi-touch technology has been around for over a decade, the unique form factor of the iPhone is very compelling as it opens the door to a whole new set of user experiences. The first few days after launch spawned reviews of the iPhone, but we wanted to conduct the first independent and objective study with actual iPhone users to separate analyst opinion from the actual everyday user," said Gavin Lew, Managing Director of User Centric.

This study represents the first in a series of longitudinal studies with iPhone users. These longitudinal studies will evaluate the long-term usability and user experience of the iPhone. This will allow User Centric to assess the usability of conventional and novel user tasks, including ease of Web browsing, use of the soft keyboard, visual voicemail, different types of text messaging, placing and receiving calls, and using dynamic map interfaces.

Test participants were recruited from iPhone customers who purchased their devices on June 29, 2007 in the Chicago metro area. Participants were required to bring their personal iPhones to the study as proof of ownership. None had used an iPhone prior to June 29. All participants were compensated for their time and none were employed by, related to, or personally known to User Centric prior to this study.

Based on test data from these short-term iPhone users, we identified the following strengths and weaknesses in the iPhone's user experience:

MAJOR STRENGTHS OF THE iPHONE INTERFACE
- Participants found the Visual Voicemail feature to be intuitive and useful
- Participants compared text entry using their iPhone and their previous phones (which used multi-tap for text entry). Overall, participants found that text entry was much easier on the touchscreen soft-keyboard of the iPhone compared to standard multi-tap text entry.
- Most participants used the landscape (horizontal) view while searching for a website (The New York Times.) The horizontal soft keyboard was definitely preferred over the vertical keyboard orientation.
- Selecting and playing a song using both the vertical and horizontal views was easy for participants. Participants also commented that the 'Cover Flow' navigation feature was a very engaging feature.
- Making an outgoing call with the iPhone was easy for all participants.
- Participants also found that receiving a phone call on an iPhone while listening to music was seamless. They found the interruption of the music and transition to a call to be very smooth.
- Saving a number as a contact and recalling that contact for a phone call was straightforward.
- Answering a phone call while in SMS mode was also straightforward. Participants found it helpful to be taken immediately to their message after the call had concluded.
- Most participants found it easy to take a picture and email it from the iPhone.

PRIMARY DIFFICULTIES WITH THE iPHONE INTERFACE
- Participants uniformly found text entry SMS and email to be difficult. They were frustrated by the forced use the vertical keyboard and the lack of visibility for editing the middle of a word or sentence.
- Many participants found Google Maps difficult to use on the iPhone. They experienced issues with the fine-motor control required to pan accurately in different dimensions in Google Maps and predictably zoom in and out. It was unclear to participants how much they needed to adjust the size of their "pinch" gesture to zoom in and out with the control that they wanted.
- Participants were often frustrated with their Web browsing experience and hoped that this would improve dramatically with an upgrade in network capability. The lack of Flash and Java capabilities during Web browsing was considered a detriment to basic Web use.
- Finally, participants were surprised (and somewhat annoyed) to discover that horizontal text entry was available only in in the Safari browser.

As part of their sessions, participants were also asked to rate their first time usage of the iPhone for key tasks. This data will be used as just one of our baseline metrics for iPhone longitudinal studies.

Dispite the frustration users found with SMS text messaging, in our experience, the touch keyboard performed better than expected. Gavin Lew explained, "We conduct studies on different text input systems (eg T9, iTap on Motorola devices, Openwave, etc) and we were surprised to find that these iPhone users were more efficient with the touch keyboard when composing text messages than they were when using the phones they owned just a week earlier."

Associated Link: User Centric

CES: Microsoft releases first Windows 7 beta
Source: vnunet.com, 9 January 2009
 
Microsoft has unveiled the first beta of Windows 7, enabling users to test the improved user interface and other features of the forthcoming operating system for the first time.

Online poker company uses Science to assess Player Preferences
Source: Recentpoker.com, 8 January 2009
 
Working with customer experience consultancy Foviance, PKR is exploiting the benefits of electroencephalography (EEG) technology to gather information on poker players' emotional relationship with a brand or service.

Do Users really love Laptops?
Source: channelinsider, 7 January 2009
 
More than one-fifth of all laptop computers will break down over the course of their life, and other limitations frustrate their users. From this list of user complaints come laptop opportunities.

User Interviews - Analysis Simplified
Source: Webcredible, 6 January 2009
 
You’ve conducted your user interviews, but now you need to make sense of all that information you’ve gathered.

Why Products Fail
Source: ComputerWorld, 5 January 2009
 
Most gadget and software makers don't understand what users want most: control.

How to Design Websites for Mobile Phones
Source: stemkoski.com, 3 January 2009
 
Tips from Ryan Stemkoski's web design blog.

Pioneer of Cyberspace honoured
Source: BBC, 2 January 2009
 
A professor who invented a forerunner of the world wide web has been made a dame in the New Year Honours.

2008 in Review: Developments that rocked the world of User Experience
Source: Catalyst Resources, 1 January 2009
 
A look back at 2008 highlights some of the key developments that rocked the world of user experience.

2008: The Year Online
Source: MIT Technology Review, 31 December 2008
 
The business of social networking, cloud computing, and a flaw in the fabric of the Internet top the most notable stories of 2008.

Shoveling through the Spamalanche
Source: UN, 30 December 2008
 
A ‘Spamalanche’ of 3,000 emails will be waiting in your inbox by the time you get back to work. What can you do besides 'delete all'?