Review: Publicity, Pseudoscience and Usability

In Jakob Neilsen's latest Alert-box offering, "Improving usability guideline compliance", it is claimed that guideline compliance has increased by 4% over 1.5 years from 45% in late 2000 to a whopping great (hold on to your hats) 49% in mid-2002. It then goes on to state 'if this growth rate continues for another fifteen years we will reach full usability guideline compliance'.

Several things struck me here, if they haven't already struck you. The supposed growth rate of 4% over 1.5 years is presented as the mean with no indication of sample variation. I'm no statistical genius, but with sample sizes of 20 sites in 2000 and 15 in 2002, it is quite likely a figure such as 4% is purely due to sample variation and displays no significant increase.

Even if this claim were borne out by reliable evidence, would '90% guideline compliance in 2017' (changed from full guideline compliance) be such a good thing when the guidelines were 15 years old? This assumes the technology will not change and that modes of interaction remain static, and, in fact, human beings in general learn nothing more about the internet in the next 15 years. Essentially, all things remain the same except the usability, which appears to give a very limited view of the future of the Internet. What will the web-savvy next generation make of all this? Furthermore, even if I wanted to verify the claims made, I have to pay $45 (1 report) or $170 (the full series) to do so.

And whose guidelines are being referred to here anyway? I suspect they are indeed Mr. Neilsen's (though I didn't pay to check), though an important issue with guidelines is that they are most useful when they are built around the individual context of use. So, when guidelines are both static and not built around the context of use, is the level of compliance a good measure of usability?

In reality, if these figures tell any story, it is that compliance with Jakob's guidelines has not changed over the years, suggesting that maybe the Svengali of Usability's influence has reached saturation point (not a bad thing). It also suggests that the point of this analysis is, in fact, self-publicity. I realise that we were supposed to be in a JN ceasefire, but it does make me question whether such thinly veiled publicity masquerading as research does any of us any good, particularly in an age when people are become increasingly intolerant of spin.

The article then discusses key improvements in search (although Jared Spool maintains Search doesn't work) and other aspects of usability - with more links to expensive reports - but by that point the damage had been done and I felt wholly disinclined to trust the rest of the article.

This is not about taking a gratuitous pot-shot at one man who has been a tireless campaigner for the cause of usability, but it does smack a bit of clutching at straws to keep the wheels turning. Maybe it is time to slow down before something breaks and concentrate on the quality of the research for the benefit of us all.

Associated Link: Alertbox: Improving Usability Guideline Compliance

Rest your Wrists when you're Writing on the go
Source: UN, 25 July 2008
 
Computer Intelligence, Inc. has launched Intelligels(R), a line of wrist rests for laptop computers.

Brits more hooked on mobile tech than Yanks are
Source: RegisterHardware, 24 July 2008
 
According to the latest edition of Carphone Warehouse’s Mobile Life Report, 94 per cent of British youngsters own mobile phones, compared to just 80 per cent of those in the US.

Five ways to Improve online cross- and up-selling
Source: Webcredible, 23 July 2008
 
Increasing cross-selling and up-selling on your website will help sell more items and keep customers coming back.

Say goodbye to the Computer Mouse
Source: BBC, 22 July 2008
 
It's nearly 40 years old but one leading research company says the days of the computer mouse are numbered.

LowBrowse: a web browser for the Visually Impaired
Source: UN, 21 July 2008
 
An innovative new add-on software tool will enable millions of people worldwide with low vision to access previously inaccessible web pages.

Now you can See your Voicemail
Source: UN, 19 July 2008
 
Speech Design's new Visual Voice Mail 'pushes' voice messages directly to mobile handsets, eliminating push-button retrieval.

User-centred research into mobile law enforcement recognised
Source: UN, 18 July 2008
 
C-innovate, a user-centred consultancy based at the Sussex Innovation Centre at the University of Sussex, has won an award for its research into mobile technology and innovation in the public sector.

The Web speaks up
Source: UN, 17 July 2008
 
Textic Limited has just announced the commercial launch of Talklets, a Web 2.0 service that ‘voice enables’ text-based Web content.

All-in-One Devices ride again
Source: Wall St Journal: Market Watch, 16 July 2008
 
Evolutions of all-in-one devices and internet-TV functionality will fuel the nascent home theatre PC market, according to ABI Research.

How to Succeed as a First-Time UX Manager
Source: UXMatters, 15 July 2008
 
Being a manager of UX is no better — and no worse — than being a great designer or user researcher, but the roles are very different.