Emint explores the Potential to Automate Moderation Services

Moderation is a specialist, but growing and costly, service that many companies employ to oversee online chat, discussion and other postings to their sites. Its profile has recently risen with the publication of Home Office guidance on protecting children online (see UN story Government Report into Best Practice for Children Online). However, even without this glare of attention, the value of moderation to avoid legal tangles, protect brand image and encourage user involvement is well established.

Emint, a group of strategists and managers in charge of moderation services and software, met last week to discuss which aspects of online moderation can be automated and what associated complications this might create.

Speakers were Tamara Littleton, founder of eModeration.com; Sara Tebelius, communications manager for chatmoderators.com, and Adrian Barrett, founder of lightmaker.com specialising in 3D virtual communities.
Littleton stressed that the job as a whole cannot be automated, but that much of the administrative/management part of it might be. She and Tebelius drew attention to the subjective nature of many interventions made by moderators. While software can flag up postings containing specific words that have been deemed unacceptable on a particular site, it cannot deal with the subtleties of ethos or allusion.

Allusions could be especially treacherous. One person gave the example of footballers involved in court cases - something which happens all the time - being talked about on a football site. Discussion of anyone's involvement in a court case mostly breaches the law of contempt of court, with potentially severe penalties for the publisher. A filter can pick up names that shouldn't be mentioned at such a time, but not oblique references such as 'the footballers who...'. And no one wants a filter that raises every instance of 'footballer' for extra scrutiny.

Some of the discussion thus echoed that heard when natural language processing is discussed in other contexts, such as search: how to produce software that can arrive at a person's meaning from what they say.

It was also pointed out that what was offensive was also related to brand. Which words did the Emint group itself find unacceptable? "Bollocks"? One speaker described the novel and automatable solution of substituting offending words with random nouns, making for a bizarre and sometimes funny posting that softened the impact of the editing. This light-hearted style went down well with the particular users and might work elsewhere.

Different tactics for dealing with removing or modifying postings were also raised. In some contexts, public removal of inappropriate material - combined with a note documenting why - is necessary to make a point. In others, everything is handled behind the scenes with a word to the poster. This aspect of relationship management is crucial and also cannot be automated as a whole.

Barrett raised the temperature of discussions by showing his company’s 3D avatar-based system. The 3D world turned the private chat-room of the text-based discussion forum - now regarded with increasing suspicion as a place for snaring children - into a full-blown apartment, with fire in the corner and rug. Other seductive features also struck the group as making moderation more difficult. Barrett commented that companies were resistant to the cost of moderation on top of the cost of installing systems of this kind. New challenges were in store.

Lizzie Jackson, head of communities at the BBC, who convenes Emint, ended the session with a list of areas where good design can support the moderator in their current tasks. Those related to software included:
* an alert button for users to push if unhappy with another's posting,
* safety bots, that promote safe behaviour within and beyond the forum,
* statistical signposting, where the best messages of the day are displayed as a role model for other postings,
* profanity filters that can be set to flag up or replace words that fall outside waht is acceptable for particular services.

All change at the top for System Concepts
Source: System Concepts Ltd, 3 July 2009
 
Leslie Fountain has been promoted to joint Managing Director of leading usability consultancy System Concepts.

Life in UCD immortalised in fiction: you couldn't make it up
Source: UN, 2 July 2009
 
Sarah Herman's fictitious book on life in a user-centred design company has hit the shelves and The Guardian's book pages...

Interfaces Magazine - Issue 79: The Education Issue
Source: Interaction Group, 1 July 2009
 
The latest issue of Interfaces is now available as a free download from the Interaction Website.

Two new Behavioural research Tools from Noldus
Source: UN, 30 June 2009
 
Tool updates make on-site behavioural data collection easier.

Cell Phones that Listen and Learn
Source: MIT Technology Review, 29 June 2009
 
New software tracks a user's behavior by monitoring everyday sounds.

Top Six Don’ts for Usability Testing
Source: FutureNow Inc., 27 June 2009
 
Six tips for creating quality usability tests to ensure useful feedback from testers.

Usability: ‘Lovely software. But I can’t work it’
Source: FT.com, 26 June 2009
 
In a recent survey by Global Graphics, 77 per cent of office workers estimate they lose up to one hour a week because business software is difficult to use.

And what do you do?
Source: Dexo Design, 25 June 2009
 
How do you describe your job role? Here are the results of a recent 'Preferred UX/UI Title' Poll.

Most Doctors cite Usability as critical to Electronic Health Record Adoption
Source: TMCNet, 24 June 2009
 
It's all about 'meaningful use'.

Glossy monitors look good but can hurt
Source: QUT, 23 June 2009
 
A new advisory cites research which suggests high gloss monitors make users sit awkwardly.