Software agents give out Advice

Filed under
Software

Governments and big business like to indulge in media spin, and that means knowing what is being said about them. But finding out is becoming ever more difficult, with thousands of news outlets, websites and blogs to monitor.

Now a British company is about to launch a software program that can automatically gauge the tone of any electronic document. It can tell whether a newspaper article is reporting a political party's policy in a positive or negative light, for instance, or whether an online review is praising a product or damning it. Welcome to the automation of PR.

Till now, discovering whether the coverage you are getting is good or bad, negative or neutral has usually meant hiring a "reputation management" firm. Teams of people employed by the company will read through everything written about a chosen organisation, person, event or issue and report back on how favourable it is.

As well as being expensive, this can be a long, slow process, says Nick Jacobi, director of research for the Corpora Software company in Surrey, UK. "There's a massive information overload." A single news agency may churn out more than eight articles each hour. That is almost 200 stories a day per news outlet.

Previous attempts to automate this kind of analysis have used one of two techniques. In the first, called machine learning, a program is trained by being given thousands of articles already determined by a human reader to be positive or negative in tone.
But learning in this way can lead to mistakes. For example, if a series of the training articles mentions bomb attacks on a mosque in Iraq, the program may incorrectly conclude that all other mentions of mosques are negative too.

The alternative is the lexicon approach, in which certain words are classified as either positive or negative. But plenty of words can be both. "The plot was unpredictable" and "the steering was unpredictable" differ by just one word. Yet the word "unpredictable" has a positive connotation in the first example and a negative meaning in the second.

And even if that problem is solved, just picking up on positive or negative words can also lead to mistakes, as is demonstrated by the sentence: "Everyone told me it was terrible, that I would hate it, but in the end it wasn't at all bad".

Full Story.