Archive — Automation

Microsoft’s robot editor confuses mixed-race Little Mix singersJim WatersonThe Guardian

Jade Thirlwall and Leigh-Anne Pinnock from Little Mix

How about this for dystopia? MSN have replaced human news editors with a robot powered by Microsoft artificial intelligence technology. The problem is, it has already begun making racist decisions.

And then, in case you thought the story wasn’t already absurd enough, this:

In advance of the publication of this article, staff at MSN were told to expect a negative article in the Guardian about alleged racist bias in the artificial intelligence software that will soon take their jobs.

Because they are unable to stop the new robot editor selecting stories from external news sites such as the Guardian, the remaining human staff have been told to stay alert and delete a version of this article if the robot decides it is of interest and automatically publishes it on MSN.com. They have also been warned that even if they delete it, the robot editor may overrule them and attempt to publish it again.

Then the article ends on a delicious snippet — that Microsoft itself is concerned about the reputational damage this scheme will cause to its AI technology.

I’m immediately reminded of Microsoft’s disastrous Tay experiment.

Comment

Crash: how computers are setting us up for disaster

Crash: how computers are setting us up for disaster

The headline is slightly over-the-top. But this is nevertheless a fascinating long read on the paradox of automation — how our reliance on computers leaves us incompetent to act when we are needed the most.

First, automatic systems accommodate incompetence by being easy to operate and by automatically correcting mistakes. Because of this, an inexpert operator can function for a long time before his lack of skill becomes apparent – his incompetence is a hidden weakness that can persist almost indefinitely. Second, even if operators are expert, automatic systems erode their skills by removing the need for practice. Third, automatic systems tend to fail either in unusual situations or in ways that produce unusual situations, requiring a particularly skilful response.

1 comment