Eugene Goostman 'passes' the Turing test — for five minutes

On 7 June 2014, at the Royal Society in London, thirty judges held five-minute keyboard conversations with a handful of programs. One of them, Eugene Goostman — a chatbot with the persona of a 13-year-old boy from Odesa who owns a guinea pig — was taken for human by ten of the judges, 33%. Kevin Warwick of the University of Reading, who organised the event, declared that Alan Turing's test had been passed for the first time.

The press amplified it as a 'world first': the BBC led with 'Computer AI passes Turing test'. The 30% figure was not a threshold, however — it was Turing's own 1950 prediction that machines would fool a third of judges by 2000. Eugene was no newcomer: it had been competing since 2001 and finished behind other systems in the Loebner Prize. Even its own collaborator John Denning hedged: 'I think we passed "a" Turing test, but I don't know if it's "the" Turing test.'

Within a day the field pushed back. 'It's nonsense, complete nonsense. We are not even close,' said Stevan Harnad. Marvin Minsky: 'Nothing is learned from poorly designed "experiments".' Gary Marcus called Eugene 'a cleverly-coded piece of software' whose 'illusion is fleeting'; Murray Shanahan said the claim was 'completely misplaced, devalues real AI research'. Noel Sharkey named the trick: 'a very clever ruse to pretend to be a 13-year-old Ukranian boy, which would constrain the conversation.'

The persona was the strategy: a non-native child with a pet excuses every non sequitur. Pressed on how many legs a camel has, Eugene answered 'Something between 2 and 4. Maybe, three?' — an answer read as childish, not broken. The stunt's real cost was public understanding: 'AI passed the Turing test' became a recurring headline that real researchers still argue against, and five-minute chats with a scripted persona replaced Turing's open-ended conversation as what 'passing' means to the public.

The 33% was Turing's prediction, not a pass mark, and the 13-year-old persona excused every non sequitur, so the stunt measured the disguise, not the machine.

Turing's 30% was a prediction, not a pass mark — the event treated it as a threshold and declared victory the moment it was met.

The persona did the work: a 13-year-old with a guinea pig makes every non sequitur look human, so the test measured the disguise, not the machine.

Five minutes of unrestricted chat is a lower bar than the 25-minute Loebner Prize in which Eugene had ranked behind seven other systems.

The announcement outran the scrutiny: 'world first' was declared the same day, before the field could weigh in, so the correction never matched the headline.

Turing's 30% was a prediction, not a pass mark; a persona that excuses every non sequitur measures the disguise, not the machine.

Eugene's victory was retracted by no one and accepted by few: the chatbot kept its persona and its creators moved on, while the episode became the textbook case of a Turing test claim outrunning its evidence. The real damage was to public language — 'passing the Turing test' became a headline shorthand that genuine AI milestones still have to fight. The event's own defence, that the conversations were 'unrestricted', only highlighted how far the test had shrunk from Turing's open-ended, years-long interrogation to five minutes with a teenager who cannot be pinned down.