Eugene Goostman

Eugene Goostman is a software program. Initially developed in 2001, by a team of seven people[1] in Princeton, New Jersey, Saint Petersburg, Russia, and Kiev, Ukraine, Goostman portrays a 13-year-old Ukrainian boy—a persona that contains many biographical elements of the developers.[2] Goostman's age was set in accordance with guidelines for readability that suggest adhering to a seventh-grade reading level for materials produced for general audiences.

Goostman was entered in a number of Turing Tests since its creation, and finished second in the 2005 and 2008 Loebner Prize. In June 2012, at an event marking what would have been the 100th birthday of the test's namesake, Alan Turing, Goostman received the highest score in what was promoted as the largest-ever Turing Test, during which it successfully convinced 29% of its judges that it was human.

On 7 June 2014, at a contest marking the 60th anniversary of Turing's death, 33% of the event's judges identified Goostman as human; the event's organizer Kevin Warwick considered it to have passed the Turing Test as a result, per Turing's prediction in his 1950 paper Computing Machinery and Intelligence, that by the year 2000, machines would be capable of fooling 30% of human judges after five minutes of questioning.[3]

Personality

Eugene Goostman is portrayed as being a 13-year-old boy from Odessa, Ukraine, who has a pet guinea pig and a father who is a gynaecologist. Veselov stated that Goostman was designed to be a "character with a believable personality". The choice of age was intentional, as, in Veselov's opinion, a thirteen-year-old is "not too old to know everything and not too young to know nothing" and is aligned with readability guidelines for general populations.[1][4] In 2014, work was made to improve the bot's "dialog controller", allowing Goostman to output more human-like dialogue.[5]

Accolades

Eugene Goostman has competed in a number of Turing test competitions, including the controversial Loebner Prize; it finished joint second in the Loebner test in 2001,[6] and came second to Jabberwacky in 2005[7] and to Elbot in 2008.[8] On 23 June 2012, Goostman obtained the highest score during the Turing Test held at Bletchley Park in Milton Keynes, held to mark the centenary of its namesake, Alan Turing. This test, which featured five bots, twenty-five hidden humans, and thirty judges, was considered to be the largest-ever Turing test contest by its organizers. After a series of five-minute-long text conversations, 29% of the judges were convinced that the bot was an actual human.[4]

2014 Pass

On 7 June 2014, in a Turing Test held at the Royal Society, that was organized by Kevin Warwick of the University of Reading to mark the 60th anniversary of Turing's death, Goostman passed the Turing Test after 33% of the judges were convinced that the bot was human. 30 judges took part in the event, which included Lord Sharkey, a sponsor of Turing's posthumous pardon, artificial intelligence Professor Aaron Sloman, Fellow of the Royal Society Mark Pagel and Red Dwarf actor Robert Llewellyn. Each judge partook in a textual conversation with each of the five bots; at the same time, they also conversed with a human. In all, a total of 300 conversations were conducted.[5][9] In Warwick's view, this made Goostman the first machine to pass a Turing test. In a press release, he added that:

Some will claim that the Test has already been passed. The words Turing Test have been applied to similar competitions around the world. However this event involved more simultaneous comparison tests than ever before, was independently verified and, crucially, the conversations were unrestricted. A true Turing Test does not set the questions or topics prior to the conversations.[5]

In his 1950 paper "Computing Machinery and Intelligence", Turing predicted that by the year 2000, computer programs would be sufficiently advanced that the average interrogator would, after five minutes of questioning, "not have more than 70 per cent chance" of correctly guessing whether they were speaking to a human or a machine. Although Turing phrased this as a prediction rather than a "threshold for intelligence", commentators believe that Warwick had chosen to interpret it as meaning that if 30% of interrogators were fooled, the software had "passed the Turing test".[10][11]

Reaction

The validity of Warwick's claim that Eugene Goostman was the first ever chatbot to pass a Turing test was met with some skepticism as several critics claimed similar "passes" had been made in the past by other chatbots under the same criteria, including PC Therapist in 1991 (which tricked 5 of 10 judges, 50%), and at the Techniche festival in 2011, where a version of Cleverbot tricked 59.3% of 1334 votes however neither of these tests included unrestricted conversations or academic oversight.

See also

References

  1. 1 2 "princetonai.com". Princeton AI. 22 November 2015. Retrieved 22 November 2015.
  2. "Jew Bot Eugene Goostman Is Kind of a Perv - The Assimilator". The Forward. Retrieved 2015-11-23.
  3. "University of Reading". University of Reading. Retrieved 2015-11-23.
  4. 1 2 "Bot with boyish personality wins biggest Turing test". New Scientist. 25 June 2012. Retrieved 8 June 2014.
  5. 1 2 3 "Turing Test success marks milestone in computing history". University of Reading. 8 June 2014. Retrieved 8 June 2014.
  6. "2001 Loebner Prize Competition in Artificial Intelligence". Loebner.net. 25 October 2001. Retrieved 13 June 2014.
  7. "2005 Summary of Results". Loebner.net. Retrieved 13 June 2014.
  8. "Loebner Prize 2008". Loebner.net. 12 October 2008. Retrieved 13 June 2014.
  9. "Computer allegedly passes Turing Test for first time by convincing judges it is a 13-year-old boy". The Verge. 8 June 2014. Retrieved 8 June 2014.
  10. Adam Mann (9 June 2014). "That Computer Actually Got an F on the Turing Test". Wired. Retrieved 9 June 2014.
  11. "Someone on the internet ISN'T a 13-year-old boy: Bot beats off Turing Test". The Register. Retrieved 9 June 2014.
This article is issued from Wikipedia - version of the Tuesday, November 24, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.