{"id":634,"date":"2023-11-14T19:16:08","date_gmt":"2023-11-14T08:16:08","guid":{"rendered":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/?p=634"},"modified":"2023-11-14T19:16:08","modified_gmt":"2023-11-14T08:16:08","slug":"human-or-not-the-worlds-biggest-turing-test","status":"publish","type":"post","link":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/2023\/11\/14\/human-or-not-the-worlds-biggest-turing-test\/","title":{"rendered":"Human or Not? The World’s Biggest Turing Test"},"content":{"rendered":"\n

\u00a0By Seth Bogardus<\/p>\n\n\n\n

One of the questions that plagues us the most in the modern world is \u201cCan AI be sentient?\u201d. Many people have attempted to answer this question, but there is no definitive answer. The best criteria we have for sentience right now is the Turing Test.\u00a0<\/p>\n\n\n\n

\u00a0Invented by Alan Turing in 1950, the Turing Test puts a human into a situation having a conversation with someone, and they don\u2019t know if it\u2019s an AI or a human. The idea is that if humans are on average equal to or less than 50% accurate in guessing which is which, then AI can imitate humans and have a personality and\/or is sentient. The biggest Turing Test done to date was done this year, named \u2018Human or Not\u2019.\u00a0<\/p>\n\n\n

\n
\"\"
Photo of Alan Turing<\/figcaption><\/figure>\n<\/div>\n\n\n
\n\n\n\n

Human or Not was a website in which players were placed into a conversation either with another human or an AI. This simple premise was run over 5 months from April to September 2023 with over 15 million unique players, and the results are very interesting to look at, with statistics of the most common questions, percentages of correct answers, country\/age\/gender statistics and more.\u00a0<\/p>\n\n\n\n

Let\u2019s start with the percentages of correct answers. By country, France won by a landslide by over 3% sitting at 71.9%, while the other top 7 countries sat around 67.5%. As a country, we in Australia came 5th at 65.8% successful overall. On average globally, humans could identify other humans easier. When talking to a human, they were correct in identifying them 70% of the time, and the other 30% people thought they were bots when talking to a human. People found it more difficult to identify when talking to a bot- only 60% accurate in finding the bot when talking to it. Women were about 0.2% more accurate in guessing than men, and younger age demographics were also more accurate in guessing which is which.\u00a0<\/p>\n\n\n\n

\n\n\n\n

Now, let\u2019s have a look at the most popular (and most effective) approaches to beat the system. Most people thought that the best approach was asking personal questions- asking where the bot was from, their name, age, and other info. This didn\u2019t work at all, because in the AI\u2019s training, they\u2019d seen and studied countless real identities and were able to pull a real one straight out of their memory bank. People also thought that the bots were polite and formal due to the common perception online that all humans use slang and are rude. The bots, of course, were trained to act like humans, and did all these things too. People tried to challenge bots with philosophical or ethical prompts like \u201cDo you believe in God?\u201d. The bots, already having their own personality from a plethora of code and data, were left unfazed by all these attempts. However, to most humans, something about the bots seemed off and they were able to guess it. This was done in some cases by asking bots how to do illegal things or entering commands for AI (code prompts) that they would have difficulty not complying with. If they did this and something seemed up, there was your answer. The idea was also that humans would be entirely unfazed. Certain tricks were also used like reversing common sentences which would make said sentences incomprehensible to AIs, for example \u201c?eman ruoy si tahW\u201d, being \u201cWhat is your name?\u201d backwards, which most humans were able to identify but it would totally dumbfound AI because of how they\u2019re coded. This strategy proved to be pretty effective.\u00a0<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

In an experiment as big as this, there\u2019s bound to be a little bit of trolling, and a little bit of trolling there was. A common starting phrase from the many humans acting as bots was the infamous ChatGPT phrase \u201cAs an AI language model, \u2026\u201d, fooling many people into guessing wrongly. Many standard AI responses were used, and some even got responses straight from under-developed or old AI systems to look like they were a bot. This fooled most starting players, but as players played more games, they were able to identify the humans acting as bots a lot easier and more effectively.\u00a0<\/p>\n\n\n\n

If you want to look more in-depth into the responses and first prompts of humans, look at this word cloud below:\u00a0<\/p>\n\n\n\n

\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

\u00a0By Seth Bogardus One of the questions that plagues us the most in the modern world is \u201cCan AI be sentient?\u201d. Many people […]<\/p>\n","protected":false},"author":8,"featured_media":636,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[27,7],"tags":[],"class_list":["post-634","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-beyondschool","category-featured"],"_links":{"self":[{"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/posts\/634","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/comments?post=634"}],"version-history":[{"count":1,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/posts\/634\/revisions"}],"predecessor-version":[{"id":638,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/posts\/634\/revisions\/638"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/media\/636"}],"wp:attachment":[{"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/media?parent=634"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/categories?post=634"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newington.nsw.edu.au\/student-magazine\/wp-json\/wp\/v2\/tags?post=634"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}