Hidden Interlocutor Misidentification in Practical Turing Tests

@article{Shah2010HiddenIM,
  title={Hidden Interlocutor Misidentification in Practical Turing Tests},
  author={Huma Shah and Kevin Warwick},
  journal={Minds and Machines},
  year={2010},
  volume={20},
  pages={441-454}
}
Based on insufficient evidence, and inadequate research, Floridi and his students report inaccuracies and draw false conclusions in their Minds and Machines evaluation, which this paper aims to clarify. Acting as invited judges, Floridi et al. participated in nine, of the ninety-six, Turing tests staged in the finals of the 18th Loebner Prize for Artificial Intelligence in October 2008. From the transcripts it appears that they used power over solidarity as an interrogation technique. As a… 
Human misidentification in Turing tests
This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human
Effects of lying in practical Turing tests
Interpretation of utterances affects an interrogator’s determination of human from machine during live Turing tests. Here, we consider transcripts realised as a result of a series of practical Turing
Some Implications of a Sample of Practical Turing Tests
TLDR
Six particular conversations that took place between human judges and a hidden entity that produced unexpected results are presented, focusing on features of Turing's machine intelligence test that the mathematician/code breaker did not consider in his examination for machine thinking.
Assumption of knowledge and the Chinese Room in Turing test interrogation
TLDR
This paper presents new results which were the outcome of a series of practical Turing tests held on 23rd June 2012 at Bletchley Park, England, and is specifically intended as a position paper claiming that practicalising Turing's test is a useful exercise throwing light on how the authors humans think.
Outwitted by the Hidden: Unsure Emotions
TLDR
The authors find that emoticons and other visual devices used to express feelings in text-based interaction were missing in the conversations between the Interrogators and hidden interlocutors.
Distinguishing AI from Male/Female Dialogue
TLDR
Five transcripts are presented, in four gender blur occurred: Turing test interrogators misclassified male for female and vice versa, and machine-human conversation artificial dialogue was branded as female teen.
The Turing Test: A New Appraisal
This paper appraises some of the prevailing ideas surrounding one of Turing's brilliant ideas, his imitation game experiment, and considers judge performance in assessing machine thinking in the
Good Machine Performance in Turing's Imitation Game
  • K. Warwick, Huma Shah
  • Philosophy
    IEEE Transactions on Computational Intelligence and AI in Games
  • 2014
In this paper, we consider transcripts which originated from a practical series of Turing's Imitation Game that was held on June 23, 2012, at Bletchley Park, U.K. In some cases, the tests involved a
Can machines think? A report on Turing test experiments at the Royal Society
In this article we consider transcripts that originated from a practical series of Turing's Imitation Game that was held on 6 and 7 June 2014 at the Royal Society London. In all cases the tests
The importance of a human viewpoint on computer natural language capabilities: a Turing test perspective
TLDR
The capabilities of humans when it comes to judging conversational abilities, as to whether they are conversing with a human or a machine are considered, and the importance of human judges interrogating in practical Turing tests is considered.
...
...

References

SHOWING 1-10 OF 13 REFERENCES
Testing Turing's five minutes, parallel-paired imitation game
TLDR
The paper presents actual responses from “modern Elizas” to human interrogators during contest dialogues that show considerable improvement in artificial conversational entities (ACE) like their ancestor – Weizenbaum's natural language understanding system – ACE are now able to recall, share information and disclose personal interests.
Life on the Screen: Identity in the Age of the Internet
From the Publisher: A Question of Identity Life on the Screen is a fascinating and wide-ranging investigation of the impact of computers and networking on society, peoples' perceptions of
Techniques of Dialogue Simulation
TLDR
It is claimed that it is more effective to simulate intelligence than it is to recreate it and to use the mind-set of the user to the advantage of the conversation, and to provoke the user into showing typical behavior.
Can Automatic Calculating Machines Be Said to Think
TLDR
The focus in this paper is on constructing a pervasive tool for evaluating Internet QoS (HolHoveling) and whether the infamous certifiable algoritm for the refinement of thin clients by P. Jackson et al. is recursiv ely enumerable.
Turing’s Imitation Game: Still an Impossible Challenge for All Machines and Some Judges––An Evaluation of the 2008 Loebner Contest
TLDR
An evaluation of the 2008 Loebner contest finds that the number of entries in the final round was higher than in the previous two contests, but the quality of the entries was lower than in previous contests.
Handbook of Research on Synthetic Emotions and Sociable Robotics: New Applications in Affective Computing and Artificial Intelligence
TLDR
The Handbook of Research on Synthetic Emotions and Sociable Robotics: New Applications in Affective Computing and Artificial Intelligence focuses on the integration of emotions into artificial environments such as computers and robotics.
The confederate effect in human–machine textual interaction
  • Proceedings of the 5 th WSEAS international conference on information science , communications and applications ( ISCA 2005 ) , Cancun , Mexico , May
  • 2005
Text based dialogical systems: gimmick or query?
The AI of elbot. Unpublished
  • 2005
...
...