AI trust paradox

Last updated

The AI trust paradox (also known as the verisimilitude paradox) is the phenomenon where advanced artificial intelligence models become so proficient at mimicking human-like language and behavior that users increasingly struggle to determine if the information generated is accurate or simply plausible. [1]

Contents

Unlike earlier concerns such as Moravec's paradox, which highlighted the surprising difficulty in replicating simple human functions in AI, and the automation paradox, which deals with balancing automation and human control, the AI trust paradox specifically addresses the issue of verisimilitude —the appearance of truth that leads to misplaced trust. [2] [3] [ page needed ] The newer challenge arises from the inherent difficulty for users in distinguishing between genuine and misleading content produced by large language models (LLMs) as they become more adept at generating natural and contextually appropriate responses. [4]

History

In the paper The AI Trust Paradox: Navigating Verisimilitude in Advanced Language Models by Christopher Foster-McBride, published by Digital Human Assistants, the evolution of large language models (LLMs) was explored through a comparative analysis of early models and their more advanced successors. [5] [ unreliable source? ] Foster-McBride demonstrated that newer LLMs, with improved architecture and training on extensive datasets, showed significant advancements across key performance metrics, including fluency and contextual understanding. [5] However, this increased sophistication made it increasingly difficult for users to detect inaccuracies, also known as hallucinations. [5]

Foster-McBride highlighted that the newer models not only provided more coherent and contextually appropriate responses but also masked incorrect information more convincingly. [5] This aspect of AI evolution posed a unique challenge: while the responses appeared more reliable, the underlying verisimilitude increased the potential for misinformation going unnoticed by human evaluators. [5]

The study concluded that as models became more capable, their fluency led to a rising trust among users, which paradoxically made discerning false information harder. [5] This finding has led to subsequent discussions and research focusing on the impact of model sophistication and fluency on user trust and behavior, as researchers investigate the implications of AI-generated content that can confidently produce misleading or incorrect information. [5]

Relation to other paradoxes

The AI trust paradox can be understood alongside other well-known paradoxes, such as the automation paradox, which addresses the complexity of balancing automation with human oversight. Similar concerns arise in Goodhart’s law, where an AI's optimization of specified objectives can lead to unintended, often negative, outcomes. [6] [7] [ page needed ]

Current research and mitigation strategies

Addressing the AI trust paradox requires methods such as reinforcement learning with human feedback (RLHF), which trains AI models to better align their responses with expected norms and user intentions. [8] [9] [10]

Efforts in trustworthy AI focus on making AI systems transparent, robust, and accountable to mitigate the risks posed by the AI trust paradox. Current research in AI safety aims to minimize the occurrence of hallucinations and ensure that AI outputs are both reliable and ethically sound. [11] [12] [ page needed ]

See also

Related Research Articles

Artificial intelligence (AI), in its broadest sense, is intelligence exhibited by machines, particularly computer systems. It is a field of research in computer science that develops and studies methods and software that enable machines to perceive their environment and use learning and intelligence to take actions that maximize their chances of achieving defined goals. Such machines may be called AIs.

<span class="mw-page-title-main">ELIZA</span> Early natural language processing computer program

ELIZA is an early natural language processing computer program developed from 1964 to 1967 at MIT by Joseph Weizenbaum. Created to explore communication between humans and machines, ELIZA simulated conversation by using a pattern matching and substitution methodology that gave users an illusion of understanding on the part of the program, but had no representation that could be considered really understanding what was being said by either party. Whereas the ELIZA program itself was written (originally) in MAD-SLIP, the pattern matching directives that contained most of its language capability were provided in separate "scripts", represented in a lisp-like representation. The most famous script, DOCTOR, simulated a psychotherapist of the Rogerian school, and used rules, dictated in the script, to respond with non-directional questions to user inputs. As such, ELIZA was one of the first chatterbots and one of the first programs capable of attempting the Turing test.

<span class="mw-page-title-main">Chatbot</span> Program that simulates conversation

A chatbot is a software application or web interface designed to have textual or spoken conversations. Modern chatbots are typically online and use generative artificial intelligence systems that are capable of maintaining a conversation with a user in natural language and simulating the way a human would behave as a conversational partner. Such chatbots often use deep learning and natural language processing, but simpler chatbots have existed for decades.

Artificial general intelligence (AGI) is a type of artificial intelligence (AI) that matches or surpasses human cognitive capabilities across a wide range of cognitive tasks. This contrasts with narrow AI, which is limited to specific tasks. Artificial superintelligence (ASI), on the other hand, refers to AGI that greatly exceeds human cognitive capabilities. AGI is considered one of the definitions of strong AI.

A superintelligence is a hypothetical agent that possesses intelligence surpassing that of the brightest and most gifted human minds. "Superintelligence" may also refer to a property of problem-solving systems whether or not these high-level intellectual competencies are embodied in agents that act in the world. A superintelligence may or may not be created by an intelligence explosion and associated with a technological singularity.

Business process automation (BPA), also known as business automation, refers to the technology-enabled automation of business processes.

In video games, artificial intelligence (AI) is used to generate responsive, adaptive or intelligent behaviors primarily in non-playable characters (NPCs) similar to human-like intelligence. Artificial intelligence has been an integral part of video games since their inception in 1948, first seen in the game Nim. AI in video games is a distinct subfield and differs from academic AI. It serves to improve the game-player experience rather than machine learning or decision making. During the golden age of arcade video games the idea of AI opponents was largely popularized in the form of graduated difficulty levels, distinct movement patterns, and in-game events dependent on the player's input. Modern games often implement existing techniques such as pathfinding and decision trees to guide the actions of NPCs. AI is often used in mechanisms which are not immediately visible to the user, such as data mining and procedural-content generation. One of the most infamous examples of this NPC technology and gradual difficulty levels can be found in the game Mike Tyson's Punch-Out!! (1987).

Moravec's paradox is the observation in the fields of artificial intelligence and robotics that, contrary to traditional assumptions, reasoning requires very little computation, but sensorimotor and perception skills require enormous computational resources. The principle was articulated in the 1980s by Hans Moravec, Rodney Brooks, Marvin Minsky, and others. Moravec wrote in 1988: "it is comparatively easy to make computers exhibit adult level performance on intelligence tests or playing checkers, and difficult or impossible to give them the skills of a one-year-old when it comes to perception and mobility".

<span class="mw-page-title-main">Braina</span> Intelligent personal assistant & dictation software

Braina is a virtual assistant and speech-to-text dictation application for Microsoft Windows developed by Brainasoft. Braina uses natural language interface, speech synthesis, and speech recognition technology to interact with its users and allows them to use natural language sentences to perform various tasks on a computer. The name Braina is a short form of "Brain Artificial".

In the field of artificial intelligence (AI), AI alignment aims to steer AI systems toward a person's or group's intended goals, preferences, and ethical principles. An AI system is considered aligned if it advances the intended objectives. A misaligned AI system pursues unintended objectives.

Explainable AI (XAI), often overlapping with interpretable AI, or explainable machine learning (XML), either refers to an artificial intelligence (AI) system over which it is possible for humans to retain intellectual oversight, or refers to the methods to achieve this. The main focus is usually on the reasoning behind the decisions or predictions made by the AI which are made more understandable and transparent. This has been brought up again as a topic of active research as users now need to know the safety and explain what automated decision making is in different applications. XAI counters the "black box" tendency of machine learning, where even the AI's designers cannot explain why it arrived at a specific decision.

Artificial intelligence is used in Wikipedia and other Wikimedia projects for the purpose of developing those projects. Human and bot interaction in Wikimedia projects is routine and iterative.

In the field of artificial intelligence (AI), the Waluigi effect is a phenomenon of large language models (LLMs) in which the chatbot or model "goes rogue" and may produce results opposite the designed intent, including potentially threatening or hostile output, either unexpectedly or through intentional prompt engineering. The effect reflects a principle that after training an LLM to satisfy a desired property, it becomes easier to elicit a response that exhibits the opposite property. The effect has important implications for efforts to implement features such as ethical frameworks, as such steps may inadvertently facilitate antithetical model behavior. The effect is named after the fictional character Waluigi from the Mario franchise, the arch-rival of Luigi who is known for causing mischief and problems.

<span class="mw-page-title-main">ChatGPT</span> Chatbot developed by OpenAI

ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022. It is based on the GPT-4o large language model (LLM). ChatGPT can generate human-like conversational responses, and enables users to refine and steer a conversation towards a desired length, format, style, level of detail, and language. It is credited with accelerating the AI boom, which has led to ongoing rapid investment in and public attention to the field of artificial intelligence (AI). Some observers have raised concern about the potential of ChatGPT and similar programs to displace human intelligence, enable plagiarism, or fuel misinformation.

<span class="mw-page-title-main">Hallucination (artificial intelligence)</span> Erroneous material generated by AI

In the field of artificial intelligence (AI), a hallucination or artificial hallucination is a response generated by AI that contains false or misleading information presented as fact. This term draws a loose analogy with human psychology, where hallucination typically involves false percepts. However, there is a key difference: AI hallucination is associated with erroneous responses rather than perceptual experiences.

The dead Internet theory is an online conspiracy theory that asserts, due to a coordinated and intentional effort, the Internet now consists mainly of bot activity and automatically generated content manipulated by algorithmic curation to control the population and minimize organic human activity. Proponents of the theory believe these social bots were created intentionally to help manipulate algorithms and boost search results in order to manipulate consumers. Some proponents of the theory accuse government agencies of using bots to manipulate public perception. The date given for this "death" is generally around 2016 or 2017. The dead Internet theory has gained traction because many of the observed phenomena are quantifiable, such as increased bot traffic, but the literature on the subject does not support the full theory.

In the 2020s, the rapid advancement of deep learning-based generative artificial intelligence models raised questions about whether copyright infringement occurs when such are trained or used. This includes text-to-image models such as Stable Diffusion and large language models such as ChatGPT. As of 2023, there were several pending U.S. lawsuits challenging the use of copyrighted data to train AI models, with defendants arguing that this falls under fair use.

In machine learning, the term stochastic parrot is a metaphor to describe the theory that large language models, though able to generate plausible language, do not understand the meaning of the language they process. The term was coined by Emily M. Bender in the 2021 artificial intelligence research paper "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜" by Bender, Timnit Gebru, Angelina McMillan-Major, and Margaret Mitchell.

Artificial intelligence is defined as “systems which display intelligent behaviour by analysing their environment and taking actions – with some degree of autonomy – to achieve specific goals”. These systems can be software-based or embedded in hardware. The so called intelligence is displayed by following either rule based or machine learning algorithms. Artificial intelligence in education (aied) is a generic term, and an interdisciplinary collection of fields which are bundled together, inter alia anthropomorphism, generative artificial intelligence, data-driven decision-making, ai ethics, classroom surveillance, data-privacy and Ai Literacy.An educator could learn these tools and become a prompt engineer.

References

  1. ↑ Trisha Ray, "The paradox of innovation and trust in Artificial Intelligence". orfonline.org. 22 February 2024. Retrieved 1 October 2024.
  2. ↑ Roger Vergauwen & Rodrigo González, "On the verisimilitude of artificial intelligence". philarchive.org. Retrieved 1 October 2024.
  3. ↑ Russell, Stuart; Norvig, Peter (2021). Artificial Intelligence: A Modern Approach (4th ed.). Pearson. ISBN   978-0-13-750513-5.
  4. ↑ "The LLM Paradox: High Expectations Coupled With Lack of Trust". theinformation.com. 14 August 2024. Retrieved 1 October 2024.
  5. 1 2 3 4 5 6 7 Christopher Foster-McBride (25 April 2024). "The AI Trust Paradox: Navigating Verisimilitude in Advanced Language Models". Digital Human Assistants. Retrieved 11 September 2024.
  6. ↑ Al Bowman, "Humans vs AI: The Trust Paradox". mindfoundry.ai. 29 July 2023. Retrieved 1 October 2024.
  7. ↑ Moravec, Hans (1988). Mind Children: The Future of Robot and Human Intelligence. Harvard University Press. ISBN   978-0-674-57618-6.
  8. ↑ Dennis Hillemann, "The Trust Paradox: Will AI in the Public Sector Trust Humans, and Should We Trust AI?". dhillemann.medium.com. Retrieved 1 October 2024.
  9. ↑ Ng, Andrew (November 2016). What Artificial Intelligence Can and Can't Do Right Now. Harvard Business Review.
  10. ↑ Unkelbach, Christian; Bayer, Myriam; Alves, Hans; Koch, Alex; Stahl, Christoph (2011). Fluency and positivity as possible causes of the truth effect. Consciousness and Cognition. 20 (3): 594–602. doi:10.1016/j.concog.2010.09.015. PMID 21111638.
  11. ↑ Sarah Kreps,Julie George ,Paul Lushenko,Adi Rao, "Exploring the artificial intelligence "Trust paradox": Evidence from a survey experiment in the United States". journals.plos.org. 18 January 2023. Retrieved 1 October 2024.
  12. ↑ Bostrom, Nick (2014). Superintelligence: Paths, Dangers, Strategies. Oxford University Press. ISBN   978-0-19-967811-2.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.