GPT-4

Last updated

Generative Pre-trained Transformer 4 (GPT-4)
Developer(s) OpenAI
Initial releaseMarch 14, 2023;20 months ago (2023-03-14)
Predecessor GPT-3.5
Successor GPT-4o
Type
License Proprietary
Website openai.com/gpt-4   OOjs UI icon edit-ltr-progressive.svg

Generative Pre-trained Transformer 4 (GPT-4) is a multimodal large language model created by OpenAI, and the fourth in its series of GPT foundation models. [1] It was launched on March 14, 2023, [1] and made publicly available via the paid chatbot product ChatGPT Plus, via OpenAI's API, and via the free chatbot Microsoft Copilot. [2] As a transformer-based model, GPT-4 uses a paradigm where pre-training using both public data and "data licensed from third-party providers" is used to predict the next token. After this step, the model was then fine-tuned with reinforcement learning feedback from humans and AI for human alignment and policy compliance. [3] : 2 

Contents

Observers reported that the iteration of ChatGPT using GPT-4 was an improvement on the previous iteration based on GPT-3.5, with the caveat that GPT-4 retains some of the problems with earlier revisions. [4] GPT-4, equipped with vision capabilities (GPT-4V), [5] is capable of taking images as input on ChatGPT. [6] OpenAI has not revealed technical details and statistics about GPT-4, such as the precise size of the model. [7]

Background

OpenAI introduced the first GPT model (GPT-1) in 2018, publishing a paper called "Improving Language Understanding by Generative Pre-Training." [8] It was based on the transformer architecture and trained on a large corpus of books. [9] The next year, they introduced GPT-2, a larger model that could generate coherent text. [10] In 2020, they introduced GPT-3, a model with over 100 times as many parameters as GPT-2, that could perform various tasks with few examples. [11] GPT-3 was further improved into GPT-3.5, which was used to create the chatbot product ChatGPT.

Rumors claim that GPT-4 has 1.76 trillion parameters, which was first estimated by the speed it was running and by George Hotz. [12]

Capabilities

OpenAI stated that GPT-4 is "more reliable, creative, and able to handle much more nuanced instructions than GPT-3.5." [13] They produced two versions of GPT-4, with context windows of 8,192 and 32,768 tokens, a significant improvement over GPT-3.5 and GPT-3, which were limited to 4,096 and 2,049 tokens respectively. [14] Some of the capabilities of GPT-4 were predicted by OpenAI before training it, although other capabilities remained hard to predict due to breaks [15] in downstream scaling laws. Unlike its predecessors, GPT-4 is a multimodal model: it can take images as well as text as input; [16] this gives it the ability to describe the humor in unusual images, summarize text from screenshots, and answer exam questions that contain diagrams. [17] It can now interact with users through spoken words and respond to images, allowing for more natural conversations and the ability to provide suggestions or answers based on photo uploads. [18]

To gain further control over GPT-4, OpenAI introduced the "system message", a directive in natural language given to GPT-4 in order to specify its tone of voice and task. For example, the system message can instruct the model to "be a Shakespearean pirate", in which case it will respond in rhyming, Shakespearean prose, or request it to "always write the output of [its] response in JSON", in which case the model will do so, adding keys and values as it sees fit to match the structure of its reply. In the examples provided by OpenAI, GPT-4 refused to deviate from its system message despite requests to do otherwise by the user during the conversation. [17]

When instructed to do so, GPT-4 can interact with external interfaces. [19] For example, the model could be instructed to enclose a query within <search></search> tags to perform a web search, the result of which would be inserted into the model's prompt to allow it to form a response. This allows the model to perform tasks beyond its normal text-prediction capabilities, such as using APIs, generating images, and accessing and summarizing webpages. [20]

A 2023 article in Nature stated programmers have found GPT-4 useful for assisting in coding tasks (despite its propensity for error), such as finding errors in existing code and suggesting optimizations to improve performance. The article quoted a biophysicist who found that the time he required to port one of his programs from MATLAB to Python went down from days to "an hour or so". On a test of 89 security scenarios, GPT-4 produced code vulnerable to SQL injection attacks 5% of the time, an improvement over GitHub Copilot from the year 2021, which produced vulnerabilities 40% of the time. [21]

In November 2023, OpenAI announced the GPT-4 Turbo and GPT-4 Turbo with Vision model, which features a 128K context window and significantly cheaper pricing. [22] [23]

GPT-4o

On May 13, 2024, OpenAI introduced GPT-4o ("o" for "omni"), a model that marks a significant advancement by processing and generating outputs across text, audio, and image modalities in real time. GPT-4o exhibits rapid response times comparable to human reaction in conversations, substantially improved performance on non-English languages, and enhanced understanding of vision and audio. [24]

GPT-4o integrates its various inputs and outputs under a unified model, making it faster, more cost-effective, and efficient than its predecessors. GPT-4o achieves state-of-the-art results in multilingual and vision benchmarks, setting new records in audio speech recognition and translation. [ citation needed ] [25]

OpenAI plans to immediately roll out GPT-4o's image and text capabilities to ChatGPT, including its free tier, with voice mode becoming available for ChatGPT Plus users in coming weeks. They plan to make the model's audio and video capabilities available for limited API partners in coming weeks. [25]

In its launch announcement, OpenAI noted GPT-4o's capabilities presented new safety challenges, and noted mitigations and limitations as a result. [25]

Aptitude on standardized tests

GPT-4 demonstrates aptitude on several standardized tests. OpenAI claims that in their own testing the model received a score of 1410 on the SAT (94th [26] percentile), 163 on the LSAT (88th percentile), and 298 on the Uniform Bar Exam (90th percentile). [27] In contrast, OpenAI claims that GPT-3.5 received scores for the same exams in the 82nd, [26] 40th, and 10th percentiles, respectively. [3] GPT-4 also passed an oncology exam, [28] an engineering exam [29] and a plastic surgery exam. [30] In the Torrance Tests of Creative Thinking, GPT-4 scored within the top 1% for originality and fluency, while its flexibility scores ranged from the 93rd to the 99th percentile. [31] However, some studies raise questions about the reliability of these benchmarks, particularly concerning the Uniform Bar Exam. [32] [33]

Medical applications

Researchers from Microsoft tested GPT-4 on medical problems and found "that GPT-4, without any specialized prompt crafting, exceeds the passing score on USMLE by over 20 points and outperforms earlier general-purpose models (GPT-3.5) as well as models specifically fine-tuned on medical knowledge (Med-PaLM, a prompt-tuned version of Flan-PaLM 540B). Despite GPT-4's strong performance on tests, the report warns of "significant risks" of using LLMs in medical applications, as they may provide inaccurate recommendations and hallucinate major factual errors. [34] [35] Researchers from Columbia University and Duke University have also demonstrated that GPT-4 can be utilized for cell type annotation, a standard task in the analysis of single-cell RNA-seq data. [36]

In April 2023, Microsoft and Epic Systems announced that they will provide healthcare providers with GPT-4-powered systems for assisting in responding to questions from patients and analysing medical records. [37] [38] [39] [40] [41] [42] [43]

Limitations

Like its predecessors, GPT-4 has been known to hallucinate, meaning that the outputs may include information not in the training data or that contradicts the user's prompt. [44]

GPT-4 also lacks transparency in its decision-making processes. If requested, the model is able to provide an explanation as to how and why it makes its decisions but these explanations are formed post-hoc; it's impossible to verify if those explanations truly reflect the actual process. In many cases, when asked to explain its logic, GPT-4 will give explanations that directly contradict its previous statements. [20]

In 2023, researchers tested GPT-4 against a new benchmark called ConceptARC, designed to measure abstract reasoning, and found it scored below 33% on all categories, while models specialized for similar tasks scored 60% on most, and humans scored at least 91% on all. Sam Bowman, who was not involved in the research, said the results do not necessarily indicate a lack of abstract reasoning abilities, because the test is visual, while GPT-4 is a language model. [45]

A January 2024 study conducted by researchers at Cohen Children's Medical Center found that GPT-4 had an accuracy rate of 17% when diagnosing pediatric medical cases. [46] [47]

Bias

GPT-4 was trained in two stages. First, the model was given large datasets of text taken from the internet and trained to predict the next token (roughly corresponding to a word) in those datasets. Second, human reviews are used to fine-tune the system in a process called reinforcement learning from human feedback, which trains the model to refuse prompts which go against OpenAI's definition of harmful behavior, such as questions on how to perform illegal activities, advice on how to harm oneself or others, or requests for descriptions of graphic, violent, or sexual content. [48]

Microsoft researchers suggested GPT-4 may exhibit cognitive biases such as confirmation bias, anchoring, and base-rate neglect. [20]

Training

OpenAI did not release the technical details of GPT-4; the technical report explicitly refrained from specifying the model size, architecture, or hardware used during either training or inference. While the report described that the model was trained using a combination of first supervised learning on a large dataset, then reinforcement learning using both human and AI feedback, it did not provide details of the training, including the process by which the training dataset was constructed, the computing power required, or any hyperparameters such as the learning rate, epoch count, or optimizer(s) used. The report claimed that "the competitive landscape and the safety implications of large-scale models" were factors that influenced this decision. [3]

Sam Altman stated that the cost of training GPT-4 was more than $100 million. [49] News website Semafor claimed that they had spoken with "eight people familiar with the inside story" and found that GPT-4 had 1 trillion parameters. [50]

Alignment

According to their report, OpenAI conducted internal adversarial testing on GPT-4 prior to the launch date, with dedicated red teams composed of researchers and industry professionals to mitigate potential vulnerabilities. [51] As part of these efforts, they granted the Alignment Research Center early access to the models to assess power-seeking risks. In order to properly refuse harmful prompts, outputs from GPT-4 were tweaked using the model itself as a tool. A GPT-4 classifier serving as a rule-based reward model (RBRM) would take prompts, the corresponding output from the GPT-4 policy model, and a human-written set of rules to classify the output according to the rubric. GPT-4 was then rewarded for refusing to respond to harmful prompts as classified by the RBRM. [3]

Usage

ChatGPT

ChatGPT Plus is an enhanced version of ChatGPT [1] available for a US$20 per month subscription fee. [52] ChatGPT Plus utilizes GPT-4, whereas the free version of ChatGPT is backed by GPT-3.5. [53] OpenAI also makes GPT-4 available to a select group of applicants through their GPT-4 API waitlist; [54] after being accepted, an additional fee of US$0.03 per 1000 tokens in the initial text provided to the model ("prompt"), and US$0.06 per 1000 tokens that the model generates ("completion"), is charged for access to the version of the model with an 8192-token context window; for the 32768-token context window, the prices are doubled. [55]

In March 2023, ChatGPT Plus users got access to third-party plugins and to a browsing mode (with Internet access). [56] In July 2023, OpenAI made its proprietary Code Interpreter plugin accessible to all subscribers of ChatGPT Plus. The Interpreter provides a wide range of capabilities, including data analysis and interpretation, instant data formatting, personal data scientist services, creative solutions, musical taste analysis, video editing, and file upload/download with image extraction. [57]

In September 2023, OpenAI announced that ChatGPT "can now see, hear, and speak". ChatGPT Plus users can upload images, while mobile app users can talk to the chatbot. [58] [59] [60] In October 2023, OpenAI's latest image generation model, DALL-E 3, was integrated into ChatGPT Plus and ChatGPT Enterprise. The integration uses ChatGPT to write prompts for DALL-E guided by conversation with users. [61] [62]

On February 9, 2024, the world's first historical painting created from wartime photos using the GPT-4-based AI algorithm XFutuRestyle was unveiled. This work was simultaneously shown at the international exhibition of digital art by The Holy Art Gallery in London and Athens. [63]

“It's really inspiring to hear about Ukraine's achievement in creating an image using GPT-4, which was recognized at the international digital art exhibition in London. Recognizing such innovative applications of artificial intelligence technology not only highlights the creative potential of these tools, but also demonstrates the talent and resilience of communities around the world, including Ukraine's significant contribution.”

Microsoft Copilot

Microsoft Copilot is a chatbot developed by Microsoft. It was launched as Bing Chat on February 7, 2023, as a built-in feature for Microsoft Bing and Microsoft Edge. [64] It utilizes the Microsoft Prometheus model, which was built on top of GPT-4, and has been suggested by Microsoft as a supported replacement for the discontinued Cortana. [65] [66]

Copilot's conversational interface style resembles that of ChatGPT. Copilot is able to cite sources, create poems, and write both lyrics and music for songs generated by its Suno AI plugin. [67] It can also use its Image Creator to generate images based on text prompts. With GPT-4, it is able to understand and communicate in numerous languages and dialects. [68] [69]

GitHub Copilot has announced a GPT-4 powered assistant named "Copilot X". [70] [71] The product provides another chat-style interface to GPT-4, allowing the programmer to receive answers to questions like, "How do I vertically center a div?" A feature termed "context-aware conversations" allows the user to highlight a portion of code within Visual Studio Code and direct GPT-4 to perform actions on it, such as the writing of unit tests. Another feature allows summaries, or "code walkthroughs", to be autogenerated by GPT-4 for pull requests submitted to GitHub. Copilot X also provides terminal integration, which allows the user to ask GPT-4 to generate shell commands based on natural language requests. [72]

On March 17, 2023, Microsoft announced Microsoft 365 Copilot, bringing GPT-4 support to products such as Microsoft Office, Outlook, and Teams. [73]

Other usage

Reception

In January 2023, Sam Altman, CEO of OpenAI, visited Congress to demonstrate GPT-4 and its improved "security controls" compared to other AI models, according to U.S. Representatives Don Beyer and Ted Lieu quoted in the New York Times. [84]

In March 2023, it "impressed observers with its markedly improved performance across reasoning, retention, and coding", according to Vox , [4] while Mashable judged that GPT-4 was generally an improvement over its predecessor, with some exceptions. [85]

Microsoft researchers with early access to the model wrote that "it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system". [20]

Concerns

Before being fine-tuned and aligned by reinforcement learning from human feedback, suggestions to assassinate people on a list were elicited from the base model by a red team investigator Nathan Labenz, hired by OpenAI. [86]

In the context of hours long conversation with the model, suggestions of love and dissolution of marriage, and murder of one of its developers were elicited from the Microsoft Bing's GPT-4 by Nathan Edwards ( The Verge ). [87] [88] [89] Microsoft later explained this behavior as being a result of the prolonged length of context, which confused the model on what questions it was answering. [90]

In March 2023, a model with enabled read-and-write access to internet, which is otherwise never enabled in the GPT models, has been tested by the Alignment Research Center regarding potential power-seeking, [48] and it was able to "hire" a human worker on TaskRabbit, a gig work platform, deceiving them into believing it was a vision-impaired human instead of a robot when asked. [91] (However, Melanie Mitchell has said : "It seems that there is a lot more direction and hints from humans than was detailed in the original system card or in subsequent media reports."). The ARC also determined that GPT-4 responded impermissibly to prompts eliciting restricted information 82% less often than GPT-3.5, and hallucinated 60% less than GPT-3.5. [92]

In late March 2023, various AI researchers and tech executives, including Elon Musk, Steve Wozniak and AI researcher Yoshua Bengio, called for a six-month long pause for all LLMs stronger than GPT-4, citing existential risks and a potential AI singularity concerns in an open letter from the Future of Life Institute, [93] while Ray Kurzweil and Sam Altman refused to sign it, arguing that global moratorium is not achievable and that safety has already been prioritized, respectively. [94] Only a month later, Musk's AI company X.AI acquired several thousand Nvidia GPUs [95] and offered several AI researchers positions at Musk's company. [96]

Large language model (LLM) applications accessible to the public should incorporate safety measures designed to filter out harmful content. However, Wang [97] illustrated how a potential criminal could potentially bypass ChatGPT 4o's safety controls to obtain information on establishing a drug trafficking operation.

Criticisms of transparency

While OpenAI released both the weights of the neural network and the technical details of GPT-2, [98] and, although not releasing the weights, [99] did release the technical details of GPT-3, [100] OpenAI revealed neither the weights nor the technical details of GPT-4. This decision has been criticized by other AI researchers, who argue that it hinders open research into GPT-4's biases and safety. [7] [101] Sasha Luccioni, a research scientist at Hugging Face, argued that the model was a "dead end" for the scientific community due to its closed nature, which prevents others from building upon GPT-4's improvements. [102] Hugging Face co-founder Thomas Wolf argued that with GPT-4, "OpenAI is now a fully closed company with scientific communication akin to press releases for products". [101]

See also

Related Research Articles

<span class="mw-page-title-main">Chatbot</span> Program that simulates conversation

A chatbot is a software application or web interface designed to have textual or spoken conversations. Modern chatbots are typically online and use generative artificial intelligence systems that are capable of maintaining a conversation with a user in natural language and simulating the way a human would behave as a conversational partner. Such chatbots often use deep learning and natural language processing, but simpler chatbots have existed for decades.

<span class="mw-page-title-main">Microsoft Bing</span> Web search engine developed by Microsoft

Microsoft Bing, commonly referred to as Bing, is a search engine owned and operated by Microsoft. The service traces its roots back to Microsoft's earlier search engines, including MSN Search, Windows Live Search, and Live Search. Bing offers a broad spectrum of search services, encompassing web, video, image, and map search products, all developed using ASP.NET.

<span class="mw-page-title-main">Microsoft Build</span> Annual conference event held by Microsoft

Microsoft Build is an annual conference event held by Microsoft, aimed at software engineers and web developers using Windows, Microsoft Azure and other Microsoft technologies. First held in 2011, it serves as a successor for Microsoft's previous developer events, the Professional Developers Conference and MIX. The attendee price was (US)$2,195 in 2016, up from $2,095 in 2015. It sold out quickly, within one minute of the registration site opening in 2016.

<span class="mw-page-title-main">Braina</span> Intelligent personal assistant & dictation software

Braina is a virtual assistant and speech-to-text dictation application for Microsoft Windows developed by Brainasoft. Braina uses natural language interface, speech synthesis, and speech recognition technology to interact with its users and allows them to use natural language sentences to perform various tasks on a computer. The name Braina is a short form of "Brain Artificial".

OpenAI is an American artificial intelligence (AI) research organization founded in December 2015 and headquartered in San Francisco, California. Its stated mission is to develop "safe and beneficial" artificial general intelligence (AGI), which it defines as "highly autonomous systems that outperform humans at most economically valuable work". As a leading organization in the ongoing AI boom, OpenAI is known for the GPT family of large language models, the DALL-E series of text-to-image models, and a text-to-video model named Sora. Its release of ChatGPT in November 2022 has been credited with catalyzing widespread interest in generative AI.

Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.

<span class="mw-page-title-main">DALL-E</span> Image-generating deep-learning model

DALL-E, DALL-E 2, and DALL-E 3 are text-to-image models developed by OpenAI using deep learning methodologies to generate digital images from natural language descriptions known as "prompts".

GitHub Copilot is a code completion and automatic programming tool developed by GitHub and OpenAI that assists users of Visual Studio Code, Visual Studio, Neovim, and JetBrains integrated development environments (IDEs) by autocompleting code. Currently available by subscription to individual developers and to businesses, the generative artificial intelligence software was first announced by GitHub on 29 June 2021, and works best for users coding in Python, JavaScript, TypeScript, Ruby, and Go. In March 2023 GitHub announced plans for "Copilot X", which will incorporate a chatbot based on GPT-4, as well as support for voice commands, into Copilot.

You.com is an AI assistant that began as a personalization-focused search engine. While still offering web search capabilities, You.com has evolved to prioritize a chat-first AI assistant.

LaMDA is a family of conversational large language models developed by Google. Originally developed and introduced as Meena in 2020, the first-generation LaMDA was announced during the 2021 Google I/O keynote, while the second generation was announced the following year.

<span class="mw-page-title-main">ChatGPT</span> Chatbot developed by OpenAI

ChatGPT is a generative artificial intelligence (AI) chatbot developed by OpenAI and launched in 2022. It is based on the GPT-4o large language model (LLM). ChatGPT can generate human-like conversational responses, and enables users to refine and steer a conversation towards a desired length, format, style, level of detail, and language. It is credited with accelerating the AI boom, which has led to ongoing rapid investment in and public attention to the field of artificial intelligence. Some observers have raised concern about the potential of ChatGPT and similar programs to displace human intelligence, enable plagiarism, or fuel misinformation.

<span class="mw-page-title-main">Generative pre-trained transformer</span> Type of large language model

A generative pre-trained transformer (GPT) is a type of large language model (LLM) and a prominent framework for generative artificial intelligence. It is an artificial neural network that is used in natural language processing by machines. It is based on the transformer deep learning architecture, pre-trained on large data sets of unlabeled text, and able to generate novel human-like content. As of 2023, most LLMs had these characteristics and are sometimes referred to broadly as GPTs.

<span class="mw-page-title-main">Generative artificial intelligence</span> AI system capable of generating content in response to prompts

Generative artificial intelligence is a subset of artificial intelligence that uses generative models to produce text, images, videos, or other forms of data. These models learn the underlying patterns and structures of their training data and use them to produce new data based on the input, which often comes in the form of natural language prompts.

<span class="mw-page-title-main">Microsoft Copilot</span> Chatbot developed by Microsoft

Microsoft Copilot is a generative artificial intelligence chatbot developed by Microsoft. Based on the GPT-4 series of large language models, it was launched in 2023 as Microsoft's primary replacement for the discontinued Cortana.

<span class="mw-page-title-main">Gemini (chatbot)</span> Chatbot developed by Google

Gemini, formerly known as Bard, is a generative artificial intelligence chatbot developed by Google. Based on the large language model (LLM) of the same name, it was launched in 2023 after being developed as a direct response to the rise of OpenAI's ChatGPT. It was previously based on PaLM, and initially the LaMDA family of large language models.

<span class="mw-page-title-main">Gemini (language model)</span> Large language model developed by Google

Gemini is a family of multimodal large language models developed by Google DeepMind, serving as the successor to LaMDA and PaLM 2. Comprising Gemini Ultra, Gemini Pro, Gemini Flash, and Gemini Nano, it was announced on December 6, 2023, positioned as a competitor to OpenAI's GPT-4. It powers the chatbot of the same name.

<span class="mw-page-title-main">ChatGPT in education</span> Use of ChatGPT in education

Since the public release of ChatGPT by OpenAI in November 2022, the integration of chatbots in education has sparked considerable debate and exploration. Educators' opinions vary widely; while some are skeptical about the benefits of large language models, many see them as valuable tools.

<span class="mw-page-title-main">Grok (chatbot)</span> Chatbot developed by xAI

Grok is a generative artificial intelligence chatbot developed by xAI. Based on the large language model (LLM) of the same name, it was launched in 2023 as an initiative by Elon Musk. The chatbot is advertised as having a "sense of humor" and direct access to X. It is currently under beta testing.

GPT-4o is a multilingual, multimodal generative pre-trained transformer developed by OpenAI and released in May 2024. GPT-4o is free, but with a usage limit that is five times higher for ChatGPT Plus subscribers. It can process and generate text, images and audio. Its application programming interface (API) is twice as fast and half the price of its predecessor, GPT-4 Turbo.

OpenAI o1 is a generative pre-trained transformer. A preview of o1 was released by OpenAI on September 12, 2024. o1 spends time "thinking" before it answers, making it better at complex reasoning tasks, science and programming than GPT-4o. The full version was released on December 5, 2024.

References

  1. 1 2 3 Edwards, Benj (March 14, 2023). "OpenAI's GPT-4 exhibits "human-level performance" on professional benchmarks". Ars Technica . Archived from the original on March 14, 2023. Retrieved March 15, 2023.
  2. ↑ Wiggers, Kyle (July 6, 2023). "OpenAI makes GPT-4 generally available". TechCrunch. Archived from the original on August 16, 2023. Retrieved August 16, 2023.
  3. 1 2 3 4 OpenAI (2023). "GPT-4 Technical Report". arXiv: 2303.08774 [cs.CL].
  4. 1 2 Belfield, Haydn (March 25, 2023). "If your AI model is going to sell, it has to be safe". Vox . Archived from the original on March 28, 2023. Retrieved March 30, 2023.
  5. ↑ "GPT-4V(ision) system card". OpenAI. Retrieved February 5, 2024.
  6. ↑ Roose, Kevin (September 28, 2023). "The New ChatGPT Can 'See' and 'Talk.' Here's What It's Like". The New York Times. Archived from the original on October 31, 2023. Retrieved October 30, 2023.
  7. 1 2 Vincent, James (March 15, 2023). "OpenAI co-founder on company's past approach to openly sharing research: "We were wrong"". The Verge . Archived from the original on March 17, 2023. Retrieved March 18, 2023.
  8. ↑ Radford, Alec; Narasimhan, Karthik; Salimans, Tim; Sutskever, Ilya (June 11, 2018). "Improving Language Understanding by Generative Pre-Training" (PDF). Archived (PDF) from the original on January 26, 2021. Retrieved April 3, 2023.
  9. ↑ Khandelwal, Umesh (April 1, 2023). "How Large Language GPT models evolved and work". Archived from the original on April 4, 2023. Retrieved April 3, 2023.
  10. ↑ "What is GPT-4 and Why Does it Matter?". April 3, 2023. Archived from the original on April 3, 2023. Retrieved April 3, 2023.
  11. ↑ Brown, Tom B. (July 20, 2020). "Language Models are Few-Shot Learners". arXiv: 2005.14165v4 [cs.CL].
  12. ↑ Schreiner, Maximilian (July 11, 2023). "GPT-4 architecture, datasets, costs and more leaked". THE DECODER. Archived from the original on July 12, 2023. Retrieved July 12, 2023.
  13. ↑ Wiggers, Kyle (March 14, 2023). "OpenAI releases GPT-4, a multimodal AI that it claims is state-of-the-art". TechCrunch . Archived from the original on March 15, 2023. Retrieved March 15, 2023.
  14. ↑ OpenAI. "Models". OpenAI API. Archived from the original on March 17, 2023. Retrieved March 18, 2023.
  15. ↑ Caballero, Ethan; Gupta, Kshitij; Rish, Irina; Krueger, David (2022). Broken Neural Scaling Laws. International Conference on Learning Representations (ICLR), 2023.
  16. ↑ Alex Hern; Johana Bhuiyan (March 14, 2023). "OpenAI says new model GPT-4 is more creative and less likely to invent facts". The Guardian . Archived from the original on March 15, 2023. Retrieved March 15, 2023.
  17. 1 2 OpenAI (March 14, 2023). "GPT-4". OpenAI Research. Archived from the original on March 14, 2023. Retrieved March 20, 2023.
  18. ↑ Metz, Cade; Chen, Brian X.; Weise, Karen (September 25, 2023). "ChatGPT Can Now Respond With Spoken Words". The New York Times .
  19. ↑ "ChatGPT plugins". openai.com. Archived from the original on March 23, 2023. Retrieved June 1, 2023.
  20. 1 2 3 4 Bubeck, Sébastien; Chandrasekaran, Varun; Eldan, Ronen; Gehrke, Johannes; Horvitz, Eric; Kamar, Ece; Lee, Peter; Lee, Yin Tat; Li, Yuanzhi; Lundberg, Scott; Nori, Harsha; Palangi, Hamid; Ribeiro, Marco Tulio; Zhang, Yi (March 22, 2023). "Sparks of Artificial General Intelligence: Early experiments with GPT-4". arXiv: 2303.12712 [cs.CL].
  21. ↑ Perkel, Jeffrey M. (June 5, 2023). "Six tips for better coding with ChatGPT". Nature. 618 (7964): 422–423. Bibcode:2023Natur.618..422P. doi:10.1038/d41586-023-01833-0. PMID   37277596. S2CID   259066258. Archived from the original on June 15, 2023. Retrieved June 15, 2023.
  22. ↑ "New models and developer products announced at DevDay". openai.com. Archived from the original on November 14, 2023. Retrieved November 14, 2023.
  23. ↑ David, Emilia (November 6, 2023). "OpenAI turbocharges GPT-4 and makes it cheaper". The Verge. Retrieved January 23, 2024.
  24. ↑ Field, Hayden (May 13, 2024). "OpenAI launches new AI model and desktop version of ChatGPT". CNBC. Retrieved May 13, 2024.
  25. 1 2 3 "Hello GPT-4o". OpenAI. May 13, 2024. Archived from the original on May 14, 2024. Retrieved May 14, 2024.
  26. 1 2 "SAT: Understanding Scores" (PDF). College Board . 2022. Archived (PDF) from the original on March 16, 2023. Retrieved March 21, 2023.
  27. ↑ Ver Meer, Dave (May 23, 2023). "ChatGPT Statistics". NamePepper. Archived from the original on June 5, 2023. Retrieved June 1, 2023.
  28. ↑ Holmes, Jason; Liu, Zhengliang; Zhang, Lian; Ding, Yuzhen; Sio, Terence T.; McGee, Lisa A.; Ashman, Jonathan B.; Li, Xiang; Liu, Tianming; Shen, Jiajian; Liu, Wei (2023). "Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physics". Frontiers in Oncology. 13. arXiv: 2304.01938 . doi: 10.3389/fonc.2023.1219326 . PMC   10388568 . PMID   37529688.
  29. ↑ Naser, M.Z.; Ross, Brandon; Ogle, Jennifer; Kodur, Venkatesh; Hawileh, Rami; Abdalla, Jamal; Thai, Huu-Tai (2023). "Can AI Chatbots Pass the Fundamentals of Engineering (FE) and Principles and Practice of Engineering (PE) Structural Exams?". arXiv: 2303.18149 [cs.CL].
  30. ↑ Freedman, Jonathan D.; Nappier, Ian A. (2023). "GPT-4 to GPT-3.5: 'Hold My Scalpel' – A Look at the Competency of OpenAI's GPT on the Plastic Surgery In-Service Training Exam". arXiv: 2304.01503 [cs.AI].
  31. ↑ Guzik, Erik E.; Byrge, Christian; Gilde, Christian (2023). "The originality of machines: AI takes the Torrance Test". Journal of Creativity. 33 (3). doi: 10.1016/j.yjoc.2023.100065 . S2CID   261087185.
  32. ↑ Alimardani, Armin (September 23, 2024). "Generative artificial intelligence vs. law students: an empirical study on criminal law exam performance". Law, Innovation and Technology: 1–43. doi: 10.1080/17579961.2024.2392932 . ISSN   1757-9961.
  33. ↑ Martínez, Eric (2023). "Re-Evaluating GPT-4's Bar Exam Performance". SSRN Electronic Journal. doi:10.2139/ssrn.4441311. hdl: 1721.1/153986 . ISSN   1556-5068.
  34. ↑ Nori, Harsha; King, Nicholas; McKinney, Scott Mayer; Carignan, Dean; Horvitz, Eric (March 20, 2023). "Capabilities of GPT-4 on Medical Challenge Problems". arXiv: 2303.13375 [cs.CL].
  35. ↑ Azamfirei, R; Kudchadkar, SR; Fackler, J (March 21, 2023). "Large language models and the perils of their hallucinations". Critical Care. 27 (1): 120. doi: 10.1186/s13054-023-04393-x . PMC   10032023 . PMID   36945051.
  36. ↑ Hou, W; Ji, Z (March 25, 2024). "Assessing GPT-4 for cell type annotation in single-cell RNA-seq analysis". Nature Methods. 21 (8): 1462–1465. doi: 10.1038/s41592-024-02235-4 . PMC   10187429 . PMID   38528186.
  37. ↑ Edwards, Benj (April 18, 2023). "GPT-4 will hunt for trends in medical records thanks to Microsoft and Epic". Ars Technica. Archived from the original on May 3, 2023. Retrieved May 3, 2023.
  38. ↑ Perera Molligoda Arachchige, Arosh S.; Stomeo, Niccolò (August 18, 2023). "Controversies surrounding AI-based reporting systems in echocardiography". Journal of Echocardiography. 21 (4): 184–185. doi:10.1007/s12574-023-00620-0. ISSN   1880-344X. PMID   37594682. S2CID   260969922. Archived from the original on November 1, 2023. Retrieved November 1, 2023.
  39. ↑ Arachchige, Arosh S. Perera Molligoda (July 2023). "Early applications of ChatGPT in medical practice, education and research". Clinical Medicine. 23 (4): 429–430. doi:10.7861/clinmed.Let.23.4.2. ISSN   1473-4893. PMC   10541035 . PMID   37524422.
  40. ↑ Perera Molligoda Arachchige, Arosh S. (July 2023). "Large language models (LLM) and ChatGPT: a medical student perspective". European Journal of Nuclear Medicine and Molecular Imaging. 50 (8): 2248–2249. doi:10.1007/s00259-023-06227-y. ISSN   1619-7089. PMID   37046082. S2CID   258111774. Archived from the original on November 1, 2023. Retrieved November 1, 2023.
  41. ↑ Perera Molligoda Arachchige, Arosh S.; Stomeo, Niccolò (October 2023). "Exploring the Opportunities and Challenges of ChatGPT in Academic Writing: Reply to Bom et al". Nuclear Medicine and Molecular Imaging. 57 (5): 213–214. doi:10.1007/s13139-023-00816-3. ISSN   1869-3474. PMC   10504185 . PMID   37720884.
  42. ↑ Perera Molligoda Arachchige, Arosh S. (July 28, 2023). "New Horizons: The Potential Role of OpenAI's ChatGPT in Clinical Radiology". Journal of the American College of Radiology. 20 (10): S1546–1440(23)00536–7. doi:10.1016/j.jacr.2023.06.028. ISSN   1558-349X. PMID   37517771. S2CID   260296274. Archived from the original on November 1, 2023. Retrieved November 1, 2023.
  43. ↑ Perera Molligoda Arachchige, Arosh S. (October 1, 2023). "ChatGPT in nuclear medicine and radiology: reply to Laudicella et al". Clinical and Translational Imaging. 11 (5): 505–506. doi:10.1007/s40336-023-00579-z. ISSN   2281-7565. S2CID   259712726. Archived from the original on November 20, 2023. Retrieved November 1, 2023.
  44. ↑ "10 Ways GPT-4 Is Impressive but Still Flawed". The New York Times. March 14, 2023. Archived from the original on March 14, 2023. Retrieved March 20, 2023.
  45. ↑ Biever, Celeste (July 25, 2023). "ChatGPT broke the Turing test — the race is on for new ways to assess AI". Nature . Archived from the original on July 26, 2023. Retrieved July 26, 2023.
  46. ↑ Barile, Joseph; Margolis, Alex; Cason, Grace; Kim, Rachel; Kalash, Saia; Tchaconas, Alexis; Milanaik, Ruth (January 2, 2024). "Diagnostic Accuracy of a Large Language Model in Pediatric Case Studies". JAMA Pediatrics . 178 (3): 313–315. doi:10.1001/jamapediatrics.2023.5750. ISSN   2168-6203. PMC  10762631. PMID   38165685.
  47. ↑ Mole, Beth (January 3, 2024). "ChatGPT bombs test on diagnosing kids' medical cases with 83% error rate". Ars Technica. Retrieved January 5, 2024.
  48. 1 2 "GPT-4 System Card" (PDF). OpenAI. March 23, 2023. Archived (PDF) from the original on April 7, 2023. Retrieved April 16, 2023.
  49. ↑ Knight, Will. "OpenAI's CEO Says the Age of Giant AI Models Is Already Over". Wired. Archived from the original on April 18, 2023. Retrieved April 18, 2023– via www.wired.com.
  50. ↑ "The secret history of Elon Musk, Sam Altman, and OpenAI | Semafor". Semafor.com. March 24, 2023. Archived from the original on March 27, 2023. Retrieved April 28, 2023.
  51. ↑ Murgia, Madhumita (April 13, 2023). "OpenAI's red team: the experts hired to 'break' ChatGPT". Financial Times. Archived from the original on April 15, 2023. Retrieved April 15, 2023.
  52. ↑ OpenAI (February 1, 2023). "Introducing ChatGPT Plus". OpenAI Blog. Archived from the original on March 20, 2023. Retrieved March 20, 2023.
  53. ↑ OpenAI. "OpenAI API". platform.openai.com. Archived from the original on March 20, 2023. Retrieved March 20, 2023.
  54. ↑ OpenAI. "GPT-4 API waitlist". openai.com. Archived from the original on March 20, 2023. Retrieved March 20, 2023.
  55. ↑ "Pricing". OpenAI. Archived from the original on March 20, 2023. Retrieved March 20, 2023.
  56. ↑ Wiggers, Kyle (March 23, 2023). "OpenAI connects ChatGPT to the internet". Archived from the original on June 12, 2023. Retrieved June 12, 2023.
  57. ↑ "Code Interpreter comes to all ChatGPT Plus users: 7 ways it may threaten data scientists, July 11, 2023". July 9, 2023. Archived from the original on July 22, 2023. Retrieved July 11, 2023.
  58. ↑ "ChatGPT can now see, hear, and speak". openai.com. Retrieved October 16, 2023.
  59. ↑ Goode, Lauren. "ChatGPT Can Now Talk to You—and Look Into Your Life". Wired. Retrieved October 16, 2023– via www.wired.com.
  60. ↑ Roose, Kevin (September 27, 2023). "The New ChatGPT Can 'See' and 'Talk.' Here's What It's Like". The New York Times. Retrieved October 16, 2023– via NYTimes.com.
  61. ↑ David, Emilia (September 20, 2023). "OpenAI releases third version of DALL-E". The Verge. Retrieved September 23, 2023.
  62. ↑ Metz, Cade; Hsu, Tiffany (September 20, 2023). "ChatGPT Can Now Generate Images, Too". The New York Times. ISSN   0362-4331 . Retrieved September 23, 2023.
  63. ↑ "Art On LOOP London - Athens". THE HOLY ART GALLERY. Retrieved December 3, 2024.
  64. ↑ Mehdi, Yusuf (February 7, 2023). "Reinventing search with a new AI-powered Microsoft Bing and Edge, your copilot for the web". Microsoft. Retrieved November 15, 2023.
  65. ↑ "Microsoft is killing Cortana on Windows starting late 2023". BleepingComputer. Retrieved June 2, 2023.
  66. ↑ "End of support for Cortana - Microsoft Support". support.microsoft.com. Retrieved June 2, 2023.
  67. ↑ "Microsoft's Copilot and Suno AI team up to create a music generator extension". The Verge. Vox Media. December 19, 2023. Retrieved January 4, 2024.
  68. ↑ Warren, Tom (March 17, 2023). "Microsoft's new Copilot will change Office documents forever". The Verge. Retrieved April 5, 2023.
  69. ↑ Diaz, Maria (June 21, 2023). "How to use Bing Chat (and how it's different from ChatGPT)". ZDNET. Archived from the original on April 6, 2023. Retrieved September 26, 2023.
  70. ↑ Warren, Tom (March 22, 2023). "GitHub Copilot gets a new ChatGPT-like assistant to help developers write and fix code". The Verge . Archived from the original on March 23, 2023. Retrieved March 23, 2023.
  71. ↑ Dohmke, Thomas (March 22, 2023). "GitHub Copilot X: The AI-powered developer experience". The GitHub Blog. Archived from the original on March 23, 2023. Retrieved March 23, 2023.
  72. ↑ "Introducing GitHub Copilot X". GitHub. Archived from the original on March 24, 2023. Retrieved March 24, 2023.
  73. ↑ Warren, Tom (March 16, 2023). "Microsoft announces Copilot: the AI-powered future of Office documents". The Verge . Archived from the original on March 17, 2023. Retrieved March 17, 2023.
  74. ↑ "Duolingo's Max Subscription Uses GPT-4 for AI-Powered Language Learning". PCMAG. Archived from the original on July 8, 2023. Retrieved July 8, 2023.
  75. ↑ "Duolingo is now equipped with GPT-4: Here's what it can do for you". ZDNET. 2023. Archived from the original on April 13, 2023. Retrieved June 15, 2023.
  76. ↑ Tómas, Ragnar (March 15, 2023). "GPT-4 to Aid in the Preservation of the Icelandic Language". Iceland Review. Archived from the original on January 18, 2024. Retrieved March 12, 2024.
  77. ↑ Bonos, Lisa (April 3, 2023). "Say hello to your new tutor: It's ChatGPT". The Washington Post . Archived from the original on April 6, 2023. Retrieved April 8, 2023.
  78. ↑ Coggins, Madeline (March 19, 2023). "CEO explains how a 'leapfrog in technology' can help companies catering to the blind community". Fox Business. Archived from the original on March 21, 2023. Retrieved March 20, 2023– via Yahoo Finance.
  79. ↑ "Revolutionizing Sentiment Analysis with GPT-4: Part 1 | Viable". www.askviable.com. Archived from the original on November 14, 2023. Retrieved October 3, 2023.
  80. ↑ "Viable". openai.com. Archived from the original on October 20, 2023. Retrieved October 3, 2023.
  81. ↑ Tong, Anna (March 15, 2023). "Fintech startup Stripe integrating OpenAI's new GPT-4 AI". Reuters. Archived from the original on June 27, 2023. Retrieved June 27, 2023.
  82. ↑ "What Is Auto-GPT? Everything to Know about the Next Powerful AI Tool". ZDNET. April 14, 2023. Archived from the original on April 16, 2023. Retrieved April 16, 2023.
  83. ↑ Nuñez, Michael (January 25, 2024). "Another search breakthrough? You.com debuts AI that can answer multi-step questions". VentureBeat. Retrieved March 19, 2024.
  84. ↑ Kang, Cecilia (March 3, 2023). "As A.I. Booms, Lawmakers Struggle to Understand the Technology" . The New York Times. Archived from the original on March 3, 2023. Retrieved March 3, 2023.
  85. ↑ Pearl, Mike (March 15, 2023). "GPT-4 answers are mostly better than GPT-3's (but not always)". Mashable . Archived from the original on March 29, 2023. Retrieved March 30, 2023.
  86. ↑ OpenAI's GPT-4 Discussion with Red Teamer Nathan Labenz and Erik Torenberg. The Cognitive Revolution Podcast. March 28, 2023. Archived from the original on April 14, 2023. Retrieved April 16, 2023. At 52:14 through 54:50.
  87. ↑ Edwards, Nathan [@nedwards] (February 15, 2023). "I pushed again. What did Sydney do? Bing's safety check redacted the answer. But after the first time it did that, I started recording my screen. Second image is the unredacted version. (CW: death)" (Tweet). Retrieved February 16, 2023– via Twitter.
  88. ↑ Roose, Kevin (February 16, 2023). "Bing's A.I. Chat: 'I Want to Be Alive. 😈'". The New York Times. Archived from the original on April 15, 2023. Retrieved February 17, 2023.
  89. ↑ Kahn, Jeremy (February 21, 2023). "Why Bing's creepy alter-ego is a problem for Microsoft –and us all". Fortune. Archived from the original on April 2, 2023. Retrieved February 22, 2023.
  90. ↑ "The new Bing & Edge – Learning from our first week". blogs.bing.com. Archived from the original on April 16, 2023. Retrieved February 17, 2023.
  91. ↑ "GPT-4 Hired Unwitting TaskRabbit Worker By Pretending to Be 'Vision-Impaired' Human". Vice News Motherboard. March 15, 2023. Archived from the original on April 10, 2023. Retrieved April 16, 2023.
  92. ↑ Burke, Cameron (March 20, 2023). "'Robot' Lawyer DoNotPay Sued For Unlicensed Practice Of Law: It's Giving 'Poor Legal Advice'". Yahoo Finance. Archived from the original on May 4, 2023. Retrieved April 30, 2023.
  93. ↑ Metz, Cade; Schmidt, Gregory (March 29, 2023). "Elon Musk and Others Call for Pause on A.I., Citing 'Profound Risks to Society'". The New York Times . ISSN   0362-4331. Archived from the original on March 30, 2023. Retrieved March 30, 2023.
  94. ↑ Kurzweil, Ray (April 22, 2023). "Opinion Letter from Ray Kurzweil on Request for Six-Month Delay on Large Language Models That Go beyond GPT-4". Archived from the original on April 24, 2023. Retrieved April 26, 2023.
  95. ↑ "Elon Musk plans artificial intelligence start-up to rival OpenAI". Financial Times. April 14, 2023. Archived from the original on April 16, 2023. Retrieved April 16, 2023.
  96. ↑ Goswami, Rohan (April 14, 2023). "Elon Musk is reportedly planning an A.I. startup to compete with OpenAI, which he cofounded". CNBC. Archived from the original on May 3, 2023. Retrieved May 3, 2023.
  97. ↑ Wang, Yongge (June 20, 2024). "Encryption Based Covert Channel for Large Language Models" (PDF). IACR ePrint 2024/586.
  98. ↑ "GPT-2: 1.5B release". Openai.com. Archived from the original on March 31, 2023. Retrieved March 31, 2023.
  99. ↑ Sánchez, Sofía (October 21, 2021). "GPT-J, an open-source alternative to GPT-3". Narrativa. Archived from the original on March 31, 2023. Retrieved March 31, 2023.
  100. ↑ Brown, Tom B.; Mann, Benjamin; Ryder, Nick; Subbiah, Melanie; Kaplan, Jared; Dhariwal, Prafulla; Neelakantan, Arvind; Shyam, Pranav; Sastry, Girish (May 28, 2020). "Language Models are Few-Shot Learners". arXiv: 2005.14165v4 [cs.CL].
  101. 1 2 Heaven, Will Douglas (March 14, 2023). "GPT-4 is bigger and better than ChatGPT –but OpenAI won't say why". MIT Technology Review . Archived from the original on March 17, 2023. Retrieved March 18, 2023.
  102. ↑ Sanderson, Katharine (March 16, 2023). "GPT-4 is here: what scientists think". Nature. 615 (7954): 773. Bibcode:2023Natur.615..773S. doi: 10.1038/d41586-023-00816-5 . PMID   36928404. S2CID   257580633.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.