ChatGPT in education

Last updated

Output from ChatGPT generating an essay draft ChatGPT essay draft.png
Output from ChatGPT generating an essay draft

Since the public release of ChatGPT by OpenAI in November 2022, the integration of chatbots in education has sparked considerable debate and exploration. Educators' opinions vary widely; while some are skeptical about the utility of large language models, many see them as valuable tools. [1]

Contents

ChatGPT serves multiple educational purposes, including providing topic overviews, generating ideas, and assisting in drafting. [2] A 2023 study highlighted its greater acceptance among professors compared to students. [1] Moreover, chatbots show promise in personalized tutoring. [3]

Efforts to prohibit chatbots like ChatGPT in schools aim to curb academic dishonesty, but enforcement faces challenges due to AI detection inaccuracies and widespread accessibility of chatbot technology. Banning could also hinder students' opportunities to learn effective technology usage, while straining teacher-student relationships. [2]

Effectiveness and applications

In a January 2023 assessment, ChatGPT demonstrated performance comparable to graduate-level standards at institutions such as the University of Minnesota and Wharton School. [4] Its application in fields like computer programming and numerical methods has been explored and validated. [5] Assessment psychologist Eka Roivainen's study suggested ChatGPT's verbal IQ approximates the top 0.1% of test-takers, though its accuracy in technical subjects remains debated. [6]

A survey conducted between March and April 2023 revealed 58% of American students admitted using ChatGPT, with 38% acknowledging use without teacher consent, highlighting challenges in enforcing bans. [7] [8]

One notable drawback of ChatGPT is occasional inaccuracies detected in academic assignments, particularly in technical subjects such as mathematics, as noted by educators like Ethan Mollick from the Wharton School. [9]

In response to educational demand, OpenAI launched "ChatGPT Edu" in May 2024, aiming to offer universities affordable access to this technology. [10]

Academic misconduct and challenges

ChatGPT's capability to generate assignments has prompted concerns about academic integrity, particularly in essay writing, with critics foreseeing potential misuse and devaluation of traditional writing skills. [11] [12] [13]

This technological evolution prompts educators to rethink pedagogical approaches, emphasizing critical thinking and ethical AI usage. Proponents argue for integrating ChatGPT into educational frameworks responsibly, leveraging its potential to enhance learning outcomes through personalized approaches. [14] [15]

The impact of ChatGPT on education, especially in English studies, is indeed a topic of significant discussion. Daniel Herman's perspective reflects concerns about the potential devaluation of writing skills if AI can generate text as easily as humans. On the other hand, Chris Stokel-Walker and Emma Bowman highlight the need for educators to adapt their methods to focus more on critical thinking and reasoning, as AI tools like ChatGPT could potentially be used for plagiarism or produce biased content. It's a complex issue with various viewpoints and implications for how education may evolve in the future. The theory that ChatGPT will destroy education is disputed almost as widely as it is believed. Kevin Brown of Christianity Today wrote that the human brain remains consistently better able to create material than ChatGPT. Brown further argued that education in its spirit will continue to live on and that ChatGPT could only revolutionize teaching methods. [12] The New York Times ' Kevin Roose also reported that ChatGPT's prohibition would never be able to be practiced effectively, noting it would be impossible to police. Roose noted that students can access the internet outside of schools, effectively rendering a ban obsolete; Roose suggested instead that teachers allow it openly for some assignments similar to calculators, and that teaching with the AI is the best approach. [16] The oral exam has also been used as an example of an instruction method which could circumvent the assignment and test students' knowledge more effectively on a 1:1 basis. [17]

One instance, as reported by Rolling Stone , resulted in a professor at Texas A&M University misusing ChatGPT to check student assignments for verifying whether an assignment utilized the large language model. ChatGPT returned a result of all students using it, and so the professor promptly returned a failing grade to all of his students. Rolling Stone noted however that ChatGPT inherently is unable to verify whether it was used to write student assignments, and a post to a Reddit community dedicated to ChatGPT received widespread attention with many attacking the professor for a lack of familiarity towards the chatbot. [18] [19] More recently, a 2024 study found that increased academic workload and time constraints lead students to use ChatGPT more frequently. However, this reliance is associated with negative outcomes like procrastination, memory loss, and decreased academic performance. [20] [21]

Support and opposition

Bans

Some educational institutions have chosen to ban access to ChatGPT. The reasons behind these decisions likely vary, but concerns about potential misuse, such as plagiarism or reliance on AI for writing tasks, could be driving factors. ChatGPT has been met with various bans from certain educational institutions. One of the earliest districts to ban the tool was the Los Angeles Unified School District, which blocked access to the tool less than a month after its official release. [22] The New York City Department of Education reportedly blocked access to ChatGPT in December 2022 [23] and officially announced a ban around January 4, 2023. [24] [25]

In February 2023, the University of Hong Kong sent a campus-wide email to instructors and students stating that the use of ChatGPT or other AI tools is prohibited in all classes, assignments and assessments at the university. Any violations would be treated as plagiarism by the university unless the student obtains the prior written consent from the course instructor. [26] [27] Also in the 2023 spring semester, Harvard University banned ChatGPT and announced that usage of generative AI would be treated as any other form of academic misconduct, though some instructors allowed for usage of the tool.[ citation needed ]

Shift in the perception of ChatGPT in education

Some schools in the United States for the 2023–24 school year announced a repeal of their bans for ChatGPT. New York City repealed its ban in May 2023 while replacing it with a statement which encourages students to learn how to use generative AI, and in rural Washington, Walla Walla Public Schools announced it would repeal its ban of ChatGPT in student assignments. [22] [28] [29] A professor at the University of California, Los Angeles, has permitted the incorporation of ChatGPT into his students' writing process instead of banning the use of this new technology. [30] He argued that educators should teach students to use ChatGPT ethically and productively, and that it is not feasible or practical to ban students from using it. [30] He also discussed the benefits of learning to write well with AI assistance, and stressed on the importance of being responsible users of AI. [30]

Adoption into assignments

Some professors have created separate college courses designed specifically to train generative AI. For example, Arizona State University professor Andrew Maynard and Vanderbilt professor Jules White both developed a new course specifically for prompt engineering generative AI chatbots. [31] Other instructors, such as Ethan Mollick at Wharton, have, in the face of inevitable use by students regardless of prohibition, not only accepted usage of generative AI but required all students to use ChatGPT in their assignments. Mollick reported to NPR that the usage of ChatGPT generally improved his students' work, using AI to further assist in the generation of ideas. [9] Some professors have focused on creating learning material and have highlighted the opportunities of using ChatGPT to personalize assignments to a student's background. [32] The use of AI in education has vast potential. It can provide personalized learning experiences and adaptive teaching methods. [33]

Chegg

The education technology company Chegg, which was a website dedicated to helping students with assignments using a database of collected worksheets and assignments, became one of the most prominent business victims to ChatGPT and other large language models, with CEO Dan Rosensweig stating, in response to his company's stock price nearly being cut in half after a quarterly earnings call in May 2023, that he has become the "poster child for getting your ass kicked in the public markets by AI". Though executives at Chegg were urging Rosenweig to work on developing a ChatGPT rival as early as possible since 2020, the technology firm ultimately decided against producing a ChatGPT competitor due to GPT 3.5 not being able to sufficiently lure away Chegg's 8 million subscribers, which makes up nearly 90% of the firm's revenue. [34] [35]

Detection software

Some companies have responded to the influx of ChatGPT and generative AI among students by developing detection software which flags down essays likely written by AI. Among the first companies to develop solutions like this was Turnitin, which developed a tool to detect AI-based academic dishonesty. A corporate blog post from the company stated that the company's database of numerous student essays was used to train its own detection system. When tested by The Washington Post , though, noted that Turnitin's detector flagged an innocent student for using ChatGPT to generate the conclusion of her essay. [36] The company itself reported that its detector was not always accurate as well. [37] [38]

Numerous tools such as GPTZero were created as tools to detect AI-generated text, and numerous other startups have released tools on detecting AI-written work, including OpenAI itself. However, research reports have stated that detection software often fails to detect content generated by AI, and that these tools are easy to fool. [39] [40] OpenAI's official tool, Classifier, launched in January 2023, was later taken down in August 2023 due to low usage and accuracy issues. [41] [42] [43]

Related Research Articles

<span class="mw-page-title-main">Chatbot</span> Program that simulates conversation

A chatbot is a software application or web interface that is designed to mimic human conversation through text or voice interactions. Modern chatbots are typically online and use generative artificial intelligence systems that are capable of maintaining a conversation with a user in natural language and simulating the way a human would behave as a conversational partner. Such chatbots often use deep learning and natural language processing, but simpler chatbots have existed for decades.

<span class="mw-page-title-main">Turnitin</span> Internet-based plagiarism-prevention service

Turnitin is an Internet-based similarity detection service run by the American company Turnitin, LLC, a subsidiary of Advance Publications.

<span class="mw-page-title-main">Plagiarism</span> Using another authors work as if it was ones own original work

Plagiarism is the representation of another person's language, thoughts, ideas, or expressions as one's own original work. Although precise definitions vary depending on the institution, in many countries and cultures plagiarism is considered a violation of academic integrity and journalistic ethics, as well as social norms around learning, teaching, research, fairness, respect, and responsibility. As such, a person or entity that is determined to have committed plagiarism is often subject to various punishments or sanctions, such as suspension, expulsion from school or work, fines, imprisonment, and other penalties.

<span class="mw-page-title-main">Quizlet</span> American online studying platform

Quizlet is a multi-national American company that provides tools for studying and learning. Quizlet was founded in October 2005 by Andrew Sutherland, who at the time was a 15-year old student, and released to the public in January 2007. Quizlet's primary products include digital flash cards, matching games, practice electronic assessments, and live quizzes. In 2017, 1 in 2 high school students used Quizlet. As of December 2021, Quizlet has over 500 million user-generated flashcard sets and more than 60 million active users.

<span class="mw-page-title-main">Chegg</span> American education technology company

Chegg, Inc., is an American education technology company based in Santa Clara, California. It provides homework help, digital and physical textbook rentals, textbooks, online tutoring, and other student services.

Digital learning is learning that is supported by technology. It encompasses any type of learning that is accompanied by technology or by instructional practice that makes effective use of technology. It includes a wide array of practices, including blended and virtual learning.

<span class="mw-page-title-main">Brainly</span> Educational technology company

Brainly is an education company based in Kraków, Poland, with headquarters in New York City. It is an AI-powered homework help platform targeting students and parents. As of November 2020, Brainly reported having 15 million daily active users, making it the world's most popular education app. In 2024, FlexOS reported Brainly as the #1 Generative AI Tool in the education category and the #6 Generative AI Tool overall. Also in 2024, Andreessen Horowitz reported Brainly as #6 in the Top 50 Gen AI Mobile Apps by monthly active users.

OpenAI is an American artificial intelligence (AI) research organization founded in December 2015 and headquartered in San Francisco, California. Its mission is to develop "safe and beneficial" artificial general intelligence, which it defines as "highly autonomous systems that outperform humans at most economically valuable work". As a leading organization in the ongoing AI boom, OpenAI is known for the GPT family of large language models, the DALL-E series of text-to-image models, and a text-to-video model named Sora. Its release of ChatGPT in November 2022 has been credited with catalyzing widespread interest in generative AI.

Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.

You.com is an AI assistant that began as a personalization-focused search engine. While still offering web search capabilities, You.com has evolved to prioritize a chat-first AI assistant.

<span class="mw-page-title-main">ChatGPT</span> Chatbot and virtual assistant developed by OpenAI

ChatGPT is a chatbot and virtual assistant developed by OpenAI and launched on November 30, 2022. Based on large language models (LLMs), it enables users to refine and steer a conversation towards a desired length, format, style, level of detail, and language. Successive user prompts and replies are considered at each conversation stage as context.

<span class="mw-page-title-main">Hallucination (artificial intelligence)</span> Confident unjustified claim by AI

In the field of artificial intelligence (AI), a hallucination or artificial hallucination is a response generated by AI which contains false or misleading information presented as fact. This term draws a loose analogy with human psychology, where hallucination typically involves false percepts. However, there is a key difference: AI hallucination is associated with unjustified responses or beliefs rather than perceptual experiences.

<span class="mw-page-title-main">Generative pre-trained transformer</span> Type of large language model

Generative pre-trained transformers (GPT) are a type of large language model (LLM) and a prominent framework for generative artificial intelligence. They are artificial neural networks that are used in natural language processing tasks. GPTs are based on the transformer architecture, pre-trained on large data sets of unlabelled text, and able to generate novel human-like content. As of 2023, most LLMs have these characteristics and are sometimes referred to broadly as GPTs.

<span class="mw-page-title-main">Generative artificial intelligence</span> AI system capable of generating content in response to prompts

Generative artificial intelligence is artificial intelligence capable of generating text, images, videos, or other data using generative models, often in response to prompts. Generative AI models learn the patterns and structure of their input training data and then generate new data that has similar characteristics.

<span class="mw-page-title-main">AI boom</span> Ongoing period of rapid progress in artificial intelligence

The AI boom, or AI spring, is an ongoing period of rapid progress in the field of artificial intelligence (AI) that started in the late 2010s before gaining global prominence by 2022. Known examples include protein folding prediction led by Google DeepMind and generative AI led by OpenAI.

<span class="mw-page-title-main">Microsoft Copilot</span> Chatbot developed by Microsoft

Microsoft Copilot is a generative artificial intelligence chatbot developed by Microsoft. Based on a large language model, it was launched in February 2023 as Microsoft's primary replacement for the discontinued Cortana.

<span class="mw-page-title-main">Gemini (chatbot)</span> Chatbot developed by Google

Gemini, formerly known as Bard, is a generative artificial intelligence chatbot developed by Google. Based on the large language model (LLM) of the same name and developed as a direct response to the meteoric rise of OpenAI's ChatGPT, it was launched in a limited capacity in March 2023 before expanding to other countries in May. It was previously based on PaLM, and initially the LaMDA family of large language models.

GPTZero is an artificial intelligence detection software developed to identify artificially generated text, such as that produced by large language models.

Writesonic is a company that develops artificial intelligence tools for content creation. It was founded by Samanyou Garg in October 2020 and is based in San Francisco. The platform uses GPT-3.5 and GPT-4 technologies.

Artificial intelligence detection software aims to determine whether some content was generated using artificial intelligence (AI).

References

  1. 1 2 Toppo, Greg (April 8, 2023). "Teachers are embracing ChatGPT—even more than students". Fast Company.
  2. 1 2 Roose, Kevin (January 12, 2023). "Don't Ban ChatGPT in Schools. Teach With It". The New York Times.
  3. Trumbore, Anne (February 22, 2023). "ChatGPT could be an effective and affordable tutor". The Conversation. Retrieved June 12, 2024.
  4. Kelly, Samantha Murphy (January 26, 2023). "ChatGPT passes exams from law and business schools". CNN. Retrieved February 3, 2023.
  5. Kashefi, Ali; Mukerji, Tapan (2023). "ChatGPT for Programming Numerical Methods". arXiv: 2303.12093 [cs.LG].
  6. Roivainen, Eka (March 28, 2023). "I Gave ChatGPT an IQ Test. Here's What I Discovered". Scientific American. Retrieved April 3, 2023.
  7. Klar, Rebecca (May 10, 2023). "Teens use, hear of ChatGPT more than parents: poll". The Hill. Retrieved June 15, 2023.
  8. Impact Research. "Parents and students are optimistic about AI, but parents have a lot to learn to catch up to their kids – and want rules and ratings to help them" (PDF). Common Sense Media. Retrieved June 15, 2023.
  9. 1 2 Kelly, Mary Louise (January 26, 2023). "'Everybody is cheating': Why this teacher has adopted an open ChatGPT policy". NPR. Retrieved October 10, 2023.
  10. "OpenAI unveils ChatGPT Edu to bring AI responsibly to university campuses". The Indian Express. May 31, 2024. Retrieved June 16, 2024.
  11. Marche, Stephen (December 6, 2022). "The College Essay Is Dead". The Atlantic. Retrieved October 10, 2023.
  12. 1 2 Brown, Kevin (December 23, 2022). "Why Educators Shouldn't Be Worried About AI". ChristianityToday.com. Retrieved October 10, 2023.
  13. Bowman, Emma (December 19, 2022). "A new AI chatbot might do your homework for you. But it's still not an A+ student". NPR. Retrieved October 10, 2023.
  14. Roose, Kevin (January 12, 2023). "Don't Ban ChatGPT in Schools. Teach With It". The New York Times. ISSN   0362-4331 . Retrieved October 10, 2023.
  15. Belkin, Douglas (June 1, 2023). "As AI-Enabled Cheating Roils Colleges, Professors Turn to an Ancient Testing Method". Wall Street Journal. ISSN   0099-9660 . Retrieved October 10, 2023.
  16. Roose, Kevin (January 12, 2023). "Don't Ban ChatGPT in Schools. Teach With It". The New York Times. ISSN   0362-4331 . Retrieved October 10, 2023.
  17. Belkin, Douglas (June 1, 2023). "As AI-Enabled Cheating Roils Colleges, Professors Turn to an Ancient Testing Method". Wall Street Journal. ISSN   0099-9660 . Retrieved October 10, 2023.
  18. Klee, Miles (May 17, 2023). "Professor Flunks All His Students After ChatGPT Falsely Claims It Wrote Their Papers". Rolling Stone. Retrieved October 10, 2023.
  19. "College instructor put on blast for accusing students of using ChatGPT". NBC News. May 18, 2023. Retrieved October 10, 2023.
  20. Dolan, Eric W. (March 25, 2024). "ChatGPT linked to declining academic performance and memory loss in new study". PsyPost - Psychology News. Retrieved March 30, 2024.
  21. ABBAS, Muhammad (February 16, 2024). "Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students". International Journal of Educational Technology in Higher Education. 21 (10). doi: 10.1186/s41239-024-00444-7 .
  22. 1 2 Singer, Natasha (August 24, 2023). "Despite Cheating Fears, Schools Repeal ChatGPT Bans". The New York Times. ISSN   0362-4331 . Retrieved October 10, 2023.
  23. "New York City Department of Education Bans ChatGPT". GovTech. January 10, 2023. Archived from the original on February 16, 2023. Retrieved February 16, 2023.
  24. Cole, Samantha (January 4, 2023). "NYC Bans Students and Teachers from Using ChatGPT". www.vice.com. Archived from the original on January 5, 2023. Retrieved January 5, 2023.
  25. Ropek, Lucas (January 4, 2023). "New York City Schools Ban ChatGPT to Head Off a Cheating Epidemic". Gizmodo. Archived from the original on January 6, 2023. Retrieved January 6, 2023.
  26. "港大禁用ChatGPT等AI工具,为全港大学首例". The Paper . China News Service. February 18, 2023. Archived from the original on March 6, 2023. Retrieved February 19, 2023.
  27. Yau, Cannix; Chan, Kahon (February 17, 2023). "University of Hong Kong temporarily bans students from using ChatGPT". South China Morning Post. Archived from the original on February 19, 2023. Retrieved February 19, 2023.
  28. Faguy, Ana. "New York City Public Schools Reverses ChatGPT Ban". Forbes. Archived from the original on May 21, 2023. Retrieved May 21, 2023.
  29. Serrano, Jody (May 19, 2023). "New York City Schools Lift Ban on ChatGPT, Say Initial Fear 'Overlooked the Potential' of AI". Gizmodo. Archived from the original on May 21, 2023. Retrieved May 21, 2023.
  30. 1 2 3 Villasenor, John (February 10, 2023). "How ChatGPT Can Improve Education, Not Threaten It". Scientific American. Retrieved December 7, 2023.
  31. Coffey, Lauren. "Professors Craft Courses on ChatGPT With ChatGPT". Inside Higher Ed. Retrieved October 10, 2023.
  32. Einarsson, Hafsteinn (December 13, 2023). "Application of ChatGPT for automated problem reframing across academic domains". Computers and Education: Artificial Intelligence. 6. doi: 10.1016/j.caeai.2023.100194 . hdl: 20.500.11815/4807 .
  33. Popescu, Anca (January 9, 2024). "AI's Secret Weapon in Education. ChatGPT – The Future of Personalized Learning". Bulletin of the Transilvania University of Brasov. Series V: Economic Sciences: 45–52. doi: 10.31926/but.es.2023.16.65.2.5 . ISSN   2065-2208.
  34. Dave, Paresh (June 5, 2023). "Chegg Embraced AI. ChatGPT Ate Its Lunch Anyway". Wired. ISSN   1059-1028 . Retrieved October 18, 2023.
  35. Shin, Rachel (July 12, 2023). "A.I. can kill your business in an instant. Just ask the CEO of Chegg". Fortune. Retrieved October 18, 2023.
  36. Fowler, Geoffrey A. (April 14, 2023). "Analysis | We tested a new ChatGPT-detector for teachers. It flagged an innocent student". Washington Post. ISSN   0190-8286 . Retrieved October 10, 2023.
  37. Delouya, Samantha. "Turnitin is the go-to software to catch students cheating. Now it's focused on a potential cat-and-mouse game with OpenAI's new ChatGPT chatbot". Business Insider. Retrieved October 10, 2023.
  38. "Sneak preview of Turnitin's AI writing and ChatGPT detection capability". www.turnitin.com. January 13, 2023. Retrieved October 10, 2023.
  39. "ChatGPT Detectors Are Biased and Easy to Fool, Research Shows". CNET. Retrieved October 10, 2023.
  40. Barshay, Jill (September 4, 2023). "PROOF POINTS: It's easy to fool ChatGPT detectors". The Hechinger Report. Retrieved October 10, 2023.
  41. Goodwin, Danny (July 26, 2023). "OpenAI's AI Text Classifier no longer available due to 'low rate of accuracy'". Search Engine Land. Retrieved October 10, 2023.
  42. David, Emilia (July 25, 2023). "OpenAI can't tell if something was written by AI after all". The Verge. Retrieved October 10, 2023.
  43. Elkhatat, Ahmed M. (January 1, 2023). "Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text" . EBSCO.