Artificial intelligence in Wikimedia projects

Last updated

AI-generated draft article getting nominated for speedy deletion under G15 criteria Example of AI-generated article getting nominated for speedy deletion.png
AI-generated draft article getting nominated for speedy deletion under G15 criteria

Artificial intelligence is used in Wikimedia projects for the purpose of developing those projects. [1] [2] Human and bot interaction in Wikimedia projects is routine and iterative. [3]

Contents

Various articles on Wikipedia have been created entirely with or with the help of artificial intelligence. AI-generated content can be detrimental to Wikipedia when unreliable or containing fake citations.

To address the issue of low-quality AI-generated content, the Wikipedia community created in 2023 a WikiProject named AI Cleanup. In August 2025, Wikipedia adopted a policy that allowed editors to nominate suspected AI-generated articles for speedy deletion.

Using artificial intelligence for Wikipedia

ORES

The Objective Revision Evaluation Service (ORES) project is an artificial intelligence service for grading the quality of Wikipedia edits. [4] [5] The Wikimedia Foundation presented the ORES project in November 2015. [6]

Wiki bots

This section is an excerpt from Vandalism on Wikipedia § ClueBot NG.[ edit ]
The most well-known bot that fights vandalism is ClueBot NG. The bot was created by Wikipedia users Christopher Breneman and Naomi Amethyst in 2010 (succeeding the original ClueBot created in 2007; NG stands for Next Generation) [7] and uses machine learning and Bayesian statistics to determine if an edit is vandalism. [8] [9]

Bias reduction

In August 2018, a company called Primer reported attempting to use artificial intelligence to create Wikipedia articles about women as a way to address gender bias on Wikipedia. [10] [11]

Beginnings of generative AI

In 2022, the public release of ChatGPT inspired more experimentation with AI and writing Wikipedia articles. A debate was sparked about whether and to what extent such large language models are suitable for such purposes in light of their tendency to generate plausible-sounding misinformation, including fake references; to generate prose that is not encyclopedic in tone; and to reproduce biases. [12] [13] Since 2023, work has been done to draft Wikipedia policy on ChatGPT and similar large language models (LLMs), e.g. at times recommending that users who are unfamiliar with LLMs should avoid using them due to the aforementioned risks, as well as noting the potential for libel or copyright infringement. [13]

On December 6, 2022, a Wikipedia contributor named Pharos created the article "Artwork title" in his sandbox, declaring he used ChatGPT to experiment with it and would extensively modify it. Another editor tagged the article as "original research", arguing that the article was initially unsourced AI-generated content, and sourced afterwards, instead of being based on reliable sources from the outset. Another editor who experimented with this early version of ChatGPT said that ChatGPT's overview of the topic was decent, but that the citations were fabricated. [14] The Wiki Education Foundation reported that some experienced editors found AI to be useful in starting drafts or creating new articles. It said that ChatGPT "knows" what Wikipedia articles look like and can easily generate one that is written in the style of Wikipedia, but warned that ChatGPT had a tendency to use promotional language, among other issues. [15] Miguel García, a former Wikimedia member from Spain, said that when ChatGPT was originally launched, the number of AI-generated articles on the site peaked. He added that the rate of AI articles has now stabilized due to the community's efforts to combat it. He said that majority of the articles that have no sources are deleted instantly or are nominated for deletion. [16]

In 2023, the Wikipedia community created a WikiProject named AI Cleanup to assist in the removal of poor quality AI content from Wikipedia. In October 2024, a study by Princeton University revealed that about 5% of 3,000 newly created articles (created in August 2024) on English Wikipedia were created using AI. The study said that some of the AI articles were on innocuous topics and that AI had likely only been used to assist in writing. For some other articles, AI had been used to promote businesses or political interests. [17] [18]

In August 2025, the Wikipedia community created a policy that allowed users to nominate suspected AI-generated articles for speedy deletion. Editors usually recognize AI-generated articles because they use citations that are not related to the subject of the article or fabricated citations. The wording of articles is also used to recognize AI writings. For example, if an article uses language that reads like an LLM response to a user, such as "Here is your Wikipedia article on" or "Up to my last training update", the article is typically tagged for speedy deletion. [17] [19] Other signs of AI use include excessive use of em dashes, overuse of the word "moreover", promotional material in articles that describes something as "breathtaking" and formatting issues like using curly quotation marks instead of straight versions. During the discussion on implementing the speedy deletion policy, one user, who is an article reviewer, said that he is "flooded non-stop with horrendous drafts" created using AI. Other users said that AI articles have a large amount of "lies and fake references" and that it takes a significant amount of time to fix the issues. [20] [21]

Ilyas Lebleu, founder of WikiProject AI Cleanup, said that they and their fellow editors noticed a pattern of unnatural writing that could be connected to ChatGPT. They added that AI is able to mass-produce content that sounds real while being completely fake, leading to the creation of hoax articles on Wikipedia that they were tasked to delete. [22] [23] Wikipedia created a guide on how to spot signs of AI-generated writing, titled "Signs of AI writing". [24]

Hoaxes and malicious AI use

In 2023, researchers discovered that ChatGPT frequently fabricates information and makes up fake articles for its users. At that time, a ban on AI was deemed "too harsh" by the community. [25] [26] AI was deliberately used to create various hoax articles on Wikipedia. For example, an in-depth 2,000-word article about an Ottoman fortress that never existed was found by Ilyas Lebleu and their team. [27] [28] Another example showed a user adding AI-generated misinformation to an article on Estola albosignata , a species of beetle. The paragraph seemed normal but referenced an unrelated article. [29]

AI has been used on Wikipedia to advocate for certain political viewpoints in articles covered by contentious topic guidelines. One instance showed a banned editor using AI to engage in edit wars and manipulate Albanian history-related articles. Other instances included users generating articles about political movements or weapons, but dedicating the majority of the content to a different subject, such as by pointedly referencing JD Vance or Volodymyr Zelensky. [30]

Simple Article Summaries

In 2025, Wikimedia started testing a "Simple Article Summaries" feature which would provide AI-generated summaries of Wikipedia articles, similar to Google Search's AI Overviews. The decision was met with immediate and harsh criticism from Wikipedia editors, who called the feature a "ghastly idea" and a "PR hype stunt." They criticized a perceived loss of trust in the site due to AI's tendency to hallucinate and questioned the necessity of the feature. [31] The negative criticism led Wikimedia to halt the rollout of Simple Article Summaries while hinting that they are still interested in how generative AI could be integrated into Wikipedia. [32]

Using Wikipedia for artificial intelligence

Datasets of Wikipedia are widely used for training AI models. Models of high-quality language data - (a) Composition of high-quality datasets - The Pile (left), PaLM (top-right), MassiveText (bottom-right).png
Datasets of Wikipedia are widely used for training AI models.

In the development of the Google's Perspective API that identifies toxic comments in online forums, a dataset containing hundreds of thousands of Wikipedia talk page comments with human-labelled toxicity levels was used. [34] Subsets of the Wikipedia corpus are considered the largest well-curated data sets available for AI training. [35] [36]

A 2012 paper reported that more than 1,000 academic articles, including those using artificial intelligence, examine Wikipedia, reuse information from Wikipedia, use technical extensions linked to Wikipedia, or research communication about Wikipedia. [37] A 2017 paper described Wikipedia as the mother lode for human-generated text available for machine learning. [38]

A 2016 research project called "One Hundred Year Study on Artificial Intelligence" named Wikipedia as a key early project for understanding the interplay between artificial intelligence applications and human engagement. [39]

There is a concern about the lack of attribution to Wikipedia articles in large-language models like ChatGPT. [35] [40] While Wikipedia's licensing policy lets anyone use its texts, including in modified forms, it does have the condition that credit is given, implying that using its contents in answers by AI models without clarifying the sourcing may violate its terms of use. [35]

Using artificial intelligence for other Wikimedia projects

Detox was a project by Google, in collaboration with the Wikimedia Foundation, to research methods that could be used to address users posting unkind comments in Wikimedia community discussions. [41] Among other parts of the Detox project, the Wikimedia Foundation and Jigsaw collaborated to use artificial intelligence for basic research and to develop technical solutions[ example needed ] to address the problem. In October 2016 those organizations published "Ex Machina: Personal Attacks Seen at Scale" describing their findings. [42] [43] Various popular media outlets reported on the publication of this paper and described the social context of the research. [44] [45] [46] Machine translation software such as DeepL is used by contributors. [47] [48] [49] [50] More than 40% of Wikipedia's active editors are in English Wikipedia. [51]

Reactions

In November 2023, Wikipedia co-founder Jimmy Wales said that AI is not a reliable source and that he is not going to use ChatGPT to write Wikipedia articles. In July 2025, he proposed the use of LLMs to provide customized default feedback when drafts are rejected. [52]

Wikimedia Foundation product director Marshall Miller said that WikiProject AI Cleanup keeps the site's content neutral and reliable and that AI enables the creation of low-quality content. When interviewed by 404 Media, Ilyas Lebleu described speedy deletion as a "band-aid" for more serious instances of AI use, and said that the bigger problem of AI use will continue. They also said that some AI articles are discussed for one week before being deleted. [53]

See also

References

  1. ↑ Marr, Bernard (17 August 2018). "The Amazing Ways How Wikipedia Uses Artificial Intelligence". Forbes.
  2. ↑ Gertner, Jon (18 July 2023). "Wikipedia's Moment of Truth - Can the online encyclopedia help teach A.I. chatbots to get their facts right — without destroying itself in the process? + comment". The New York Times . Archived from the original on 18 July 2023. Retrieved 19 July 2023.{{cite news}}: CS1 maint: bot: original URL status unknown (link)
  3. ↑ Piscopo, Alessandro (1 October 2018). "Wikidata: A New Paradigm of Human-Bot Collaboration?". arXiv: 1810.00931 [cs.HC].
  4. ↑ Simonite, Tom (1 December 2015). "Software That Can Spot Rookie Mistakes Could Make Wikipedia More Welcoming". MIT Technology Review.
  5. ↑ Metz, Cade (1 December 2015). "Wikipedia Deploys AI to Expand Its Ranks of Human Editors". Wired. Archived from the original on 2 Apr 2024.
  6. ↑ Halfaker, Aaron; Taraborelli, Dario (30 November 2015). "Artificial intelligence service "ORES" gives Wikipedians X-ray specs to see through bad edits". Wikimedia Foundation.
  7. ↑ Hicks, Jesse (18 February 2014). "This machine kills trolls". The Verge . Archived from the original on 27 August 2014. Retrieved 18 February 2014.
  8. ↑ Nasaw, Daniel (25 July 2012). "Meet the 'bots' that edit Wikipedia". BBC News . Archived from the original on 16 September 2018. Retrieved 21 July 2018.
  9. ↑ Raja, Sumit. "Little about the bot that runs Wikipedia, ClueBot NG". Archived from the original on 22 November 2013. Retrieved 11 April 2017.
  10. ↑ Simonite, Tom (3 August 2018). "Using Artificial Intelligence to Fix Wikipedia's Gender Problem". Wired.
  11. ↑ Verger, Rob (7 August 2018). "Artificial intelligence can now help write Wikipedia pages for overlooked scientists". Popular Science.
  12. ↑ Harrison, Stephen (2023-01-12). "Should ChatGPT Be Used to Write Wikipedia Articles?". Slate Magazine. Retrieved 2023-01-13.
  13. 1 2 Woodcock, Claire (2 May 2023). "AI Is Tearing Wikipedia Apart". Vice.
  14. ↑ Harrison, Stephen (January 12, 2023). "Should ChatGPT Be Used to Write Wikipedia Articles?". Slate Magazine .
  15. ↑ Ross, Sage (February 21, 2023). "ChatGPT, Wikipedia, and student writing assignments". Wiki Education Foundation .
  16. ↑ Bejerano, Pablo G. (August 10, 2024). "How Wikipedia is surviving in the age of ChatGPT". El País .
  17. 1 2 Wu, Daniel (August 8, 2025). "Volunteers fight to keep 'AI slop' off Wikipedia". The Washington Post . ISSN   0190-8286.
  18. ↑ Stokel-Walker, Chris (November 1, 2024). "One in 20 new Wikipedia pages seem to be written with the help of AI" . New Scientist .
  19. ↑ Maiberg, Emanuel (August 5, 2025). "Wikipedia Editors Adopt 'Speedy Deletion' Policy for AI Slop Articles". 404 Media .
  20. ↑ Roth, Emma (August 8, 2025). "How Wikipedia is fighting AI slop content". The Verge . Archived from the original on August 10, 2025.
  21. ↑ Gills, Drew (August 8, 2025). "Read this: How Wikipedia identifies and removes AI slop". AV Club .
  22. ↑ Maiberg ·, Emanuel (October 9, 2024). "The Editors Protecting Wikipedia from AI Hoaxes" . 404 Media .
  23. ↑ Lomas, Natasha (October 11, 2024). "How AI-generated content is upping the workload for Wikipedia editors". TechCrunch .
  24. ↑ Clair, Grant (August 20, 2025). "Wikipedia publishes list of AI writing tells". Boing Boing .
  25. ↑ Woodrock, Claire (May 2, 2023). "AI Is Tearing Wikipedia Apart". Vice Magazine . Archived from the original on October 4, 2024.
  26. ↑ Harrison, Stephen (August 24, 2023). "Wikipedia Will Survive A.I." Slate Magazine .
  27. ↑ Durpe, Maggie (October 10, 2024). "Wikipedia Declares War on AI Slop". Futurism .
  28. ↑ Funaki, Kaiyo (October 25, 2024). "Wikipedia editors form urgent task force to combat rampant issues with recent wave of content: 'The entire thing was ... [a] hoax'". TCD.
  29. ↑ Nine, Adrianna (October 9, 2024). "People Are Stuffing Wikipedia with AI-Generated Garbage". ExtremeTech .
  30. ↑ Brooks, Creston; Eggert, Samuel; Peskoff, Dennis (October 7, 2024). "The Rise of AI-Generated Content in Wikipedia". ArXiv .
  31. ↑ Whitwam, Ryan (June 11, 2025). ""Yuck": Wikipedia pauses AI summaries after editor revolt". Ars Technica.
  32. ↑ Wiggers, Kyle (June 11, 2025). "Wikipedia pauses AI-generated summaries pilot after editors protest".
  33. ↑ Villalobos, Pablo; Ho, Anson; Sevilla, Jaime; Besiroglu, Tamay; Heim, Lennart; Hobbhahn, Marius (2022). "Will we run out of data? Limits of LLM scaling based on human-generated data". arXiv: 2211.04325 [cs.LG].
  34. ↑ "Google's comment-ranking system will be a hit with the alt-right". Engadget. 2017-09-01.
  35. 1 2 3 "Wikipedia's Moment of Truth". New York Times. 18 July 2023. Retrieved 29 November 2024.
  36. ↑ Johnson, Isaac; Lescak, Emily (2022). "Considerations for Multilingual Wikipedia Research". arXiv: 2204.02483 [cs.CY].
  37. ↑ Nielsen, Finn Årup (2012). "Wikipedia Research and Tools: Review and Comments". SSRN Working Paper Series. doi: 10.2139/ssrn.2129874 . ISSN   1556-5068.
  38. ↑ Mehdi, Mohamad; Okoli, Chitu; Mesgari, Mostafa; Nielsen, Finn Årup; Lanamäki, Arto (March 2017). "Excavating the mother lode of human-generated text: A systematic review of research that uses the wikipedia corpus". Information Processing & Management. 53 (2): 505–529. doi:10.1016/j.ipm.2016.07.003. S2CID   217265814.
  39. ↑ "AI Research Trends - One Hundred Year Study on Artificial Intelligence (AI100)". ai100.stanford.edu.
  40. ↑ "Wikipedia Built the Internet's Brain. Now Its Leaders Want Credit". Observer. 28 March 2025. Retrieved 2 April 2025. Attributions, however, remain a sticking point. Citations not only give credit but also help Wikipedia attract new editors and donors. " If our content is getting sucked into an LLM without attribution or links, that's a real problem for us in the short term,"
  41. ↑ Research:Detox - Meta.
  42. ↑ Wulczyn, Ellery; Thain, Nithum; Dixon, Lucas (2017). "Ex Machina: Personal Attacks Seen at Scale". Proceedings of the 26th International Conference on World Wide Web. pp. 1391–1399. arXiv: 1610.08914 . doi:10.1145/3038912.3052591. ISBN   9781450349130. S2CID   6060248.
  43. ↑ Jigsaw (7 February 2017). "Algorithms And Insults: Scaling Up Our Understanding Of Harassment On Wikipedia". Medium.
  44. ↑ Wakabayashi, Daisuke (23 February 2017). "Google Cousin Develops Technology to Flag Toxic Online Comments". The New York Times.
  45. ↑ Smellie, Sarah (17 February 2017). "Inside Wikipedia's Attempt to Use Artificial Intelligence to Combat Harassment". Motherboard. Vice Media.
  46. ↑ Gershgorn, Dave (27 February 2017). "Alphabet's hate-fighting AI doesn't understand hate yet". Quartz.
  47. ↑ Costa-jussà, Marta R.; Cross, James; Çelebi, Onur; Elbayad, Maha; Heafield, Kenneth; Heffernan, Kevin; Kalbassi, Elahe; Lam, Janice; Licht, Daniel; Maillard, Jean; Sun, Anna; Wang, Skyler; Wenzek, Guillaume; Youngblood, Al; Akula, Bapi; Barrault, Loic; Gonzalez, Gabriel Mejia; Hansanti, Prangthip; Hoffman, John; Jarrett, Semarley; Sadagopan, Kaushik Ram; Rowe, Dirk; Spruit, Shannon; Tran, Chau; Andrews, Pierre; Ayan, Necip Fazil; Bhosale, Shruti; Edunov, Sergey; Fan, Angela; Gao, Cynthia; Goswami, Vedanuj; Guzmán, Francisco; Koehn, Philipp; Mourachko, Alexandre; Ropers, Christophe; Saleem, Safiyyah; Schwenk, Holger; Wang, Jeff (June 2024). "Scaling neural machine translation to 200 languages". Nature. 630 (8018): 841–846. Bibcode:2024Natur.630..841N. doi:10.1038/s41586-024-07335-x. ISSN   1476-4687. PMC   11208141 . PMID   38839963.
  48. ↑ "Wikipedia's Moment of Truth". New York Times. 18 July 2023. Retrieved 29 November 2024.
  49. ↑ Johnson, Isaac; Lescak, Emily (2022). "Considerations for Multilingual Wikipedia Research". arXiv: 2204.02483 [cs.CY].
  50. ↑ Mamadouh, Virginie (2020). "Wikipedia: Mirror, Microcosm, and Motor of Global Linguistic Diversity". Handbook of the Changing World Language Map. Springer International Publishing. pp. 3773–3799. doi:10.1007/978-3-030-02438-3_200. ISBN   978-3-030-02438-3. Some versions have expanded dramatically using machine translation through the work of bots or web robots generating articles by translating them automatically from the other Wikipedias, often the English Wikipedia. […] In any event, the English Wikipedia is different from the others because it clearly serves a global audience, while other versions serve more localized audience, even if the Portuguese, Spanish, and French Wikipedias also serves a public spread across different continents
  51. ↑ Khincha, Siddharth; Jain, Chelsi; Gupta, Vivek; Kataria, Tushar; Zhang, Shuo (2023). "InfoSync: Information Synchronization across Multilingual Semi-structured Tables". arXiv: 2307.03313 [cs.CL].
  52. ↑ Maiberg, Emanuel (Aug 21, 2025). "Jimmy Wales Says Wikipedia Could Use AI. Editors Call It the 'Antithesis of Wikipedia'". 404 Media.
  53. ↑ Crider, Michael (August 6, 2025). "Wikipedia goes to war against AI slop articles with new deletion policy". PC World .
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.