Artificial intelligence and elections

Last updated

As artificial intelligence (AI) has become more mainstream, there is growing concern about how this will influence elections. Potential targets of AI include election processes, election offices, election officials and election vendors. [1]

Contents

Tactics

Generative AI capabilities allow creation of misleading content. Examples of this include text-to-video, deepfake videos, text-to-image, AI-altered image, text-to-speech, voice cloning, and text-to-text. In the context of an election, a deepfake video of a candidate may propagate information that the candidate does not endorse. [2] Chatbots could spread misinformation related to election locations, times or voting methods. In contrast to malicious actors in the past, these techniques require little technical skill and can spread rapidly. [3]

Usage by country

Argentina

2023 elections

During the 2023 Argentine primary elections, Javier Milei's team distributed AI generated images including a fabricated image of his rival Sergio Massa and drew 3 million views. [4] The team also created an unofficial Instagram account entitled "AI for the Homeland." [4] Sergio Massa's team also distributed AI generated images and videos. [5] [6]

Bangladesh

2024 elections

In the run up to the 2024 Bangladesh elections, a strict muslim country, deepfake videos of female opposition politicians appeared. [7] Rumin Farhana was pictured in a bikini while Nipun Ray was shown in a swimming pool. [7]

India

2024 elections

In the 2024 Indian general election, politicians used deepfakes in their campaign materials. These deepfakes included politicians who had died prior to the election. Mathuvel Karunanidhi's party posted with his likeness even though he had died 2018. [8] [9] [10] A video The All-India Anna Dravidian Progressive Federation party posted showed an audio clip of Jayaram Jayalalithaa even though she had died in 2016. [11] [12] The Deepfakes Analysis Unit (DAU) is an open source platform created in March 2024 for the public to share misleading content and assess if it had been AI-generated. [13]

AI was also used to translate political speeches in real time. [9] This translating ability was widely used to reach more voters. [9] [10]

New Zealand

2023 Elections

In May 2023, ahead of the New Zealand October 2023 general election, the New Zealand National Party published a "series of AI-generated political advertisements" on its Instagram account. [14] After confirming that the images were faked, a party spokesperson said that it was "an innovative way to drive our social media". [14]

Pakistan

2024 Elections

AI has been used by the imprisoned ex-Prime Minister Imran Khan and his media team in the Pakistani elections of 2024: [15] i) An AI generated audio of his voice was added to a video clip and was broadcast at a virtual rally. [15] ii) An op-ed in the The Economist written by Khan was later claimed by himself to have been written by AI which was later denied by his team. [15] The article was liked and shared on social media by thousands of users.

South Africa

2024 Elections

In the South African general elections, there were several uses of AI content: [16] i) A deepfaked video of Joe Biden emerged on social media showing him saying that "The U.S. would place sanctions on SA and declare it an enemy state if the African National Congress (ANC) won". [16] ii) In a deepfake video, Donald Trump was shown endorsing the uMkhonto weSizwe party. It was posted to social media and was viewed more than 158,000 times. [16] iii) Less than 3 months before the elections, a deepfake video showed U.S. rapper Eminem endorsing the Economic Freedom Fighters party while criticizing the ANC. The deepfake was viewed on social media more than 173,000 times. [16]

South Korea

2022 Elections

A committee for one presidential candidate Yoon Suk Yeol released an AI avatar 'Al Yoon Seok-yeol' that would campaign in places the candidate could not go. The other presidential candidate Lee Jae-myung introduced a chatbot that provided information about the candidate's pledges. [17]

2024 Elections

Deepfakes were used to spread misinformation before South Korea's parliamentary elections with one source reporting 129 deepfake violations of election laws within a two week period. [18] Seoul hosted the 2024 Summit for Democracy, a virtual gathering of world leaders initiated by US President Joe Biden in 2021. [19] The focus of the summit was on digital threats to democracy including artificial intelligence and deepfakes. [20]

United Kingdom

2024 elections

Steve Endacott created "AI Steve," an AI avatar as the face of his campaign for member of parliament. [21] The Centre for Emerging Technology and Security provided a report on the threat of AI to the 2024 UK general elections. The report findings said that AI impact was limited but may damage the democratic system. [22]

United States

2024 elections

Regulation of AI with regard to elections was unlikely to see a resolution for most of the 2024 United States general election season. [23] [24] The campaign for the 2024 Republican nominee, [25] Donald Trump, has used deepfake videos of political opponents in campaign ads and fake images showing Trump with black supporters. [23] [26] In 2023, while he was still running for re-election, the presidential campaign of Joe Biden prepared a task force to respond to AI images and videos. [27]

A Democratic consultant working for Dean Phillips also admitted to using AI to generate a robocall which used Joe Biden's voice to discourage voter participation. [28]

Generative AI increased the efficiency with which political candidates were able to raise money by analyzing donor data and identifying possible donors and target audiences. [29] [30]

Regulation

By governments

Philippines

The Commission on Elections (COMELEC) issued guidelines on the usage of AI, to be implemented starting from the 2025 Philippine general election including the parallel Bangsamoro Parliament election. It mandates candidate to disclose usage of AI in their campaign materials and prohibits the usage of the technology to spread misinformation against their rivals. [31] This is the first time the COMELEC has release guidelines on campaigning through social media. [32]

United States

US states have attempted regulation of AI use in elections and campaigns with varying degrees of success. [33] The National Conference of State Legislatures has compiled a list of legislation regarding AI use by state as of 2024, some carrying both civil and criminal penalties. [34] Oregon Senate Bill 1571 requires that campaign communications in Oregon disclose the use of AI. [35] [36] [37] California has enacted legislation that makes using deepfakes to discredit political opponents illegal within sixty days of an election. [38] [39]

Self-regulation by private firms

Midjourney, an AI image-generator, has started blocking users from creating fake images of the 2024 US Presidential candidates. [40] Research from the Center for Countering Digital Hate found that image generators such as Midjourney, ChatGPT Plus, DreamStudio, and Microsoft's Image Creator create images that constitute election disinformation in 41% of the test text prompts they tried. [40] OpenAI implemented policies to counter election misinformation such as adding digital credentials to image origin and a classifier to detect if images were AI generated. [41]

Ethics of AI use in political campaigning

As the use of AI and its associated tools in political campaigning and messaging increases, many ethical concerns have been raised. [42] Campaigns have used AI in a number of ways, including speech writing, fundraising, voter behaviour prediction, fake robocalls and the generation of fake news. [42] At the moment there are no US federal rules when it comes to using AI in campaigning and so its use can undermine public trust. [42] Yet according to one expert: "A lot of the questions we're asking about AI are the same questions we've asked about rhetoric and persuasion for thousands of years." [42]

As more insight into how AI is used becomes ever greater, concerns have become much broader than just the generating of misinformation or fake news. [43] Its use by politicians and political parties for "purposes that are not overtly malicious" can also raise ethical worries. [43] For instance, the use of 'softfakes' have become more common. [43] These can be images, videos or audio clips that have been edited, often by campaign teams, "to make a political candidate seem more appealing." [43] An example can be found in Indonesia's presidential election where the winning candidate created and promoted cartoonish avatars so as to rebrand himself. [43]

How citizens come by information has been increasingly impacted by AI, especially through online platforms and social media. [44] These platforms are part of complex and opaque systems which can result in a "significant impact on freedom of expression", with the generalisation of AI in campaigns also creating huge pressures on "voters’ mental security". [44] As the frequency of AI use in political campaigning becomes common, together with globalization, more 'universalized' content can be used so that territorial boundaries matter less. [44] While AI collides with the reasoning processes of people, the creation of "dangerous behaviours" can happen which disrupt important levels of society and nation states. [44]

In the future it is likely that AI will further revolutionise campaigning by the use of, for example, speech analysis and policy development. [30] Campaign assistants could interact with voters by answering questions which provides information about policies leading to greater accessibility. [30] The cyber security of political campaigns could be enhanced by protecting data from malicious hackers. [30] As technologies advance, AI could create more innovative tools for campaigning, which might also bring "challenges in terms of ethical use and data privacy". [30] Over time, AI-powered political campaigns are likely to become more "data-driven, efficient, and tailored to the evolving dynamics of voter behavior and preferences". [30]

See Also

Related Research Articles

<span class="mw-page-title-main">Voice acting</span> Performing voice-overs to represent a character or provide information

Voice acting is the art of performing a character or providing information to an audience with one's voice. Performers are often called voice actors/actresses in addition to other names. Examples of voice work include animated, off-stage, off-screen, or non-visible characters in various works such as films, dubbed foreign films, anime, television shows, video games, cartoons, documentaries, commercials, audiobooks, radio dramas and comedies, amusement rides, theater productions, puppet shows, and audio games.

Fact-checking is the process of verifying the factual accuracy of questioned reporting and statements. Fact-checking can be conducted before or after the text or content is published or otherwise disseminated. Internal fact-checking is such checking done in-house by the publisher to prevent inaccurate content from being published; when the text is analyzed by a third party, the process is called external fact-checking.

<span class="mw-page-title-main">Fake news</span> False or misleading information presented as real

Fake news or information disorder is false or misleading information claiming the aesthetics and legitimacy of news. Fake news often has the aim of damaging the reputation of a person or entity, or making money through advertising revenue. Although false news has always been spread throughout history, the term fake news was first used in the 1890s when sensational reports in newspapers were common. Nevertheless, the term does not have a fixed definition and has been applied broadly to any type of false information presented as news. It has also been used by high-profile people to apply to any news unfavorable to them. Further, disinformation involves spreading false information with harmful intent and is sometimes generated and propagated by hostile foreign actors, particularly during elections. In some definitions, fake news includes satirical articles misinterpreted as genuine, and articles that employ sensationalist or clickbait headlines that are not supported in the text. Because of this diversity of types of false news, researchers are beginning to favour information disorder as a more neutral and informative term.

<span class="mw-page-title-main">Deepfake</span> Realistic artificially generated media

Deepfakes are images, videos, or audio which are edited or generated using artificial intelligence tools, and which may depict real or non-existent people. They are a type of synthetic media.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is a visual artwork created through the use of an artificial intelligence (AI) program.

Social media was used extensively in the 2020 United States presidential election. Both incumbent president Donald Trump and Democratic Party nominee Joe Biden's campaigns employed digital-first advertising strategies, prioritizing digital advertising over print advertising in the wake of the pandemic. Trump had previously utilized his Twitter account to reach his voters and make announcements, both during and after the 2016 election. The Democratic Party nominee Joe Biden also made use of social media networks to express his views and opinions on important events such as the Trump administration's response to the COVID-19 pandemic, the protests following the murder of George Floyd, and the controversial appointment of Amy Coney Barrett to the Supreme Court.

Synthetic media is a catch-all term for the artificial production, manipulation, and modification of data and media by automated means, especially through the use of artificial intelligence algorithms, such as for the purpose of misleading people or changing an original meaning. Synthetic media as a field has grown rapidly since the creation of generative adversarial networks, primarily through the rise of deepfakes as well as music synthesis, text generation, human image synthesis, speech synthesis, and more. Though experts use the term "synthetic media," individual methods such as deepfakes and text synthesis are sometimes not referred to as such by the media but instead by their respective terminology Significant attention arose towards the field of synthetic media starting in 2017 when Motherboard reported on the emergence of AI altered pornographic videos to insert the faces of famous actresses. Potential hazards of synthetic media include the spread of misinformation, further loss of trust in institutions such as media and government, the mass automation of creative and journalistic jobs and a retreat into AI-generated fantasy worlds. Synthetic media is an applied form of artificial imagination.

Deepfake pornography, or simply fake pornography, is a type of synthetic pornography that is created via altering already-existing photographs or video by applying deepfake technology to the images of the participants. The use of deepfake porn has sparked controversy because it involves the making and sharing of realistic videos featuring non-consenting individuals, typically female celebrities, and is sometimes used for revenge porn. Efforts are being made to combat these ethical concerns through legislation and technology-based solutions.

Audio deepfake technology, also referred to as voice cloning or deepfake audio, is an application of artificial intelligence designed to generate speech that convincingly mimics specific individuals, often synthesizing phrases or sentences they have never spoken. Initially developed with the intent to enhance various aspects of human life, it has practical applications such as generating audiobooks and assisting individuals who have lost their voices due to medical conditions. Additionally, it has commercial uses, including the creation of personalized digital assistants, natural-sounding text-to-speech systems, and advanced speech translation services.

<span class="mw-page-title-main">Midjourney</span> Image-generating machine learning model

Midjourney is a generative artificial intelligence program and service created and hosted by the San Francisco-based independent research lab Midjourney, Inc. Midjourney generates images from natural language descriptions, called prompts, similar to OpenAI's DALL-E and Stability AI's Stable Diffusion. It is one of the technologies of the AI boom.

Synthesia is a synthetic media generation company that develops software used to create AI generated video content. It is based in London, England.

<span class="mw-page-title-main">Generative artificial intelligence</span> AI system capable of generating content in response to prompts

Generative artificial intelligence is a subset of artificial intelligence that uses generative models to produce text, images, videos, or other forms of data. These models often generate output in response to specific prompts. Generative AI systems learn the underlying patterns and structures of their training data, enabling them to create new data.

<span class="mw-page-title-main">2024 New Hampshire Democratic presidential primary</span>

The 2024 New Hampshire Democratic presidential primary was held on January 23, 2024, as part of the Democratic Party primaries for the 2024 presidential election. The January New Hampshire primary was not sanctioned by the Democratic National Committee (DNC). The DNC-approved 2024 calendar placed the South Carolina primary first, but New Hampshire state law mandates them to hold the first primary in the country, and a "bipartisan group of state politicians", including the chairs of the Democratic and the Republican parties, announced that the state would preserve this status. Thus, the DNC initially stripped all 33 of the state's delegates that would have been allocated to the Democratic National Convention. The delegates will be allowed to be seated at the convention following the holding of a party-backed firehouse primary on April 27.

<span class="mw-page-title-main">TrumporBiden2024</span> Political humor Twitch channel

TrumporBiden2024 was a Twitch channel that featured artificial intelligence (AI) versions of former U.S. president Donald Trump and current president Joe Biden engaging in an endless, profane, comedic political debate. After launching, the channel gained the attention of news media. The channel was presented as satire.

Spamouflage, Dragonbridge, Spamouflage Dragon, Storm 1376, or Taizi Flood is an online propaganda and disinformation operation that uses a network of social media accounts to make posts in favor of the Chinese government and harass dissidents and journalists overseas since 2017. Beginning in the early 2020s, Spamouflage accounts also began making posts about American and Taiwanese politics. It is widely believed that the Chinese government, particularly the Ministry of Public Security, is behind the network. Spamouflage has increasingly used generative artificial intelligence for influence operations. The campaign has largely failed to receive views from real users, although it has attracted some organic engagement using new tactics.

The Iranian government has interfered in the 2024 United States elections through social media efforts and hacking operations. Iranian interference has come amidst larger foreign interference in the 2024 United States elections. The efforts were identified as an effort to tip the race against former president Donald Trump through propaganda and disinformation campaigns. However, Iranian efforts have also targeted Joe Biden and Kamala Harris with similar attacks, which The New York Times stated suggested "a wider goal of sowing internal discord and discrediting the democratic system in the United States more broadly in the eyes of the world."

The Russian government has interfered in the 2024 United States elections through disinformation and propaganda campaigns aimed at damaging Joe Biden, Kamala Harris and other Democrats while boosting the candidacy of Donald Trump and other candidates who support isolationism and undercutting support for Ukraine aid and NATO. Russia's efforts represent the most active threat of foreign interference in the 2024 United States elections and follows Russia's previous pattern of spreading disinformation through fake social media accounts and right-wing YouTube channels in order to divide American society and foster anti-Americanism. On September 4, 2024, the U.S. Department of Justice indicted members of Tenet Media for having received $9.7 million as part of a covert Russian influence operation to co-opt American right-wing influencers to espouse pro-Russian content and conspiracy theories. Many of the followers of the related influencers were encouraged to steal ballots, intimidate voters, and remove or destroy ballot drop offs in the weeks leading up to the election.

China has interfered in the 2024 United States elections through propaganda and disinformation campaigns, primarily linked to its Spamouflage influence operation. The efforts come amidst larger foreign interference in the 2024 United States elections.

Several nations have interfered in the 2024 United States elections. U.S. intelligence agencies have identified China, Iran, and Russia as the most pressing concerns, with Russia being the most active threat.

Artificial intelligence (AI) has been developed rapidly in recent years, and has been used by groups in the 2024 United States presidential election, as well as foreign groups such as China, Russia and Iran. There have also been efforts to control the use of generative artificial intelligence, such as those in California.

References

  1. Risk in Focus: Generative A.I. and the 2024 Election Cycle (PDF) (Report). Cybersecurity and Infrastructure Security Agency. January 18, 2024. Retrieved March 18, 2024.
  2. McMillan, Robert; Corse, Alexa; Volz, Dustin (February 15, 2024). "New Era of AI Deepfakes Complicates 2024 Elections" . The Wall Street Journal . Archived from the original on February 18, 2024. Retrieved March 18, 2024.
  3. Swenson, Ali; Chan, Kelvin (March 14, 2024). "Election disinformation takes a big leap with AI being used to deceive worldwide". Associated Press . Retrieved March 18, 2024.
  4. 1 2 Feliba, David. "How AI shaped Milei's path to Argentina presidency | Context". www.context.news. Retrieved October 29, 2024.
  5. Nicas, Jack; Herrera, Lucia Cholakian (November 16, 2023). "Is Argentina the First A.I. Election?". The New York Times. Retrieved October 28, 2024.
  6. AI used against candidates in this country's election | CNN. November 17, 2023. Retrieved October 29, 2024 via www.cnn.com.
  7. 1 2 "Pakistanis, Bangladeshi politicians are new targets of deepfake, 90 per cent of videos online are pornographic". The Tribune . Reuters. December 14, 2023. Retrieved November 18, 2024.
  8. "Muthuvel Karunanidhi | Indian Politician, Tamil Nadu, & DMK Leader | Britannica". www.britannica.com. September 20, 2024. Retrieved October 28, 2024.
  9. 1 2 3 "India's latest election embraced AI technology. Here are some ways it was used constructively". PBS News. June 12, 2024. Retrieved October 28, 2024.
  10. 1 2 Shukla, Vandinika (May 24, 2024). "The Era of AI-Generated Election Campaigning is Underway in India | TechPolicy.Press". Tech Policy Press. Retrieved October 28, 2024.
  11. "Jayalalitha: The 'goddess' of Tamil Nadu politics". BBC News. December 5, 2016. Retrieved October 28, 2024.
  12. Sun News (January 23, 2024). தமிழ்நாடு முதலமைச்சர் மு.க.ஸ்டாலின் சாதனைகளை பட்டியலிட்டு வாழ்த்திய AI-ஆல் உருவாக்கப்பட்ட கலைஞர்! . Retrieved October 28, 2024 via YouTube.
  13. "Deepfakes Analysis Unit - A Misinformation Combat Alliance Initiative". dau.mcaindia.in. Retrieved October 28, 2024.
  14. 1 2 Smith, Adam; Harrisberg, Kim; Starcevic, Seb (November 22, 2023). "Are AI deepfakes a threat to elections?". Context. Thomson Reuters Foundation . Retrieved November 17, 2024.
  15. 1 2 3 Dad, Nighat (January 12, 2024). "The deepfake elections are here". Context. Thomson Reuters Foundation . Retrieved November 15, 2024.
  16. 1 2 3 4 Elliott, Vittoria (May 30, 2024). "The WIRED AI Elections Project". WIRED . Retrieved November 19, 2024.
  17. ""내가 윤석열로 보이니"… 'AI 정치인' 혁신인가, 재앙인가". 한국일보 (in Korean). December 11, 2021. Retrieved November 8, 2024.
  18. Herald, Korea (February 22, 2024). "[Editorial] Deepfake risks in election". The Korea Herald. Retrieved November 8, 2024.
  19. "The 3rd Summit for Democracy | International IDEA". www.idea.int. Retrieved November 8, 2024.
  20. Smith, Josh (March 17, 2024). Doyle, Gerry (ed.). "Explainer: Why is South Korea hosting a 'Summit for Democracy'?". Reuters. Retrieved November 8, 2024.{{cite web}}: CS1 maint: url-status (link)
  21. M, Muvija; Mcdill, Stuart (June 20, 2024). "No hallucination: AI candidate on the ballot for UK election". Reuters. Retrieved October 28, 2024.
  22. Stockwell, Sam; Hughes, Megan; Swatton, Phil; Bishop, Katie (May 28, 2024). "AI-Enabled Influence Operations: The Threat to the UK General Election". Centre for Emerging Technology and Security. Retrieved October 28, 2024.
  23. 1 2 Mansfield, Erin (March 11, 2024). "AI deepfakes are part of the 2024 election. Will the federal government regulate them?". USA Today . Retrieved March 18, 2024.
  24. Fung, Brian (February 14, 2024). "AI could disrupt the election. Congress is running out of time to respond". CNN Business . Retrieved March 18, 2024.
  25. Colvin, Jill (March 12, 2024). "Trump wins delegates needed to become GOP's presumptive nominee for third straight election". Associated Press . Retrieved March 18, 2024.
  26. Brown, Matt; Klepper, David (March 8, 2024). "Fake images made to show Trump with Black supporters highlight concerns around AI and elections". Associated Press . Retrieved March 18, 2024.
  27. O'Sullivan, Donie; Fung, Brian (November 30, 2023). "First on CNN: Biden campaign prepares legal fight against election deepfakes". CNN . Retrieved March 18, 2024.
  28. Verma, Pranshu; Kornfield, Meryl (March 2, 2024). "Democratic operative admits to commissioning Biden AI robocall in New Hampshire" . The Washington Post . Archived from the original on February 27, 2024. Retrieved March 18, 2024.
  29. Curi, Maria (January 30, 2024). "Exclusive: AI turbocharges campaign fundraising". Axios. Retrieved November 10, 2024.
  30. 1 2 3 4 5 6 Sahota, Neil. "The AI Factor In Political Campaigns: Revolutionizing Modern Politics". Forbes. Retrieved November 11, 2024.
  31. Chi, Cristina (September 19, 2024). "Comelec releases guidelines on AI use in 2025 polls". The Philippine Star. Retrieved October 20, 2024.
  32. Sampang, Dianne (September 19, 2024). "No absolute ban of AI from poll campaign – Comelec". Philippine Daily Inquirer. Retrieved October 20, 2024.
  33. "Artificial Intelligence (AI) in Elections and Campaigns". www.ncsl.org. Retrieved March 18, 2024.
  34. "National Council of State Legislatures". Artificial Intelligence (AI) in Elections and Campaigns. October 7, 2024. Retrieved October 21, 2024.
  35. "Oregon Law to Regulate AI in Political Campaigns". www.northbendoregon.us. Retrieved October 21, 2024.
  36. "Oregon State Legislature 2024 Regular Session" (PDF). Senate Bill 1571. March 6, 2024. Retrieved October 21, 2024.
  37. "Oregon lawmakers consider regulating use of AI in campaign ads". opb. Retrieved October 21, 2024.
  38. "Bill Text - AB-730 Elections: deceptive audio or visual media". leginfo.legislature.ca.gov. Retrieved October 21, 2024.
  39. "California laws seek to crack down on deepfakes in politics and porn". CNET. Retrieved October 21, 2024.
  40. 1 2 O'Brien, Matt (March 13, 2024). "AI image-generator Midjourney blocks images of Biden and Trump as election looms". Associated Press . Retrieved March 18, 2024.
  41. Fischer, Sara (January 15, 2024). "OpenAI unveils plans for tackling abuse ahead of 2024 elections". Axios. Retrieved November 10, 2024.{{cite web}}: CS1 maint: url-status (link)
  42. 1 2 3 4 "AI in Political Campaigns: How it's being used and the ethical considerations it raises". George Washington University. April 22, 2024. Retrieved November 12, 2024.
  43. 1 2 3 4 5 Chowdhury, Rumman (April 9, 2024). "AI-fuelled election campaigns are here — where are the rules?". Nature . Springer Nature. Retrieved November 12, 2024.
  44. 1 2 3 4 Vacarelu, Marius (June 2023). "8". Malicious Use of Artificial Intelligence in Political Campaigns: Challenges for International Psychological Security for the Next Decades. Springer Nature. pp. 203–230. Retrieved November 12, 2024.