Taylor Swift deepfake pornography controversy

Last updated

In late January 2024, sexually explicit AI-generated deepfake images of American musician Taylor Swift were proliferated on social media platforms 4chan and X (formerly Twitter). The images led Microsoft to enhance Microsoft Designer's text-to-image model to prevent future abuse. [1] Several artificial images of Swift of a sexual or violent nature were quickly spread, [2] with one post reported to have been seen over 47 million times before its eventual removal. [3] These images prompted responses from anti sexual assault advocacy groups, US politicians, Swift's fans, Microsoft CEO Satya Nadella, among others, and it has been suggested that Swift's influence could result in new legislation regarding the creation of deepfake pornography.

Contents

Background

American musician Taylor Swift has been reported by journalists to have been the target of misogyny and slut-shaming throughout her career. [4] [5] American technology corporation Microsoft offers AI image creators called Microsoft Designer and Bing Image Creator, which employ censorship safeguards to prevent users from generating unsafe or objectionable content. Members of a Telegram group discussed ways to circumvent these censors to creative pornographic images of celebrities. [6] Graphika, a disinformation research firm, traced the creation of the images back to a 4chan community. [7] [8]

Reactions

The deepfake images of Swift immediately became a source of controversy and outrage, drawing condemnations from Rape, Abuse & Incest National Network and SAG-AFTRA. The latter group, who had been following issues regarding AI-generated media prior to Swift's involvement, considered the images "upsetting, harmful and deeply concerning." [9] Microsoft CEO Satya Nadella, whose company's products were believed to be used to make these images, responded to the controversy as "alarming and terrible", further stating his belief that "we all benefit when the online world is a safe world." [10] [11]

Taylor Swift

A source close to Swift told the Daily Mail that she would be considering legal action, saying, "Whether or not legal action will be taken is being decided, but there is one thing that is clear: These fake AI-generated images are abusive, offensive, exploitative, and done without Taylor's consent and/or knowledge." [12] [13]

Politicians

White House press secretary Karine Jean-Pierre expressed concern over the counterfeit images, deeming them "alarming", and emphasized the obligation of social media platforms to curb the dissemination of misinformation. Several members of American politics called for legislation against AI-generated pornography. [14] Later in the month, a bipartisan bill was introduced by US senators Dick Durbin, Lindsey Graham, Amy Klobuchar and Josh Hawley. The bill would allow victims to sue individuals who produced or possessed "digital forgeries" with intent to distribute, or those who received the material knowing it was made without consent. [15] The European Union struck a deal in February 2024 on a similar bill that would criminalize deepfake pornography, as well as online harassment and revenge porn, by mid-2027. [16]

Social media platforms

X responded to the sharing of these images on their own website with claims they would suspend accounts that participated in their spread. Despite this, the photos continued to be reshared among accounts of X, and spread to other platforms including Instagram and Reddit. [17] X enforces a "synthetic and manipulated media policy", which has been criticized for its efficacy. [18] [19] They briefly blocked searches of Swift's name on January 27, 2024, [20] reinstating them two days later.[ citation needed ]

Fanbase

Swift's fanbase responded to the circulation of these images by pushing the hashtag #ProtectTaylorSwift to trend on X. They also flooded other hashtags related to the images with more positive images and videos of her live performances. [21]

Cultural significance

Deepfake pornography has remained highly controversial and has affected figures from other celebrities to ordinary people, most of whom are women. [22] Journalists have opined that the involvement of a prominent public figure such as Swift in the dissemination of AI-generated pornography could bring public awareness and political reform to the issue. [23]

Related Research Articles

<span class="mw-page-title-main">Human image synthesis</span> Computer generation of human images

Human image synthesis is technology that can be applied to make believable and even photorealistic renditions of human-likenesses, moving or still. It has effectively existed since the early 2000s. Many films using computer generated imagery have featured synthetic images of human-like characters digitally composited onto the real or other simulated film material. Towards the end of the 2010s deep learning artificial intelligence has been applied to synthesize images and video that look like humans, without need for human assistance, once the training phase has been completed, whereas the old school 7D-route required massive amounts of human work .

<span class="mw-page-title-main">Microsoft Bing</span> Web search engine developed by Microsoft

Microsoft Bing, commonly referred to as Bing, is a search engine owned and operated by Microsoft. The service traces its roots back to Microsoft's earlier search engines, including MSN Search, Windows Live Search, and Live Search. Bing offers a broad spectrum of search services, encompassing web, video, image, and map search products, all developed using ASP.NET.

Hany Farid is an American university professor who specializes in the analysis of digital images and the detection of digitally manipulated images such as deepfakes. Farid served as Dean and Head of School for the UC Berkeley School of Information. In addition to teaching, writing, and conducting research, Farid acts as a consultant for non-profits, government agencies, and news organizations. He is the author of the book Photo Forensics (2016).

<span class="mw-page-title-main">Satya Nadella</span> Indian-American business executive (born 1967)

Satya Narayana Nadella is an Indian-American business executive. He is the executive chairman and CEO of Microsoft, succeeding Steve Ballmer in 2014 as CEO and John W. Thompson in 2021 as chairman. Before becoming CEO, he was the executive vice president of Microsoft's cloud and enterprise group, responsible for building and running the company's computing platforms.

<span class="mw-page-title-main">Phil Spencer (business executive)</span> American business executive

Phil Spencer is an American business executive and the CEO of Microsoft Gaming. Starting his career at Microsoft as an intern in 1988, Spencer has worked in various sectors within the company, including developing Microsoft's first CD-ROM-based titles. He joined the Xbox team in 2001.

<span class="mw-page-title-main">OpenAI</span> Artificial intelligence research organization

OpenAI is a U.S.-based artificial intelligence (AI) research organization founded in December 2015, researching artificial intelligence with the goal of developing "safe and beneficial" artificial general intelligence, which it defines as "highly autonomous systems that outperform humans at most economically valuable work". As one of the leading organizations of the AI boom, it has developed several large language models, advanced image generation models, and previously, released open-source models. Its release of ChatGPT has been credited with starting the AI boom.

Celeb Jihad is a website known for sharing leaked private videos and photos as well as faked ones of celebrities as a form of jihad satire. The Daily Beast describes it as a "satirical celebrity gossip website."

Deepfakes are synthetic media that have been digitally manipulated to replace one person's likeness convincingly with that of another. It can also refer to computer-generated images of human subjects that do not exist in real life. While the act of creating fake content is not new, deepfakes leverage tools and techniques from machine learning and artificial intelligence, including facial recognition algorithms and artificial neural networks such as variational autoencoders (VAEs) and generative adversarial networks (GANs). In turn the field of image forensics develops techniques to detect manipulated images.

Digital cloning is an emerging technology, that involves deep-learning algorithms, which allows one to manipulate currently existing audio, photos, and videos that are hyper-realistic. One of the impacts of such technology is that hyper-realistic videos and photos makes it difficult for the human eye to distinguish what is real and what is fake. Furthermore, with various companies making such technologies available to the public, they can bring various benefits as well as potential legal and ethical concerns.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is any visual artwork created through the use of artificial intelligence (AI) programs such as text-to-image models. AI art began to gain popularity in the mid- to late-20th century through the boom of artificial intelligence.

Fake nude photography is the creation of nude photographs designed to appear as genuine nudes of an individual. The motivations for the creation of these modified photographs include sexual gratification, the stigmatization or embarrassment of the subject, and commercial gain, such as through the sale of the photographs via pornographic websites. Fakes can be created using image editing software or through machine learning. Fake pornographic images created using the latter method are called deepfakes.

Synthetic media is a catch-all term for the artificial production, manipulation, and modification of data and media by automated means, especially through the use of artificial intelligence algorithms, such as for the purpose of misleading people or changing an original meaning. Synthetic media refers to any form of media, including but not limited to images, videos, audio recordings, and text, that are generated or manipulated using artificial intelligence (AI) techniques. This technology enables the creation of highly realistic content that may be indistinguishable from authentic media produced by humans. Synthetic media as a field has grown rapidly since the creation of generative adversarial networks, primarily through the rise of deepfakes as well as music synthesis, text generation, human image synthesis, speech synthesis, and more. Though experts use the term "synthetic media," individual methods such as deepfakes and text synthesis are sometimes not referred to as such by the media but instead by their respective terminology Significant attention arose towards the field of synthetic media starting in 2017 when Motherboard reported on the emergence of AI altered pornographic videos to insert the faces of famous actresses. Potential hazards of synthetic media include the spread of misinformation, further loss of trust in institutions such as media and government, the mass automation of creative and journalistic jobs and a retreat into AI-generated fantasy worlds. Synthetic media is an applied form of artificial imagination.

Deepfake pornography, or simply fake pornography, is a type of synthetic porn that is created via altering already-existing pornographic material by applying deepfake technology to the faces of the actors. The use of deepfake porn has sparked controversy because it involves the making and sharing of realistic videos featuring non-consenting individuals, typically female celebrities, and is sometimes used for revenge porn. Efforts are being made to combat these ethical concerns through legislation and technology-based solutions.

<span class="mw-page-title-main">DALL-E</span> Image-generating deep-learning model

DALL·E, DALL·E 2, and DALL·E 3 are text-to-image models developed by OpenAI using deep learning methodologies to generate digital images from natural language descriptions, called "prompts."

<span class="mw-page-title-main">Midjourney</span> Image-generating machine learning model

Midjourney is a generative artificial intelligence program and service created and hosted by the San Francisco–based independent research lab Midjourney, Inc. Midjourney generates images from natural language descriptions, called prompts, similar to OpenAI's DALL-E and Stability AI's Stable Diffusion. It is one of the technologies of the AI boom.

<span class="mw-page-title-main">Generative artificial intelligence</span> AI system capable of generating content in response to prompts

Generative artificial intelligence is artificial intelligence capable of generating text, images, videos, or other data using generative models, often in response to prompts. Generative AI models learn the patterns and structure of their input training data and then generate new data that has similar characteristics.

<span class="mw-page-title-main">AI boom</span> Rapid progress in artificial intelligence

The AI boom, or AI spring, is an ongoing period of rapid progress in the field of artificial intelligence (AI). Prominent examples include protein folding prediction led by Google DeepMind and generative AI led by OpenAI.

<i>404 Media</i> Digital media company

404 Media is an online publication focusing on technology and internet reporting. The publication covers topics such as hacking, sex work, niche online communities, and the right to repair movement. The publication is worker-owned.

Graphika is an American social network analysis company known for tracking online disinformation. It was established in 2013.

As artificial intelligence (AI) has become more mainstream, there is growing concern about how this will influence elections. Potential targets of AI include election processes, election offices, election officials and election vendors.

References

  1. ↑ Weatherbed, Jess (January 25, 2024). "Trolls have flooded X with graphic Taylor Swift AI fakes". The Verge. Archived from the original on January 25, 2024. Retrieved February 7, 2024.
  2. ↑ "Taylor Swift deepfakes spread online, sparking outrage". CBS News. January 26, 2024. Archived from the original on 6 February 2024. Retrieved February 7, 2024.
  3. ↑ Wilkes, Emma (February 5, 2024). "Taylor Swift deepfakes spark calls for new legislation". NME . Archived from the original on February 7, 2024. Retrieved February 7, 2024.
  4. ↑ Wahi, Sukriti (March 3, 2021). "Every Time Taylor Swift Perfectly Shut Down A Sexist Interview Question". Elle. Archived from the original on April 22, 2022. Retrieved November 4, 2021.
  5. ↑ Davis, Allison P. (June 28, 2018). "The Taylor Swift Slut-Shaming Continues". The Cut . Archived from the original on May 24, 2022. Retrieved November 4, 2021.
  6. ↑ Belanger, Ashley (January 26, 2024). "Toxic Telegram group produced X's X-rated fake AI Taylor Swift images, report says". Ars Technica . Archived from the original on January 25, 2024. Retrieved February 7, 2024.
  7. ↑ Hsu, Tiffany (February 5, 2024). "Fake and Explicit Images of Taylor Swift Started on 4chan, Study Says". The New York Times . Archived from the original on February 9, 2024. Retrieved February 10, 2024.
  8. ↑ Belanger, Ashley (February 5, 2024). "4chan daily challenge sparked deluge of explicit AI Taylor Swift images". Ars Technica. Archived from the original on February 9, 2024. Retrieved February 9, 2024.
  9. ↑ "SAG-AFTRA Slams Explicit Taylor Swift AI Images: 'Upsetting, Harmful' and 'Must Be Made Illegal'". Variety . January 27, 2024. Archived from the original on February 7, 2024. Retrieved February 7, 2024.
  10. ↑ Yang, Angela (January 30, 2024). "Microsoft CEO Satya Nadella calls for coordination to address AI risk". NBC News. Archived from the original on February 25, 2024. Retrieved February 26, 2024.
  11. ↑ Pilley, Max (January 27, 2024). "Microsoft CEO: Taylor Swift AI deepfakes are "alarming and terrible"". NME. Archived from the original on 7 February 2024. Retrieved February 7, 2024.
  12. ↑ Zhang, Cat (2024-01-26). "The Swiftie Fight to Protect Taylor Swift From AI". The Cut . Archived from the original on 2024-01-30. Retrieved 2024-03-06.
  13. ↑ Specter, Emma (2024-01-26). "If Anyone Can Stop the Coming AI Hellscape, It's Taylor Swift". Vogue . Archived from the original on 2024-02-06. Retrieved 2024-03-06.
  14. ↑ Beaumont-Thomas, Ben (January 26, 2024). "Taylor Swift deepfake pornography sparks renewed calls for US legislation". The Guardian . Archived from the original on January 29, 2024. Retrieved February 7, 2024.
  15. ↑ Montgomery, Blake (January 31, 2024). "Taylor Swift AI images prompt US bill to tackle nonconsensual, sexual deepfakes". The Guardian . Archived from the original on January 31, 2024. Retrieved January 31, 2024.
  16. ↑ Goujard, Clothilde (February 6, 2024). "Taylor Swift deepfakes nudge EU to get real about AI". Politico. Archived from the original on February 7, 2024. Retrieved February 7, 2024.
  17. ↑ Stokel-Walker, Chris (January 25, 2024). "The explicit AI-created images of Taylor Swift flooding the internet highlight a major problem with generative AI". Fast Company . Archived from the original on January 26, 2024. Retrieved January 26, 2024.
  18. ↑ Hadavas, Chloe (March 11, 2020). "This Is What's Wrong With Twitter's New "Manipulated Media" Label". Slate . ISSN   1091-2339. Archived from the original on February 26, 2024. Retrieved February 26, 2024.
  19. ↑ Ghaffary, Shirin (February 4, 2020). "Twitter is finally fighting back against deepfakes and other deceptive media". Vox . Archived from the original on February 26, 2024. Retrieved February 26, 2024.
  20. ↑ Saner, Emine (January 31, 2024). "Inside the Taylor Swift deepfake scandal: 'It's men telling a powerful woman to get back in her box'". The Guardian . ISSN   0261-3077. Archived from the original on February 27, 2024. Retrieved February 26, 2024.
  21. ↑ Rosenzweig-Ziff, Dan. "AI deepfakes of Taylor Swift spread on X. Here's what to know". The Washington Post . Archived from the original on January 30, 2024. Retrieved February 7, 2024.
  22. ↑ "Found through Google, bought with Visa and Mastercard: Inside the deepfake porn economy". NBC News. March 27, 2023. Archived from the original on November 29, 2023. Retrieved November 30, 2023.
  23. ↑ Volkering, Sam (6 February 2024). "The Taylor Swift Deepfake Scandal Will Change AI as We Know It". Brownstone Research. Archived from the original on February 7, 2024. Retrieved February 7, 2024.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.