Artbreeder

Last updated
Artbreeder
ArtbreederGeneralLogo.jpg
The logo for the 'General' category
Type of site
Content creation
Available in English
Country of origin United States [1]
Created byJoel Simon [2]
URL artbreeder.com
CommercialNo
Launched2018 [2]
Current statusActive
Content license
CC0 [3]

Artbreeder, formerly known as Ganbreeder, [4] is a collaborative, machine learning-based art website. Using the models StyleGAN and BigGAN, [4] [5] the website allows users to generate and modify images of faces, landscapes, and paintings, among other categories. [6]

Contents

Overview

An example of portraits in Artbreeder Artbreeder example portraits.jpg
An example of portraits in Artbreeder

On Artbreeder, users mainly interact through the remixing - referred to as 'breeding' - of other users' images found in the publicly accessible database of images. [1] The creation of new variations can be done by tweaking sliders on an image's page, known as "genes", which in the "Portraits" model can range from color balance to gender, facial hair, and glasses. [6] Additionally, any image can be "crossbred" with other publicly viewable images from the database, using a slider to control how much of each image should influence the resulting "child". [2] [5]

The site also allows for uploading new images, which the model will attempt to convert into the latent space of the network. [6]

Notable usages

The similarly AI-driven text adventure game AI Dungeon uses Artbreeder to generate profile pictures for its users, [7] and The Static Age's Andrew Paley has used Artbreeder to create the visuals for his music videos. [8] [9] Artbreeder has been used to create portraits of characters from popular novels such as Harry Potter and Twilight. [10] [11] They have also been used to add realistic features to ancient portraits. [12]

Artbreeder was used to create characters in the sequel to Ben Drowned with the titular villain, an AI-construct itself, created entirely using the website. [13]

Changes to Artbreeder

An example of the pattern feature of Artbreeder, if you squint, you can see the Wikipedia logo. Wikipedia-Logo-Pattern-Artbreeder.png
An example of the pattern feature of Artbreeder, if you squint, you can see the Wikipedia logo.

ArtBreeder underwent an overhaul, introducing several features to enhance the user experience. Among these updates is the integration SD-XL, developed by stability.ai. Additionally, ArtBreeder also added a functionality known as ControlNet [14] , which enables users to create images based on specific poses. With ControlNet, users can incorporate various poses into their AI Artworks. More features that were introduced into Artbreeder, are Pattern, which creates AI Pattern Images, [15] Outpainting or Uncropping was also an added feature to Artbreeder, that allows the user to expand the image beyond the normal dimensions of the image.

Reception

The artwork generated by users of the website has been described as "beautiful" and "surreal," drawing comparisons to "weird, incomprehensible dreams" that "somehow touch the deep, unconscious parts of [the] mind". [16] However, the generated faces were noted as "creepy and 'off'", and still nowhere near the quality attained by actual digital artists. [6]

Additionally, the site faced criticism for perceived confusing aspects of the AI's behavior. Jonathan Bartlett of Mind Matters News noted that "As is always the case with AI, sometimes the [gene] knobs don't work as expected and sometimes the results are... strange," while conceding that Artbreeder was still "probably the start of a new future of made-to-order stock images." [17] Writers from Hyperallergic also took issue with perceived racial biases in the Portraits model, citing a comment from a user who faced difficulty from the neural network while attempting to darken the skin of a portrait to match a source image. [18]

See also

Related Research Articles

<span class="mw-page-title-main">Digital art</span> Collective term for art that is generated digitally with a computer

Digital art refers to any artistic work or practice that uses digital technology as part of the creative or presentation process. It can also refer to computational art that uses and engages with digital media.

<span class="mw-page-title-main">Computer-generated imagery</span> Application of computer graphics to create or contribute to images

Computer-generated imagery (CGI) is a specific-technology or application of computer graphics for creating or improving images in art, printed media, simulators, videos and video games. These images are either static or dynamic. CGI both refers to 2D computer graphics and 3D computer graphics with the purpose of designing characters, virtual worlds, or scenes and special effects. The application of CGI for creating/improving animations is called computer animation, or CGI animation.

Google Brain was a deep learning artificial intelligence research team under the umbrella of Google AI, a research division at Google dedicated to artificial intelligence. Formed in 2011, Google Brain combined open-ended machine learning research with information systems and large-scale computing resources. The team has created tools such as TensorFlow, which allow for neural networks to be used by the public, with multiple internal AI research projects. The team aims to create research opportunities in machine learning and natural language processing. The team was merged into former Google sister company DeepMind to form Google DeepMind in April 2023.

Picsart is an Armenian-American technology company based in Miami, Florida and Yerevan, Armenia that develops the Picsart suite of online photo and video editing applications, with a social creative community. The platform allows users to take and edit pictures and videos, draw with layers, and share the images on Picsart and other social networks. It is one of the world's most popular apps, with reportedly more than 1 billion downloads across 180 countries.

Deepfakes are synthetic media that have been digitally manipulated to replace one person's likeness convincingly with that of another. Deepfakes are the manipulation of facial appearance through deep generative methods. While the act of creating fake content is not new, deepfakes leverage powerful techniques from machine learning and artificial intelligence to manipulate or generate visual and audio content that can more easily deceive. The main machine learning methods used to create deepfakes are based on deep learning and involve training generative neural network architectures, such as autoencoders, or generative adversarial networks (GANs). In turn the field of image forensics develops techniques to detect manipulated images.

<span class="mw-page-title-main">StyleGAN</span> Novel generative adversarial network

StyleGAN is a generative adversarial network (GAN) introduced by Nvidia researchers in December 2018, and made source available in February 2019.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is any visual artwork created through the use of artificial intelligence (AI) programs.

Synthetic media is a catch-all term for the artificial production, manipulation, and modification of data and media by automated means, especially through the use of artificial intelligence algorithms, such as for the purpose of misleading people or changing an original meaning. Synthetic media as a field has grown rapidly since the creation of generative adversarial networks, primarily through the rise of deepfakes as well as music synthesis, text generation, human image synthesis, speech synthesis, and more. Though experts use the term "synthetic media," individual methods such as deepfakes and text synthesis are sometimes not referred to as such by the media but instead by their respective terminology Significant attention arose towards the field of synthetic media starting in 2017 when Motherboard reported on the emergence of AI altered pornographic videos to insert the faces of famous actresses. Potential hazards of synthetic media include the spread of misinformation, further loss of trust in institutions such as media and government, the mass automation of creative and journalistic jobs and a retreat into AI-generated fantasy worlds. Synthetic media is an applied form of artificial imagination.

<span class="mw-page-title-main">Ai-Da</span> Humanoid robot artist

Ai-Da is a robotic art exhibition created by British artist Aidan Meller, which has been described by its creator as "the world's first ultra-realistic humanoid robot". Completed in 2019, Ai-Da is an android incorporating computer graphics and artificial intelligence algorithms that makes drawings, paintings, and sculptures. It is named after Ada Lovelace.

Deepfake pornography, or simply fake pornography, is a type of synthetic porn that is created via altering already-existing pornographic material by applying deepfake technology to the faces of the actors. The use of deepfake porn has sparked controversy because it involves the making and sharing of realistic videos featuring non-consenting individuals, typically female celebrities, and is sometimes used for revenge porn. Efforts are being made to combat these ethical concerns through legislation and technology-based solutions.

<span class="mw-page-title-main">Kyle McDonald</span>

Kyle McDonald is a media artist. McDonald creates visually appealing models using code, and releases tool kits for other artists to customize their own art as they see fit. McDonald was recently an adjunct professor at New York University Tisch School of the Arts' ITP. He is a member of F.A.T lab, and a community manager for OpenFrameworks. He was a resident at STUDIO for Creative Inquiry at Carnegie Mellon University.

<span class="mw-page-title-main">15.ai</span> Real-time text-to-speech tool using artificial intelligence

15.ai is a non-commercial freeware artificial intelligence web application that generates natural emotive high-fidelity text-to-speech voices from an assortment of fictional characters from a variety of media sources. Developed by a pseudonymous MIT researcher under the name 15, the project uses a combination of audio synthesis algorithms, speech synthesis deep neural networks, and sentiment analysis models to generate and serve emotive character voices faster than real-time, particularly those with a very small amount of trainable data.

<span class="mw-page-title-main">DALL-E</span> Image-generating deep-learning model

DALL·E, DALL·E 2, and DALL·E 3 are text-to-image models developed by OpenAI using deep learning methodologies to generate digital images from natural language descriptions, called "prompts."

Prequel, Inc. is an American technology company and mobile app developer known for developing the Prequel mobile application, which enables editing photos and videos with filters and effects generated using artificial intelligence. Prequel was founded in 2018 by Serge Aliseenko and Timur Khabirov, who currently serves as the company’s CEO. It is headquartered in New York City. As of August 2022, it had been downloaded more than 100 million times.

<span class="mw-page-title-main">Midjourney</span> Image-generating machine learning model

Midjourney is a generative artificial intelligence program and service created and hosted by the San Francisco–based independent research lab Midjourney, Inc. Midjourney generates images from natural language descriptions, called prompts, similar to OpenAI's DALL-E and Stability AI's Stable Diffusion. It is one of the technologies of the AI boom.

<span class="mw-page-title-main">Stable Diffusion</span> Image-generating machine learning model

Stable Diffusion is a deep learning, text-to-image model released in 2022 based on diffusion techniques. It is considered to be a part of the ongoing AI boom.

<span class="mw-page-title-main">Loab</span> Image found using AI text-to-image software

Loab is a fictional character that artist and writer Steph Maj Swanson has claimed to have discovered with a text-to-image AI model in April 2022. In a viral Twitter thread, Swanson described it as an unexpectedly emergent property of the software, saying they discovered it when asking the model to produce something "as different from the prompt as possible".

<span class="mw-page-title-main">NovelAI</span> Online service for AI media creation

NovelAI is an online cloud-based, SaaS model, and a paid subscription service for AI-assisted storywriting and text-to-image synthesis, originally launched in beta on June 15, 2021, with the image generation feature being implemented later on October 3, 2022. NovelAI is owned and operated by Anlatan, which is headquartered in Wilmington, Delaware.

In the 2020s, the rapid increase in the capabilities of deep learning-based generative artificial intelligence models, including text-to-image models such as Stable Diffusion and large language models such as ChatGPT, are posing questions of how copyright law applies to the training and use of such models. Because there is limited existing case law, experts consider this area to be fraught with uncertainty.

<span class="mw-page-title-main">Ganimal</span> Fictional animal

A ganimal, also commonly referred to as GANimal, is a hybrid animal created with generative artificial intelligence systems, such as generative adversarial networks (GANs) or diffusion models. The concept was created for a website from the MIT Media Lab in 2020, where users could create ganimal images. 78,210 ganimals were generated from hybrid pairs of animal labels from BigGAN (G1) and 3,058,362,945 ganimals generated from blending G1 ganimals.

References

  1. 1 2 Groskin, Luke (8 March 2021). "The uncanny art inspired by evolution and generated by 'crossbreeding' images".
  2. 1 2 3 Bailey, Jason (January 8, 2020). "The Tools of Generative Art, from Flash to Neural Networks" . Retrieved March 3, 2021.
  3. "Support". Artbreeder. Retrieved 10 November 2021.
  4. 1 2 Simon, Joel. "About". Archived from the original on March 2, 2021. Retrieved March 3, 2021.
  5. 1 2 George & Carmichael (2021 , pp. 7–25)
  6. 1 2 3 4 Lee, Giacomo (July 21, 2020). "Will this creepy AI platform put artists out of a job?". Digital Arts Online. Archived from the original on December 22, 2020. Retrieved March 3, 2021.
  7. @AiDungeon (May 1, 2020). "How have you been liking the AI generated avatars? (All images created on @Artbreeder)" (Tweet) via Twitter.
  8. "Musician Andrew Paley Creates AI Videos: "Collaborating with a Machine Fit the Moment"". 1 September 2020.
  9. Gerage, Alex. "Human-Machine Collaboration Visualizes Music". Northwestern University .
  10. Miller, Leon (2022-05-05). "AI-Created Harry Potter Images Reveal Scarily Book-Accurate Character Portraits". CBR. Retrieved 2022-06-03.
  11. "Twilight Images Reveal Characters' Book-Accurate Looks Using AI". ScreenRant. 2022-05-17. Retrieved 2022-06-03.
  12. Vincent, James (2020-08-21). "These photorealistic portraits of ancient Roman emperors were created using old statues and AI". The Verge. Retrieved 2022-06-03.
  13. arcadeattack (2020-09-28). "Arcade Attack Podcast – September (4 of 4) 2020 - Alex Hall (Ben Drowned) - Interview". Arcade Attack. Retrieved 2022-10-31.
  14. Simon, Joel (25 February 2024). "ControlNet Poser for Artbreeder". ArtBreeder.{{cite web}}: Check |archive-url= value (help)
  15. Simon, Joel (25 Sep 2023). "Artbreeder 𝗣𝗮𝘁𝘁𝗲𝗿𝗻𝘀 is a new tool to easily generate and draw patterns for creating AI images".
  16. Kulicki, Maks (2020-05-22). "3 Artificial Intelligence tools to enhance your creativity". Medium. Retrieved 2021-03-03.
  17. Bartlett, Jonathan (October 22, 2019). "The AI Revolution has come for Stock Art" . Retrieved March 3, 2021.
  18. Bond, Sarah E.; Junior, Nyasha (October 8, 2020). "How Racial Bias in Tech Has Developed the "New Jim Code"". Hyperallergic. Archived from the original on February 7, 2021.

Bibliography