Artbreeder

Last updated

Artbreeder
ArtbreederGeneralLogo.jpg
The logo for the 'General' category
Type of site
Content creation
Available in English
Country of origin United States [1]
Created byJoel Simon [2]
URL artbreeder.com
CommercialNo
Launched2018 [2]
Current statusActive
Content license
CC0 [3]

Artbreeder, formerly known as Ganbreeder, [4] is a collaborative, machine learning-based art website. Using the models StyleGAN and BigGAN, [4] [5] the website allows users to generate and modify images of faces, landscapes, and paintings, among other categories. [6]

Contents

Overview

An example of portraits in Artbreeder Artbreeder example portraits.jpg
An example of portraits in Artbreeder

On Artbreeder, users mainly interact through the remixing - referred to as 'breeding' - of other users' images found in the publicly accessible database of images. [1] The creation of new variations can be done by tweaking sliders on an image's page, known as "genes", which in the "Portraits" model can range from color balance to gender, facial hair, and glasses. [6] Additionally, any image can be "crossbred" with other publicly viewable images from the database, using a slider to control how much of each image should influence the resulting "child". [2] [5]

The site also allows for uploading new images, which the model will attempt to convert into the latent space of the network. [6]

Notable usages

The similarly AI-driven text adventure game AI Dungeon uses Artbreeder to generate profile pictures for its users, [7] and The Static Age's Andrew Paley has used Artbreeder to create the visuals for his music videos. [8] [9] Artbreeder has been used to create portraits of characters from popular novels such as Harry Potter and Twilight. [10] [11] They have also been used to add realistic features to ancient portraits. [12]

Artbreeder was used to create characters in the sequel to Ben Drowned with the titular villain, an AI-construct itself, created entirely using the website. [13]

Changes to Artbreeder

An example of the pattern feature of Artbreeder, if you squint, you can see the Wikipedia logo. Wikipedia-Logo-Pattern-Artbreeder.png
An example of the pattern feature of Artbreeder, if you squint, you can see the Wikipedia logo.

ArtBreeder underwent an overhaul, introducing several features to enhance the user experience. Among these updates is the integration SD-XL, developed by stability.ai. Additionally, ArtBreeder also added a functionality known as ControlNet, [14] which enables users to create images based on specific poses. With ControlNet, users can incorporate various poses into their AI Artworks. More features that were introduced into Artbreeder, are Pattern, which creates AI Pattern Images, [15] Outpainting or Uncropping was also an added feature to Artbreeder, that allows the user to expand the image beyond the normal dimensions of the image.

Reception

The artwork generated by users of the website has been described as "beautiful" and "surreal," drawing comparisons to "weird, incomprehensible dreams" that "somehow touch the deep, unconscious parts of [the] mind". [16] However, the generated faces were noted as "creepy and 'off'", and still nowhere near the quality attained by actual digital artists. [6]

Additionally, the site faced criticism for perceived confusing aspects of the AI's behavior. Jonathan Bartlett of Mind Matters News noted that "As is always the case with AI, sometimes the [gene] knobs don't work as expected and sometimes the results are... strange," while conceding that Artbreeder was still "probably the start of a new future of made-to-order stock images." [17] Writers from Hyperallergic also took issue with perceived racial biases in the Portraits model, citing a comment from a user who faced difficulty from the neural network while attempting to darken the skin of a portrait to match a source image. [18]

See also

Related Research Articles

<span class="mw-page-title-main">Digital art</span> Collective term for art that is generated digitally with a computer

Digital art refers to any artistic work or practice that uses digital technology as part of the creative or presentation process. It can also refer to computational art that uses and engages with digital media.

<span class="mw-page-title-main">Wacom</span> Japanese company specializing in graphics tablets and related products

Wacom Co., Ltd. is a Japanese company headquartered in Kazo, Saitama, Japan, that specializes in manufacturing graphics tablets and related products. As of 2012 Wacom generated sales of approximately 40.7 billion yen with 785 employees. The company's shares are listed on the Tokyo Stock Exchange.

<span class="mw-page-title-main">Human image synthesis</span> Computer generation of human images

Human image synthesis is technology that can be applied to make believable and even photorealistic renditions of human-likenesses, moving or still. It has effectively existed since the early 2000s. Many films using computer generated imagery have featured synthetic images of human-like characters digitally composited onto the real or other simulated film material. Towards the end of the 2010s deep learning artificial intelligence has been applied to synthesize images and video that look like humans, without need for human assistance, once the training phase has been completed, whereas the old school 7D-route required massive amounts of human work .

Artificial intelligence (AI) has been used in applications throughout industry and academia. Similar to electricity or computers, AI serves as a general-purpose technology that has numerous applications. Its applications span language translation, image recognition, decision-making, credit scoring, e-commerce and various other domains. AI which accommodates such technologies as machines being equipped perceive, understand, act and learning a scientific discipline.

<span class="mw-page-title-main">Computer-generated imagery</span> Application of computer graphics to create or contribute to images

Computer-generated imagery (CGI) is a specific-technology or application of computer graphics for creating or improving images in art, printed media, simulators, videos and video games. These images are either static or dynamic. CGI both refers to 2D computer graphics and 3D computer graphics with the purpose of designing characters, virtual worlds, or scenes and special effects. The application of CGI for creating/improving animations is called computer animation, or CGI animation.

Picsart is an Armenian-American technology company based in Miami, Florida, United States and Yerevan, Armenia that develops the Picsart suite of online photo and video editing applications, with a social creative community. The platform allows users to take and edit pictures and videos, draw with layers, and share the images on Picsart and other social networks. It is one of the world's most popular apps, with reportedly more than 1 billion downloads across 180 countries.

<span class="mw-page-title-main">Deepfake</span> Artificial intelligence-based human image synthesis technique

Deepfakes were originally defined as synthetic media that have been digitally manipulated to replace one person's likeness convincingly with that of another. The term was coined in 2017 by a Reddit user, and has later been expanded to cover any videos, pictures, or audio made with artificial intelligence to appear real, for example realistic-looking images of people who do not exist. While the act of creating fake content is not new, deepfakes leverage tools and techniques from machine learning and artificial intelligence, including facial recognition algorithms and artificial neural networks such as variational autoencoders (VAEs) and generative adversarial networks (GANs). In turn the field of image forensics develops techniques to detect manipulated images. Deepfakes have garnered widespread attention for their potential use in creating child sexual abuse material, celebrity pornographic videos, revenge porn, fake news, hoaxes, bullying, and financial fraud. The spreading of disinformation and hate speech through deepfakes has a potential to undermine core functions and norms of democratic systems by interfering with people's ability to participate in decisions that affect them, determine collective agendas and express political will through informed decision-making. Both the information technology industry and government have responded with recommendations to detect and limit their use.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is visual artwork created through the use of an artificial intelligence (AI) program.

Synthetic media is a catch-all term for the artificial production, manipulation, and modification of data and media by automated means, especially through the use of artificial intelligence algorithms, such as for the purpose of misleading people or changing an original meaning. Synthetic media as a field has grown rapidly since the creation of generative adversarial networks, primarily through the rise of deepfakes as well as music synthesis, text generation, human image synthesis, speech synthesis, and more. Though experts use the term "synthetic media," individual methods such as deepfakes and text synthesis are sometimes not referred to as such by the media but instead by their respective terminology Significant attention arose towards the field of synthetic media starting in 2017 when Motherboard reported on the emergence of AI altered pornographic videos to insert the faces of famous actresses. Potential hazards of synthetic media include the spread of misinformation, further loss of trust in institutions such as media and government, the mass automation of creative and journalistic jobs and a retreat into AI-generated fantasy worlds. Synthetic media is an applied form of artificial imagination.

Deepfake pornography, or simply fake pornography, is a type of synthetic pornography that is created via altering already-existing pornographic material by applying deepfake technology to the faces of the actors. The use of deepfake porn has sparked controversy because it involves the making and sharing of realistic videos featuring non-consenting individuals, typically female celebrities, and is sometimes used for revenge porn. Efforts are being made to combat these ethical concerns through legislation and technology-based solutions.

<span class="mw-page-title-main">15.ai</span> Real-time text-to-speech tool using artificial intelligence

15.ai is a non-commercial freeware artificial intelligence web application that generates natural emotive high-fidelity text-to-speech voices from an assortment of fictional characters from a variety of media sources. Developed by a pseudonymous MIT researcher under the name 15, the project uses a combination of audio synthesis algorithms, speech synthesis deep neural networks, and sentiment analysis models to generate and serve emotive character voices faster than real-time, particularly those with a very small amount of trainable data.

Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.

<span class="mw-page-title-main">DALL-E</span> Image-generating deep-learning model

DALL·E, DALL·E 2, and DALL·E 3 are text-to-image models developed by OpenAI using deep learning methodologies to generate digital images from natural language descriptions known as "prompts".

Prequel, Inc. is an American technology company and mobile app developer known for developing the Prequel mobile application, which enables editing photos and videos with filters and effects generated using artificial intelligence. Prequel was founded in 2018 by Serge Aliseenko and Timur Khabirov, who currently serves as the company’s CEO. It is headquartered in New York City. As of August 2022, it had been downloaded more than 100 million times.

<span class="mw-page-title-main">Midjourney</span> Image-generating machine learning model

Midjourney is a generative artificial intelligence program and service created and hosted by the San Francisco–based independent research lab Midjourney, Inc. Midjourney generates images from natural language descriptions, called prompts, similar to OpenAI's DALL-E and Stability AI's Stable Diffusion. It is one of the technologies of the AI boom.

<span class="mw-page-title-main">Stable Diffusion</span> Image-generating machine learning model

Stable Diffusion is a deep learning, text-to-image model released in 2022 based on diffusion techniques. The generative artificial intelligence technology is the premier product of Stability AI and is considered to be a part of the ongoing artificial intelligence boom.

<span class="mw-page-title-main">Loab</span> Image found using AI text-to-image software

Loab is a fictional character that artist and writer Steph Maj Swanson has claimed to have discovered with a text-to-image AI model in April 2022. In a viral Twitter thread, Swanson described it as an unexpectedly emergent property of the software, saying they discovered it when asking the model to produce something "as different from the prompt as possible".

<span class="mw-page-title-main">NovelAI</span> Online service for AI media creation

NovelAI is an online cloud-based, SaaS model, and a paid subscription service for AI-assisted storywriting and text-to-image synthesis, originally launched in beta on June 15, 2021, with the image generation feature being implemented later on October 3, 2022. NovelAI is owned and operated by Anlatan, which is headquartered in Wilmington, Delaware.

In the 2020s, the rapid advancement of deep learning-based generative artificial intelligence models are raising questions about whether copyright infringement occurs when the generative AI is trained or used. This includes text-to-image models such as Stable Diffusion and large language models such as ChatGPT. As of 2023, there are several pending U.S. lawsuits challenging the use of copyrighted data to train AI models, with defendants arguing that this falls under fair use.

<span class="mw-page-title-main">Ganimal</span> Fictional animal

A ganimal, also commonly referred to as GANimal, is a hybrid animal created with generative artificial intelligence systems, such as generative adversarial networks (GANs) or diffusion models. The concept was created for a website from the MIT Media Lab in 2020, where users could create ganimal images. 78,210 ganimals were generated from hybrid pairs of animal labels from BigGAN (G1) and 3,058,362,945 ganimals generated from blending G1 ganimals.

References

  1. 1 2 Groskin, Luke (8 March 2021). "The uncanny art inspired by evolution and generated by 'crossbreeding' images". Aeon.
  2. 1 2 3 Bailey, Jason (8 January 2020). "The Tools of Generative Art, from Flash to Neural Networks". ARTnews. Retrieved 3 March 2021.
  3. "Support". Artbreeder. Retrieved 10 November 2021.
  4. 1 2 Simon, Joel. "About". Archived from the original on 2 March 2021. Retrieved 3 March 2021.
  5. 1 2 George & Carmichael (2021 , pp. 7–25)
  6. 1 2 3 4 Lee, Giacomo (21 July 2020). "Will this creepy AI platform put artists out of a job?". Digital Arts Online. Archived from the original on 22 December 2020. Retrieved 3 March 2021.
  7. @AiDungeon (1 May 2020). "How have you been liking the AI generated avatars? (All images created on @Artbreeder)" (Tweet) via Twitter.
  8. "Musician Andrew Paley Creates AI Videos: "Collaborating with a Machine Fit the Moment"". Red Herring. 1 September 2020.
  9. Gerage, Alex (Spring 2021). "Human-Machine Collaboration Visualizes Music". Northwestern Engineering. Northwestern University.
  10. Miller, Leon (5 May 2022). "AI-Created Harry Potter Images Reveal Scarily Book-Accurate Character Portraits". CBR. Retrieved 3 June 2022.
  11. Bentz, Adam (17 May 2022). "Twilight Images Reveal Characters' Book-Accurate Looks Using AI". ScreenRant. Retrieved 3 June 2022.
  12. Vincent, James (21 August 2020). "These photorealistic portraits of ancient Roman emperors were created using old statues and AI". The Verge. Retrieved 3 June 2022.
  13. "Arcade Attack Podcast – September (4 of 4) 2020 - Alex Hall (Ben Drowned) - Interview". Arcade Attack. 28 September 2020. Retrieved 31 October 2022.
  14. Simon, Joel (25 February 2024). "ControlNet Poser for Artbreeder". ArtBreeder.
  15. Simon, Joel [@Artbreeder] (25 September 2023). "Artbreeder 𝗣𝗮𝘁𝘁𝗲𝗿𝗻𝘀 is a new tool to easily generate and draw patterns for creating AI images" (Tweet) via Twitter.
  16. Kulicki, Maks (22 May 2020). "3 Artificial Intelligence tools to enhance your creativity". Medium. Retrieved 3 March 2021.
  17. Bartlett, Jonathan (22 October 2019). "The AI Revolution has come for Stock Art" . Retrieved 3 March 2021.
  18. Bond, Sarah E.; Junior, Nyasha (8 October 2020). "How Racial Bias in Tech Has Developed the "New Jim Code"". Hyperallergic. Archived from the original on 7 February 2021.

Bibliography