Mat Dryhurst

Last updated

Mat Dryhurst is a British artist, musician, and technological researcher [1] [2] based in Berlin, Germany. [3] Dryhurst often works on interdisciplinary audiovisual projects in collaboration with Holly Herndon. The duo is known for their contributions to music and art, in which they explore the creative potential and ethics of creating content using technologies, such as AI, Web 3.0, and blockchain. [4] Dryhurst and Herndon have been listed among Art Review's Power 100 in 2021 [4] and 2022. [5]

Contents

Career

Advocacy for a decentralized internet

As an early adopter and practitioner of emerging blockchain technology including NFTs and social tokens, [6] Dryhurst's work envisions cultural production within a decentralized internet. [7] He exemplifies how artists and musicians can use technology to reclaim and direct how their work is displayed and contextualized when it is presented online. [8] [9]

In 2015, Dryhurst launched Saga, which is an embeddable self-hosting and publishing framework that lets content creators claim ownership in every space where their work is embedded online. Saga enables creatives to choose how their work will look when displayed on different websites where it is hosted or displayed. [10] [11]

Dryhurst envisions online culture through a lens similar to how independent record labels and DIY culture helped make the music industry more equitable and accessible. [12] He notes that: “I’m bored of handing control of my work to centralized platforms that have no interest in representing the community of artists I identify with. An independent music industry was built by artists, for artists decades ago, and I think that we need to devise an equivalent infrastructure for online media. That doesn’t mean SoundCloud with a different name and font, but an entirely different logic that is as nuanced and distinguished as the independent communities that use it.” [12]

Collaborations with Holly Herndon

Dryhurst has collaborated on music, visual art, and tech-based projects with Holly Herndon since 2013. One of their first collaborative projects was designing sound for Sonic Movement, a research project operated by the Swedish company Semcon. [13] Responding to the need for pedestrian safety due to the silent nature of electric cars, the duo developed a system that transformed an electric vehicle into a musical instrument that sang and collaborated with its environment and crafted warning sounds alerting pedestrians of the vehicle's presence. [14] Their work premiered as an installation during Frankfurt Motorshow 2013. [13]

In 2015, Dryhurst and Herndon released an eleven minute long track called Recruit, which they made for British menswear line Cottweiler. [15] The artwork merges outdoor soundscapes alongside Herndon's treated vocal samples. [16]

Dryhurst co-produced Herndon's albums Platform (2015) [17] and Proto (2019) and joined her on tour as the supporting act for Radiohead in May 2016. [18] Platform addresses themes of internet decentralization by actively exploring the concept of decentralized autonomous organizations (DAOs), which Dryhurst explains as “a native way to create agreements and trust amongst people who you've not met or who might be pseudonymous”. [19] Platform was created through the Internet in collaboration between Dryhurst and Herndon and participants from all over the world. [19]  

Spawn and Holly+

Since 2019, Dryhurst and Herndon have been making music using their own AI generators, which they named Spawn and Holly+. [20] They have called Spawn their “AI baby,” [21] while Holly+ is referred to as Herndon's “deepfake twin”. [22] In 2021, a real time version of Holly+ premiered at Sonar Festival in Barcelona, Spain with Maria Arnal and Tarta Relena. [23] [24] Holly+ was also presented at TED2022: A New Era in April 2022 with Pher. [25] Dryhurst and Herndon won the 2022 Ars Electronica STARTS prize for digital art for Holly+. [26]

Spawn was developed during the making of Proto by Dryhurst, Herndon, and Jules LaPlace. [27] [28] It is an artificial neural network that can be trained to recognize and replicate distinct human voices. [29] Dryhurst and Herndon taught Spawn to create original music by feeding it audio files, mainly featuring Herndon's own singing voice. [22] Spawn was also trained to learn vocal ranges by listening to the voices of others. During the making of Proto, they held “training ceremonies” which are live call and response singing performances where Dryhurst, Herndon, and other enlisted participants train Spawn by singing to it. [30]  Once Spawn develops a framework for a particular vocal timbre, it is able to improvise and compose music on its own. [30] One of the first sounds that Spawn produced became the foundation of the first track on Proto, titled “Birth”. [31]

In 2021, Dryhurst and Herndon developed Holly+, a music AI generator that lets the public upload polyphonic tracks that are then performed by a deepfaked version of Herndon's voice. [32] In 2022, they released a cover version of Dolly Parton's “Jolene,” using Holly+. A modified score of the original song composed of new tonal harmonies was fed to Holly+ and then generated in Herndon's voice. [33] Every distinct vocal sound, including the deep breathes, usually taken by a performer before embarking on a harmony, was AI generated. [20] Musician Ryan Norris accompanies Holly+ on guitar. [34]

Interdependence

On April 30, 2020, Dryhurst and Herndon debuted their podcast, Interdependence. [35] Broadcasting from their studio in Berlin, they host conversations with individuals who are working at the forefront of integrating arts and technology. [35] Podcast guests have included artists James Bridle, Simon Denny, Harm van den Dorpel, and Emad Mostaque who is the founder of AI deep learning platform Stable Diffusion. [4]

Spawning

In September 2022, Dryhurst and Herndon began collaborating with Jordan Meyer and Patrick Hoepner to develop an organization called Spawning. The name comes from the reproductive process that AI uses to create an infinite number of new works from its training data. [36] It is intended to help distinguish this process from more familiar concepts like sampling. [32] Spawning allows artists to consciously opt in or out of the datasets that AI art generators use to train and create compositions. [37] They set up a website called haveibeentrained.com, where artists can search the approximately 5.8 billion images in the Laion-5b dataset used to train popular AI art models Stable Diffusion and Midjourney. [32] If an artist finds out that their work is being hosted within a dataset, Spawning can help them declare whether they want to continue or terminate the use of their imagery for AI training. [32] Dryhurst believes that “more will ultimately opt in than out, but first we have to establish a common respect”. [32] In March 2023, Spawning, partnering with stock footage company Shutterstock and portfolio platform Artstation, announced that 80 million artworks have been opted out of Stable Diffusion version 3.0 to honor artists’ claims. [38] Spawning's approach has been cited as being instructive towards guiding the European Union’s policy on text and data mining. [39]

In 2023, Spawning launched Source.plus, "a tool to search and curate image collections into individually tailored training datasets."

Exhibitions and visual art projects

In 2015, Dryhurst and Herndon presented their first fine art exhibition at Hamburg's Kunstverein space. [40] The project was commissioned by ZKM | Center for Art and Media’s Sound Dome. [41] The exhibition, titled Everywhere and Nowhere, featured a combination of a 23.2-channel sound installation and related video works, as well as live performances by dancer and choreographer Jone San Martin, Jiu Jitsu fighter Sam Forsythe, and artist Brian Rogers. [41] The performances are guided by whispered narration by Czech artists Marek Luzny and Lukas Hofmann. [40] Inspiration for Everywhere and Nowhere came from a performance by Dryhurst and Herndon at Creepy Teepee, an anti-fascist music festival in the Czech forest. [40]

Teaching

Dryhurst has been a lecturer at the NYU Clive Davis Institute of Recorded Music, [42] Strelka Institute, and the European Graduate School. [43]

Related Research Articles

<span class="mw-page-title-main">Mixtape</span> Musical project

In the modern music industry, a mixtape is a musical project, typically with looser constraints than that of an album or EP. Unlike the traditional album or extended play, mixtapes are labeled as laid-back projects that allow artists more creative freedom and less commercial pressure. The term has significantly increased in popularity over the years due to high-profile artists marketing their projects as such. Mixtapes also have been inconsistently referred to as albums by reputable media outlets such as Pitchfork, Rolling Stone and Complex. This has caused notable confusion on the differences between an album and a mixtape.

Music and artificial intelligence (AI) is the development of music software programs which use AI to generate music. As with applications in other fields, AI in music also simulates mental tasks. A prominent feature is the capability of an AI algorithm to learn based on past data, such as in computer accompaniment technology, wherein the AI is capable of listening to a human performer and performing accompaniment. Artificial intelligence also drives interactive composition technology, wherein a computer composes music in response to a live performance. There are other AI applications in music that cover not only music composition, production, and performance but also how music is marketed and consumed. Several music player programs have also been developed to use voice recognition and natural language processing technology for music voice control. Current research includes the application of AI in music composition, performance, theory and digital sound processing.

<span class="mw-page-title-main">Grimes</span> Canadian musician (born 1988)

Claire Elise Boucher, known professionally as Grimes, is a Canadian musician, singer, songwriter, and record producer. Her lyrics often touch on science fiction and feminist themes. The visuals in her videos are elaborate and sometimes have fantasy themes. She has released five studio albums.

<span class="mw-page-title-main">ASMR</span> Static-like or tingling sensation on the skin/body

An autonomous sensory meridian response (ASMR) is a tingling sensation that usually begins on the scalp and moves down the back of the neck and upper spine. A pleasant form of paresthesia, it has been compared with auditory-tactile synesthesia and may overlap with frisson. ASMR is a subjective experience of "low-grade euphoria" characterized by "a combination of positive feelings and a distinct static-like tingling sensation on the skin". It is most commonly triggered by specific auditory stimuli, and less commonly by intentional attention control.

<span class="mw-page-title-main">Holly Herndon</span> American composer and musician

Holly Herndon is an American artist and composer based in Berlin, Germany. After studying composition at Stanford University and completing her Ph.D. at Stanford University's Center for Computer Research in Music and Acoustics, she pursued a music career internationally. Herndon's music often includes human singing voices, is primarily computer-based, and regularly uses the visual programming language Max/MSP to create custom instruments and vocal processes. She has released music on the labels RVNG Intl. and 4AD. Her third full-length album, Proto, was released on May 10, 2019.

<span class="mw-page-title-main">Sonic Movement</span>

Sonic Movement is a research project operated by the Swedish company Semcon. Premiered in September 2013, Sonic Movement proposes an "adaptive" system of warning sounds and noises for electric cars, which is in opposition to industry trend of replicating combustion engine noises for electric car sound effects.

<i>Platform</i> (album) 2015 studio album by Holly Herndon

Platform is the second studio album by American electronic producer Holly Herndon, released on May 19, 2015, via 4AD. The album received wide critical acclaim upon its release. It is the first commercially released album to include a track intended to trigger autonomous sensory meridian response (ASMR), "Lonely at the Top".

<span class="mw-page-title-main">Jlin</span> American electronic musician (born 1987)

Jerrilynn Patton, known as Jlin, is an electronic musician. She began producing music in 2008 and received early attention for her 2011 track "Erotic Heat". Jlin's debut album, Dark Energy, was released in 2015 to critical praise. Her follow-up Black Origami (2017) received further acclaim.

<i>Movement</i> (Holly Herndon album) 2012 studio album by Holly Herndon

Movement is the first studio album by American electronic musician Holly Herndon, released by RVNG Intl. on 12 November 2012. A music video for the album's title track was uploaded to the RVNG Intl. YouTube account on 29 November 2012.

Colin Self is an American artist, composer, and choreographer. Their work centers around ideas of gender, communication, and consciousness, and their practice includes social relationships and digital technologies. They gained attention as a member of the avant-drag collective Chez Deep 2012–2014 performing in New York City, Miami, and Glasgow with members Alexis Penney, Bailey Stiles, Hari Nef, and Sam Banks. They are a member of the electronic music trio Holly Herndon, which supported Radiohead on their 2016 European tour.

<i>Proto</i> (Holly Herndon album) 2019 studio album by Holly Herndon

Proto is the third studio album by American electronic musician Holly Herndon. It was released on May 10, 2019, via 4AD. It includes the singles "Godmother" and "Eternal", with the video of the latter accompanying the album announcement. The album was called a collaboration with an AI named "Spawn" co-created by Herndon and Mat Dryhurst.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is visual artwork created through the use of an artificial intelligence (AI) program.

Alexander Luke Bahta is an American musician and artist known by the alias Quiet Luke.

<span class="mw-page-title-main">DALL-E</span> Image-generating deep-learning model

DALL·E, DALL·E 2, and DALL·E 3 are text-to-image models developed by OpenAI using deep learning methodologies to generate digital images from natural language descriptions known as "prompts".

<span class="mw-page-title-main">Midjourney</span> Image-generating machine learning model

Midjourney is a generative artificial intelligence program and service created and hosted by the San Francisco-based independent research lab Midjourney, Inc. Midjourney generates images from natural language descriptions, called prompts, similar to OpenAI's DALL-E and Stability AI's Stable Diffusion. It is one of the technologies of the AI boom.

<span class="mw-page-title-main">Stable Diffusion</span> Image-generating machine learning model

Stable Diffusion is a deep learning, text-to-image model released in 2022 based on diffusion techniques. The generative artificial intelligence technology is the premier product of Stability AI and is considered to be a part of the ongoing artificial intelligence boom.

<span class="mw-page-title-main">Text-to-image model</span> Machine learning model

A text-to-image model is a machine learning model which takes an input natural language description and produces an image matching that description.

<span class="mw-page-title-main">NovelAI</span> Online service for AI media creation

NovelAI is an online cloud-based, SaaS model, and a paid subscription service for AI-assisted storywriting and text-to-image synthesis, originally launched in beta on June 15, 2021, with the image generation feature being implemented later on October 3, 2022. NovelAI is owned and operated by Anlatan, which is headquartered in Wilmington, Delaware.

Generative AI pornography or simply AI pornography refers to digitally created explicit content produced through generative artificial intelligence (AI) technologies. Unlike traditional pornography, which involves real actors and cameras, this content is synthesized entirely by AI algorithms. These algorithms, including Generative adversarial network (GANs) and text-to-image models, generate lifelike images, videos, or animations from textual descriptions or datasets.

References

  1. ↑ Lamm, Oliver (2020-10-11). "Streaming: 'The Tools to Move Forward are There Ready to Be Used". Culture Next.
  2. ↑ "Building an interdependent music scene: A list of resources by Mat Dryhurst". Crack Magazine. 2020-09-18. Retrieved 2023-03-31.
  3. ↑ Krell, Tom (2019-02-08). "On Redesigning the System". The Creative Independent. Retrieved 2023-03-31.
  4. 1 2 3 "Art Review Power 100: Holly Herndon & Mat Dryhurst". Art Review. 2021. Retrieved 2023-03-31.
  5. ↑ "Art Review Power 100: Holly Herndon & Mat Dryhurst". artreview.com. 2022. Retrieved 2023-03-31.
  6. ↑ Howard, George (2021-03-26). "Web3 As An Interdependent Economy: A Conversation With Mat Dryhurst". Forbes. Retrieved 2023-03-31.
  7. ↑ Martin, Lauren (2015). "Interview: Mat Dryhurst". daily.redbullmusicacademy.com. Retrieved 2023-03-31.
  8. ↑ "Tools In Our Hands: Discussing SAGA with Mat Dryhurst". Fallow Media. Retrieved 2023-03-31.
  9. ↑ Sutherland, Morgan. "Mathew Dryhurst | Data Sagacity and Site-Specificity". DIS Magazine. Retrieved 2023-03-31.
  10. ↑ Wilson, Scott (2015-10-27). "Saga wants to change how artists display work online". Fact Magazine. Retrieved 2023-03-31.
  11. ↑ Iadarola, Alexander (2015-10-27). "Saga Is An Exciting New Piece Of Software Fighting Artist Exploitation". Vice. Retrieved 2023-03-31.
  12. 1 2 Arcand, Rob (2016-11-30). "Sonic Youth". Real Life. Retrieved 2023-03-31.
  13. 1 2 Moss, Ceci (2014-01-22). "Continuous Partial Listening: Holly Herndon in Conversation". Rhizome. Retrieved 2023-03-31.
  14. ↑ Black, John (2014-04-07). "Sonic Movement". Designing Sound. Retrieved 2023-03-31.
  15. ↑ Swift, T (2015-01-30). "An interview with Mat Dryhurst | atractivoquenobello". AQNB. Retrieved 2023-03-31.
  16. ↑ Garnett, Abby (2015-02-10). "Holly Herndon / Mat Dryhurst: "Recruit"". Pitchfork. Retrieved 2023-03-31.
  17. ↑ "The Quietus | News | LISTEN: New Holly Herndon". The Quietus. 2015-03-10. Retrieved 2023-03-31.
  18. ↑ Chiaverina, John (2016-05-11). "Holly Herndon, Colin Self, and Mat Dryhurst To Support Radiohead On Upcoming Dates". ARTnews.com. Retrieved 2023-03-31.
  19. 1 2 Howard, Lindsay (2021-05-25). "Holly Herndon and Mat Dryhurst on the dreamy possibilities of decentralized collaboration. | Foundation". foundation.app. Retrieved 2023-03-31.
  20. 1 2 O'Brien, Terrence (2022-11-02). "Listen to an AI sing an uncannily human rendition of 'Jolene'". Engadget. Retrieved 2023-03-31.
  21. ↑ Gotrich, Lars (2018-12-04). "Holly Herndon's AI Baby Sings To Her 'Godmother'". NPR.
  22. 1 2 Cliff, Aimee (2018-09-19). "The musicians leading the AI revolution". Dazed. Retrieved 2023-03-31.
  23. ↑ Philip, Sherburne (2022-05-24). "Will AI Take the Pleasure Out of Music?". Pitchfork. Retrieved 2023-03-31.
  24. ↑ Rosés, Mercedes (2021). "Sónar Barcelona 2021 | Metal Magazine". metalmagazine.eu. Retrieved 2023-03-31.
  25. ↑ Delahoussaye, James; Zomorodi, Manoush; Simon, Katie (2022-08-26). "Holly Herndon: How AI can transform your voice". NPR.
  26. ↑ "Holly+". S+T+ARTS PRIZE. Retrieved 2023-03-31.
  27. ↑ Bloom, Madison (2019-03-11). "Holly Herndon Announces New Album PROTO, Shares Video: Watch". Pitchfork. Retrieved 2023-03-31.
  28. ↑ Beaumont-Thomas, Ben (2019-05-10). "Holly Herndon: Proto review – dystopia averted! AI and IRL in pop harmony". The Guardian. ISSN   0261-3077 . Retrieved 2023-03-31.
  29. ↑ Friedlander, Emilie (2019-05-21). "How Holly Herndon and her AI baby spawned a new kind of folk music". The FADER. Retrieved 2023-03-31.
  30. 1 2 Beedham, Tom (2019-05-06). "Holly Herndon Interweaves Human and Artificial Intelligence on New Album 'PROTO'". Exclaim.
  31. ↑ Francis, Hannah (2020-01-15). "The artist who spawned an AI baby". The Sydney Morning Herald. Retrieved 2023-03-31.
  32. 1 2 3 4 5 Stokel-Walker, Chris (14 September 2022). "This couple is launching an organization to protect artists in the AI era". Input. Retrieved 2023-03-31.
  33. ↑ Diaz, Jesus (2022-11-08). "Dolly Parton's Jolene cover is a triumph of AI, artistry, and technical genius". Fast Company.
  34. ↑ Arcand, Rob (2022-11-01). "Holly Herndon Covers Dolly Parton's "Jolene" Using AI". Pitchfork. Retrieved 2023-03-31.
  35. 1 2 Bloom, Madison (2020-05-04). "Holly Herndon Launches New Podcast With Mat Dryhurst". Pitchfork. Retrieved 2023-03-31.
  36. ↑ Dryhurst, Mat (2023-01-10). "AI Art and the Problem of Consent". Art Review. Retrieved 2023-03-31.
  37. ↑ Ovide, Shira (2022-12-09). "Your selfies are helping AI learn. You did not consent to this". Washington Post. ISSN   0190-8286 . Retrieved 2023-03-31.
  38. ↑ Kemper, Jonathan (2023-03-08). "Artists remove 80 million images from Stable Diffusion 3 training data". THE DECODER. Retrieved 2023-03-31.
  39. ↑ Keller, Paul (2023-02-17). "Protecting Creatives or Impeding Progress?". Open Future. Retrieved 2023-03-31.
  40. 1 2 3 Pangburn, DJ (2015-08-29). "A Utopian Installation Where the Real and Virtual Coexist". Vice. Retrieved 2023-03-31.
  41. 1 2 "Holly Herndon In Collaboration With Mathew Dryhurst at Kunstverein Hamburg Hamburg - Artmap.com". artmap.com. Retrieved 2023-03-31.
  42. ↑ Paul Titlow, John (2020-08-13). "How Live Music Is Coping, And What The Near Future Will Bring". KERA News. Retrieved 2023-03-31.
  43. ↑ Goldsmith, Craig (2021-09-13). "Holly+ Ep2: IP and the DAO". KUNM. Retrieved 2023-03-31.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.