ReRites

Last updated

ReRites (also known as RERITES, ReadingRites, Big Data Poetry) is a literary work of "Human + A.I. poetry" by David Jhave Johnston that used neural network models trained to generate poetry which the author then edited. ReRites won the Robert Coover Award for a Work of Electronic Literature in 2022. [1]

Contents

About the project

The ReRites project began as a daily rite of writing with a neural network, expanded into a series of performances from which video documentation has been published online, [2] and concluded with a set of 12 books [3] and an accompanying book of essays [4] published by Anteism Books in 2019. In Electronic Literature, Scott Rettberg describes the early phases of the project in 2016, when it bore the preliminary name Big Data Poetry. [5]

Jhave (the artist name that David Jhave Johnston goes by) describes the process of writing ReRites as a rite: "Every morning for 2 hours (normally 6:30–8:30am) I get up and edit the poetic output of a neural net. Deleting, weaving, conjugating, lineating, cohering. Re-writing. Re-wiring authorship: hybrid augmented enhanced evolutionary". [6] There is video documentation of the writing process. [7]

The human editing of the neural network's output is fundamental to this project, and Jhave gives examples of both unedited text extracts and his edited versions in publications about the project. [8] Kyle Booten describes ReRites as "simultaneously dusty and outrageously verdant, monotonously sublime and speckled with beautiful and rare specimens". [9]

Performances

ReRites was first shared with an audience through a series of performances where audience members and poets would participate in reading the automatically generated texts, which appeared on screen so fast that human readers could barely keep up. This has been described as allowing participants to "re-discover[..] the peculiar pleasures of being embodied", [1] or, in Jhave's own words, as a space where human participants were "playing their wits and voices against an evocative infinite deep-learning muse". [6]

The first performance was at Brown University's Interrupt Festival in 2019. [6] It has been performed many times since, including at the Barbican Centre in London [10] and Anteism Books. [8]

For a single year Jhave published one book of poetry from the ReRites project each month. These twelve volumes are accompanied by a book of essays, [4] all published by Anteism Books. [11] The accompanying essays provide critical responses to the project from poets and scholars including Allison Parrish, Johanna Drucker, Kyle Booten, Stephanie Strickland, John Cayley, Lai-Tze Fan, Nick Montfort, Mairéad Byrne, and Chris Funkhouser. Allison Parrish notes elsewhere that these paratexts to ReRites serve a legitimising function for a genre of poetry that is not yet institutionally acknowledged. [12]

Technical details

Starting in 2016 under the name Big Data Poetry, Jhave generated poems using, in his own words, "neural network code (..) adapted from three corporate github-hosted machine-learning libraries: TensorFlow (Google), PyTorch (Facebook), and AWSD (SalesForce)". [13] He explains that the "models were trained on a customised corpus of 600,000 lines of poetry ranging from the romantic epoch to the 20th century avant garde". [14] Jhave maintains a GitHub repository with some of the code supporting ReRites. [15]

Reception

ReRites is described by John Cayley as "one of the most thorough and beautiful" poetic responses to machine learning. [16] The work's influence on the field of electronic literature was acknowledged in 2022, when the work won the Electronic Literature Organization's Robert Coover Award for a Work of Electronic Literature. The jury described ReRites as particularly poignant in the time of the pandemic, as it was "a documentation of the performance of the private ritual of writing and the obsessive-compulsive need for writers to communicate — even when no one else is reading". [1]

The question of authorship and voice in ReRites has been raised by several critics. [17] Although generated poetry is an established genre in electronic literature, Cayley notes that unlike the combinatory poems created by authors like Nick Montfort, where the author explicitly defines which words and phrases will be recombined, ReRites has "not been directed by literary preconceptions inscribed in the program itself, but only by patterns and rhythms pre-existing in the corpora". [16] In an essay for the Australian journal TEXT, David Thomas Henry Wright asks how to understand authorship and authority in ReRites: "Who or what is the authority of the work? The original data fed into the machine, that is not currently retrievable or discernible from the final works? The code that was taken and adapted for his purposes? Or Jhave, the human editor?" [18] Wright concludes that Jhave is the only actor with any intentionality and therefore the authority of the work. The centrality of the human editor is also emphasised by other scholars. [19] In a chapter analysing ReRites Malthe Stavning Erslev argues that the machine learning misrepresents the dataset it is trained on. [20]

While ReRites uses 21st century neural networks, it has been compared to earlier literary traditions. Poet Victoria Stanton, who read at one of the ReRites performances, has compared ReRites to found poetry, [21] while David Thomas Henry Wright compares it to the Oulipo movement [22] and Mark Amerika to the cut-up technique. [23] Scholars also position ReRites firmly within the long tradition of generative poetry both in electronic literature and print, stretching from the I Ching, Queneau's Cent Mille Milliards de Poemes and Nabokov's Pale Fire to computer-generated poems like Christopher Strachey's Love Letter Generator (1952) and more contemporary examples. [24] [5]

Jhave describes the process of working with the output from the neural network as "carving". In his book My Life as an Artificial Creative Intelligence, Mark Amerika writes that the "method of carving the digital outputs provided by the language model as part of a collaborative remix jam session with GPT-2, where the language artist and the language model play off each other’s unexpected outputs as if caught in a live postproduction set, is one I share with electronic literature composer David Jhave Johnston, whose AI poetry experiments precede my own investigations." [23]

Related Research Articles

<span class="mw-page-title-main">Neural network (machine learning)</span> Computational model used in machine learning, based on connected, hierarchical functions

In machine learning, a neural network is a model inspired by the structure and function of biological neural networks in animal brains.

<span class="mw-page-title-main">Jürgen Schmidhuber</span> German computer scientist

Jürgen Schmidhuber is a German computer scientist noted for his work in the field of artificial intelligence, specifically artificial neural networks. He is a scientific director of the Dalle Molle Institute for Artificial Intelligence Research in Switzerland. He is also director of the Artificial Intelligence Initiative and professor of the Computer Science program in the Computer, Electrical, and Mathematical Sciences and Engineering (CEMSE) division at the King Abdullah University of Science and Technology (KAUST) in Saudi Arabia.

Electronic literature or digital literature is a genre of literature where digital capabilities such as interactivity, multimodality or algorithmic text generation are used aesthetically. Works of electronic literature are usually intended to be read on digital devices, such as computers, tablets, and mobile phones. They cannot be easily printed, or cannot be printed at all, because elements crucial to the work cannot be carried over onto a printed version.

<span class="mw-page-title-main">Nick Montfort</span> American poet & digital media professor

Nick Montfort is a poet and professor of digital media at MIT, where he directs a lab called The Trope Tank. He also holds a part-time position at the University of Bergen where he leads a node on computational narrative systems at the Center for Digital Narrative. Among his publications are seven books of computer-generated literature and six books from the MIT Press, several of which are collaborations. His work also includes digital projects, many of them in the form of short programs. He lives in New York City.

Mez Breeze is an Australian-based artist and practitioner of net.art, working primarily with code poetry, electronic literature, mezangelle, and digital games. Born Mary-Anne Breeze, she uses a number of avatar nicknames, including Mez and Netwurker. She received degrees in both Applied Social Science [Psychology] at Charles Sturt University in Bathurst, Australia in 1991 and Creative Arts at the University of Wollongong in Australia in 2001. In 1994, Breeze received a diploma in Fine Arts at the Illawarra Institute of Technology, Arts and Media Campus in Australia. As of May 2014, Mez is the only Interactive Writer and Artist who is a non-USA citizen to have her comprehensive career archive housed at Duke University, through their David M. Rubenstein Rare Book & Manuscript Library.

Music and artificial intelligence is the development of music software programs which use AI to generate music. As with applications in other fields, AI in music also simulates mental tasks. A prominent feature is the capability of an AI algorithm to learn based on past data, such as in computer accompaniment technology, wherein the AI is capable of listening to a human performer and performing accompaniment. Artificial intelligence also drives interactive composition technology, wherein a computer composes music in response to a live performance. There are other AI applications in music that cover not only music composition, production, and performance but also how music is marketed and consumed. Several music player programs have also been developed to use voice recognition and natural language processing technology for music voice control. Current research includes the application of AI in music composition, performance, theory and digital sound processing.

<span class="mw-page-title-main">Deep learning</span> Branch of machine learning

Deep learning is the subset of machine learning methods based on neural networks with representation learning. The adjective "deep" refers to the use of multiple layers in the network. Methods used can be either supervised, semi-supervised or unsupervised.

Adversarial machine learning is the study of the attacks on machine learning algorithms, and of the defenses against such attacks. A survey from May 2020 exposes the fact that practitioners report a dire need for better protecting machine learning systems in industrial applications.

WaveNet is a deep neural network for generating raw audio. It was created by researchers at London-based AI firm DeepMind. The technique, outlined in a paper in September 2016, is able to generate relatively realistic-sounding human-like voices by directly modelling waveforms using a neural network method trained with recordings of real speech. Tests with US English and Mandarin reportedly showed that the system outperforms Google's best existing text-to-speech (TTS) systems, although as of 2016 its text-to-speech synthesis still was less convincing than actual human speech. WaveNet's ability to generate raw waveforms means that it can model any kind of audio, including music.

<i>1 the Road</i> Novel written by an artificial intelligence

1 the Road is an experimental novel composed by artificial intelligence (AI). Emulating Jack Kerouac's On the Road, Ross Goodwin drove from New York to New Orleans in March 2017 with an AI in a laptop hooked up to various sensors, whose output the AI turned into words that were printed on rolls of receipt paper. The novel was published in 2018 by Jean Boîte Éditions.

Artificial intelligence and machine learning techniques are used in video games for a wide variety of applications such as non-player character (NPC) control and procedural content generation (PCG). Machine learning is a subset of artificial intelligence that uses historical data to build predictive and analytical models. This is in sharp contrast to traditional methods of artificial intelligence such as search trees and expert systems.

John Howland Cayley is a Canadian pioneer of writing in digital media as well as a theorist of the practice, a poet, and a Professor of Literary Arts at Brown University.

David Jhave Johnston is a Canadian poet, videographer, and motion graphics artist working chiefly in digital and computational media,. and a researcher at the Center for Digital Narrative at the University of Bergen. This artist's work is often attributed, simply, to the name Jhave.

Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.

<span class="mw-page-title-main">GPT-2</span> 2019 text-generating language model

Generative Pre-trained Transformer 2 (GPT-2) is a large language model by OpenAI and the second in their foundational series of GPT models. GPT-2 was pre-trained on a dataset of 8 million web pages. It was partially released in February 2019, followed by full release of the 1.5-billion-parameter model on November 5, 2019.

<span class="mw-page-title-main">Samantha Gorman</span> Writer and narrative designer

Samantha Gorman is an American game developer known for her combination of narrative, theatricality and gaming in VR environments, and for introducing gestural interactions in touchscreen narratives. She has won multiple awards for her work, both in the field of games and in electronic literature and new media writing. Gorman co-founded the computer art and games studio Tender Claws in 2014 and has been an assistant professor at Northeastern University since 2020.

<span class="mw-page-title-main">Text-to-image model</span> Machine learning model

A text-to-image model is a machine learning model which takes an input natural language description and produces an image matching that description.

Generative literature is poetry or fiction that is automatically generated, often using computers. It is a genre of electronic literature, and also related to generative art.

Pry is a 2014 interactive digital novella for iPad created by Samantha Gorman and Daniel Cannizzaro, which follows an American ex-soldier named James after he returns home from the first Gulf War. The novella combines text, haptic gestures, audio, and video to convey James's struggles with issues such as PTSD and his worsening eyesight as he works as a demolition expert.

References

  1. 1 2 3 Snyder, R. (2022-10-04). "Announcing the 2022 ELO Prizes – Electronic Literature Organization". Electronic Literature Organization. Retrieved 2022-10-11.
  2. ↑ Johnston, David (Jhave) (2021-03-01), ReRites : Human + A.I. Poetry Project (2016–2019) , retrieved 2022-10-11
  3. ↑ "RERITES : machine learning poetry edited by a human". glia.ca. Retrieved 2022-10-11.
  4. 1 2 Strickland, Stephanie, ed. (2019). ReRites : human + A.I. poetry; Raw output : A.I. trained on custom poetry corpus; Responses : 8 essays about poetry and A.I. Stephanie Strickland. Montreal, Quebec. ISBN   978-1-926968-50-6. OCLC   1110014654.{{cite book}}: CS1 maint: location missing publisher (link)
  5. 1 2 Rettberg, Scott (2019). Electronic literature. Cambridge, UK. ISBN   978-1-5095-1681-0. OCLC   1038024013.{{cite book}}: CS1 maint: location missing publisher (link)
  6. 1 2 3 Johnston, David Jhave (2019-06-13). "ReRites (& ReadingRites)". Proceedings of the 2019 on Creativity and Cognition. C&C '19. New York, NY, USA: Association for Computing Machinery. pp. 444–448. doi:10.1145/3325480.3329182. ISBN   978-1-4503-5917-7. S2CID   189895861.
  7. ↑ Johnston, David (Jhave) (2018-04-07), 07-04-2018 RERITES (writing process 4xspeed) , retrieved 2022-10-11
  8. 1 2 Stanton, Victoria (2019-10-22). "Performance at Anteism Books – Jhave's ReRites Revisited". Bank of Victoria. Retrieved 2022-10-11.
  9. ↑ Booten, Kyle (2019). "Harvesting ReRites". In Johnston, David Jhave (ed.). ReRites: Human + A.I. Poetry + Raw Output + Responses (PDF). Montréal: Anteism.
  10. ↑ "ReRites: Human and AI poetry | Barbican". www.barbican.org.uk. 22 May 2019. Retrieved 2022-10-11.
  11. ↑ "ReRites - David (Jhave) Johnston". Anteism Books. Retrieved 2022-10-11.
  12. ↑ Parrish, Allison (2022-06-28). "Material paratexts". Allison Posts. Retrieved 2022-10-11.
  13. ↑ Johnston, David Jhave. "RERITES : machine learning poetry edited by a human". glia.ca. Retrieved 2022-10-11.
  14. ↑ Johnston, David Jhave. "About – BDP". Big Data Poetry. Retrieved 2022-10-11.
  15. ↑ jhave (2019-06-27), Adapted AWD-LSTM / AWD-QRNN Language Model, GitHub, retrieved 2022-10-11
  16. 1 2 Cayley, John (2020). "Reading Language Art in Digital Media: Reconfigurations of Experimental Practices". In Colby, Georgina (ed.). Reading Experimental Writing. Edinburgh University Press. p. 200. ISBN   978-1-4744-4040-0.
  17. ↑ Henrickson, Leah (2020-05-29). "Authorship in Computer-Generated Texts". Oxford Research Encyclopedia of Literature. doi:10.1093/acrefore/9780190201098.013.1226. ISBN   978-0-19-020109-8 . Retrieved 2022-10-11.
  18. ↑ Wright, David Thomas Henry (2020). "Collaboration and authority in electronic literature" (PDF). TEXT: Journal of Writing and Writing Courses. 24 (2).
  19. ↑ Oviedo, Cynthia Patricia Villagómez (2022-06-28). "La interacción y el texto: Cruce de recursos en el arte electrónico". AusArt (in Spanish). 10 (1). doi:10.1387/ausart.23583. hdl: 10810/59061 . ISSN   2340-9134. S2CID   252296776.
  20. ↑ Erslev, Malthe Stavning (2023). "A Poetics of Misrepresentation: The Mimesis of Machine Learning in ReRites". In Ensslin, Astrid; Round, Julia; Thomas, Bronwen (eds.). The Routledge Companion to Literary Media. Routledge. ISBN   9781003119739.
  21. ↑ Ranaudo, Abegail (2019-10-27). "Making Art From Chaos: An Artificial Intelligence Poetry Reading | Fringe Arts". The Link. Retrieved 2022-10-11.
  22. ↑ Wright, David Thomas Henry (2022-10-04). "Digital Literary Creative Practice and COVID-19". Journal of Intercultural Studies. 43 (6): 897–910. doi:10.1080/07256868.2022.2128081. ISSN   0725-6868. S2CID   252723044.
  23. 1 2 Amerika, Mark (2022). My life as an artificial creative intelligence. Stanford, California. p. 57. ISBN   978-1-5036-3171-7. OCLC   1269411078.{{cite book}}: CS1 maint: location missing publisher (link)
  24. ↑ Husárová, Zuzana; Piorecký, Karel (2022). "reception of literature generated by artificial neural networks" (PDF). World Literature Studies. 14: 44–60. doi:10.31577/WLS.2022.14.1.4. S2CID   248305840.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.