ReRites

Last updated

ReRites (also known as RERITES, ReadingRites, Big Data Poetry) is a literary work of "Human + A.I. poetry" by David Jhave Johnston that used neural network models trained to generate poetry which the author then edited. ReRites won the Robert Coover Award for a Work of Electronic Literature in 2022. [1]

Contents

About the project

The ReRites project began as a daily rite of writing with a neural network, expanded into a series of performances from which video documentation has been published online, [2] and concluded with a set of 12 books [3] and an accompanying book of essays [4] published by Anteism Books in 2019. In Electronic Literature, Scott Rettberg describes the early phases of the project in 2016, when it bore the preliminary name Big Data Poetry. [5]

Jhave (the artist name that David Jhave Johnston goes by) describes the process of writing ReRites as a rite: "Every morning for 2 hours (normally 6:30–8:30am) I get up and edit the poetic output of a neural net. Deleting, weaving, conjugating, lineating, cohering. Re-writing. Re-wiring authorship: hybrid augmented enhanced evolutionary". [6] There is video documentation of the writing process. [7]

The human editing of the neural network's output is fundamental to this project, and Jhave gives examples of both unedited text extracts and his edited versions in publications about the project. [8] Kyle Booten describes ReRites as "simultaneously dusty and outrageously verdant, monotonously sublime and speckled with beautiful and rare specimens". [9]

Performances

ReRites was first shared with an audience through a series of performances where audience members and poets would participate in reading the automatically generated texts, which appeared on screen so fast that human readers could barely keep up. This has been described as allowing participants to "re-discover[..] the peculiar pleasures of being embodied", [1] or, in Jhave's own words, as a space where human participants were "playing their wits and voices against an evocative infinite deep-learning muse". [6]

The first performance was at Brown University's Interrupt Festival in 2019. [6] It has been performed many times since, including at the Barbican Centre in London [10] and Anteism Books. [8]

For a single year Jhave published one book of poetry from the ReRites project each month. These twelve volumes are accompanied by a book of essays, [4] all published by Anteism Books. [11] The accompanying essays provide critical responses to the project from poets and scholars including Allison Parrish, Johanna Drucker, Kyle Booten, Stephanie Strickland, John Cayley, Lai-Tze Fan, Nick Montfort, Mairéad Byrne, and Chris Funkhouser. Allison Parrish notes elsewhere that these paratexts to ReRites serve a legitimising function for a genre of poetry that is not yet institutionally acknowledged. [12]

Technical details

Starting in 2016 under the name Big Data Poetry, Jhave generated poems using, in his own words, "neural network code (..) adapted from three corporate github-hosted machine-learning libraries: TensorFlow (Google), PyTorch (Facebook), and AWSD (SalesForce)". [13] He explains that the "models were trained on a customised corpus of 600,000 lines of poetry ranging from the romantic epoch to the 20th century avant garde". [14] Jhave maintains a GitHub repository with some of the code supporting ReRites. [15]

Reception

ReRites is described by John Cayley as "one of the most thorough and beautiful" poetic responses to machine learning. [16] The work's influence on the field of electronic literature was acknowledged in 2022, when the work won the Electronic Literature Organization's Robert Coover Award for a Work of Electronic Literature. The jury described ReRites as particularly poignant in the time of the pandemic, as it was "a documentation of the performance of the private ritual of writing and the obsessive-compulsive need for writers to communicate — even when no one else is reading". [1]

The question of authorship and voice in ReRites has been raised by several critics. [17] Although generated poetry is an established genre in electronic literature, Cayley notes that unlike the combinatory poems created by authors like Nick Montfort, where the author explicitly defines which words and phrases will be recombined, ReRites has "not been directed by literary preconceptions inscribed in the program itself, but only by patterns and rhythms pre-existing in the corpora". [16] In an essay for the Australian journal TEXT, David Thomas Henry Wright asks how to understand authorship and authority in ReRites: "Who or what is the authority of the work? The original data fed into the machine, that is not currently retrievable or discernible from the final works? The code that was taken and adapted for his purposes? Or Jhave, the human editor?" [18] Wright concludes that Jhave is the only actor with any intentionality and therefore the authority of the work. The centrality of the human editor is also emphasised by other scholars. [19] In a chapter analysing ReRites Malthe Stavning Erslev argues that the machine learning misrepresents the dataset it is trained on. [20]

While ReRites uses 21st century neural networks, it has been compared to earlier literary traditions. Poet Victoria Stanton, who read at one of the ReRites performances, has compared ReRites to found poetry, [21] while David Thomas Henry Wright compares it to the Oulipo movement [22] and Mark Amerika to the cut-up technique. [23] Scholars also position ReRites firmly within the long tradition of generative poetry both in electronic literature and print, stretching from the I Ching, Queneau's Cent Mille Milliards de Poemes and Nabokov's Pale Fire to computer-generated poems like Christopher Strachey's Love Letter Generator (1952) and more contemporary examples. [24] [5]

Jhave describes the process of working with the output from the neural network as "carving". In his book My Life as an Artificial Creative Intelligence, Mark Amerika writes that the "method of carving the digital outputs provided by the language model as part of a collaborative remix jam session with GPT-2, where the language artist and the language model play off each other’s unexpected outputs as if caught in a live postproduction set, is one I share with electronic literature composer David Jhave Johnston, whose AI poetry experiments precede my own investigations." [23]

Related Research Articles

Artificial intelligence (AI), in its broadest sense, is intelligence exhibited by machines, particularly computer systems. It is a field of research in computer science that develops and studies methods and software which enable machines to perceive their environment and uses learning and intelligence to take actions that maximize their chances of achieving defined goals. Such machines may be called AIs.

<span class="mw-page-title-main">Neural network (machine learning)</span> Computational model used in machine learning, based on connected, hierarchical functions

In machine learning, a neural network is a model inspired by the neuronal organization found in the biological neural networks in animal brains.

Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of statistical algorithms that can learn from data and generalize to unseen data, and thus perform tasks without explicit instructions. Recently, artificial neural networks have been able to surpass many previous approaches in performance.

Digital poetry is a form of electronic literature, displaying a wide range of approaches to poetry, with a prominent and crucial use of computers. Digital poetry can be available in form of CD-ROM, DVD, as installations in art galleries, in certain cases also recorded as digital video or films, as digital holograms, on the World Wide Web or Internet, and as mobile phone apps.

Electronic literature or digital literature is a genre of literature where digital capabilities such as interactivity, multimodality or algorithmic text generation are used aesthetically. Works of electronic literature are usually intended to be read on digital devices, such as computers, tablets, and mobile phones. They cannot be easily printed, or cannot be printed at all, because elements crucial to the work cannot be carried over onto a printed version.

<span class="mw-page-title-main">Nick Montfort</span> American poet & digital media professor

Nick Montfort is a poet and professor of digital media at MIT, where he directs a lab called The Trope Tank. He also holds a part-time position at the University of Bergen where he leads a node on computational narrative systems at the Center for Digital Narrative. Among his publications are seven books of computer-generated literature and six books from the MIT Press, several of which are collaborations. His work also includes digital projects, many of them in the form of short programs. He lives in New York City.

Mez Breeze is an Australian-based artist and practitioner of net.art, working primarily with code poetry, electronic literature, mezangelle, and digital games. Born Mary-Anne Breeze, she uses a number of avatar nicknames, including Mez and Netwurker. She received degrees in both Applied Social Science [Psychology] at Charles Sturt University in Bathurst, Australia in 1991 and Creative Arts at the University of Wollongong in Australia in 2001. In 1994, Breeze received a diploma in Fine Arts at the Illawarra Institute of Technology, Arts and Media Campus in Australia. As of May 2014, Mez is the only Interactive Writer and Artist who is a non-USA citizen to have her comprehensive career archive housed at Duke University, through their David M. Rubenstein Rare Book & Manuscript Library.

Music and artificial intelligence is the development of music software programs which use AI to generate music. As with applications in other fields, AI in music also simulates mental tasks. A prominent feature is the capability of an AI algorithm to learn based on past data, such as in computer accompaniment technology, wherein the AI is capable of listening to a human performer and performing accompaniment. Artificial intelligence also drives interactive composition technology, wherein a computer composes music in response to a live performance. There are other AI applications in music that cover not only music composition, production, and performance but also how music is marketed and consumed. Several music player programs have also been developed to use voice recognition and natural language processing technology for music voice control. Current research includes the application of AI in music composition, performance, theory and digital sound processing.

<span class="mw-page-title-main">Stephanie Strickland</span> American poet

Stephanie Strickland is a poet living in New York City. She has published ten volumes of print poetry and co-authored twelve digital poems. Her files and papers are being collected by the David M. Rubenstein Rare Book And Manuscript Library at Duke University.

Loss Pequeño Glazier is the creator of books of print poetry, digital poems, theoretical texts, and performance works. Glazier stands among literary figures at the "forefront of the digital poetics movement. A "distinguished writer of electronic poetry as well as a critic", according to N. Katherine Hayles, he is author of Luna Lunera, Anatman, Pumpkin Seed, Algorithm, Digital Poetics: the Making of E-Poetries, the first book-length study of digital poetry, and Small Press, as well as the major digital works, white faced bromeliads on 20 hectares, Io Sono at Swoons, and Territorio Libre (2003-2010). These three works are featured in his digital poetry performance film, Middle Orange | Media Naranja. His projects also include numerous poems, essays, film, visual art, sound, digital works, and projects for dance, music, installations, and performance. Glazier's poetic vision was the subject of an interview by David Jhave Johnston in 2012. His recent project, Luna Lunera: Poems al-Andalus is a ten-year project culminating in a collection of print poetry drawn from scores of digital, code, and performance iterations. Luna Lunera is co-presented on the Web as digital poems, solo readings and as dance performances.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is any visual artwork created through the use of artificial intelligence (AI) programs such as text-to-image models.

John Howland Cayley is a Canadian pioneer of writing in digital media as well as a theorist of the practice, a poet, and a Professor of Literary Arts at Brown University.

David Jhave Johnston is a Canadian poet, videographer, and motion graphics artist working chiefly in digital and computational media,. and a researcher at the Center for Digital Narrative at the University of Bergen. This artist's work is often attributed, simply, to the name Jhave.

Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020. Like its predecessor, GPT-2, it is a decoder-only transformer model of deep neural network, which supersedes recurrence and convolution-based architectures with a technique known as "attention". This attention mechanism allows the model to selectively focus on segments of input text it predicts to be most relevant. It uses a 2048-tokens-long context, float16 (16-bit) precision, and a hitherto-unprecedented 175 billion parameters, requiring 350GB of storage space as each parameter takes 2 bytes of space, and has demonstrated strong "zero-shot" and "few-shot" learning abilities on many tasks.

<span class="mw-page-title-main">GPT-2</span> 2019 text-generating language model

Generative Pre-trained Transformer 2 (GPT-2) is a large language model by OpenAI and the second in their foundational series of GPT models. GPT-2 was pre-trained a dataset of 8 million web pages. It was partially released in February 2019, followed by full release of the 1.5-billion-parameter model on November 5, 2019.

<span class="mw-page-title-main">Samantha Gorman</span> Writer and narrative designer

Samantha Gorman is an American game developer known for her combination of narrative, theatricality and gaming in VR environments, and for introducing gestural interactions in touchscreen narratives. She has won multiple awards for her work, both in the field of games and in electronic literature and new media writing. Gorman co-founded the computer art and games studio Tender Claws in 2014 and has been an assistant professor at Northeastern University since 2020.

<span class="mw-page-title-main">Text-to-image model</span> Machine learning model

A text-to-image model is a machine learning model which takes an input natural language description and produces an image matching that description.

Generative literature is poetry or fiction that is automatically generated, often using computers. It is a genre of electronic literature, and also related to generative art.

Pry is a 2014 interactive digital novella for iPad created by Samantha Gorman and Daniel Cannizzaro, which follows an American ex-soldier named James after he returns home from the first Gulf War. The novella combines text, haptic gestures, audio, and video to convey James's struggles with issues such as PTSD and his worsening eyesight as he works as a demolition expert.

References

  1. 1 2 3 Snyder, R. (2022-10-04). "Announcing the 2022 ELO Prizes – Electronic Literature Organization". Electronic Literature Organization. Retrieved 2022-10-11.
  2. Johnston, David (Jhave) (2021-03-01), ReRites : Human + A.I. Poetry Project (2016–2019) , retrieved 2022-10-11
  3. "RERITES : machine learning poetry edited by a human". glia.ca. Retrieved 2022-10-11.
  4. 1 2 Strickland, Stephanie, ed. (2019). ReRites : human + A.I. poetry; Raw output : A.I. trained on custom poetry corpus; Responses : 8 essays about poetry and A.I. Stephanie Strickland. Montreal, Quebec. ISBN   978-1-926968-50-6. OCLC   1110014654.{{cite book}}: CS1 maint: location missing publisher (link)
  5. 1 2 Rettberg, Scott (2019). Electronic literature. Cambridge, UK. ISBN   978-1-5095-1681-0. OCLC   1038024013.{{cite book}}: CS1 maint: location missing publisher (link)
  6. 1 2 3 Johnston, David Jhave (2019-06-13). "ReRites (& ReadingRites)". Proceedings of the 2019 on Creativity and Cognition. C&C '19. New York, NY, USA: Association for Computing Machinery. pp. 444–448. doi:10.1145/3325480.3329182. ISBN   978-1-4503-5917-7. S2CID   189895861.
  7. Johnston, David (Jhave) (2018-04-07), 07-04-2018 RERITES (writing process 4xspeed) , retrieved 2022-10-11
  8. 1 2 Stanton, Victoria (2019-10-22). "Performance at Anteism Books – Jhave's ReRites Revisited". Bank of Victoria. Retrieved 2022-10-11.
  9. Booten, Kyle (2019). "Harvesting ReRites". In Johnston, David Jhave (ed.). ReRites: Human + A.I. Poetry + Raw Output + Responses (PDF). Montréal: Anteism.
  10. "ReRites: Human and AI poetry | Barbican". www.barbican.org.uk. 22 May 2019. Retrieved 2022-10-11.
  11. "ReRites - David (Jhave) Johnston". Anteism Books. Retrieved 2022-10-11.
  12. Parrish, Allison (2022-06-28). "Material paratexts". Allison Posts. Retrieved 2022-10-11.
  13. Johnston, David Jhave. "RERITES : machine learning poetry edited by a human". glia.ca. Retrieved 2022-10-11.
  14. Johnston, David Jhave. "About – BDP". Big Data Poetry. Retrieved 2022-10-11.
  15. jhave (2019-06-27), Adapted AWD-LSTM / AWD-QRNN Language Model, GitHub, retrieved 2022-10-11
  16. 1 2 Cayley, John (2020). "Reading Language Art in Digital Media: Reconfigurations of Experimental Practices". In Colby, Georgina (ed.). Reading Experimental Writing. Edinburgh University Press. p. 200. ISBN   978-1-4744-4040-0.
  17. Henrickson, Leah (2020-05-29). "Authorship in Computer-Generated Texts". Oxford Research Encyclopedia of Literature. doi:10.1093/acrefore/9780190201098.013.1226. ISBN   978-0-19-020109-8 . Retrieved 2022-10-11.
  18. Wright, David Thomas Henry (2020). "Collaboration and authority in electronic literature" (PDF). TEXT: Journal of Writing and Writing Courses. 24 (2).
  19. Oviedo, Cynthia Patricia Villagómez (2022-06-28). "La interacción y el texto: Cruce de recursos en el arte electrónico". AusArt (in Spanish). 10 (1). doi:10.1387/ausart.23583. hdl: 10810/59061 . ISSN   2340-9134. S2CID   252296776.
  20. Erslev, Malthe Stavning (2023). "A Poetics of Misrepresentation: The Mimesis of Machine Learning in ReRites". In Ensslin, Astrid; Round, Julia; Thomas, Bronwen (eds.). The Routledge Companion to Literary Media. Routledge. ISBN   9781003119739.
  21. Ranaudo, Abegail (2019-10-27). "Making Art From Chaos: An Artificial Intelligence Poetry Reading | Fringe Arts". The Link. Retrieved 2022-10-11.
  22. Wright, David Thomas Henry (2022-10-04). "Digital Literary Creative Practice and COVID-19". Journal of Intercultural Studies. 43 (6): 897–910. doi:10.1080/07256868.2022.2128081. ISSN   0725-6868. S2CID   252723044.
  23. 1 2 Amerika, Mark (2022). My life as an artificial creative intelligence. Stanford, California. p. 57. ISBN   978-1-5036-3171-7. OCLC   1269411078.{{cite book}}: CS1 maint: location missing publisher (link)
  24. Husárová, Zuzana; Piorecký, Karel (2022). "reception of literature generated by artificial neural networks" (PDF). World Literature Studies. 14: 44–60. doi:10.31577/WLS.2022.14.1.4. S2CID   248305840.