Adaptive music

Last updated

In video games, adaptive music (also called dynamic or interactive music) is background music whose volume, rhythm or tune changes in response to specific events in the game.[ citation needed ]

Contents

History

Adaptive music was first[ citation needed ] used in the video game Frogger by Konami (1981), where the music would abruptly change once the player reached a safe point in the game.

Many of LucasArts' games used the iMUSE dynamic music system, from Monkey Island 2 onwards and including games like Dark Forces , Star Wars: TIE Fighter , Full Throttle and Grim Fandango . The iMUSE system is notable in that it segues seamlessly between different pieces of music rather than having an abrupt cut. [1] [2] [3] [4]

Later games which made notable use of similar dynamic music systems include the Deus Ex and Freespace series of games.

It is also a staple of the role-playing game genre, often being used to change the music when the player is in combat, such as in The Elder Scrolls III: Morrowind or Kingdom Come: Deliverance [5]

Horizontal and vertical techniques

The music in video or computer games and certain films is meant to draw the audience through a storyline using two distinct techniques: horizontal re-sequencing and vertical re-orchestration.

Horizontal re-sequencing is the method by which pre-composed segments of music can be re-shuffled according to a player’s choice of where they go in a storyline or environment. The most basic re-sequencing technique is to simply crossfade between two cues immediately. When the scenario changes, the first cue is faded out while the second cue fades in. A more elaborated technique when using this method is phrase branching. In this case the change to the next segment starts when the current musical phrase is ended. [6] A more sophisticated and flexible technique are dedicated transitions. Transitions are triggered when switching between different segments. These transitional elements make the changes musically fluent and therefore keep up the flow of music. [5]

Vertical re-orchestration is the technique of changing the mix of separate parts of an ongoing loop of music in relation to a player’s movement within the narrative of a game.[ citation needed ] Games, such as Halo 2 , employ a mixture of these techniques in the creation of their soundtracks. Street Fighter II and Mario Kart DS are examples of games which change the music's tempo under certain circumstances.

Algorithmic music

Instead of relying on individual tracks of audio such as in horizontal re-sequencing and vertical re-orchestration, some games automatically generate their content on the fly, such as the case of Spore , which uses an embedded version of the music software Pure Data to generate music to certain cues such as the addition of parts to your creature throughout the game. [7] Ape Out is another notable example, with a procedurally generated jazz percussion soundtrack that changes based on the intensity of the gameplay, as well as the actions and movement of the player. [8]

Soundtrack switching

Games may also employ two soundtracks and mix between them, as in the case of FTL: Faster Than Light , which has an "explore" and "battle" version of each track. When the player is in battle with another ship, the audio fades into the "battle" version. This "battle" version is usually similar to the "explore" version with the addition of drums and similar dark timbres. Because of this, the transition is rather smooth and doesn't ruin the player's immersion. This is in contrast to the invincibility theme in the Super Mario series which aims to stick out, making the change sudden and obvious.

Interactive blending of music and sound effects

Some video games, such as Rez and Extase , use sound effects triggered by the player's actions that are automatically delayed to stay in synchronization with the background music and that blend well with the music. Dead Space 2 is another example of this, in which the music during gameplay appears to be arranged into four layers, each are a stereo track identifying with a distinct level of fear. Each layer of music is then either individually or collectively mixed "on-the-fly" depending on a variety of variables in the game, such as distance the player is from Necromorphs. [9] This creates an interactive musical landscape in which the player's actions actively and instantaneously take part, enhance, shape and influence the music. On the box of Extase, such a music system, created by Stéphane Picq, was advertised with a sticker as "Interactive Music System."

As goal of the game

Music games such as Sound Shapes use adaptive music as the goal of the game. As the player gets better at the game (and collects more 'coins'), the soundtrack (which is entirely composed of the melodies and beats created by these 'coins') intensifies as a sign that they're doing well.

Other occurrences

Adaptive music was used notably in theatre in 2010 in the play 'Dom Duardos' from Gil Vicente, co-produced by Companhia Contigo Teatro and Grupo de Mímica e Teatro Oficina Versus, with music by Pedro Macedo Camacho. [10] [11]

See also

Related Research Articles

Video game music (VGM) is the soundtrack that accompanies video games. Early video game music was once limited to sounds of early sound chips, such as programmable sound generators (PSG) or FM synthesis chips. These limitations have led to the style of music known as chiptune, which became the sound of the first video games.

Sound design is the art and practice of creating soundtracks for a variety of needs. It involves specifying, acquiring or creating auditory elements using audio production techniques and tools. It is employed in a variety of disciplines including filmmaking, television production, video game development, theatre, sound recording and reproduction, live performance, sound art, post-production, radio, new media and musical instrument development. Sound design commonly involves performing and editing of previously composed or recorded audio, such as sound effects and dialogue for the purposes of the medium, but it can also involve creating sounds from scratch through synthesizers. A sound designer is one who practices sound design.

<span class="mw-page-title-main">Music video game</span> Video game genre

A music video game, also commonly known as a music game, is a video game where the gameplay is meaningfully and often almost entirely oriented around the player's interactions with a musical score or individual songs. Music video games may take a variety of forms and are often grouped with puzzle games due to their common use of "rhythmically generated puzzles".

Stéphane Picq is a French composer of video game music, primarily for ERE Informatique/Exxos and Cryo Interactive.

iMUSE is an interactive music system used in a number of LucasArts video games. The idea behind iMUSE is to synchronize music with the visual action in a video game so that the audio continuously matches the on-screen events and transitions from one musical theme to another are done seamlessly. iMUSE was developed in the early 1990s by composers Michael Land and Peter McConnell while working at LucasArts. The iMUSE system was patented by LucasArts in 1994, after being added to the fifth version of the SCUMM game engine in 1991.

<i>SSX on Tour</i> 2005 video game

SSX on Tour is a snowboarding and skiing game, the fourth title in the SSX series of video games for the GameCube, PlayStation 2, Xbox and PlayStation Portable. It was released in North America on October 11, 2005 and in the PAL region on October 21, 2005. The PlayStation Portable version was released in Europe on October 28, 2005. In 2007, a prequel titled SSX Blur was released, which took place between SSX 3 and SSX on Tour. The GameCube version contains Mario, Luigi, and Princess Peach as playable characters. This was part of a deal Nintendo had with EA Sports to have Nintendo's intellectual properties appear in EA franchises.

<i>Star Wars: X-Wing</i> (video game) 1993 video game

Star Wars: X-Wing is a space simulation video game, the first of the X-Wing combat flight simulation games series. The player's character flies starfighters, including the X-wing, for the Rebel Alliance. The narrative precedes and parallels the events of Star Wars Episode IV: A New Hope.

<span class="mw-page-title-main">Peter McConnell</span> American video game composer and musician

Peter Nelson McConnell, also known as Peter Mc, is an American video game composer and musician, best known for his work at LucasArts and for composing the soundtracks for every Sly Cooper game since the second installment.

<span class="mw-page-title-main">Grant Kirkhope</span> British composer

Grant Kirkhope is a Scottish composer and voice actor for video games and film. Some of his notable works include GoldenEye 007, Banjo-Kazooie, Donkey Kong 64, and Perfect Dark, among many others. He has been nominated for various BAFTA, ASCAP, and IFMCA awards.

<i>Star Wars: Episode I – The Phantom Menace</i> (soundtrack) 1999 film score by John Williams

Star Wars Episode I: The Phantom Menace – Original Motion Picture Soundtrack is the film score to the 1999 film of the same name, composed and conducted by John Williams, and performed by the London Symphony Orchestra, London Voices and the New London Children's Choir with orchestrations provided by Conrad Pope and John Neufeld. The soundtrack album was released by Sony Classical Records on May 4, 1999, two weeks before the film's theatrical release. In anticipation of the long-awaited film, the soundtrack was certified Platinum in the United States where it debuted and peaked on the Billboard 200 at number 3, and certified Gold in the United Kingdom, where it entered the UK album charts at number eight.

<span class="mw-page-title-main">Jack Wall (composer)</span> Video game music composer, born 1964

Jack Wall is an American video game music composer. He has worked on video game music for over 20 games including the Myst franchise, Splinter Cell, Jade Empire, Mass Effect, and Call of Duty. Wall earned a degree in civil engineering from Drexel University in Philadelphia, Pennsylvania, and, after a brief stint working in civil engineering, transitioned into music production. He worked with musicians such as John Cale, David Byrne, and Patti Smith, and, after performing increasingly complex production and sound engineering tasks, moved into music composition in 1995.

<span class="mw-page-title-main">Pedro Camacho</span> Portuguese composer

Pedro Macedo Camacho is a Portuguese composer of classical music as well as film and video game scores. He is best known for his scores to Star Citizen and World of Warcraft: Shadowlands.

Lux Æterna is an orchestral composition by Clint Mansell. Performed by the Kronos Quartet, it forms a leitmotif in the 2000 film Requiem for a Dream, and is the penultimate piece in the movie's soundtrack.

<i>Jimmy Whites 2: Cueball</i> 1999 video game

Jimmy White's 2: Cueball is a snooker and pool video game developed by Awesome Developments and published by Virgin Interactive as a sequel to Jimmy White's 'Whirlwind' Snooker. It was originally released in 1999 for Windows and Dreamcast. A PlayStation version was released in 2000 in Europe and North America, distributed and released by Bay Area Multimedia. Archer Maclean, the designer of the original game, led the development team. The game includes mini-games connected with a pub setting. A Game Boy Color version of the game was released in 2000. A sequel to Cueball, called Jimmy White's Cueball World, was released in Europe for the PC in 2001. The game received mixed reviews from critics, with the PC and Dreamcast versions faring better than the PlayStation port.

<i>Flower</i> (video game) 2009 video game

Flower is a video game developed by Thatgamecompany and published by Sony Computer Entertainment. It was designed by Jenova Chen and Nicholas Clark and was released in February 2009 on the PlayStation 3, via the PlayStation Network. PlayStation 4 and PlayStation Vita versions of the game were ported by Bluepoint Games and released in November 2013. An iOS version was released in September 2017, and a Windows version was released in February 2019, both published by Annapurna Interactive. The game was intended as a "spiritual successor" to Flow, a previous title by Chen and Thatgamecompany. In Flower, the player controls the wind, blowing a flower petal through the air using the movement of the game controller. Flying close to flowers results in the player's petal being followed by other flower petals. Approaching flowers may also have side-effects on the game world, such as bringing vibrant color to previously dead fields or activating stationary wind turbines. The game features no text or dialogue, forming a narrative arc primarily through visual representation and emotional cues.

Dynamic game difficulty balancing (DGDB), also known as dynamic difficulty adjustment (DDA) or dynamic game balancing (DGB), is the process of automatically changing parameters, scenarios, and behaviors in a video game in real-time, based on the player's ability, in order to avoid making the player bored or frustrated. The goal of dynamic difficulty balancing is to keep the user interested from the beginning to the end, providing a good level of challenge.

<i>Journey</i> (2012 video game) 2012 video game

Journey is an indie adventure game developed by Thatgamecompany, published by Sony Computer Entertainment, and directed by Jenova Chen. It was released for the PlayStation 3 via PlayStation Network in March 2012 and ported to PlayStation 4 in July 2015. It was later ported to Windows in June 2019 and iOS in August 2019.

The music for the 2011 neo-noir detective video game L.A. Noire, developed by Team Bondi and published by Rockstar Games, was composed by musicians Andrew Hale and Simon Hale. Recorded at Abbey Road Studios in London, the score also features contributions from Woody Jackson, who had collaborated with Rockstar on other projects both previously and since. Andrew Hale felt that composing the game's score was about setting a mood, attempting to compose music that felt accessible to players. The score was inspired by films from the 1940s, though the team avoided specifically composing for this time period, instead opting to focus on that after the music had been produced. Three supplementary vocal recordings were composed by The Real Tuesday Weld and performed by Claudia Brücken; they also sought to fit with the game's setting.

Ludomusicology is a field of academic research and scholarly analysis focusing on video game music, understood as the music found in video games and in related contexts. It is closely related to the fields of musicology and interactive and games audio research, and game music and audio are sometimes studied as a united phenomenon. Ludomusicology is also related to the field of game studies, as music is one element of the wider video game text and some theories on video game functions are directly relevant to music.

Music of <i>Grim Fandango</i> 1998 Grim Fandango video game music by Peter McConnell

The music for the video game Grim Fandango was composed and produced by Peter McConnell and published by LucasArts in 1998. The soundtrack is a mix of South American folk music, jazz, swing and big band sounds, for the game story filled with adventure and intrigue set in a unique combination of film noir and Mexican folklore's Day of the Dead. The soundtrack garnered critical acclaim and remained subject of positive reviews and inclusion in critics' rankings for the two decades after its first release. The soundtrack was praised both as a stand-alone musical experience, as well as for its outstanding contribution to the overall game experience; capturing the spirit of the game, "gluing" the story together, and becoming "integral" to the success of the game.

References

  1. Politis, Dionysios; Tsalighopoulos, Miltiadis; Iglezakis, Ioannis (June 27, 2016). Digital Tools for Computer Music Production and Distribution. IGI Global. p. 181. ISBN   978-1522502647.
  2. Sweet, Michael (October 2, 2014). Writing Interactive Music for Video Games: A Composer's Guide. Addison-Wesley Professional. p. 99. ISBN   978-0321961587. Frustrated with the state of music in games at the time, two composers at LucasArts Peter MccConnell and Michal Land created one of the first adaptive music systems, called iMuse. iMuse (Interactive MUsic Streaming Engine) let composers insert branch and loop markers into a sequence that would allow the music to change based on the decisions of the player. The iMuse engine was one of the first significant contributions to interactive music for video games. Its importance in shaping many of the techniques that you see in video games today cannot be overemphasized. (...) Other excellent iMuse titles includes Grim Fandango (1998), which features an incredible jazz-based soundtrack composed by Peter McConnell. (...)
  3. Moormann, Peter (August 11, 2012). Music and Game: Perspectives on a Popular Alliance. Springer VS. p. 90-91. ISBN   978-3531174099.
  4. Collins, Karen (August 8, 2008). Game Sound: An Introduction to the History, Theory, and Practice of Video. The MIT Press. p. 102, 146. ISBN   978-0262033787.
  5. 1 2 Sporka, Adam; Valta, Jan (2 October 2017). "Design and implementation of a non-linear symphonic soundtrack of a video game". New Review of Hypermedia and Multimedia. 23 (4): 229–246. Bibcode:2017NRvHM..23..229S. doi:10.1080/13614568.2017.1416682. S2CID   46835283.
  6. Sweet, Michael (13 June 2016). "Top 6 Adaptive Music Techniques in Games - Pros and Cons - Designing Music NOW". Designing Music Now. Archived from the original on 13 November 2018. Retrieved 13 November 2018.
  7. Wright, Steven (27 February 2019). "How 'Ape Out' Creates a Soundscape Worthy of Smashing". Variety. Variety Media.
  8. Kosak, Dave (20 February 2008). "Gamespy: The Beat Goes on: Dynamic Music in Spore". GameSpy. IGN Entertainment, Inc.
  9. Kamp, Michiel; Summers, Tim; Sweeney, Mark eds (2016) Ludomusicology : Approaches to Video Game Music. Sheffield: Equinox. pp 188-189. ISBN 9781781791974
  10. dnoticias, Newspaper news about Dom Duardos from Gil Vicente, archived from the original on 2011-10-07, retrieved 2011-01-15
  11. audiokinetic, Audiokinetic interview with Pedro Macedo Camacho (PDF), retrieved 2011-01-15