Streaming audio in video games

Last updated

In video games, music can be streamed, where the audio is pre-recorded and played back when required. While early video games were restricted to sequenced music, streaming music has become a more viable option as technology has improved.

Contents

History

Arcade games

Early video game streaming was analog, sourced from a cassette tape inside an arcade cabinet. In the case with certain games that used FMV sequences, or were based entirely upon some type of video like 1983's Astron Belt and Dragon's Lair , carried audio streamed with the video. However, the continued reliance of arcade games on solid-state memory as opposed to optical media resulted in less use of streamed audio until the release of games such as Killer Instinct . This game used a magnetic hard drive with a comparatively high capacity and played back audio streams from the drive. Exceptions included the genre of rhythm games, which, by their nature, number music as an integral feature. Currently, many arcade game platforms are based either on similar home-console technology, or general purpose computers using x86 architecture.

Console games

Early console games with streaming audio were on CD-based systems such as the PC Engine CD-ROM² System in 1988, and the CD-i and Mega CD in 1991. With their increased storage size over previous media such as cartridges, streaming audio and video could be added to games. These games typically used Mixed Mode CD audio, similar to audio CDs, except on a Mixed Mode CD, the data and audio coexist. Because of this, many early games with streaming audio can be played in any CD player, although the first track, which typically makes up the game itself, will either not play or result in an unpleasant screeching noise which can damage the listener's speakers.

Some of the earliest examples of Mixed Mode CD audio in video games was the Ys series, composed by Yuzo Koshiro and Mieko Ishikawa, and arranged by Ryo Yonemitsu for the PC Engine from 1989. The Ys soundtracks, particularly Ys I & II (1989), are still regarded as some of the best and most influential video game music ever composed. [1] [2] [3]

By the fifth generation of video game consoles, the majority of games with streaming audio adopted audio formats other than CD audio, which offered flexibility in sound quality and looping, where a track can repeat seamlessly until it is no longer needed, for example, until the end of a stage.

Computer games

Streaming audio in computer games came about with the advent of improved sound cards. Early sound cards had support for playing back sequenced but not streamed audio. It wasn't until Creative Labs's Sound Blaster series, introduced in 1989, that PCs became capable of playing back pre-recorded audio. However, the early Sound Blasters' streaming audio support was not widely made use of, and only with the 1992 release of the Sound Blaster 16, did the use of pre-recorded audio begin to catch on.

Benefits and drawbacks

Use of streaming audio does not lack any limitations on sound quality, where sequenced music is limited by the number of synthesized voices available and the quality of the wavetable (or sample) used by the sequencer. The instrumentation of streaming audio is limited only by a developer's capacity to record and master the audio. However, this complexity requires that audio streams be much larger in file size than sequences. Also, where sequenced audio can include dynamic shifts, such as additional orchestration during battle scenes, etc., streamed audio cannot. Some games, such as Super Mario Galaxy (2007), [4] work around this by synchronizing sequenced and streaming audio so that additional effects can be added to the streamed music.

Related Research Articles

Neo Geo (system) Cartridge-based arcade system board and home video game console

The Neo Geo, stylised as NEO•GEO, also written as NEOGEO, is a cartridge-based arcade system board and fourth-generation home video game console released on April 26, 1990, by Japanese game company SNK Corporation. It was the first system in SNK's Neo Geo family. The Neo Geo was marketed as 24-bit; its CPU is technically a 16/32-bit 68000-based system with an 8/16-bit Z80 coprocessor, while its GPU chipset has a 24-bit graphics data bus.

Sound card internal computer expansion card that facilitates the input and output of audio signals

A sound card is an internal expansion card that provides input and output of audio signals to and from a computer under control of computer programs. The term sound card is also applied to external audio interfaces used for professional audio applications.

Chiptune electronic music genre based on 8-bit sounds

Chiptune, also known as chip music, is a style of synthesized electronic music made using the programmable sound generator (PSG) sound chips or synthesizers in vintage arcade machines, computers and video game consoles. The term is commonly used to refer to tracker format music which intentionally sounds similar to older PSG-created music, as well as music that combines PSG sounds with modern musical styles. It has been described as "an interpretation of many genres" since any existing song can be arranged in a chiptune style defined more by choice of instrument and timbre than specific style elements.

In multimedia, Motion JPEG is a video compression format in which each video frame or interlaced field of a digital video sequence is compressed separately as a JPEG image. Originally developed for multimedia PC applications, M-JPEG is now used by video-capture devices such as digital cameras, IP cameras, and webcams, as well as by non-linear video editing systems. It is natively supported by the QuickTime Player, the PlayStation 3 console, and web browsers such as Safari, Google Chrome, Mozilla Firefox and Microsoft Edge.

<i>Sonic the Hedgehog</i> (8-bit video game) 8-bit 1991 platform video game

Sonic the Hedgehog is a 1991 side-scrolling platform game and companion to the 16-bit Sega Genesis game of the same name for the 8-bit Game Gear and Master System consoles. Ancient—a studio founded by composer Yuzo Koshiro for the project—developed the game and Sega published it to promote the handheld Game Gear. The 8-bit Sonic is similar in style to its Genesis predecessor, but reduced in complexity to fit the 8-bit systems. It was released for the Game Gear on December 28, 1991, and for the Master System around the same time. It was later released through Sonic game compilations and Nintendo's Virtual Console.

Yamaha YM2612 FM synthesis sound chip by Yamaha

The YM2612, a.k.a. OPN2, is a sound chip developed by Yamaha. It belongs to Yamaha's OPN family of FM synthesis chips used in several game and computer systems.

Video game music is the soundtrack that accompanies video games. Early video game music was once limited to simple melodies of early sound synthesizer technology. These limitations inspired the style of music known as chiptunes, which combines simple melodic styles with more complex patterns or traditional music styles, and became the most popular sound of the first video games.

Ys is a series of action role-playing games developed by Nihon Falcom. The first game in the series, Ys I: Ancient Ys Vanished, was released on the NEC PC-8801 in 1987. Ys games have also appeared on the Sharp X1, MSX2, FM-7, NEC PC-9801, Sharp X68000, Master System, Sega Genesis, Sega Saturn, Famicom, NES, Nintendo DS, Microsoft Windows, PlayStation 2, PlayStation Portable, TurboGrafx-CD, Apple IIGS, mobile phones, Super NES, PlayStation Vita, PlayStation 4, Nintendo Switch, and Xbox One. As of 2017, the series had sold over 4.8 million copies worldwide.

A full motion video (FMV) is a video game narration technique that relies upon pre-recorded video files to display action in the game. While many games feature FMVs as a way to present information during cutscenes, games that are primarily presented through FMVs are referred to as full-motion video games or interactive movies.

The digital sound revolution refers to the widespread adoption of digital audio technology in the computer industry beginning in the 1980s.

<i>Streets of Rage</i> (video game) 1991 video game

Streets of Rage is a side-scrolling beat 'em up video game developed and published by Sega for the Mega Drive/Genesis in 1991. The game was later converted for the Game Gear, Sega CD and Master System and was later rereleased as part of various compilations, as well as onto various download services.

Nihon Falcom Corporation (日本ファルコム株式会社) is a Japanese video game developer of role-playing video games, most notably the Ys, The Legend of Heroes, and Trails series. The company was founded in 1981, making them one of the oldest game developers still active. They are credited with pioneering the action role-playing game genre, the Japanese role-playing game industry, and the development of the personal computer software industry in Japan overall.

<i>The Revenge of Shinobi</i> 1989 video game

The Revenge of Shinobi, released in Japan as The Super Shinobi, is a video game developed and published by Sega in 1989. It was the first Shinobi game developed for the Sega Genesis, and was later released on the coin-operated version of that console, the Mega-Tech.

Yuzo Koshiro Japanese video game music composer, electronic music producer, and audio programmer

Yuzo Koshiro is a Japanese video game musician programmer, and president of the game development company Ancient. He is often regarded as one of the most influential innovators in chiptune and video game music, producing music in a number of genres, including various electronic genres, experimental, symphonic, hip hop, jazz, and synth-rock.

<i>Streets of Rage 2</i> 1992 video game

Streets of Rage 2, released in Japan as Bare Knuckle II: The Requiem of the Deadly Battle, is a side-scrolling beat 'em up video game published by Sega in 1992 for the Mega Drive/Genesis and developed by an ad hoc team of several companies: Sega, Ancient, Shout! Designworks, MNM Software and H.I.C. It is the second game in the Streets of Rage series, a sequel to Streets of Rage and followed by Streets of Rage 3 and Streets of Rage 4.

Pre-rendering is the process in which video footage is not rendered in real-time by the hardware that is outputting or playing back the video. Instead, the video is a recording of footage that was previously rendered on different equipment. Pre-rendered assets may also be outsourced by the developer to an outside production company. Such assets usually have a level of complexity that is too great for the target platform to render in real-time.

A mixed mode CD is a Compact Disc which contains both data and audio in one session. Typically the first track is a data track while the rest are audio tracks. The most common use for mixed mode CDs is to add CD-quality audio to video games on a CD.

<i>Ys I: Ancient Ys Vanished</i> Action roie-playing video game produced by Nihon Falcom

Ys: The Vanished Omens is the first installment of Ys, an action role-playing video game series developed by Nihon Falcom in 1987. The name is commonly misspelled Y's due to an error on the packaging of an English-language release.

Music of the <i>Streets of Rage</i> series Albums discography

The Streets of Rage series of beat 'em up action video games by Sega are known for their memorable in-game electronic music, produced by noted video game music composer Yuzo Koshiro. The series has inspired three soundtracks featuring music from the games.

<i>Ys I & II</i> 1989 video game

Ys I & II is an action role-playing video game compilation for the TurboGrafx-CD released in 1989 by Hudson Soft/NEC. It consists of enhanced remakes of the first two Ys games developed and published by Nihon Falcom for the PC-8801 home computer in Japan. It was released as Ys Book I & II for the TurboGrafx-CD in North America in 1990, and was a pack-in title for the TurboDuo in 1992. Ys I & II was released on the Virtual Console in Japan on October 2007, and worldwide the following year.

References

  1. Kalata, Kurt (2010-11-27). "Ys". Hardcore Gaming 101. Retrieved 3 September 2011.
  2. Ryan Mattich. "Falcom Classics II". RPGFan. Retrieved 3 September 2011.
  3. Chris Greening & Don Kotowski (February 2011). "Interview with Yuzo Koshiro". Square Enix Music Online. Retrieved 2011-06-20.
  4. Iwata, Satoru; Kondo, Koji; Yokota, Mahito; Kawamuri, Masafumi. Interview with the Super Mario Galaxy sound team. Wii.com. Retrieved on April 26, 2008 Archived September 29, 2011, at the Wayback Machine

Stream players