Stereoscopic video game

Last updated
The New Nintendo 3DS uses parallax barrier autostereoscopy to display a 3D image. New Nintendo 3DS.png
The New Nintendo 3DS uses parallax barrier autostereoscopy to display a 3D image.

A stereoscopic video game (also S-3D video game) is a video game which uses stereoscopic technologies to create depth perception for the player by any form of stereo display. Such games should not be confused with video games that use 3D game graphics on a mono screen, which give the illusion of depth only by monocular cues but lack binocular depth information.

Contents

Description

Stereoscopic video games have been available for several years for PCs through the Nvidia 3D Vision and other platforms including AMD HD3D, DDD TriDef [1] that use compatible hardware and active shutter 3D glasses. For video game consoles, however, stereoscopic 3D support must be specifically built into each game. Potential stereoscopic game support is available, for instance, on Xbox 360, PlayStation 3, Xbox One, Wii U and PlayStation 4. [2] Nintendo 3DS is fully designed for autostereoscopic games.

Although no longer considered a key feature for successful game development by as many as during the stereoscopic 3D hype in 2010, stereoscopic support for video games is still considered a minor enhancement to video games. Many individuals consider it to be the most significant enhancement to video games. [3] One of the reasons for the technology's lack of success was that the surprise effect quickly wears off. [4]

A HTC Vive that is designed for virtual reality gaming with stereo 3D graphics HTC Vive (11).jpg
A HTC Vive that is designed for virtual reality gaming with stereo 3D graphics

A study at the University of Derby showed that converted 2D games do not transfer very well to stereoscopic 3D and concluded: "... games targeted to stereoscopic 3D audiences and devices must be designed from the start with stereoscopic 3D in mind." Therefore, stereo video games must have elements that can only be achieved in S-3D for a proper stereoscopic immersion. [5]

For example, in the game Super Stardust HD , asteroids stand out from the plane. It makes navigation easier and serves a fundamental purpose. Super Mario 3D Land is another example for easier navigation and furthermore the game plays with depth, e.g. with Escher-style perspective puzzles. [3]

Developers also need to mind perceptual problems such as stereo window violations [6] and occlusion of virtual objects. [7] Another scientific paper showed that S3D vision can measurably change player behavior depending on actual game design. [8]

Recent developments of consumer virtual reality headsets such as for example Oculus Rift, HTC Vive, PlayStation VR, Fove, and Open Source Virtual Reality also include stereoscopic support as one of their features. [3] The entire development trend of games and other software for such head-mounted displays remains to be seen. [3]

Rendering techniques

There are two primary rendering techniques employed in stereoscopic video games: 2D + depth rendering, and dual rendered 3D. [9]

2D + depth rendering

This technique generates a second point of view from a single rendered image. It has an upper limit on how much parallax can be created. 2D+ can be compared to 2D to 3D conversion techniques for 3D films. Several video games for Xbox 360 and PS3 used this method. [9]

Dual rendering

This technique renders two images. It creates the best stereoscopic effect but has double system requirements for graphic rendering and higher production demands. [9]

History

1980s

Famicom 3D System, released in 1987 for Japan only Famicom-3D-System.jpg
Famicom 3D System, released in 1987 for Japan only

Sega released the world's first commercial stereoscopic video game, SubRoc-3D , in 1982. [10] This arcade game introduced an active shutter 3D system, jointly developed by Sega with Matsushita (now Panasonic). [11] In 1983, the first model of the TomyTronic series of gaming laptop LCD game & watch-type stereoscopic 3D was released by Takara Tomy. [12] A 3D imager for the console Vectrex vector, a pair of 3D glasses using a rotating color wheel synchronized with the display was released by Smith Engineering in 1984.

Battle Bird, developed by Irem, was released in Japan in January 1986, [13] and demonstrated at London's Amusement Trades Exhibition International (ATEI) show the same month. [14] It was a space shooter that used Irem's 3D Vision system, which displayed stereoscopic 3D color graphics using a complex 3D system consisting of a dual-monitor setup, a half-silvered mirror, and a viewer with a polarizing filter for each eye. [14] [15] Upon its debut in early 1986, Mike Roberts of Computer Gamer magazine called it "the best example of the 3D effect that" he had ever seen. [14] However, only a small number of arcade cabinets were manufactured. [15] Taito also developed an unsuccessful 3-D arcade game, followed by Namco with 3-D Thunder Ceptor II (1986), which generates 3-D images using LCD shutter glasses enhanced by a Fresnel lens placed between the glasses and video screen, giving the impression of large 3-D images coming near the player. [16]

In 1987, the shutter-based SegaScope 3D Glasses for the Sega Master System home console was released, [17] and the Famicom 3D System for Nintendo's Famicom (NES) was launched only in Japan but met with limited success. [18] The Taito Z System arcade game Continental Circus , the first stereoscopic 3D racing video game, [19] also released in 1987. The SegaScope 3D, Famicom 3D System and Continental Circus all used active shutter 3D glasses. In 1988, the X-Specs 3D glasses including 3D game SpaceSpuds for Amiga were brought out by Haitex.

1990s

In 1991, the Sega VR was announced and demonstrated, a virtual reality helmet that was never distributed. [20] [21] In 1993 Pioneer released the LaserActive system which had a bay for various "PAC's" including the Sega PAC and the NEC PAC. The unit was 3D capable with the addition of the LaserActive 3D goggles (GOL-1) and an adapter (ADP-1). The Virtual Boy was brought out in 1995, a console equipped with a virtual reality helmet that provided a stereoscopic rendering of 384x224 pixels per eye in monochrome (black and red) and for which 12 games were available in late 1995. Marketing was a dismal failure and production was halted in late 1996.[ citation needed ] SimulEyes PC VR goggles (a consumer version of CrystalEyes), bundled with the game Descent: Destination Saturn , was released in 1995. [22]

In early 1997, Sega demonstrated an early glasses-free 3D display system, called the Floating Image System. It displayed 3D imaging based on a multi-layer parallax system, and was presented by Sega AM3's general manager Hisao Oguchi. [23]

Metabyte produced Wicked Vision the first driver that made a half-resolution stereo (sync doubling) of more than fifty gaming PC (Glide, Direct3D and miniOpenGL) 3Dfx Voodoo2 graphics card with infrared glasses H3D in 1998. A year later, Elsa Revelator released a similar driver for Direct3D that provided full resolution (page flipping) for stereo 3D on different graphics cards.

2000s

The Glasstron by Sony, mounted on a clear head Glasstron.jpg
The Glasstron by Sony, mounted on a clear head

The GameCube (and Game Boy Advance to a lesser extent) had been built with Stereoscopic capabilities in mind, however the cost for the liquid crystals technology were prohibitively expensive at the time to make commercial sense. [24] [25] [26]

In 2001, NVIDIA brought out a driver based on Elsa technology that supported different types of glasses and screens, but only with their own graphics cards. The PUD-J5A for the PlayStation 2 was released in 2002, which incorporated virtual helmet technology (Glasstron) and was sold exclusively on the internet in Japan. It weighed 320 grams (11 oz), and used two screens of 108,000 pixels each (probably 450x240 pixels) [27] and had a single game (Energy Airforce Aim Strike! [28] ).

In 2005, the game Metal Gear Acid 2 was released on the PlayStation Portable from Sony with a stereoscopic rendering via the "Solid Eye" accessory that included a stereoscope lens cardboard that could never be reused. The EyeFX 3D shutter glasses for the PlayStation 2 was produced by SplitFish Gameware in 2006. This plugged into a joystick port of the console and added support for stereoscopic 3D in ten existing games. The 3D Vision kit for the latest generation of NVIDIA graphics cards was brought out in 2001, and combines a pair of LC shutter glasses as well as a wireless infrared transmitter connected to a USB driver for Windows.

2010s

In 2010, stereoscopic support for the PlayStation 3 was released via an automatic update of firmware. The new software includes a function for detection of 3D displays and a stereoscopic frame-buffer support. [29] The first games in stereoscopic 3D included Wipeout HD and Super Stardust HD [30] and coincided with the release of the 3D TV Bravia brand also by Sony. In the same year, a 3D Surround kit was brought out that works with the 3D Vision and several NVIDIA graphics cards with stereoscopic 3D support. The AMD HD3D added HDMI 1.4 support on ATI graphics cards for games in stereoscopic 3D using the drivers provided by iZ3D 3D stereo also in 2010.

In October 2010 Josef Kunz published the app 'Difficult' in the apple appstore, a skill game, that uses a Side-by-side view, the first available 3D game for handhelds.

The Nintendo 3DS, the first handheld with an autostereoscopic display using a parallax barrier and a resolution of 400x240 pixels per eye for stereoscopic 3D, was first produced in 2011. An XL version was released in 2012, as well as the non-stereoscopic Nintendo 2DS in 2013. This was followed by the New Nintendo 3DS and its XL version in 2015. These have a feature known as "Super Stable 3D", which uses a sensor to detect the viewing angle of the player and adjust the autostereoscopic display as required to maintain the same stereoscopic effect at a wider viewing angle. [31]

See also

Related Research Articles

<span class="mw-page-title-main">Virtual Boy</span> Video game console by Nintendo

The Virtual Boy is a 32-bit tabletop portable video game console developed and manufactured by Nintendo. Released in 1995, it was marketed as the first console capable of displaying stereoscopic "3D" graphics. The player uses the console like a head-mounted display, placing the head against the eyepiece to see a red monochrome display. The games use a parallax effect to create the illusion of depth. Sales failed to meet targets, and Nintendo ceased distribution and game development in 1996, having released only 22 games for the system.

<span class="mw-page-title-main">3D display</span> Display device

A 3D display is a display device capable of conveying depth to the viewer. Many 3D displays are stereoscopic displays, which produce a basic 3D effect by means of stereopsis, but can cause eye strain and visual fatigue. Newer 3D displays such as holographic and light field displays produce a more realistic 3D effect by combining stereopsis and accurate focal length for the displayed content. Newer 3D displays in this manner cause less visual fatigue than classical stereoscopic displays.

<i>Marios Tennis</i> 1995 video game

Mario's Tennis is a 1995 sports game developed by Nintendo for the Virtual Boy video game console. The game was released at the launch of the Virtual Boy, and later as a pack-in game in North America.

<span class="mw-page-title-main">Active shutter 3D system</span> Method of displaying stereoscopic 3D images

An active shutter 3D system is a technique of displaying stereoscopic 3D images. It works by only presenting the image intended for the left eye while blocking the right eye's view, then presenting the right-eye image while blocking the left eye, and repeating this so rapidly that the interruptions do not interfere with the perceived fusion of the two images into a single 3D image.

<span class="mw-page-title-main">Autostereoscopy</span> Any method of displaying stereoscopic images without the use of special headgear or glasses

Autostereoscopy is any method of displaying stereoscopic images without the use of special headgear, glasses, something that affects vision, or anything for eyes on the part of the viewer. Because headgear is not required, it is also called "glasses-free 3D" or "glassesless 3D". There are two broad approaches currently used to accommodate motion parallax and wider viewing angles: eye-tracking, and multiple views so that the display does not need to sense where the viewer's eyes are located. Examples of autostereoscopic displays technology include lenticular lens, parallax barrier, and may include Integral imaging, but notably do not include volumetric display or holographic displays.

<i>SubRoc-3D</i> 1982 video game

SubRoc-3D is a first-person arcade shooter game released in 1982 by Sega. It is the first commercial video game in stereoscopic 3-D, using a periscope-shaped display with a different image for each eye. It was jointly developed by Sega and Matsushita Electric, who developed its active shutter 3D system. The game has stereo sound, and also changes the backdrop to reflect day, night, dawn, and dusk.

<span class="mw-page-title-main">Parallax barrier</span>

A parallax barrier is a device placed in front of an image source, such as a liquid crystal display, to allow it to show a stereoscopic or multiscopic image without the need for the viewer to wear 3D glasses. Placed in front of the normal LCD, it consists of an opaque layer with a series of precisely spaced slits, allowing each eye to see a different set of pixels, so creating a sense of depth through parallax in an effect similar to what lenticular printing produces for printed products and lenticular lenses for other displays. A disadvantage of the method in its simplest form is that the viewer must be positioned in a well-defined spot to experience the 3D effect. However, recent versions of this technology have addressed this issue by using face-tracking to adjust the relative positions of the pixels and barrier slits according to the location of the user's eyes, allowing the user to experience the 3D from a wide range of positions. Another disadvantage is that the horizontal pixel count viewable by each eye is halved, reducing the overall horizontal resolution of the image.

Digital 3D is a non-specific 3D standard in which films, television shows, and video games are presented and shot in digital 3D technology or later processed in digital post-production to add a 3D effect.

<span class="mw-page-title-main">Virtuality (product)</span> Virtual reality gaming machine

Virtuality was a range of virtual reality machines produced by Virtuality Group, and found in video arcades in the early 1990s. The machines delivered real-time VR gaming via a stereoscopic VR headset, joysticks, tracking devices and networked units for a multi-player experience.

<span class="mw-page-title-main">Nintendo video game consoles</span> Overview of the various video game consoles released by Nintendo

The Japanese multinational consumer electronics company Nintendo has developed seven home video game consoles and multiple portable consoles for use with external media, as well as dedicated consoles and other hardware for their consoles. As of September 30, 2021, in addition to Nintendo Switch, Nintendo has sold over 863.07 million hardware units.

<span class="mw-page-title-main">Nintendo 3DS</span> Handheld game console

The Nintendo 3DS is a foldable handheld game console produced by Nintendo. The console was announced in March 2010 and unveiled at E3 2010 as the successor to the Nintendo DS. The system features backward compatibility with Nintendo DS video games. As an eighth-generation console, its primary competitor was Sony's PlayStation Vita.

Nvidia 3D Vision is a discontinued stereoscopic gaming kit from Nvidia which consists of LC shutter glasses and driver software which enables stereoscopic vision for any Direct3D game, with various degrees of compatibility. There have been many examples of shutter glasses. Electrically controlled mechanical shutter glasses date back to the middle of the 20th century. LCD shutter glasses appeared in the 1980s, one example of which is Sega's SegaScope. This was available for Sega's game console, the Master System. The NVIDIA 3D Vision gaming kit introduced in 2008 made this technology available for mainstream consumers and PC gamers.

<span class="mw-page-title-main">Famicom 3D System</span> Accessory for the Nintendo Family Computer

The Famicom 3D System is a Japan-exclusive accessory for the Nintendo Family Computer released in 1987.

<span class="mw-page-title-main">Nintendo 2DS</span> Handheld game console

The Nintendo 2DS is a handheld game console produced by Nintendo. Announced in August 2013, the device was released in North America, Europe and Australia on October 12, 2013. The Nintendo 2DS is an entry-level version of the Nintendo 3DS which maintains otherwise identical hardware, similar functionality, and compatibility with software designed for the Nintendo DS and 3DS. However, the 2DS is differentiated by a new slate form factor rather than the clamshell design used by its precursors and by lacking the Nintendo 3DS's signature autostereoscopic 3D display. The 2DS was sold concurrently with existing 3DS models as an incentive to expand the market for Nintendo 3DS games; former Nintendo of America president Reggie Fils-Aimé stated that the 2DS was primarily targeted towards younger players, whom Nintendo had previously advised not to use the 3D functionality on the 3DS due to potential eye health concerns. The Nintendo 2DS's successor, the New Nintendo 2DS XL, was launched in 2017.

3D Classics is a label applied to certain updates of old games for the Nintendo 3DS, with added stereoscopic 3D functionality and updated features while retaining their original art style and graphics. There are two unrelated series of releases under the 3D Classics title: a first-party series of NES/Famicom and arcade games, and a Sega-published, M2-developed set of classic Sega games, mostly from Sega Mega Drive/Genesis and Sega arcade hardware.

<i>Thunder Ceptor</i> 1986 video game

Thunder Ceptor is a 3D rail shooter arcade game that was released by Namco in 1986. It usurped both Libble Rabble and Toy Pop as the company's most powerful 8-bit arcade games, was the first game from them to use an analogue (360-degree) joystick. A stereoscopic 3-D sequel, 3-D Thunder Ceptor II, was released towards the end of the year.

<span class="mw-page-title-main">Virtual reality game</span> Video game played in virtual reality

A virtual reality game or VR games is a video game played on virtual reality (VR) hardware. Most VR games are based on player immersion, typically through head-mounted display unit or headset with stereoscopic displays and one or more controllers.

<span class="mw-page-title-main">Vergence-accommodation conflict</span> Visual and perceptual phenomenon

Vergence-accommodation conflict (VAC), also known as accommodation-vergence conflict, is a visual phenomenon that occurs when the brain receives mismatching cues between vergence and accommodation of the eye. This commonly occurs in virtual reality devices, augmented reality devices, 3D movies, and other types of stereoscopic displays and autostereoscopic displays. The effect can be unpleasant and cause eye strain.

References

  1. "MTBS GameGrade 3D". Gamegrade3d.com. Retrieved 2014-05-24.
  2. "Best and worst stereoscopic 3D console games (photos)". CNET. 2011-12-14. Retrieved 2014-05-24.
  3. 1 2 3 4 Leadbetter, Richard (23 June 2012). "What Went Wrong with Stereo 3D?". Eurogamer .
  4. Orland, Kyle (2012-07-15). "What happened to the stereoscopic gaming revolution?". Ars Technica. Retrieved 2014-05-24.
  5. Mahoney, N.; Oikonomou, A. (2011). "Stereoscopic 3D in video games: A review of current design practices and challenges". 2011 16th International Conference on Computer Games (CGAMES). IEEE. pp. 148–155. doi:10.1109/CGAMES.2011.6000331. ISBN   978-1-4577-1451-1. S2CID   15290066.
  6. Zerebecki, Chris; Stanfield, Brodie; Tawadrous, Mina; Buckstein, Daniel; Hogue, Andrew; Kapralos, Bill (1 January 2012). Woods, Andrew J; Holliman, Nicolas S; Favalora, Gregg E (eds.). "Interactive floating windows: a new technique for stereoscopic video games". Stereoscopic Displays and Applications XXIII. 8288: 82882L–82882L–8. Bibcode:2012SPIE.8288E..2LZ. doi:10.1117/12.906782. S2CID   62657173.
  7. Schild, Jonas; Seele, Sven; Masuch, Maic (2011). "Integrating Stereoscopic Video in 3D Games". Entertainment Computing – ICEC 2011. Lecture Notes in Computer Science. Vol. 6972. pp. 124–135. doi:10.1007/978-3-642-24500-8_13. ISBN   978-3-642-24499-5.
  8. Schild, Jonas; LaViola, Joseph J. Jr.; Masuch, Maic (1 January 2014). Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14. ACM. pp. 207–216. CiteSeerX   10.1.1.643.8866 . doi:10.1145/2556288.2557283. ISBN   978-1-4503-2473-1. S2CID   1091895.
  9. 1 2 3 "A Developer's Guide To Stereoscopic 3D In Games". Gamasutra. 2011-08-17. Retrieved 2014-06-14.
  10. Edwards, Benj (2011-03-03). "The History of Stereoscopic 3D Gaming". PCWorld. p. 3. Retrieved 2014-05-24.
  11. "The Arcade Flyer Archive - Video Game Flyers: Subroc-3D, Sega".
  12. "The top ten retro gaming secrets".
  13. "バトルバード" [Battle Bird]. Media Arts Database (in Japanese). Agency for Cultural Affairs. Retrieved 11 May 2021.
  14. 1 2 3 Roberts, Mike (March 1986). "Coin-Op Connection". Computer Gamer . No. 12. pp. 26–7.
  15. 1 2 "Battle Bird – 1987 Developer Interview". TV Game: Denshi Yuugi Taizen (in Japanese). ユー・ピー・ユー. 1988. ISBN   4-946432-31-0.
  16. "Overseas Readers Column" (PDF). Game Machine (in Japanese). No. 301. Amusement Press, Inc. 1 February 1987. p. 22.
  17. Beuscher, David. "Sega Master System - Overview". Allgame. Archived from the original on November 14, 2014. Retrieved March 31, 2014.
  18. Plunkett, Luke. Nintendo's First 3D Technology Shot A Spaceship At Mario's Face . Kotaku. 30 April 2010.
  19. "Continental Circus arcade game review".
  20. Horowitz, Ken (December 28, 2004). "Sega VR: Great Idea or Wishful Thinking?". Sega-16. Archived from the original on 2010-01-14. Retrieved 21 August 2010.
  21. "SegaVR". YouTube. Retrieved 30 December 2013.
  22. "Quick Hits". GamePro . No. 89. IDG. February 1996. p. 17.
  23. Electronic Gaming Monthly , issue 93 (April 1997), page 22
  24. Serrels, Mark (2011-01-07). "The Gamecube and the Game Boy Advance Were 3D Compatible!".
  25. "Iwata Asks".
  26. Beta64 (11 December 2012). "Beta64 - Luigi's Mansion" via YouTube.{{cite web}}: CS1 maint: numeric names: authors list (link)
  27. "Sony prepares sales of PUD-J5A head-mounted display". iXBT Labs. Retrieved 2014-05-25.
  28. "'Energy Airforce: Aim Strike!' (PS2) - Screens & Trailer". Worthplaying. 2005-02-10. Retrieved 2014-05-25.
  29. "100 Stereoscopic 3D PS3 Games Available". 3D Tested. 2012-05-28. Retrieved 2014-05-25.
  30. "3D PS3 Games List". 3D Tested. Retrieved 2014-05-25.
  31. "New 3DS XL Review". GameSpot. Retrieved 2023-05-08.