Immersion (virtual reality)

Last updated
A woman using the Manus VR glove development kit in 2016 ManusVR Glove 2016.png
A woman using the Manus VR glove development kit in 2016

In virtual reality (VR), immersion is the perception of being physically present in a non-physical world. The perception is created by surrounding the user of the VR system in images, sound or other stimuli that provide an engrossing total environment.

Contents

Etymology

The name is a metaphoric use of the experience of submersion applied to representation, fiction or simulation. Immersion can also be defined as the state of consciousness where a "visitor" (Maurice Benayoun) or "immersant" (Char Davies) has their awareness of their physical self transformed by being surrounded in an artificial environment. The term is used to describe partial or complete suspension of disbelief, enabling action or reaction to stimulations encountered in a virtual or artistic environment. The greater the suspension of disbelief, the greater the degree of presence achieved.

Types

According to Ernest W. Adams, [1] immersion can be separated into three main categories:

Staffan Björk and Jussi Holopainen, in Patterns In Game Design, [2] divide immersion into similar categories, but call them sensory-motoric immersion, cognitive immersion and emotional immersion, respectively. In addition to these, they add a new category: spatial immersion, which occurs when a player feels the simulated world is perceptually convincing. The player feels that he or she is really "there" and that a simulated world looks and feels "real".

Presence

"10.000 moving cities", a telepresence-based installation artwork by Marc Lee 10'000 moving cities V3, net-and-telepresence-based installation, 2015.jpg
"10.000 moving cities", a telepresence-based installation artwork by Marc Lee

Presence, a term derived from the shortening of the original "telepresence", is a phenomenon enabling people to interact with and feel connected to the world outside their physical bodies via technology. It is defined as a person's subjective sensation of being there in a scene depicted by a medium, usually virtual in nature. [4]

Most designers focus on the technology used to create a high-fidelity virtual environment; however, the human factors involved in achieving a state of presence must be taken into account as well. It is the subjective perception, although generated by and/or filtered through human-made technology, that ultimately determines the successful attainment of presence. [5]

Virtual reality glasses can produce a visceral feeling of being in a simulated world, a form of spatial immersion called Presence. According to Oculus VR, the technology requirements to achieve this visceral reaction are low-latency and precise tracking of movements. [6] [7] [8]

Michael Abrash gave a talk on VR at Steam Dev Days in 2014. [9] According to the VR research team at Valve, all of the following are needed to establish presence.

Immersive media and technology

Immersive media is a term applied to a group of concepts, [10] variously defined, which may have application in fields such as engineering, media, healthcare, education and retail. [11] Concepts included in immersive media are:

Technology

Engineer research psychologist from the Naval Research Laboratory (NRL) demonstrates the Infantry Immersive Trainer (IIT), one of several Virtual Training Environment projects (VIRTE). US Navy 070801-N-7676W-084 Joe Coyne, engineer research psychologist, Naval Research Laboratory (NRL), demonstrates the Infantry Immersive Trainer (IIT), one of several Virtual Training Environment projects (VIRTE).jpg
Engineer research psychologist from the Naval Research Laboratory (NRL) demonstrates the Infantry Immersive Trainer (IIT), one of several Virtual Training Environment projects (VIRTE).
A version of modern virtual reality goggles that would be used today Exploring the Universe in Virtual Reality.jpg
A version of modern virtual reality goggles that would be used today

Immersive virtual reality is a technology that aims to completely immerse the user inside the computer generated world, giving the impression to the user that they have "stepped inside" the synthetic world. [13] This is achieved by either using the technologies of Head-Mounted Display(HMD) or multiple projections. HMD allows VR to be projected right in front of the eyes and allows users to focus on it without any distraction. [14] The earliest attempts at developing immersive technology date back to the 1800s. Without these early attempts, the world of immersive technology would never have reached its advanced technological state we have today. The many elements that surround the realm of immersive technology all come together in different ways to create different types of immersive technology including virtual reality and pervasive gaming. [15] While immersive technology has already had an immense impact on our world, its progressive growth and development will continue to make lasting impacts among our technological culture.

Origin

One of the first devices that was designed to look like and function as a virtual reality headset was called a stereoscope. It was invented in the 1830s during the early days of photography, and it used a slightly different image in each eye to create a kind of 3D effect. [16] Although as photography continued to develop in the late 1800s, stereoscopes became more and more obsolete. Immersive technology became more available to the people in 1957 when Morton Heilig invented the Sensorama cinematic experience that included speakers, fans, smell generators, and a vibrating chair to immerse the viewer in the movie. [14] When one imagines the VR headsets they see today, they must give credit to The Sword of Damocles which was invented in 1968 and allowed users to connect their VR headsets to a computer rather than a camera. In 1991, Sega launched the Sega VR headset which was made for arcade/home use, but only the arcade version was released due to technical difficulties. [14] Augmented reality began to rapidly develop within the 1990s when Louis Rosenberg created Virtual Fixtures, which was the first fully immersive augmented reality system, used for the Air Force. The invention enhanced operator performance of manual tasks in remote locations by using two robot controls in an exoskeleton. [14] The first introduction of augmented reality displayed to a live audience was in 1998, when the NFL first displayed a virtual yellow line to represent the line of scrimmage/first down. In 1999, Hirokazu Kato developed the ARToolkit, which was an open source library for the development of AR applications. This allowed people to experiment with AR and release new and improved applications. [14] Later, in 2009 Esquire's magazine was the first to use a QR code on the front of their magazine to provide additional content. Once The Oculus came out in 2012, it revolutionized virtual reality and eventually raised 2.4 million dollars and began releasing their pre-production models to developers. Facebook purchased Oculus for 2 billion dollars in 2014, which showed the world the upward trajectory of VR. [14] In 2013, Google announced their plans to develop their first AR headset, Google Glass. The production stopped in 2015 due to privacy concerns, but relaunched in 2017 exclusively for the enterprise. In 2016, Pokémon Go took the world by storm and became one of the most downloaded apps of all time. It was the first augmented reality game that was accessible through ones phone.

Elements of immersive technology

Man uses immersive technology headset and hand controls to complete the stage of a virtual reality video game. Reality check ESA384313.jpg
Man uses immersive technology headset and hand controls to complete the stage of a virtual reality video game.

A full immersive technology experience happens when all elements of sight, sound, and touch come together. A true immersive experience needs to be done with either virtual reality or augmented reality, as these two types utilize all of these elements. [17] Interactivity and connectivity is the entire focus of immersive technology. It is not placing someone in an entirely different environment, it is when they are virtually presented with a new environment and are given the opportunity to learn how to optimally live and interact with it.

Types of immersive technology

Virtual reality is the primary source of immersive technology that allows the user to be completely immersed in a fully digital environment that replicates another reality. [18] Users must use a headset, hand controls, and headphones in order to have a fully immersive experience where one is able to utilize movements/reflects. [15] There are also pervasive games which utilize real world locations within game play. [18] This is when the user's interaction on a virtual game lead to them interacting in real life. Some of these games may require users to physically meet up in order to complete stages. [18] The gaming world has developed a series of popular virtual reality video games, such as Vader Immortal , Trover Saves the Universe , and No Man's Sky . [19] The world of immersive technology has many facets that will continue to develop/expand over time.

Immersive technology today

Immersive technology has grown immensely in the past few decades, and is continuing to progress. VR has even been described as the learning aid of the 21st century. [20] Head mounted displays (HMD) is what allows users to get the full immersive experience. The HMD market is expected to be worth over 25 billion USD by the year 2022. [20] The technologies of VR and AR received a boost in attention when Mark Zuckerberg, founder/creator of Facebook, bought Oculus for 2 billion USD in 2014. [21] Recently, the Oculus quest was released, which is wireless and allows users to move more freely. It costs around 400 USD which is around the same price as the previous generation headsets with cables. [20] Other massive corporations such as, Sony, Samsung, HTC are also making huge investments into VR/AR. [21] In regards to education, there are currently many researchers who are exploring the benefits and applications of virtual reality in the classroom. [20] However, there is little systemic work that currently exists regarding how researchers have applied immersive VR for higher education purposes using HMD's. [20] The most popular use of immersive technology comes in the world of video games. Completely immersing users into their favorite game, HMD's have allowed individuals to experience the realm of video games in an entirely new light. [22] Current video games such as Star Wars: Squadron, Half-Life: Alyx, and No Man's Sky are giving users the ability to experience every aspect of the digital world in their game. [22] While there is still a lot to learn about immersive technology and what it has to offer, it has come an entirely long way from its beginning on the early 1800s.

Child discovering the applications of immersive technology through a virtual reality headset Pexels-julia-m-cameron-4145251.jpg
Child discovering the applications of immersive technology through a virtual reality headset

Components

Perception

Hardware technologies are developed to stimulate one or more of the senses to create perceptually real sensations. Some vision technologies are 3D displays, fulldomes, head-mounted displays, and holography. Some auditory technologies are 3D audio effects, high-resolution audio, and surround sound. Haptic technology simulates tactile responses.

Interaction

Various technologies provide the ability to interact and communicate with the virtual environment, including brain-computer interfaces, gesture recognition, omnidirectional treadmills, and speech recognition.

Software

Software interacts with the hardware technology to render the virtual environment and process the user input to provide dynamic, real-time response. To achieve this, software often integrates components of artificial intelligence and virtual worlds. This is done differently depending on the technology and environment; Whether the software needs to create a fully immersive environment or display a projection on the already existing environment the user is looking at.

Research and development

Many universities have programs that research and develop immersive technology. Examples are Stanford's Virtual Human Interaction Lab, USC's Computer Graphics and Immersive Technologies Lab, Iowa State Virtual Reality Applications Center, University of Buffalo's VR Lab, Teesside University's Intelligent Virtual Environments Lab, Liverpool John Moores University's Immersive Story Lab, University of Michigan Ann Arbor, Oklahoma State University and the University of Southern California. [23] All of these universities and more are researching the advancement of the technology along with the different uses that VR could be applied to. [24]

As well universities the video game industry has received a massive boost from immersive technology specifically Augmented reality. The company Epic games known for their popular game Fortnite generated 1.25 billion dollars in a round of investing in 2018 as they have a leading 3D development platform for AR apps. [25] The U.S. Government requests information for immersive technology development [26] and funds specific projects. [27] This is for implementation in government branches in the future.

Application

Immersive technology is applied in several areas, including retail and e-commerce, [28] the adult industry, [29] art, [30] entertainment and video games and interactive storytelling, military, education, [31] [32] and medicine. [33] It is also growing in the Non-profit industry in fields such as disaster relief and conservation due to its ability to put a user in a situation that would elicit more of a real-world experience than just a picture giving them a stronger emotional connection to the situation they would be viewing. As immersive technology becomes more mainstream, it will likely pervade other industries. Also with the legalization of cannabis happening worldwide, the cannabis industry has seen a large growth in the immersive technology market to allow virtual tours of their facilities to engage potential customers and investors.

Concerns and ethics

The potential perils of immersive technology have often been portrayed in science fiction and entertainment. Movies such as eXistenZ, The Matrix, and the short film Play by David Kaplan and Eric Zimmerman, [34] raise questions about what may happen if we are unable to distinguish the physical world from the digital world. As the world of immersive technology becomes deeper and more intense this will be a growing concern for consumers and governments alike as to how to regulate this industry. Because all these technology is immersive and therefore not taking place in real life the application and or problems that come with the developing industry are something to keep an eye on. For example, Legal systems debate on topics of virtual crime, and whether it is ethical to permit illegal behavior such as rape [35] in a simulated environment, this is relative to the adult industry, art, entertainment and video games industries.

Immersive virtual reality

A Cave Automatic Virtual Environment (CAVE) system CAVE Crayoland.jpg
A Cave Automatic Virtual Environment (CAVE) system

Immersive virtual reality is a hypothetical future technology that exists today as virtual reality art projects, for the most part. [36] It consists of immersion in an artificial environment where the user feels just as immersed as they usually feel in everyday life.

Direct interaction of the nervous system

The most considered method would be to induce the sensations that made up the virtual reality in the nervous system directly. In functionalism/conventional biology we interact with everyday life through the nervous system. Thus we receive all input from all the senses as nerve impulses. It gives your neurons a feeling of heightened sensation. It would involve the user receiving inputs as artificially stimulated nerve impulses, the system would receive the CNS outputs (natural nerve impulses) and process them allowing the user to interact with the virtual reality. Natural impulses between the body and central nervous system would need to be prevented. This could be done by blocking out natural impulses using nanorobots which attach themselves to the brain wiring, whilst receiving the digital impulses of which describe the virtual world, which could then be sent into the wiring of the brain. A feedback system between the user and the computer which stores the information would also be needed. Considering how much information would be required for such a system, it is likely that it would be based on hypothetical forms of computer technology.

Requirements

Understanding of the nervous system

A comprehensive understanding of which nerve impulses correspond to which sensations, and which motor impulses correspond to which muscle contractions will be required. This will allow the correct sensations in the user, and actions in the virtual reality to occur. The Blue Brain Project is the current, most promising research with the idea of understanding how the brain works by building very large scale computer models.

Ability to manipulate CNS

The central nervous system would obviously need to be manipulated. Whilst non-invasive devices using radiation have been postulated, invasive cybernetic implants are likely to become available sooner and be more accurate.[ citation needed ] Molecular nanotechnology is likely to provide the degree of precision required and could allow the implant to be built inside the body rather than be inserted by an operation. [37]

Computer hardware/software to process inputs/outputs

A very powerful computer would be necessary for processing virtual reality complex enough to be nearly indistinguishable from everyday life and interacting with central nervous system fast enough.

Immersive digital environments

Cosmopolis, Overwriting the City (2005), Maurice Benayoun's large Virtual Reality Interactive Installation COSMOPOLIS.jpg
Cosmopolis, Overwriting the City (2005), Maurice Benayoun's large Virtual Reality Interactive Installation

An immersive digital environment is an artificial, interactive, computer-created scene or "world" within which a user can immerse themselves. [38]

Immersive digital environments could be thought of as synonymous with virtual reality, but without the implication that actual "reality" is being simulated. An immersive digital environment could be a model of reality, but it could also be a complete fantasy user interface or abstraction, as long as the user of the environment is immersed within it. The definition of immersion is wide and variable, but here it is assumed to mean simply that the user feels like they are part of the simulated "universe". The success with which an immersive digital environment can actually immerse the user is dependent on many factors such as believable 3D computer graphics, surround sound, interactive user-input and other factors such as simplicity, functionality and potential for enjoyment. New technologies are currently under development which claim to bring realistic environmental effects to the players' environment – effects like wind, seat vibration and ambient lighting.

Perception

To create a sense of full immersion, the 5 senses (sight, sound, touch, smell, taste) must perceive the digital environment to be physically real. Immersive technology can perceptually fool the senses through:

Interaction

Once the senses reach a sufficient belief that the digital environment is real (it is interaction and involvement which can never be real), the user must then be able to interact with the environment in a natural, intuitive manner. Various immersive technologies such as gestural controls, motion tracking, and computer vision respond to the user's actions and movements. Brain control interfaces (BCI) respond to the user's brainwave activity.

Examples and applications

Training and rehearsal simulations run the gamut from part task procedural training (often buttonology, for example: which button do you push to deploy a refueling boom) through situational simulation (such as crisis response or convoy driver training) to full motion simulations which train pilots or soldiers and law enforcement in scenarios that are too dangerous to train in actual equipment using live ordinance.

Video games from simple arcade to massively multiplayer online game and training programs such as flight and driving simulators. Entertainment environments such as motion simulators that immerse the riders/players in a virtual digital environment enhanced by motion, visual and aural cues. Reality simulators, such as one of the Virunga Mountains in Rwanda that takes you on a trip through the jungle to meet a tribe of mountain gorillas. [39] Or training versions such as one which simulates taking a ride through human arteries and the heart to witness the buildup of plaque and thus learn about cholesterol and health. [40]

In parallel with scientists, artists like Knowbotic Research, Donna Cox, Rebecca Allen, Robbie Cooper, Maurice Benayoun, Char Davies, and Jeffrey Shaw use the potential of immersive virtual reality to create physiologic or symbolic experiences and situations.

Other examples of immersion technology include physical environment / immersive space with surrounding digital projections and sound such as the CAVE, and the use of virtual reality headsets for viewing movies, with head-tracking and computer control of the image presented, so that the viewer appears to be inside the scene. Additionally, immersion technology can include audio with head-tracking and precise directivity of sound, such as the Nokia OZO technology. The next generation is VIRTSIM, which achieves total immersion through motion capture and wireless head mounted displays for teams of up to thirteen immersants enabling natural movement through space and interaction in both the virtual and physical space simultaneously.

Use in medical care

New fields of studies linked to immersive virtual reality emerge every day. Researchers see a great potential in virtual reality tests serving as complementary interview methods in psychiatric care. [41] Immersive virtual reality have in studies also been used as an educational tool in which the visualization of psychotic states have been used to get increased understanding of patients with similar symptoms. [42] New treatment methods are available for schizophrenia [43] and other newly developed research areas where immersive virtual reality is expected to achieve melioration is in education of surgical procedures, [44] rehabilitation program from injuries and surgeries [45] and reduction of phantom limb pain. [46]

Applications in the built environment

In the domain of architectural design and building science, immersive virtual environments are adopted to facilitate architects and building engineers to enhance the design process through assimilating their sense of scale, depth, and spatial awareness. Such platforms integrate the use of virtual reality models and mixed reality technologies in various functions of building science research, [47] construction operations, [48] personnel training, end-user surveys, performance simulations [49] and building information modeling visualization. [50] [51] Head-mounted displays (with both 3 degrees of freedom and 6 degrees of freedom systems) and CAVE platforms are used for spatial visualization and building information modeling (BIM) navigations for different design and evaluation purposes. [52] Clients, architects and building owners use derived applications from game engines to navigate 1:1 scale BIM models, allowing a virtual walkthrough experience of future buildings. [51] For such use cases, the performance improvement of space navigation between virtual reality headsets and 2D desktop screens has been investigated in various studies, with some suggesting significant improvement in virtual reality headsets [53] [54] while others indicate no significant difference. [55] [56]  Architects and building engineers can also use immersive design tools to model various building elements in virtual reality CAD interfaces, [57] [58] and apply property modifications to building information modeling (BIM) files through such environments. [50] [59]

In the building construction phase, immersive environments are used to improve site preparations, on site communication and collaboration of team members, safety [60] [61] and logistics. [62] For training of construction workers, virtual environments have shown to be highly effective in skill transfer with studies showing similar performance results to training in real environments. [63] Moreover, virtual platforms are also used in the operation phase of buildings to interact and visualize data with Internet of Things (IoT) devices available in buildings, process improvement and also resource management. [64] [65]

Occupant and end-user studies are performed through immersive environments. [66] [67] Virtual immersive platforms engage future occupants in the building design process by providing a sense of presence to users with integrating pre-construction mock-ups and BIM models for the evaluation of alternative design options in the building model in a timely and cost efficient manner. [68] Studies conducting human experiments have shown users perform similarly in daily office activities (object identification, reading speed and comprehension) within immersive virtual environments and benchmarked physical environments. [66] In the field of lighting, virtual reality headsets have been used investigate the influence of façade patterns on the perceptual impressions and satisfaction of a simulated daylit space. [69]  Moreover, artificial lighting studies have implemented immersive virtual environments to evaluate end-users lighting preferences of simulated virtual scenes with the controlling of the blinds and artificial lights in the virtual environment. [67]

For structural engineering and analysis, immersive environments enable the user to focus on structural investigations without getting too distracted to operate and navigate the simulation tool. [70] Virtual and augmented reality applications have been designed for finite element analysis of shell structures. Using stylus and data gloves as input devices, the user can create, modify mesh, and specify boundary conditions. For a simple geometry, real-time color-coded results are obtained by changing loads on the model. [71]  Studies have used artificial neural networks (ANN) or approximation methods to achieve real-time interaction for the complex geometry, and to simulate its impact via haptic gloves. [72] Large scale structures and bridge simulation have also been achieved in immersive virtual environments. The user can move the loads acting on the bridge, and finite element analysis results are updated immediately using an approximate module. [73]

Detrimental effects

Simulation sickness, or simulator sickness, is a condition where a person exhibits symptoms similar to motion sickness caused by playing computer/simulation/video games (Oculus Rift is working to solve simulator sickness). [74]

Motion sickness due to virtual reality is very similar to simulation sickness and motion sickness due to films. In virtual reality, however, the effect is made more acute as all external reference points are blocked from vision, the simulated images are three-dimensional and in some cases stereo sound that may also give a sense of motion. Studies have shown that exposure to rotational motions in a virtual environment can cause significant increases in nausea and other symptoms of motion sickness. [75]

Other behavioural changes such as stress, addiction, isolation and mood changes are also discussed to be side-effects caused by immersive virtual reality. [76]

See also

Related Research Articles

Multimedia refers to the integration of multiple forms of content such as text, audio, images, video, and interactive elements into a single digital platform or application. This integration allows for a more immersive and engaging experience compared to traditional single-medium content. Multimedia is utilized in various fields including education, entertainment, communication, game design, and digital art, reflecting its broad impact on modern technology and media.

<span class="mw-page-title-main">Virtual reality</span> Computer-simulated experience

Virtual reality (VR) is a simulated experience that employs 3D near-eye displays and pose tracking to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment, education and business. VR is one of the key technologies in the reality-virtuality continuum. As such, it is different from other digital visualization solutions, such as augmented virtuality and augmented reality.

<span class="mw-page-title-main">Augmented reality</span> View of the real world with computer-generated supplementary features

Augmented reality (AR) is an interactive experience that combines the real world and computer-generated 3D content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. As such, it is one of the key technologies in the reality-virtuality continuum.

<span class="mw-page-title-main">Computer-mediated reality</span> Ability to manipulate ones perception of reality through the use of a computer

Computer-mediated reality refers to the ability to add to, subtract information from, or otherwise manipulate one's perception of reality through the use of a wearable computer or hand-held device such as a smartphone.

A virtual environment is a networked application that allows a user to interact with both the computing environment and the work of other users. Email, chat, and web-based document sharing applications are all examples of virtual environments. Simply put, it is a networked common operating space. Once the fidelity of the virtual environment is such that it "creates a psychological state in which the individual perceives himself or herself as existing within the virtual environment" then the virtual environment (VE) has progressed into the realm of immersive virtual environments (IVEs).

<span class="mw-page-title-main">Mixed reality</span> Merging of real and virtual worlds to produce new environments

Mixed reality (MR) is a term used to describe the merging of a real-world environment and a computer-generated one. Physical and virtual objects may co-exist in mixed reality environments and interact in real time.

<span class="mw-page-title-main">Head-mounted display</span> Type of display device

A head-mounted display (HMD) is a display device, worn on the head or as part of a helmet, that has a small display optic in front of one or each eye. HMDs have many uses including gaming, aviation, engineering, and medicine.

<span class="mw-page-title-main">360-degree video</span> Visual arts technique

360-degree videos, also known as surround video, or immersive videos or spherical videos, are video recordings where a view in every direction is recorded at the same time, shot using an omnidirectional camera or a collection of cameras. The term 360x180 can be used to indicate 360° of azimuth and 180° from nadir to zenith. During playback on normal flat display the viewer has control of the viewing direction like a panorama. It can also be played on a display or projectors arranged in a sphere or some part of a sphere.

A projection augmented model is an element sometimes employed in virtual reality systems. It consists of a physical three-dimensional model onto which a computer image is projected to create a realistic looking object. Importantly, the physical model is the same geometric shape as the object that the PA model depicts.

<span class="mw-page-title-main">Oculus Rift</span> Virtual reality headsets by Oculus VR

Oculus Rift is a discontinued line of virtual reality headsets developed and manufactured by Oculus VR, a virtual reality company founded by Palmer Luckey that is widely credited with reviving the virtual reality industry. It was the first virtual reality headset to provide a realistic experience at an accessible price, utilizing novel technology to increase quality and reduce cost by orders of magnitude compared to earlier systems. The first headset in the line was the Oculus Rift DK1, released on March 28, 2013. The last was the Oculus Rift S, discontinued in April 2021.

Virtual reality sickness occurs when exposure to a virtual environment causes symptoms that are similar to motion sickness symptoms. The most common symptoms are general discomfort, eye strain, headache, stomach awareness, nausea, vomiting, pallor, sweating, fatigue, drowsiness, disorientation, and apathy. Other symptoms include postural instability and retching. Common causes are low frame rate, input lag, and the vergence-accommodation-conflict.

<span class="mw-page-title-main">Windows Mixed Reality</span> Mixed reality platform

Windows Mixed Reality (WMR) is a discontinued platform by Microsoft which provides augmented reality and virtual reality experiences with compatible head-mounted displays.

Visual computing is a generic term for all computer science disciplines dealing with the 3D modeling of graphical requirements, for which extenuates to all disciplines of the Computational Sciences. While this is directly relevant to the software visualistics of Microservices, Visual Computing also includes the specializations of the subfields that are called Computer Graphics, Image Processing, Visualization, Computer Vision, Computational Imaging, Augmented Reality, and Video Processing, upon which extenuates into Design Computation. Visual computing also includes aspects of Pattern Recognition, Human-Computer Interaction, Machine Learning, Robotics, Computer Simulation, Steganography, Security Visualization, Spatial Analysis, Computational Visualistics, and Computational Creativity. The core challenges are the acquisition, processing, analysis and rendering of visual information. Application areas include industrial quality control, medical image processing and visualization, surveying, multimedia systems, virtual heritage, special effects in movies and television, and ultimately computer games, which is central towards the visual models of User Experience Design. Conclusively, this includes the extenuations of large language models (LLM) that are in Generative Artificial Intelligence for developing research around the simulations of scientific instruments in the Computational Sciences. This is especially the case with the research simulations that are between Embodied Agents and Generative Artificial Intelligence that is designed for Visual Computation. Therefore, this field also extenuates into the diversity of scientific requirements that are addressed through the visualized technologies of interconnected research in the Computational Sciences.

<span class="mw-page-title-main">Virtual reality headset</span> Head-mounted device that provides virtual reality for the wearer

A virtual reality headset is a head-mounted device that uses 3D near-eye displays and positional tracking to provide a virtual reality environment for the user. VR headsets are widely used with VR video games, but they are also used in other applications, including simulators and trainers. VR headsets typically include a stereoscopic display, stereo sound, and sensors like accelerometers and gyroscopes for tracking the pose of the user's head to match the orientation of the virtual camera with the user's eye positions in the real world. Augmented reality (AR) headsets are VR headsets that enable the user to see and interact with the outside world. Examples of AR headsets include the Apple Vision Pro and Meta Quest 3.

<span class="mw-page-title-main">Pose tracking</span> Detection of a virtual/augmented reality users pose

In virtual reality (VR) and augmented reality (AR), a pose tracking system detects the precise pose of head-mounted displays, controllers, other objects or body parts within Euclidean space. Pose tracking is often referred to as 6DOF tracking, for the six degrees of freedom in which the pose is often tracked.

Virtual reality (VR) is a computer application which allows users to experience immersive, three dimensional visual and audio simulations. According to Pinho (2004), virtual reality is characterized by immersion in the 3D world, interaction with virtual objects, and involvement in exploring the virtual environment. The feasibility of the virtual reality in education has been debated due to several obstacles such as affordability of VR software and hardware. The psychological effects of virtual reality are also a negative consideration. However, recent technological progress has made VR more viable and promise new learning models and styles for students. These facets of virtual reality have found applications within the primary education sphere in enhancing student learning, increasing engagement, and creating new opportunities for addressing learning preferences.

<span class="mw-page-title-main">Virtual reality game</span> Video game played in virtual reality

A virtual reality game or VR game is a video game played on virtual reality (VR) hardware. Most VR games are based on player immersion, typically through a head-mounted display unit or headset with stereoscopic displays and one or more controllers.

<span class="mw-page-title-main">Virtual reality applications</span> Overview of the various applications that make use of virtual reality

There are many applications of virtual reality (VR). Applications have been developed in a variety of domains, such as architectural and urban design, industrial designs, restorative nature experiences, healthcare and clinical therapies, digital marketing and activism, education and training, engineering and robotics, entertainment, virtual communities, fine arts, heritage and archaeology, occupational safety, as well as social science and psychology.

Immersive learning is a learning method with students being immersed into a virtual dialogue, the feeling of presence is used as an evidence of getting immersed. The virtual dialogue can be created by two ways, the usage of virtual technics, and the narrative like reading a book. The motivations of using virtual reality (VR) for teaching contain: learning efficiency, time problems, physical inaccessibility, limits due to a dangerous situation and ethical problems.

Cinematic virtual reality (Cine-VR) is an immersive experience where the audience can look around in 360 degrees while hearing spatialized audio specifically designed to reinforce the belief that the audience is actually in the virtual environment rather than watching it on a two-dimensional screen. Cine-VR is different from traditional Virtual Reality which uses computer generated worlds and characters more akin to interactive gaming engines, while cine-VR uses live images captured thorough a camera which makes it more like film.

References

  1. ↑ Adams, Ernest (July 9, 2004). "Postmodernism and the Three Types of Immersion". Gamasutra. Archived from the original on October 24, 2007. Retrieved 2007-12-26.
  2. ↑ Björk, Staffan; Jussi Holopainen (2004). Patterns In Game Design. Charles River Media. p. 206. ISBN   978-1-58450-354-5.
  3. ↑ "10.000 Moving Cities - Same but Different, interactive net-and-telepresence-based installation 2015". Marc Lee. Archived from the original on 2018-08-15. Retrieved 2017-03-12.
  4. ↑ Barfield, Woodrow; Zeltzer, David; Sheridan, Thomas; Slater, Mel (1995). "Presence and Performance Within Virtual Environments". In Barfield, Woodrow; Furness, III, Thomas A. (eds.). Virtual Environments and Advanced Interface Design. Oxford University Press. p. 473. ISBN   978-0195075557.
  5. ↑ Thornson, Carol; Goldiez, Brian (January 2009). "Predicting presence: Constructing the Tendency toward Presence Inventory". International Journal of Human-Computer Studies. 67 (1): 62–78. doi:10.1016/j.ijhcs.2008.08.006.
  6. ↑ Seth Rosenblatt (19 March 2014). "Oculus Rift Dev Kit 2 now on sale for $350". CNET. CBS Interactive. Archived from the original on 28 March 2014.
  7. ↑ "Oculus Rift DK2 hands-on and first-impressions". SlashGear. 19 March 2014.
  8. ↑ "Announcing the Oculus Rift Development Kit 2 (DK2)". Oculus Vr. Archived from the original on 13 September 2014. Retrieved 3 May 2018.
  9. ↑ Abrash M. (2014). What VR could, should, and almost certainly will be within two years Archived 2014-03-20 at the Wayback Machine
  10. 1 2 3 4 Kaplan-Rakowski, Regina; Meseberg, Kay (2018). "Immersive Media and their Future". SSRN Electronic Journal . doi:10.2139/ssrn.3254392.
  11. ↑ "Immersive Media". Infocomm Media Development Authority. 18 May 2022. Retrieved 13 June 2022.
  12. 1 2 3 4 5 6 Carter, Rebekah (10 May 2021). "What is Immersive Media: An Introduction". XR Today. Retrieved 13 June 2022.
  13. ↑ Furht, Borko, ed. (2008), "Immersive Virtual Reality", Encyclopedia of Multimedia, Boston, MA: Springer US, pp. 345–346, doi:10.1007/978-0-387-78414-4_85, ISBN   978-0-387-78414-4, OSTI   1109141 , retrieved 2021-02-22
  14. 1 2 3 4 5 6 "An Introduction to Immersive Technologies". Vista Equity Partners. 2020-02-28. Retrieved 2021-03-22.
  15. 1 2 "Immersive Technology & Experiences | Transforming How We Do Business". Future Visual. 2020-07-02. Retrieved 2021-03-28.
  16. ↑ "The origins of immersive technologies". FutureLearn. Retrieved 2021-03-22.
  17. ↑ Sachidanand, Rishab (2019-11-20). "Elements of a true immersive experience: comparing altered reality technologies". Medium. Retrieved 2021-03-28.
  18. 1 2 3 "5 Types of Immersive Technology". Simplicable. Retrieved 2021-03-28.
  19. ↑ Hood, Vic; Knapp, Mark; February 2021, Dan Griliopoulos 27. "Best VR games 2021: the top virtual reality games to play right now". TechRadar. Retrieved 2021-03-07.{{cite web}}: CS1 maint: numeric names: authors list (link)
  20. 1 2 3 4 5 Radianti, Jaziar; Majchrzak, Tim A.; Fromm, Jennifer; Wohlgenannt, Isabell (April 2020). "Elsevier Enhanced Reader". Computers & Education. 147: 103778. doi: 10.1016/j.compedu.2019.103778 . hdl: 11250/2736325 . S2CID   211073617.
  21. 1 2 Cipresso, Pietro; Giglioli, Irene Alice Chicchi; Raya, Mariano Alcañiz; Riva, Giuseppe (2018-11-06). "The Past, Present, and Future of Virtual and Augmented Reality Research: A Network and Cluster Analysis of the Literature". Frontiers in Psychology. 9: 2086. doi: 10.3389/fpsyg.2018.02086 . ISSN   1664-1078. PMC   6232426 . PMID   30459681.
  22. 1 2 Hood, Vic; Knapp, Mark; February 2021, Dan Griliopoulos 27. "Best VR games 2021: the top virtual reality games to play right now". TechRadar. Retrieved 2021-03-07.{{cite web}}: CS1 maint: numeric names: authors list (link)
  23. ↑ Banna, Srinivasa (2020-04-02). "MicroLED Technology for AR/VR Displays (Conference Presentation)". Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR). Vol. 11310. SPIE. p. 147. doi:10.1117/12.2566410. ISBN   978-1-5106-3387-2. S2CID   216268924.
  24. ↑ "Top and Best Universities in US for VR / AR". Virtual Reality Augmented Reality Technology Latest News. 10 January 2018. Retrieved 2020-12-07.
  25. ↑ "The 10 Biggest AR Investments of 2018". Next Reality. 28 December 2018. Retrieved 2019-11-22.
  26. ↑ "Intelligence Advanced Research Projects Activity (IARPA) RFI". Fbo.gov. 2010-03-12.
  27. ↑ "Army's Telemedicine and Advanced Technology Research Center funds virtual world for amputees". Whatsbrewin.next.gov.com. Archived from the original on 2012-03-05. Retrieved 2010-03-28.
  28. ↑ Petronzio, Matt (April 25, 2013). "Immersing Consumers in 'Immersive Experiences'". Mashable.
  29. ↑ "Porn Industry Embraces Immersive 3D technology". Tgdaily.com. Archived from the original on 2016-09-27. Retrieved 2021-02-17.
  30. ↑ "Media Arts and Technology, UC Santa Barbara". Mat.ucsb.edu. Retrieved 20 April 2019.
  31. ↑ "Home - Immersive Education Initiative". Immersiveeducation.org. Retrieved 20 April 2019.
  32. ↑ "Immersive Learning Research Network". Immersive Learning Research Network. Retrieved 20 April 2019.
  33. ↑ "Doctors test new gestural interface during brain surgery". Immersivetech.org. Archived from the original on 2010-06-21. Retrieved 2010-03-28.
  34. ↑ Kaplan, David; Zimmerman, Eric. "Play". Archived from the original on 2010-06-25. Retrieved 2010-03-28.
  35. ↑ "Virtual Rape Is Traumatic, but Is It a Crime?". Wired.com. 4 May 2007.
  36. ↑ Joseph Nechvatal, Immersive Ideals / Critical Distances. LAP Lambert Academic Publishing. 2009, pp. 367-368
  37. ↑ Saha, Moni (October 2009). "Nanomedicine: Promising Tiny Machine for the Healthcare in Future-A Review". Oman Medical Journal. 24 (4): 242–247. doi:10.5001/omj.2009.50. ISSN   1999-768X. PMC   3243873 . PMID   22216376.
  38. ↑ Joseph Nechvatal, Immersive Ideals / Critical Distances. LAP Lambert Academic Publishing. 2009, pp. 48-60
  39. ↑ pulseworks.com Archived 2009-05-05 at the Wayback Machine
  40. ↑ "Thank You".
  41. ↑ Freeman, D.; Antley, A.; Ehlers, A.; Dunn, G.; Thompson, C.; Vorontsova, N.; Garety, P.; Kuipers, E.; Glucksman, E.; Slater, M. (2014). "The use of immersive virtual reality (VR) to predict the occurrence 6 months later of paranoid thinking and posttraumatic stress symptoms assessed by self-report and interviewer methods: A study of individuals who have been physically assaulted". Psychological Assessment. 26 (3): 841–847. doi:10.1037/a0036240. PMC   4151801 . PMID   24708073.
  42. ↑ http://www.life-slc.org/docs/Bailenson_etal-immersiveVR.pdf [ bare URL PDF ]
  43. ↑ Freeman, D. (2007). "Studying and Treating Schizophrenia Using Virtual Reality: A New Paradigm". Schizophrenia Bulletin. 34 (4): 605–610. doi:10.1093/schbul/sbn020. PMC   2486455 . PMID   18375568.
  44. ↑ Virtual Reality in Neuro-Psycho-Physiology , p. 36, at Google Books
  45. ↑ De Los Reyes-Guzman, A.; Dimbwadyo-Terrer, I.; Trincado-Alonso, F.; Aznar, M. A.; Alcubilla, C.; Pérez-Nombela, S.; Del Ama-Espinosa, A.; Polonio-López, B. A.; Gil-Agudo, Á. (2014). "A Data-Globe and Immersive Virtual Reality Environment for Upper Limb Rehabilitation after Spinal Cord Injury". XIII Mediterranean Conference on Medical and Biological Engineering and Computing 2013. IFMBE Proceedings. Vol. 41. p. 1759. doi:10.1007/978-3-319-00846-2_434. ISBN   978-3-319-00845-5.
  46. ↑ Llobera, J.; González-Franco, M.; Perez-Marcos, D.; Valls-Solé, J.; Slater, M.; Sanchez-Vives, M. V. (2012). "Virtual reality for assessment of patients suffering chronic pain: A case study". Experimental Brain Research. 225 (1): 105–117. doi:10.1007/s00221-012-3352-9. PMID   23223781. S2CID   2064966.
  47. ↑ Kuliga, S.F.; Thrash, T.; Dalton, R.C.; Hölscher, C. (2015). "Virtual reality as an empirical research tool — Exploring user experience in a real building and a corresponding virtual model". Computers, Environment and Urban Systems. 54: 363–375. Bibcode:2015CEUS...54..363K. doi:10.1016/j.compenvurbsys.2015.09.006.
  48. ↑ Kamat Vineet R.; Martinez Julio C. (2001-10-01). "Visualizing Simulated Construction Operations in 3D". Journal of Computing in Civil Engineering. 15 (4): 329–337. doi:10.1061/(asce)0887-3801(2001)15:4(329).
  49. ↑ Malkawi, Ali M.; Srinivasan, Ravi S. (2005). "A new paradigm for Human-Building Interaction: the use of CFD and Augmented Reality". Automation in Construction. 14 (1): 71–84. doi:10.1016/j.autcon.2004.08.001.
  50. 1 2 "Revit Live | Immersive Architectural Visualization | Autodesk". Archived from the original on 2017-11-09. Retrieved 2017-11-09.
  51. 1 2 "IrisVR - Virtual Reality for Architecture, Engineering, and Construction". irisvr.com. Retrieved 2017-11-09.
  52. ↑ Frost, P.; Warren, P. (2000). "Virtual reality used in a collaborative architectural design process". 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics. pp. 568–573. doi:10.1109/iv.2000.859814. ISBN   978-0-7695-0743-9. S2CID   30912415.
  53. ↑ Santos, Beatriz Sousa; Dias, Paulo; Pimentel, Angela; Baggerman, Jan-Willem; Ferreira, Carlos; Silva, Samuel; Madeira, Joaquim (2009-01-01). "Head-mounted display versus desktop for 3D navigation in virtual reality: a user study". Multimedia Tools and Applications. 41 (1): 161. CiteSeerX   10.1.1.469.4984 . doi:10.1007/s11042-008-0223-2. ISSN   1380-7501. S2CID   17298825.
  54. ↑ Ruddle, Roy A.; Payne, Stephen J.; Jones, Dylan M. (1999-04-01). "Navigating Large-Scale Virtual Environments: What Differences Occur Between Helmet-Mounted and Desk-Top Displays?" (PDF). Presence: Teleoperators and Virtual Environments. 8 (2): 157–168. doi:10.1162/105474699566143. ISSN   1054-7460. S2CID   15785663.
  55. ↑ Robertson, George; Czerwinski, Mary; van Dantzich, Maarten (1997). "Immersion in desktop virtual reality". Proceedings of the 10th annual ACM symposium on User interface software and technology - UIST '97. New York, NY, USA: ACM. pp. 11–19. CiteSeerX   10.1.1.125.175 . doi:10.1145/263407.263409. ISBN   978-0897918817. S2CID   2699341.
  56. ↑ Ruddle, Roy A; Péruch, Patrick (2004-03-01). "Effects of proprioceptive feedback and environmental characteristics on spatial learning in virtual environments". International Journal of Human-Computer Studies. 60 (3): 299–326. CiteSeerX   10.1.1.294.6442 . doi:10.1016/j.ijhcs.2003.10.001.
  57. ↑ "vSpline". www.vspline.com. Archived from the original on 2017-09-19. Retrieved 2017-11-09.
  58. ↑ "VR - Gravity Sketch". Gravity Sketch. Archived from the original on 2017-01-15. Retrieved 2017-11-09.
  59. ↑ "VR Productivity for AEC". www.kalloctech.com. Archived from the original on 2017-11-09. Retrieved 2017-11-09.
  60. ↑ Colombo, Simone; Manca, Davide; Brambilla, Sara; Totaro, Roberto; Galvagni, Remo (2011-01-01). "Towards the Automatic Measurement of Human Performance in Virtual Environments for Industrial Safety". ASME 2011 World Conference on Innovative Virtual Reality. pp. 67–76. doi:10.1115/winvr2011-5564. ISBN   978-0-7918-4432-8.
  61. ↑ "DAQRI - Smart Helmet®". daqri.com. Archived from the original on 2017-11-09. Retrieved 2017-11-09.
  62. ↑ Messner, John I. (2006). "Evaluating the Use of Immersive Display Media for Construction Planning". Intelligent Computing in Engineering and Architecture. Lecture Notes in Computer Science. Vol. 4200. Springer, Berlin, Heidelberg. pp. 484–491. doi:10.1007/11888598_43. ISBN   9783540462460.
  63. ↑ Waller, David; Hunt, Earl; Knapp, David (1998-04-01). "The Transfer of Spatial Knowledge in Virtual Environment Training". Presence: Teleoperators and Virtual Environments. 7 (2): 129–143. CiteSeerX   10.1.1.39.6307 . doi:10.1162/105474698565631. ISSN   1054-7460. S2CID   17900737.
  64. ↑ V. Whisker; A. Baratta; S. Yerrapathruni; J.Messner; T. Shaw; M.Warren; E. Rotthoff; J. Winters; J. Clelland; F. Johnson (2003). "Using immersive virtual environments to develop and visualize construction schedules for advanced nuclear power plants". Proceedings of ICAPP. 3: 4–7. CiteSeerX   10.1.1.456.7914 .
  65. ↑ Colombo, Simone; Nazir, Salman; Manca, Davide (2014-10-01). "Immersive Virtual Reality for Training and Decision Making: Preliminary Results of Experiments Performed With a Plant Simulator". SPE Economics & Management. 6 (4): 165–172. doi:10.2118/164993-pa. ISSN   2150-1173.
  66. 1 2 Heydarian, Arsalan; Carneiro, Joao P.; Gerber, David; Becerik-Gerber, Burcin; Hayes, Timothy; Wood, Wendy (2015). "Immersive virtual environments versus physical built environments: A benchmarking study for building design and user-built environment explorations". Automation in Construction. 54: 116–126. doi:10.1016/j.autcon.2015.03.020.
  67. 1 2 Heydarian, Arsalan; Carneiro, Joao P.; Gerber, David; Becerik-Gerber, Burcin (2015). "Immersive virtual environments, understanding the impact of design features and occupant choice upon lighting for building performance". Building and Environment. 89: 217–228. Bibcode:2015BuEnv..89..217H. doi:10.1016/j.buildenv.2015.02.038.
  68. ↑ Mahdjoub, Morad; Monticolo, Davy; Gomes, Samuel; Sagot, Jean-Claude (2010). "A collaborative Design for Usability approach supported by Virtual Reality and a Multi-Agent System embedded in a PLM environment". Computer-Aided Design. 42 (5): 402–413. doi:10.1016/j.cad.2009.02.009. S2CID   9933280.
  69. ↑ Chamilothori, Kynthia; Wienold, Jan; Andersen, Marilyne (2016). "Daylight patterns as a means to influence the spatial ambiance: a preliminary study". Proceedings of the 3rd International Congress on Ambiances.
  70. ↑ Huang, J.M.; Ong, S.K.; Nee, A.Y.C. (2017). "Visualization and interaction of finite element analysis in augmented reality". Computer-Aided Design. 84: 1–14. doi:10.1016/j.cad.2016.10.004.
  71. ↑ Liverani, A.; Kuester, F.; Hamann, B. (1999). "Towards interactive finite element analysis of shell structures in virtual reality". 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210). pp. 340–346. doi:10.1109/iv.1999.781580. ISBN   978-0-7695-0210-6. S2CID   13613971.
  72. ↑ Hambli, Ridha; Chamekh, Abdessalam; Salah, Hédi Bel Hadj (2006). "Real-time deformation of structure using finite element and neural networks in virtual reality applications". Finite Elements in Analysis and Design. 42 (11): 985–991. doi:10.1016/j.finel.2006.03.008.
  73. ↑ Connell, Mike; Tullberg, Odd (2002). "A framework for immersive FEM visualisation using transparent object communication in a distributed network environment". Advances in Engineering Software. 33 (7–10): 453–459. doi:10.1016/s0965-9978(02)00063-7.
  74. ↑ "Oculus Rift is working to solve simulator sickness". Polygon. 19 August 2013. Archived from the original on 2015-09-24. Retrieved 2015-05-05.
  75. ↑ So, R.H.Y. and Lo, W.T. (1999) "Cybersickness: An Experimental Study to Isolate the Effects of Rotational Scene Oscillations." Proceedings of IEEE Virtual Reality '99 Conference, March 13–17, 1999, Houston, Texas. Published by IEEE Computer Society, pp. 237–241
  76. ↑ Costello, Patrick (1997-07-23). "Health and Safety Issues associated with Virtual Reality - A Review of Current Literature" (PDF). Archived (PDF) from the original on 2014-12-18. Retrieved 2014-11-25.

Further reading

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.