Scenario (artwork)

Last updated

Scenario is an Artificial Intelligence (AI) computer graphic interactive installation, directed by the artist Dennis Del Favero, and developed in collaboration with scriptwriter Stephen Sewell, AI scientist Maurice Pagnucco working with computer scientists Anuraag Sridhar, Arcot Sowmya and Paul Compton. It is a 360-degree 3D cinematic work whose narrative is interactively produced by the audience and humanoid characters. [1] The title is a Commedia dell'arte term (Italian pronunciation:  [ʃeˈnaːrjo] ) referring to the way dramatic action is dependent on the way actors and audience interact. [2] Scenario was developed at the iCinema Centre for Interactive Cinema Research. [3]

Contents

Description

Scenario is inspired by the experimental television work of Samuel Beckett. It is set within a concealed labyrinth where five humanoid characters have been imprisoned. The characters take the audience through the labyrinth in an attempt to discover the possible ways they and the audience can resolve the mystery of their imprisonment and so effect an escape. Watching them are a series of shadowy humanoid sentinels who track these humanoids and the audience, physically trying to block their escape.

By rapidly interpreting and responding to audience behaviour by means of a sophisticated AI system, the humanoid sentinels work effortlessly to try and inhibit the audience at every turn. This two-fold dramatic action enables the work to create a narrative that evolves according to how the humanoids and the audience physically interact with each other. [4] This is effected by means of a vision system that tracks the audience's behaviour, linked to an AI system that allows the humanoids to independently interpret and respond to audience behaviour.

Scenario's AI system

The AI system is based on a variant of a symbolic logic planner drawn from the cognitive robotics language Golog developed at the University of Toronto, capable of dealing with sensors and external actions. Animations that can be performed by a humanoid character are considered actions that need to be modeled and controlled (e.g., walking to a location, pushing a character, etc.). Each action is modeled in terms of the conditions under which it can be performed (e.g., you can push a character if you are located next to it) and how it affects the environment when the action is performed. Using this modeling, the AI system plans or coordinates the actions (i.e., animations) of the humanoid characters by reasoning about the most appropriate course of action. A custom 3D behaviour toolset allows the creation of 'scenarios' that exhibit a cycle of cause and effect between the real world and the digital world. Its principal feature is that it allows the cognitive robotic language to implement realistic behaviour in the humanoid characters with a minimum of programming effort.

Scenario's environment: AVIE

Scenario takes place within iCinema's Advanced Visualisation and Interaction Environment (AVIE), which consists of a 360 degree stereoscopic immersive interactive visualisation environment with motion and shape tracking systems and a multi-channel audio system. Measuring four meters high and ten meters in diameter, it is a set of state-of-the-art resources that enables the development and study of applications in the fields of immersive visualisation, interactive narrative, and human interaction design. [5] It is located in iCinema's Scientia Facility.

See also

Related Research Articles

Role-playing game Game in which players assume the roles of characters in a fictional setting

A role-playing game is a game in which players assume the roles of characters in a fictional setting. Players take responsibility for acting out these roles within a narrative, either through literal acting or through a process of structured decision-making regarding character development. Actions taken within many games succeed or fail according to a formal system of rules and guidelines.

Virtual reality Computer-simulated experience

Virtual reality (VR) is a simulated experience that can be similar to or completely different from the real world. Applications of virtual reality include entertainment, education and business. Other distinct types of VR-style technology include augmented reality and mixed reality, sometimes referred to as extended reality or XR.

Interactive storytelling is a form of digital entertainment in which the storyline is not predetermined. The author creates the setting, characters, and situation which the narrative must address, but the user experiences a unique story based on their interactions with the story world. The architecture of an interactive storytelling program includes a drama manager, user model, and agent model to control, respectively, aspects of narrative production, player uniqueness, and character knowledge and behavior. Together, these systems generate characters that act "human," alter the world in real-time reactions to the player, and ensure that new narrative events unfold comprehensibly.

In video games, artificial intelligence (AI) is used to generate responsive, adaptive or intelligent behaviors primarily in non-player characters (NPCs) similar to human-like intelligence. Artificial intelligence has been an integral part of video games since their inception in the 1950s. AI in video games is a distinct subfield and differs from academic AI. It serves to improve the game-player experience rather than machine learning or decision making. During the golden age of arcade video games the idea of AI opponents was largely popularized in the form of graduated difficulty levels, distinct movement patterns, and in-game events dependent on the player's input. Modern games often implement existing techniques such as pathfinding and decision trees to guide the actions of NPCs. AI is often used in mechanisms which are not immediately visible to the user, such as data mining and procedural-content generation.

Human–robot interaction is the study of interactions between humans and robots. It is often referred as HRI by researchers. Human–robot interaction is a multidisciplinary field with contributions from human–computer interaction, artificial intelligence, robotics, natural-language understanding, design, and psychology.

Action selection is a way of characterizing the most basic problem of intelligent systems: what to do next. In artificial intelligence and computational cognitive science, "the action selection problem" is typically associated with intelligent agents and animats—artificial systems that exhibit complex behaviour in an agent environment. The term is also sometimes used in ethology or animal behavior.

In artificial intelligence, reactive planning denotes a group of techniques for action selection by autonomous agents. These techniques differ from classical planning in two aspects. First, they operate in a timely fashion and hence can cope with highly dynamic and unpredictable environments. Second, they compute just one next action in every instant, based on the current context. Reactive planners often exploit reactive plans, which are stored structures describing the agent's priorities and behaviour.

iCub Open source robotics humanoid robot testbed

iCub is a 1 metre tall open source robotics humanoid robot testbed for research into human cognition and artificial intelligence.

The following outline is provided as an overview of and topical guide to artificial intelligence:

360-degree video Visual arts technique

360-degree videos, also known as surround video, or immersive videos or spherical videos, are video recordings where a view in every direction is recorded at the same time, shot using an omnidirectional camera or a collection of cameras. During playback on normal flat display the viewer has control of the viewing direction like a panorama. It can also be played on a display or projectors arranged in a sphere or some part of a sphere.

Immersion (virtual reality) Perception of being physically present in a non-physical world

Immersion into virtual reality (VR) is a perception of being physically present in a non-physical world. The perception is created by surrounding the user of the VR system in images, sound or other stimuli that provide an engrossing total environment.

Dennis Del Favero is an Australian artist and academic. He has been awarded numerous Artist-in-Residencies and Fellowships, including an Artist-in-Residence at Neue Galerie Graz and Visiting Professorial Fellowship at ZKM Center for Art and Media, Karlsruhe. He is an Australian Research Council Laureate Fellow, Scientia Professor of Digital Innovation and Executive Director of the iCinema Centre for Interactive Cinema Research at the University of New South Wales; Visiting Professor at IUAV, Venice; Member of the editorial board of Studio Corpi’s Quodlibet, Rome; and former Executive Director of the Australian Research Council | Humanities and Creative Arts (2015–2016).

Jeffrey Shaw is a visual artist known for being a leading figure in new media art. In a prolific career of widely exhibited and critically acclaimed work, he has pioneered the creative use of digital media technologies in the fields of expanded cinema, interactive art, virtual, augmented and mixed reality, immersive visualization environments, navigable cinematic systems and interactive narrative. Shaw was co-designer of Algie the inflatable pig, which was photographed above Battersea Power Station for the 1977 Pink Floyd album, Animals.

Virtual intelligence is the term given to artificial intelligence that exists within a virtual world. Many virtual worlds have options for persistent avatars that provide information, training, role playing, and social interactions.

Immersive Journalism is a form of journalism production that allows first person experience of the events or situations described in news reports and documentary film. Using 3D gaming and immersive technologies that create a sense of "being there" and offer the opportunity to personally engage with a story, immersive journalism puts an audience member directly into the event. By accessing a virtual version of the location where the story is occurring as a witness/participant, or by experiencing the perspective of a character depicted in the news story, the audience could be afforded unprecedented access to the sights and sounds, and even the feelings and emotions, which accompany the news.

Kate Moore is an Australian composer currently based in the Netherlands. Moore was born in Oxfordshire, England, and has studied with Australian composers Larry Sitsky, Jim Cotter, and Michael Smetanin; Dutch composers Louis Andriessen, Martijn Padding, Diderik Wagenaar and Gilius van Bergeijk; and attended summer schools including Bang on a Can hosted by David Lang, Julia Wolfe and Michael Gordon and Tanglewood hosted by John Harbison, Michael Gandolfi and Helen Grime.


CREW is a Belgian performance group, founded in Brussels in 1991 by Eric Joris. CREW operates on the border between art and science, between performance art and new technology. Artist Eric Joris develops his live-art projects in close collaboration with scientists and other artists.

Immersive theater differentiates itself from traditional theater by removing the stage and immersing audiences within the performance itself. Often, this is accomplished by using a specific location (site-specific), allowing audiences to converse with the actors and interact with their surroundings (interactive), thereby breaking the fourth wall.

Immersive learning is a learning method which students being immersed into a virtual dialogue, the feeling of presence is used as an evidence of getting immersed. The virtual dialogue can be created by two ways, the usage of virtual technics, and the narrative like reading a book. The motivations of using virtual reality (VR) for teaching contain: learning efficiency, time problems, physical inaccessibility, limits due to a dangerous situation and ethical problems.

Cinematic virtual reality(Cine-VR) is an immersive experience where the audience can look around in 360 degrees while hearing spatialized audio specifically designed to reinforce the belief that the audience is actually in the virtual environment rather than watching it on a two-dimensional screen. Cine-VR is different from traditional Virtual Reality which uses computer generated worlds and characters more akin to interactive gaming engines, while cine-VR uses live images captured thorough a camera which makes it more like film.

References

  1. ↑ Neil C.M. Brown, Timothy Barker and Dennis Del Favero. Performing Digital Aesthetics: The Framework for a Theory of the Formation of Interactive Narratives Leonardo 44(3)
  2. ↑ "Project Scenario". www.icinema.unsw.edu.au. Archived from the original on 14 May 2006.
  3. ↑ at the University of New South Wales
  4. ↑ Dennis Del Favero and Timothy Barker. Scenario: Co-Evolution, Shared Autonomy and Mixed Reality. Proceedings of IEEE International Symposium on Mixed and Augmented Reality, Seoul, 13–16 October 2010
  5. ↑ McGinity, M., Shaw, J., Del Favero, D., and Kuchelmeister, V. (2007). AVIE: A Versatile Multi-User Stereo 360-Degree Interactive VR Theatre. The 34th International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH San Diego, California, USA, 5–9 August 2007. (AVIE : International Documentary Film Festival Amsterdam (2009). Jeffrey Shaw, Dennis Del Favero, Matthew McGinity, Ardrian Hardjono, Volker Kuchelmeister).
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.