Teleoperation

Last updated
An IED detonator, a telemanipulator for investigating potentially explosive devices IED detonator.jpg
An IED detonator, a telemanipulator for investigating potentially explosive devices

Teleoperation (or remote operation) indicates operation of a system or machine at a distance. It is similar in meaning to the phrase "remote control" but is usually encountered in research, academia and technology. It is most commonly associated with robotics and mobile robots but can be applied to a whole range of circumstances in which a device or machine is operated by a person from a distance.

Contents

Teleoperation can be considered a human-machine system. For example, ArduPilot provides a spectrum of autonomy ranging from manual control to full autopilot for autonomous vehicles.

The term teleoperation is in use in research and technical communities as a standard term for referring to operation at a distance. This is as opposed to telepresence which is a less standard term and might refer to a whole range of existence or interaction that include a remote connotation.

History

The 19th century saw many inventors working on remotely operated weapons (torpedoes) including prototypes built by John Louis Lay (1872), John Ericsson (1873), Victor von Scheliha (1873), and the first practical wire guided torpedo, the Brennan torpedo, patented by Louis Brennan in 1877. [1] [2] In 1898, Nikola Tesla demonstrated a remotely controlled boat with a patented wireless radio guidance system that he tried to market to the United States military, but was turned down. [3]

Teleoperation is now moving into the hobby industry with first-person view (FPV) equipment. [4] FPV equipment mounted on hobby cars, planes and helicopters give a TV-style transmission back to the operator, extending the range of the vehicle to greater than line-of-sight range.

Examples

There are several particular types of systems that are often controlled remotely:

Teleoperation of Autonomous Vehicles

Teleoperation of Autonomous Vehicles, is the ability to remotely drive or assist a self-driving car.

Most leading companies in the industry believe that to bridge the gap between current self-driving capabilities and the requirements needed for widespread adoption of autonomous vehicles, there is a need to have Teleoperation capabilities for assisting self-driving cars, in situations of ‘edge cases’ – where the autonomous vehicle software stack has low confidence level in its ability to perform the correct action, or when the vehicle needs to operate outside of its standard operating parameters. Without remote assistance, in such situations the self-driving car would transition to a Minimum Risk Maneuverer (MRM) which is usually to stop.

Many AV companies plan on using teleoperations as part of their rollout for self driving cars. Examples of companies that have stated they will deploy, or currently deploying teleoperations solutions include Voyage.auto, [6] Denso, Waymo, GM Cruise, Aptiv, Zoox.

Teleoperation of Autonomous Vehicles includes privately owned self driving car use cases, such as self parking assistants, shared mobility use cases, e.g. in robotaxis and autonomous shuttles and industrial use cases, for example autonomous forklifts.

There are two main modes for Teleoperation of Autonomous Vehicles: Remote Driving, also called “Direct Driving” – where the remote operator performs the dynamic drive task, i.e. drives the car remotely, controlling the car's steering, acceleration and braking systems. Remote Assistance, also called “High Level Commands” – remote operators supervise the vehicle, and provide instructions, approve or correct the vehicle path, without actually performing the dynamic driving task. Some companies deploy a combination of both concepts, depending on the use case. Examples of companies that provide solutions in the field of Teleoperations are DriveU.auto, [7] Roboauto, Scotti.ai, Phantom.Auto, Pylot, Ottopia, Designated Driver and Soliton Systems. [8]

See also

Related Research Articles

<span class="mw-page-title-main">Robot</span> Machine capable of carrying out a complex series of actions automatically

A robot is a machine—especially one programmable by a computer—capable of carrying out a complex series of actions automatically. A robot can be guided by an external control device, or the control may be embedded within. Robots may be constructed to evoke human form, but most robots are task-performing machines, designed with an emphasis on stark functionality, rather than expressive aesthetics.

An autonomous robot is a robot that acts without recourse to human control. Historic examples include space probes. Modern examples include self-driving vacuums and cars.

<span class="mw-page-title-main">Radio control</span> Use of radio signals to remotely control a device, vehicle or drone

Radio control is the use of control signals transmitted by radio to remotely operate a device. Examples of simple radio control systems are garage door openers and keyless entry systems for vehicles, in which a small handheld radio transmitter unlocks or opens doors. Radio control is also used for control of model vehicles from a hand-held radio transmitter. Industrial, military, and scientific research organizations make use of radio-controlled vehicles as well. A rapidly growing application is control of unmanned aerial vehicles for both civilian and military uses, although these have more sophisticated control systems than traditional applications.

<span class="mw-page-title-main">Self-driving car</span> Vehicle operated with reduced human input

A self-driving car, also known as a autonomous car (AC), driverless car, robotaxi, robotic car or robo-car, is a car that is capable of operating with reduced or no human input. Self-driving cars are responsible for all driving activities, such as perceiving the environment, monitoring important systems, and controlling the vehicle, which includes navigating from origin to destination.

<span class="mw-page-title-main">Telepresence</span> Technologies allowing a person to feel they are present in another place

Telepresence is the appearance or sensation of a person being present at a place other than their true location, via telerobotics or video.

<span class="mw-page-title-main">Telerobotics</span> Controlling robots from a distance

Telerobotics is the area of robotics concerned with the control of semi-autonomous robots from a distance, chiefly using television, wireless networks or tethered connections. It is a combination of two major subfields, which are teleoperation and telepresence.

<span class="mw-page-title-main">Remote-control vehicle</span> Type of vehicle

A remote-control vehicle, is defined as any vehicle that is teleoperated by a means that does not restrict its motion with an origin external to the device. This is often a radio-control device, a cable between the controller and the vehicle, or an infrared controller.

<span class="mw-page-title-main">Autonomous underwater vehicle</span> Uncrewed underwater vehicle with autonomous guidance system

An autonomous underwater vehicle (AUV) is a robot that travels underwater without requiring continuous input from an operator. AUVs constitute part of a larger group of undersea systems known as unmanned underwater vehicles, a classification that includes non-autonomous remotely operated underwater vehicles (ROVs) – controlled and powered from the surface by an operator/pilot via an umbilical or using remote control. In military applications an AUV is more often referred to as an unmanned undersea vehicle (UUV). Underwater gliders are a subclass of AUVs.

<span class="mw-page-title-main">Unmanned ground vehicle</span> Type of vehicle

An unmanned ground vehicle (UGV) is a vehicle that operates while in contact with the ground without an onboard human presence. UGVs can be used for many applications where it is inconvenient, dangerous, expensive, or impossible to use an onboard human operator. Typically, the vehicle has sensors to observe the environment, and autonomously controls its behavior or uses a remote human operator to control the vehicle via teleoperation.

<span class="mw-page-title-main">Unmanned underwater vehicle</span> Submersible vehicles that can operate underwater without a human occupant

Unmanned underwater vehicles (UUV), also known as uncrewed underwater vehicles and underwater drones, are submersible vehicles that can operate underwater without a human occupant. These vehicles may be divided into two categories: remotely operated underwater vehicles (ROUVs) and autonomous underwater vehicles (AUVs). ROUVs are remotely controlled by a human operator. AUVs are automated and operate independently of direct human input.

<span class="mw-page-title-main">Vehicular automation</span> Automation for various purposes of vehicles

Vehicular automation involves the use of mechatronics, artificial intelligence, and multi-agent systems to assist the operator of a vehicle such as a car, lorry, aircraft, or watercraft. A vehicle using automation for tasks such as navigation to ease but not replace human control, qualify as semi-autonomous, whereas a fully self-operated vehicle is termed autonomous.

A virtual fixture is an overlay of augmented sensory information upon a user's perception of a real environment in order to improve human performance in both direct and remotely manipulated tasks. Developed in the early 1990s by Louis Rosenberg at the U.S. Air Force Research Laboratory (AFRL), Virtual Fixtures was a pioneering platform in virtual reality and augmented reality technologies.

Squad Mission Support System is an unmanned all terrain wheeled vehicle developed by Lockheed Martin.

<span class="mw-page-title-main">Glossary of robotics</span> List of definitions of terms and concepts commonly used in the study of robotics

Robotics is the branch of technology that deals with the design, construction, operation, structural disposition, manufacture and application of robots. Robotics is related to the sciences of electronics, engineering, mechanics, and software.

<span class="mw-page-title-main">Uncrewed vehicle</span> Type of vehicle

An uncrewed vehicle or unmanned vehicle is a vehicle without a person on board. Uncrewed vehicles can either be under telerobotic control—remote controlled or remote guided vehicles—or they can be autonomously controlled—autonomous vehicles—which are capable of sensing their environment and navigating on their own.

The following outline is provided as an overview of and topical guide to robotics:

<span class="mw-page-title-main">K-10 robot</span>

K10 are rovers used to explore planetary surfaces. Each third-generation K10 has four-wheel drive, all-wheel steering and a passive averaging suspension. This helps reduce the motion induced by travel over uneven ground. The K10 has mounting points on its front, back, and bottom that allows for antennas, sensors, and other scientific instruments to be attached. The K10 controller runs on a Linux laptop and communicates via 802.11g wireless, or a Tropos mesh wireless.

Adaptive collaborative control is the decision-making approach used in hybrid models consisting of finite-state machines with functional models as subcomponents to simulate behavior of systems formed through the partnerships of multiple agents for the execution of tasks and the development of work products. The term “collaborative control” originated from work developed in the late 1990s and early 2000 by Fong, Thorpe, and Baur (1999). It is important to note that according to Fong et al. in order for robots to function in collaborative control, they must be self-reliant, aware, and adaptive. In literature, the adjective “adaptive” is not always shown but is noted in the official sense as it is an important element of collaborative control. The adaptation of traditional applications of control theory in teleoperations sought initially to reduce the sovereignty of “humans as controllers/robots as tools” and had humans and robots working as peers, collaborating to perform tasks and to achieve common goals. Early implementations of adaptive collaborative control centered on vehicle teleoperation. Recent uses of adaptive collaborative control cover training, analysis, and engineering applications in teleoperations between humans and multiple robots, multiple robots collaborating among themselves, unmanned vehicle control, and fault tolerant controller design.

<span class="mw-page-title-main">Remote Applications in Challenging Environments</span> Robotics test centre near Oxford, England

Remote Applications in Challenging Environments (RACE) is a remote handling and robotics test facility located at Culham Science Centre near Oxford, UK, operated by UKAEA. As part of the UK Government's Robotics and Autonomous Systems Strategy (RAS) this is one of the initiatives that is supporting development and growth in remote handling. RACE uses the broad range of expertise from UKAEA and CCFE's past experience in remote handling used on JET.

Torc Robotics (Torc), an independent subsidiary of Daimler Truck, is an American autonomous truck company headquartered in Blacksburg, Virginia, with operations in Albuquerque, New Mexico; Austin, Texas; and Stuttgart, Germany. Torc is testing autonomous trucks in Virginia, New Mexico, and Texas and is taking a pure play approach to commercialization – focusing at first on one platform in one region.

References

  1. Gray, Edwyn (2004). Nineteenth-century Torpedoes and Their Inventors. Annapolis, Maryland: Naval Institute Press
  2. Roger Branfill-Cook, Torpedo: The Complete History of the World's Most Revolutionary Naval Weapon, Naval Institute Press, 2014, page 45
  3. Roger Branfill-Cook, Torpedo: The Complete History of the World's Most Revolutionary Naval Weapon, Naval Institute Press, 2014, page 31
  4. Fritsche, L.; Unverzagt, F.; Peters, J. & Calandra, R., First-Person Tele-Operation of a Humanoid Robot, IEEE-RAS International Conference on Humanoid Robots (HUMANOIDS), 2015, 997-1002
  5. Armasuisse and SBB, RSL demonstrated the use of a teleoperated Menzi Muck M545 to clean up a rock slide, 2020.
  6. "Delivering on the promise of self-driving cars". 2020-09-23. Retrieved 2020-09-23.
  7. "Superior connectivity platform for autonomous vehicle teleoperation". 2020-09-23. Retrieved 2020-09-23.
  8. "ultra low latency video streaming platform for autonomous vehicle teleoperation". 2024-08-27. Retrieved 2024-08-27.