Teleoperation

Last updated
An IED detonator, a telemanipulator for investigating potentially explosive devices IED detonator.jpg
An IED detonator, a telemanipulator for investigating potentially explosive devices

Teleoperation (or remote operation) indicates operation of a system or machine at a distance. It is similar in meaning to the phrase "remote control" but is usually encountered in research, academia and technology. It is most commonly associated with robotics and mobile robots but can be applied to a whole range of circumstances in which a device or machine is operated by a person from a distance.

Contents

Teleoperation can be considered a human-machine system. For example, ArduPilot provides a spectrum of autonomy ranging from manual control to full autopilot for autonomous vehicles.

The term teleoperation is in use in research and technical communities as a standard term for referring to operation at a distance. This is as opposed to telepresence which is a less standard term and might refer to a whole range of existence or interaction that include a remote connotation.

History

The 19th century saw many inventors working on remotely operated weapons (torpedoes) including prototypes built by John Louis Lay (1872), John Ericsson (1873), Victor von Scheliha (1873), and the first practical wire guided torpedo, the Brennan torpedo, patented by Louis Brennan in 1877. [1] [2] In 1898, Nikola Tesla demonstrated a remotely controlled boat with a patented wireless radio guidance system that he tried to market to the United States military, but was turned down. [3]

Teleoperation is now moving into the hobby industry with first-person view (FPV) equipment. [4] FPV equipment mounted on hobby cars, planes and helicopters give a TV-style transmission back to the operator, extending the range of the vehicle to greater than line-of-sight range.

Examples

There are several particular types of systems that are often controlled remotely:

Teleoperation of Autonomous Vehicles

Teleoperation of Autonomous Vehicles, is the ability to remotely drive or assist a self-driving car.

Most leading companies in the industry believe that to bridge the gap between current self-driving capabilities and the requirements needed for widespread adoption of autonomous vehicles, there is a need to have Teleoperation capabilities for assisting self-driving cars, in situations of ‘edge cases’ – where the autonomous vehicle software stack has low confidence level in its ability to perform the correct action, or when the vehicle needs to operate outside of its standard operating parameters. Without remote assistance, in such situations the self-driving car would transition to a Minimum Risk Maneuverer (MRM) which is usually to stop.

Many AV companies plan on using teleoperations as part of their rollout for self driving cars. Examples of companies that have stated they will deploy, or currently deploying teleoperations solutions include Voyage.auto, [6] Denso, Waymo, GM Cruise, Aptiv, Zoox.

Teleoperation of Autonomous Vehicles includes privately owned self driving car use cases, such as self parking assistants, shared mobility use cases, e.g. in robotaxis and autonomous shuttles and industrial use cases, for example autonomous forklifts.

There are two main modes for Teleoperation of Autonomous Vehicles: Remote Driving, also called “Direct Driving” – where the remote operator performs the dynamic drive task, i.e. drives the car remotely, controlling the car's steering, acceleration and braking systems. Remote Assistance, also called “High Level Commands” – remote operators supervise the vehicle, and provide instructions, approve or correct the vehicle path, without actually performing the dynamic driving task. Some companies deploy a combination of both concepts, depending on the use case. Examples of companies that provide solutions in the field of Teleoperations are DriveU.auto, [7] Roboauto, Scotti.ai, Phantom.Auto, Pylot, Ottopia, and Designated Driver.

See also

Related Research Articles

<span class="mw-page-title-main">Robot</span> Machine capable of carrying out a complex series of actions automatically

A robot is a machine—especially one programmable by a computer—capable of carrying out a complex series of actions automatically. A robot can be guided by an external control device, or the control may be embedded within. Robots may be constructed to evoke human form, but most robots are task-performing machines, designed with an emphasis on stark functionality, rather than expressive aesthetics.

An autonomous robot is a robot that acts without recourse to human control. The first autonomous robots environment were known as Elmer and Elsie, which were constructed in the late 1940s by W. Grey Walter. They were the first robots in history that were programmed to "think" the way biological brains do and meant to have free will. Elmer and Elsie were often labeled as tortoises because of how they were shaped and the manner in which they moved. They were capable of phototaxis which is the movement that occurs in response to light stimulus.

<span class="mw-page-title-main">Remote control</span> Device used to control other device remotely

In electronics, a remote control is an electronic device used to operate another device from a distance, usually wirelessly. In consumer electronics, a remote control can be used to operate devices such as a television set, DVD player or other digital home media appliance. A remote control can allow operation of devices that are out of convenient reach for direct operation of controls. They function best when used from a short distance. This is primarily a convenience feature for the user. In some cases, remote controls allow a person to operate a device that they otherwise would not be able to reach, as when a garage door opener is triggered from outside.

<span class="mw-page-title-main">Radio control</span> Use of radio signals to remotely control a device, vehicle or drone

Radio control is the use of control signals transmitted by radio to remotely operate a device. Examples of simple radio control systems are garage door openers and keyless entry systems for vehicles, in which a small handheld radio transmitter unlocks or opens doors. Radio control is also used for control of model vehicles from a hand-held radio transmitter. Industrial, military, and scientific research organizations make use of radio-controlled vehicles as well. A rapidly growing application is control of unmanned aerial vehicles for both civilian and military uses, although these have more sophisticated control systems than traditional applications.

<span class="mw-page-title-main">Self-driving car</span> Vehicle operated with reduced human input

A self-driving car, also known as an autonomous car (AC), driverless car, or robotic car (robo-car), is a car that is capable of operating with reduced or no human input. Self-driving cars are responsible for all driving activities including perceiving the environment, monitoring important systems, and controlling the vehicle, including navigating from origin to destination.

Telepresence refers to a set of technologies which allow a person to feel as if they were present, to give the appearance or effect of being present via telerobotics, at a place other than their true location.

<span class="mw-page-title-main">Telerobotics</span>

Telerobotics is the area of robotics concerned with the control of semi-autonomous robots from a distance, chiefly using television, wireless networks or tethered connections. It is a combination of two major subfields, which are teleoperation and telepresence.

<span class="mw-page-title-main">Remote-control vehicle</span> Type of vehicle

A remote-control vehicle is defined as any vehicle that is teleoperated by a means that does not restrict its motion with an origin external to the device. This is often a radio-control device, a cable between the controller and the vehicle, or an infrared controller.

<span class="mw-page-title-main">Autonomous underwater vehicle</span> Unmanned underwater vehicle with autonomous guidance system

An autonomous underwater vehicle (AUV) is a robot that travels underwater without requiring continuous input from an operator. AUVs constitute part of a larger group of undersea systems known as unmanned underwater vehicles, a classification that includes non-autonomous remotely operated underwater vehicles (ROVs) – controlled and powered from the surface by an operator/pilot via an umbilical or using remote control. In military applications an AUV is more often referred to as an unmanned undersea vehicle (UUV). Underwater gliders are a subclass of AUVs.

<span class="mw-page-title-main">Unmanned ground vehicle</span> Type of vehicle

An unmanned ground vehicle (UGV) is a vehicle that operates while in contact with the ground and without an onboard human presence. UGVs can be used for many applications where it may be inconvenient, dangerous, or impossible to have a human operator present. Generally, the vehicle will have a set of sensors to observe the environment, and will either autonomously make decisions about its behavior or pass the information to a human operator at a different location who will control the vehicle through teleoperation.

<span class="mw-page-title-main">Vehicular automation</span> Automation for various purposes of vehicles

Vehicular automation involves the use of mechatronics, artificial intelligence, and multi-agent systems to assist the operator of a vehicle such as a car, lorries, aircraft, or watercraft. A vehicle using automation for tasks such as navigation to ease but not replace human control, qualify as semi-autonomous, whereas a fully self-operated vehicle is termed autonomous.

<span class="mw-page-title-main">Unmanned surface vehicle</span> Vehicle that operates on the surface of the water without a crew

An unmanned surface vehicle, unmanned surface vessel or uncrewed surface vessel (USV), colloquially called a drone boat, drone ship or sea drone, is a boat or ship that operates on the surface of the water without a crew. USVs operate with various levels of autonomy, from remote control to fully autonomous surface vehicles (ASV).

A virtual fixture is an overlay of augmented sensory information upon a user's perception of a real environment in order to improve human performance in both direct and remotely manipulated tasks. Developed in the early 1990s by Louis Rosenberg at the U.S. Air Force Research Laboratory (AFRL), Virtual Fixtures was a pioneering platform in virtual reality and augmented reality technologies.

<span class="mw-page-title-main">Glossary of robotics</span> List of definitions of terms and concepts commonly used in the study of robotics

Robotics is the branch of technology that deals with the design, construction, operation, structural disposition, manufacture and application of robots. Robotics is related to the sciences of electronics, engineering, mechanics, and software.

<span class="mw-page-title-main">Uncrewed vehicle</span> Type of vehicle

An uncrewed vehicle or unmanned vehicle is a vehicle without a person on board. Uncrewed vehicles can either be under telerobotic control—remote controlled or remote guided vehicles—or they can be autonomously controlled—autonomous vehicles—which are capable of sensing their environment and navigating on their own.

The following outline is provided as an overview of and topical guide to robotics:

<span class="mw-page-title-main">K-10 robot</span>

K10 are rovers used to explore planetary surfaces. Each third-generation K10 has four-wheel drive, all-wheel steering and a passive averaging suspension. This helps reduce the motion induced by travel over uneven ground. The K10 has mounting points on its front, back, and bottom that allows for antennas, sensors, and other scientific instruments to be attached. The K10 controller runs on a Linux laptop and communicates via 802.11g wireless, or a Tropos mesh wireless.

Adaptive collaborative control is the decision-making approach used in hybrid models consisting of finite-state machines with functional models as subcomponents to simulate behavior of systems formed through the partnerships of multiple agents for the execution of tasks and the development of work products. The term “collaborative control” originated from work developed in the late 1990s and early 2000 by Fong, Thorpe, and Baur (1999). It is important to note that according to Fong et al. in order for robots to function in collaborative control, they must be self-reliant, aware, and adaptive. In literature, the adjective “adaptive” is not always shown but is noted in the official sense as it is an important element of collaborative control. The adaptation of traditional applications of control theory in teleoperations sought initially to reduce the sovereignty of “humans as controllers/robots as tools” and had humans and robots working as peers, collaborating to perform tasks and to achieve common goals. Early implementations of adaptive collaborative control centered on vehicle teleoperation. Recent uses of adaptive collaborative control cover training, analysis, and engineering applications in teleoperations between humans and multiple robots, multiple robots collaborating among themselves, unmanned vehicle control, and fault tolerant controller design.

<span class="mw-page-title-main">Remote Applications in Challenging Environments</span> Robotics test centre near Oxford, England

Remote Applications in Challenging Environments (RACE) is a remote handling and robotics test facility located at Culham Science Centre near Oxford, UK, operated by UKAEA. As part of the UK Government's Robotics and Autonomous Systems Strategy (RAS) this is one of the initiatives that is supporting development and growth in remote handling. RACE uses the broad range of expertise from UKAEA and CCFE's past experience in remote handling used on JET.

Torc Robotics (Torc), an independent subsidiary of Daimler Truck, is an American autonomous truck company headquartered in Blacksburg, Virginia, with operations in Albuquerque, New Mexico; Austin, Texas; and Stuttgart, Germany. Torc is testing autonomous trucks in Virginia, New Mexico, and Texas and is taking a pure play approach to commercialization – focusing at first on one platform in one region.

References

  1. Gray, Edwyn (2004). Nineteenth-century Torpedoes and Their Inventors. Annapolis, Maryland: Naval Institute Press
  2. Roger Branfill-Cook, Torpedo: The Complete History of the World's Most Revolutionary Naval Weapon, Naval Institute Press, 2014, page 45
  3. Roger Branfill-Cook, Torpedo: The Complete History of the World's Most Revolutionary Naval Weapon, Naval Institute Press, 2014, page 31
  4. Fritsche, L.; Unverzagt, F.; Peters, J. & Calandra, R., First-Person Tele-Operation of a Humanoid Robot, IEEE-RAS International Conference on Humanoid Robots (HUMANOIDS), 2015, 997-1002
  5. Armasuisse and SBB, RSL demonstrated the use of a teleoperated Menzi Muck M545 to clean up a rock slide, 2020.
  6. "Delivering on the promise of self-driving cars". 2020-09-23. Retrieved 2020-09-23.
  7. "Superior connectivity platform for autonomous vehicle teleoperation". 2020-09-23. Retrieved 2020-09-23.