Artificial Passenger

Last updated January 28, 2024

The Artificial Passenger is a telematic device, developed by IBM, that interacts verbally with a driver to reduce the likelihood of them falling asleep at the controls of a vehicle.^[1] It is based on inventions covered by U.S. patent 6,236,968.^[2]Whereas, Telematics device perform a range of functions by gathering vehicle location and activity data, and turning this into business insight. Also Telematic machine works by Capturing vehicle location data via a GPS enabled device installed in a vehicle. The Artificial Passenger is equipped to engage a vehicle operator by carrying on conversations, playing verbal games, controlling the vehicle's stereo system, and so on. It also monitors the driver's speech patterns to detect fatigue, and in response can suggest that the driver take a break or get some sleep.^[3]^[4] The Artificial Passenger may also be integrated with wireless services to provide weather and road information, driving directions, and other such notifications systems.^[5]

Voice control interface

According to Dimitri Kanevsky, a former IBM researcher, currently at Google, The Artificial Passenger was developed using the Conversational Interactivity for Telematics (CIT) speech system which counts on the driver's natural speech instead of the use of hands. The CIT relies on a Natural Language Understanding (NLU) system that is difficult to develop because of the low-powered computer systems available inside cars. IBM suggests that this system be located on a server and accessed through the cars' wireless technologies. IBM also says they are working on a "quasi-NLU" that uses fewer resources from the CPU and can be used inside the car.^[6] The CIT system includes another system called the Dialog Manager (DM). The DM takes the load of the NLU system by interacting with the vehicle, the driver, and external systems such as weather systems, email, telephones and more.^[7]

The NLU system receives a voice command from the driver and looks through a file system to come up with an action to be performed and executes that action.^[6] The DM works with questions asked by the driver such as "How far is The Gallatin Field Airport from here?" The NLU system will still not be able to understand everything a driver says. Reasons for that are the different idioms and dialects of different regions. IBM is working on developing a system that recognizes where the driver is and acknowledge the regional diction used in that area.^[7]

Another system used within this technology is the Learning Transformation (LT) system which monitors the actions of the occupants of the car and of the cars around it, learns patterns within the driver's speech and store that data, and learns from such data to try to improve the performance of the technology as a whole.^[6]

Speech recognition

The speech recognition process relies on three steps. The front-end filters out any unwanted noise such as noise from the car, background music, or background passengers. It gets rid of all low energy and high variability signal being recognized.^[7] The labeler breaks apart the speech and searches in a data base to recognize what is being said. It starts broad by seeing what subject the driver is speaking of. Then goes into more details of what the driver is truly asking. The decoder next takes all this information and formulates a response to the driver.^[6] IBM states through much experimentation that the speech recognition is very accurate but the process has not fully been refined and still has kinks with in it.^[7]

The main part of the Artificial Passenger is the disruptive speech recognition. This technology keeps a conversation with the driver and analyzes what the driver is saying and how s/he is saying it. It can recognize fluctuations in the driver's voice to determine if the driver is sleepy, upset, or in a good mood through different vibration patterns in the driver's speech. It also record the time it takes for a driver to respond in the conversation and from that determine if the driver is nodding off or being distracted by something.^[7]

Driver drowsiness prevention

When the computer recognizes that the driver is dozing off, it sends a signal to interfere. The computer will step in by changing the radio, trying to play games with the driver, or by opening window to wake the driver up.^[5] The computer wants to improve their alertness by doing these. If it finds that the driver is nodding off over and over, the computer system is programmed to ask to call a nearby hotel and book a room or suggest the driver take a break.^[6]

The Artificial Passenger will try to read jokes, play games, ask questions or read interactive books to stimulate the driver. Drivers that show more drowsiness will be given content that is more stimulating than a driver who is not as drowsy.^[6]

Distributive user interface between cars

IBM recognizes that there are more dangers to a driver than him/herself. Artificial Passenger is proposed to work between cars by relaying information to one another. The information could include driving records to show if they have a history of being a bad driver or on-time analysis of all drivers to show which ones are becoming drowsy and can interfere through this information. It can also show if a driver is being distracted by games or wireless devices and interfere with all surrounding drivers.^[7]

Related Research Articles

Speech recognition is an interdisciplinary subfield of computer science and computational linguistics that develops methodologies and technologies that enable the recognition and translation of spoken language into text by computers. It is also known as automatic speech recognition (ASR), computer speech recognition or speech to text (STT). It incorporates knowledge and research in the computer science, linguistics and computer engineering fields. The reverse process is speech synthesis.

<span class="mw-page-title-main">Intelligent transportation system</span> Advanced application

An intelligent transportation system (ITS) is an advanced application which aims to provide innovative services relating to different modes of transport and traffic management and enable users to be better informed and make safer, more coordinated, and 'smarter' use of transport networks.

Wireless communication is the transfer of information (telecommunication) between two or more points without the use of an electrical conductor, optical fiber or other continuous guided medium for the transfer. The most common wireless technologies use radio waves. With radio waves, intended distances can be short, such as a few meters for Bluetooth or as far as millions of kilometers for deep-space radio communications. It encompasses various types of fixed, mobile, and portable applications, including two-way radios, cellular telephones, personal digital assistants (PDAs), and wireless networking. Other examples of applications of radio wireless technology include GPS units, garage door openers, wireless computer mouse, keyboards and headsets, headphones, radio receivers, satellite television, broadcast television and cordless telephones. Somewhat less common methods of achieving wireless communications involve other electromagnetic phenomena, such as light and magnetic or electric fields, or the use of sound.

Automatic vehicle location is a means for automatically determining and transmitting the geographic location of a vehicle. This vehicle location data, from one or more vehicles, may then be collected by a vehicle tracking system to manage an overview of vehicle travel. As of 2017, GPS technology has reached the point of having the transmitting device be smaller than the size of a human thumb, able to run 6 months or more between battery charges, easy to communicate with smartphones — all for less than $20 USD.

Mobile computing is human–computer interaction in which a computer is expected to be transported during normal usage and allow for transmission of data, which can include voice and video transmissions. Mobile computing involves mobile communication, mobile hardware, and mobile software. Communication issues include ad hoc networks and infrastructure networks as well as communication properties, protocols, data formats, and concrete technologies. Hardware includes mobile devices or device components. Mobile software deals with the characteristics and requirements of mobile applications.

An over-the-air update, also known as over-the-air programming, is an update to an embedded system that is delivered through a wireless network, such as Wi-Fi or a cellular network. These embedded systems include mobile phones, tablets, set-top boxes, cars and telecommunications equipment. OTA updates for cars and internet of things devices can also be called firmware over-the-air (FOTA). Various components may be updated OTA, including the device's operating system, applications, configuration settings, or parameters like encryption keys.

Telematics is an interdisciplinary field encompassing telecommunications, vehicular technologies, electrical engineering, and computer science. Telematics can involve any of the following:

An advanced driver-assistance system (ADAS) includes technologies that assist drivers with the safe operation of a vehicle. Through a human-machine interface, ADAS increases car and road safety. ADAS uses automated technology, such as sensors and cameras, to detect nearby obstacles or driver errors, and respond accordingly. ADAS can enable various levels of autonomous driving.

Usage-based insurance (UBI), also known as pay as you drive (PAYD), pay how you drive (PHYD) and mile-based auto insurance, is a type of vehicle insurance whereby the costs are dependent upon type of vehicle used, measured against time, distance, behavior and place.

Machine to machine (M2M) is direct communication between devices using any communications channel, including wired and wireless. Machine to machine communication can include industrial instrumentation, enabling a sensor or meter to communicate the information it records to application software that can use it. Such communication was originally accomplished by having a remote network of machines relay information back to a central hub for analysis, which would then be rerouted into a system like a personal computer.

Vehicle safety technology (VST) in the automotive industry refers to the special technology developed to ensure the safety and security of automobiles and their passengers. The term encompasses a broad umbrella of projects and devices within the automotive world. Notable examples of VST include geo-fencing capabilities, remote speed sensing, theft deterrence, damage mitigation, vehicle-to-vehicle communication, and car-to-computer communication devices which use GPS tracking.

A virtual assistant (VA) is a software agent that can perform a range of tasks or services for a user based on user input such as commands or questions, including verbal ones. Such technologies often incorporate chatbot capabilities to simulate human conversation, such as via online chat, to facilitate interaction with their users. The interaction may be via text, graphical interface, or voice - as some virtual assistants are able to interpret human speech and respond via synthesized voices.

Driver drowsiness detection is a car safety technology which helps prevent accidents caused by the driver getting drowsy. Various studies have suggested that around 20% of all road accidents are fatigue-related, up to 50% on certain roads.

G-Book is a telematics subscription service provided by Toyota Motor Corporation in Japan for its Toyota- and Lexus-branded vehicles. G-Book allows users to link with cellphones. personal digital assistants (PDA)'s, personal computers (PC) and G-Book equipped cars across Japan. It is based on the former GAZOO infrastructure of Toyota's membership-based information service and membership system, and it provides interactive information services via vehicle installed touch-screen wireless communication terminals. It also incorporates information from Toyota Mapmaster Inc. which updates digital mapping information and is used by various international companies.

A vehicle tracking system combines the use of automatic vehicle location in individual vehicles with software that collects these fleet data for a comprehensive picture of vehicle locations. Modern vehicle tracking systems commonly use GPS or GLONASS technology for locating the vehicle, but other types of automatic vehicle location technology can also be used. Vehicle information can be viewed on electronic maps via the Internet or specialized software. Urban public transit authorities are an increasingly common user of vehicle tracking systems, particularly in large cities.

Hari Balakrishnan is the Fujitsu Professor of Computer Science and Artificial Intelligence in the Department of Electrical Engineering and Computer Science at MIT, and the Co-founder and CTO at Cambridge Mobile Telematics.

Fatigue detection software is intended to reduce fatigue related fatalities and incidents. Several companies are working on a technology for use in industries such as mining, road- and rail haulage and aviation. The technology may soon find wider applications in industries such as health care and education.

Cellport Systems, Inc., is an American company specializing in the invention, prototype development, patenting, and licensing of wireless connectivity technologies for Internet-connected vehicles and mobile devices. Cellport also develops vehicle gateways using secure blockchain technology. Cellport licenses its technologies to vehicle and wireless device manufacturers worldwide.

CalAmp is an Irvine, California-based provider of Internet of things (IoT) software applications, cloud services, data intelligence and telematics products and services. The company's technology includes edge computing devices and SaaS-based applications for remotely tracking and managing vehicles, drivers, cargo and other mobile assets. The company also owns the patents and trademarks for the LoJack Stolen Vehicle Recovery System and provides connected car and lot management products.

Automotive security refers to the branch of computer security focused on the cyber risks related to the automotive context. The increasingly high number of ECUs in vehicles and, alongside, the implementation of multiple different means of communication from and towards the vehicle in a remote and wireless manner led to the necessity of a branch of cybersecurity dedicated to the threats associated with vehicles. Not to be confused with automotive safety.

References

↑ Sample, Ian, You drive me crazy , New Scientist, Issue 2300, July 2001. Retrieved on June 29, 2008.
↑ "U.S. patent: Sleep prevention dialog based car system". Archived from the original on 2011-05-23. Retrieved 2008-06-29.
↑ The New York Times, December 27, 2001. A passenger whose chatter is always appreciated Archived October 17, 2009, at the Wayback Machine by A. Eisenberg. Retrieved on June 29, 2008
↑ Kanevsky, D., Telematics: Artificial Passenger and beyond, Human Factors and Voice Interactive Systems, Signals and Communications Technology Series, Springer US, pp. 291-325. https://doi.org/10.1007%2F978-0-387-68439-0_10
1 2 Kharif, olga. "IBM to Drivers: Wake Up!". Archived from the original on August 21, 2001. Retrieved 6 December 2011.
1 2 3 4 5 6 Kanevsky, Dimitri. "IBM Research Report" (PDF). Retrieved 6 December 2011.
1 2 3 4 5 6 Kanevsky, Dimitri (2008). "Telematics: Artificial Passenger and Beyond". Human Factors and Voice Interactive Systems. Signals and Communication Technology. pp. 291–325. doi:10.1007/978-0-387-68439-0_10. ISBN 978-0-387-25482-1.

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[1] Sample, Ian, You drive me crazy , New Scientist, Issue 2300, July 2001. Retrieved on June 29, 2008.

[2] "U.S. patent: Sleep prevention dialog based car system". Archived from the original on 2011-05-23. Retrieved 2008-06-29.

[3] The New York Times, December 27, 2001. A passenger whose chatter is always appreciated Archived October 17, 2009, at the Wayback Machine by A. Eisenberg. Retrieved on June 29, 2008

[4] Kanevsky, D., Telematics: Artificial Passenger and beyond, Human Factors and Voice Interactive Systems, Signals and Communications Technology Series, Springer US, pp. 291-325. https://doi.org/10.1007%2F978-0-387-68439-0_10

[BWeek-5] 1 2 Kharif, olga. "IBM to Drivers: Wake Up!". Archived from the original on August 21, 2001. Retrieved 6 December 2011.

[bare_url-6] 1 2 3 4 5 6 Kanevsky, Dimitri. "IBM Research Report" (PDF). Retrieved 6 December 2011.

[springerlink-7] 1 2 3 4 5 6 Kanevsky, Dimitri (2008). "Telematics: Artificial Passenger and Beyond". Human Factors and Voice Interactive Systems. Signals and Communication Technology. pp. 291–325. doi:10.1007/978-0-387-68439-0_10. ISBN 978-0-387-25482-1.

[1]

[2]

[3]

[4]

[5]

[6]

[7]