Traffic-sign recognition

Last updated
Traffic-sign (speed limit) recognition Verkehrszeichenerkennung IMG 6859.JPG
Traffic-sign (speed limit) recognition

Traffic-sign recognition (TSR) is a technology by which a vehicle is able to recognize the traffic signs put on the road e.g. "speed limit" or "children" or "turn ahead". This is part of the features collectively called ADAS. The technology is being developed by a variety of automotive suppliers to improve the safety of vehicles. It uses image processing techniques to detect the traffic signs. The detection methods can be generally divided into color based, shape based and learning based methods.

Contents

History

The Vienna Convention on Road Signs and Signals is a treaty signed in 1968 which has been able to standardize traffic signs across different countries. About 52 countries have signed this treaty, which includes 31 countries from Europe. The convention has broadly classified the road signs into seven categories designated with letters A to H. This standardization has been the main drive for helping the development of traffic-sign recognition systems that can be used globally.

A speed limit sign in the United States Traffic Sign Detection Stop Sign.jpeg
A speed limit sign in the United States

Traffic-sign recognition first appeared, in the form of speed limit sign recognition, in 2008 for the 2009 Vauxhall Insignia. [1] Later in 2009 they appeared on the new BMW 7 Series, and the following year on the Mercedes-Benz S-Class. At that time, these systems only detected the round speed limit signs found all across Europe (e.g. [2] ).

Second-generation systems can also detect overtaking restrictions. It was introduced in 2008 in the Opel Insignia, [3] later followed by the Opel Astra and the Saab 9-5. This technology is also available on the 2011 Volkswagen Phaeton [4] and, since 2012, in the Volvo S80, V70, XC70, XC60, S60, V60 and V40, as a technology called Road Sign Information. [5] They are not able to recognize city limit signs, which in most European countries are associated with speed limits, as they are too similar to direction signs.

Such systems are expected to be mandatory on new cars sold in the EU from May 2022 [6] [7] which should apply regulation 2021/1958 from 23 June 2021. [8]

Implementation

Traffic signs can be analyzed using forward-facing cameras in many modern cars, vehicles and trucks. One of the basic use cases of a traffic-sign recognition system is for speed limits. Most of the GPS data would procure speed information, but additional speed limit traffic signs can also be used to extract information and display it in the dashboard of the car to alert the driver about the road sign. This is an advanced driver-assistance feature available in most high-end cars, mainly in European vehicles.

An example algorithm for traffic-sign detection Traffic Sign Detection Algorithm.jpg
An example algorithm for traffic-sign detection

Modern traffic-sign recognition systems are being developed using convolutional neural networks, mainly driven by the requirements of autonomous vehicles and self-driving cars. In these scenarios, the detection system needs to identify a variety of traffic signs and not just speed limits. This is where the Vienna Convention on Road Signs and Signals comes to help. A convolutional neural network can be trained to take in these predefined traffic signs and 'learn' using Deep Learning techniques.

The neural net in turn uses Image Processing and Computer Vision to train the network with its potential outcomes. The trained neural net can then be used in real time to detect new traffic signs in real time. Self driving car companies including Waymo and Uber are generating and outsourcing traffic-sign data sets along with map and navigation companies like Tom Tom. [9] Advanced computer vision and neural network techniques make this goal highly efficient and achievable in real time.

An example implementation of the image preprocessing steps in a traffic-sign detection algorithm Traffic Sign Detection Example.jpg
An example implementation of the image preprocessing steps in a traffic-sign detection algorithm

There are diverse algorithms for traffic-sign recognition. Common ones are those based on the shape of the sign board. Typical sign board shapes like hexagons, circles, and rectangles define different types of signs, which can be used for classification. Other major algorithms for character recognition includes Haar-like features, Freeman Chain code, AdaBoost detection and deep learning neural networks methods. Haar-like features can be used to create cascaded classifiers which can then help detect the sign board characters.

Deep learning can be incorporated into traffic-sign detection. Polygonal approximation of digital curves using Ramer–Douglas–Peucker algorithm can be used to detect the shape of the sign boards and methods like Support Vector Machines and Byte-MCT with an AdaBoost classifier has been used in one of the methods to detect traffic signs. [10]

Identification of speed limit signs also needs to take into account the units used in a particular area. For instance, a vehicle travelling from Northern Ireland to Ireland would need to be able to differentiate the km/h speed limit signage in Ireland from the mph speed limit signage still used in Northern Ireland, which is particularly important when traffic sign recognition is linked to Intelligent speed assistance systems. Geofencing and reference to online navigation databases can be used as a hint to the algorithm to identify which units are likely to be in use. [11]

Usage

Information gathered from road signs by a forward facing camera is used in Tesla's Autosteer and Traffic-aware Cruise Control Systems to Bring the vehicle to a stop if a stop sign is detected. [12] After a recent software update many Tesla vehicles upload the speed limit data collected by their cameras to Tesla's navigation software for all other vehicles to use.

Car makers and vehicles

Some cars with such system are made by Audi, BMW, Citroën, Ford, Honda, Infiniti, Jaguar, Jeep, Land Rover, Lexus, Mercedes, Nissan, Opel, Peugeot, Porsche, Renault, Toyota, Volkswagen, Tesla and Volvo.

For instance:

See also

Related Research Articles

<span class="mw-page-title-main">Intelligent transportation system</span> Advanced application

An intelligent transportation system (ITS) is an advanced application that aims to provide innovative services relating to different modes of transport and traffic management and enable users to be better informed and make safer, more coordinated, and 'smarter' use of transport networks.

<span class="mw-page-title-main">Self-driving car</span> Vehicle operated with reduced human input

A self-driving car, also known as an autonomous car (AC), driverless car, robotaxi, robotic car or robo-car, is a car that is capable of operating with reduced or no human input. Self-driving cars are responsible for all driving activities, such as perceiving the environment, monitoring important systems, and controlling the vehicle, which includes navigating from origin to destination.

<span class="mw-page-title-main">Volkswagen Phaeton</span> Motor vehicle

The Volkswagen Phaeton is a full-size sedan/saloon manufactured by the German automobile manufacturer Volkswagen, described by Volkswagen as their "premium class" vehicle. Introduced at the 2002 Geneva Motor Show, the Phaeton was marketed worldwide. Sales in North America ended in 2006 and global sales ended in 2016.

<span class="mw-page-title-main">Advanced driver-assistance system</span> Electronic systems that help a vehicle driver while driving or parking

Advanced driver-assistance systems (ADAS) are technologies that assist drivers with the safe operation of a vehicle. Through a human-machine interface, ADAS increase car and road safety. ADAS use automated technology, such as sensors and cameras, to detect nearby obstacles or driver errors, and respond accordingly. ADAS can enable various levels of autonomous driving.

<span class="mw-page-title-main">Lane departure warning system</span> Mechanism designed to warn a driver when the vehicle begins to move out of its lane

In road-transport terminology, a lane departure warning system (LDWS) is a mechanism designed to warn the driver when the vehicle begins to move out of its lane on freeways and arterial roads. These systems are designed to minimize accidents by addressing the main causes of collisions: driver error, distractions and drowsiness. In 2009 the U.S. National Highway Traffic Safety Administration (NHTSA) began studying whether to mandate lane departure warning systems and frontal collision warning systems on automobiles.

<span class="mw-page-title-main">Geneva International Motor Show</span> Annual Swiss auto show

The Geneva International Motor Show was an annual auto show held in March in the Swiss city of Geneva.

<span class="mw-page-title-main">Automatic parking</span> Autonomous car-maneuvering system

Automatic parking is an autonomous car-maneuvering system that moves a vehicle from a traffic lane into a parking spot to perform parallel, perpendicular, or angle parking. The automatic parking system aims to enhance the comfort and safety of driving in constrained environments where much attention and experience is required to steer the car. The parking maneuver is achieved by means of coordinated control of the steering angle and speed which takes into account the actual situation in the environment to ensure collision-free motion within the available space.

<span class="mw-page-title-main">Adaptive cruise control</span> Cruise control advanced driver-assistance system

Adaptive cruise control (ACC) is a type of advanced driver-assistance system for road vehicles that automatically adjusts the vehicle speed to maintain a safe distance from vehicles ahead. As of 2019, it is also called by 20 unique names that describe that basic functionality. This is also known as Dynamic cruise control.

<span class="mw-page-title-main">D-segment</span> Car size classification in Europe

The D-segment is the 4th category of the European segments for passenger cars, and is described as "large cars".

Intelligent speed assistance (ISA), or intelligent speed adaptation, also known as alerting, and intelligent authority, is any system that ensures that vehicle speed does not exceed a safe or legally enforced speed. In case of potential speeding, the driver can be alerted or the speed reduced automatically.

<span class="mw-page-title-main">Driver monitoring system</span> Vehicle safety system

The Driver Monitoring System (DMS), also known as driver attention monitor, is a vehicle safety system to assess the driver's alertness and warn the driver if needed and eventually apply the brakes. It was first introduced by Toyota in 2006 for its and Lexus' latest models. It was first offered in Japan on the GS 450h. The system's functions co-operate with the pre-collision system (PCS). The system uses infrared sensors to monitor driver attentiveness. Specifically, the driver monitoring system includes a CCD camera placed on the steering column which tracks the face, via infrared LED detectors. If the driver is not paying attention to the road ahead and a dangerous situation is detected, the system will warn the driver by flashing lights, warning sounds. If no action is taken, the vehicle will apply the brakes. This system is said to be the first of its kind.

<span class="mw-page-title-main">Collision avoidance system</span> Motorcar safety system

A collision avoidance system (CAS), also known as a pre-crash system, forward collision warning system (FCW), or collision mitigation system, is an advanced driver-assistance system designed to prevent or reduce the severity of a collision. In its basic form, a forward collision warning system monitors a vehicle's speed, the speed of the vehicle in front of it, and the distance between the vehicles, so that it can provide a warning to the driver if the vehicles get too close, potentially helping to avoid a crash. Various technologies and sensors that are used include radar (all-weather) and sometimes laser (LIDAR) and cameras to detect an imminent crash. GPS sensors can detect fixed dangers such as approaching stop signs through a location database. Pedestrian detection can also be a feature of these types of systems.

A speed limiter is a governor used to limit the top speed of a vehicle. For some classes of vehicles and in some jurisdictions they are a statutory requirement, for some other vehicles the manufacturer provides a non-statutory system which may be fixed or programmable by the driver.

<span class="mw-page-title-main">Automotive night vision</span> Vehicle safety system

An automotive night vision system uses a thermographic camera to increase a driver's perception and seeing distance in darkness or poor weather beyond the reach of the vehicle's headlights. Such systems are offered as optional equipment on certain premium vehicles. The technology was first introduced in the year 2000 on the Cadillac Deville. This technology is based on the night vision devices (NVD), which generally denotes any electronically enhanced optical devices operate in three modes: image enhancement, thermal imaging, and active illumination. The automotive night vision system is a combination of NVDs such as infrared cameras, GPS, Lidar, and Radar, among others to sense and detect objects.

Driver drowsiness detection is a car safety technology which helps prevent accidents caused by the driver getting drowsy. Various studies have suggested that around 20% of all road accidents are fatigue-related, up to 50% on certain roads.

A connected car is a car that can communicate bidirectionally with other systems outside of the car. This connectivity can be used to provide services to passengers or to support or enhance self-driving functionality. For safety-critical applications, it is anticipated that cars will also be connected using dedicated short-range communications (DSRC) or cellular radios, operating in the FCC-granted 5.9 GHz band with very low latency.

<span class="mw-page-title-main">2014 Paris Motor Show</span> International auto show

The 2014 Paris Mondial de l'Automobile or 2014 Paris Motor Show took place from 4 October to 19 October 2014 on 'Automobile and Fashion' theme.

<span class="mw-page-title-main">Lane centering</span> Mechanism designed to keep a car centered in the lane

In road-transport terminology, lane centering, also known as auto steer or autosteer, is an advanced driver-assistance system that keeps a road vehicle centered in the lane, relieving the driver of the task of steering. Lane centering is similar to lane departure warning and lane keeping assist, but rather than warn the driver, or bouncing the car away from the lane edge, it keeps the car centered in the lane. Together with adaptive cruise control (ACC), this feature may allow unassisted driving for some length of time. It is also part of automated lane keeping systems.

Pedestrian crash avoidance mitigation (PCAM) systems, also known as pedestrian protection or detection systems, use computer and artificial intelligence technology to recognize pedestrians and bicycles in an automobile's path to take action for safety. PCAM systems are often part of a pre-collision system available in several high end car manufacturers, such as Volvo and Mercedes and Lexus, and used less widely in lower end cars such as Ford and Nissan. As of 2018 using 2016 data, more than 6,000 pedestrians and 800 cyclists are killed every year in the US in car crashes. Effective systems deployed widely could save up to 50% of these lives. More than 270,000 pedestrians are killed every year in the world. An excellent analysis of technology capabilities and limitations is provided in Death of Elaine Herzberg. Pedestrian safety has traditionally taken a secondary role to passenger safety.

References

  1. ↑ "Vauxhall Insignia to read speed limit signs". Business Car. 18 June 2008. Retrieved 2 April 2019.
  2. ↑ Eichner, M.; Breckon, T. (2008). "Integrated speed limit detection and recognition from real-time video" (PDF). 2008 IEEE Intelligent Vehicles Symposium. pp. 626–631. doi:10.1109/IVS.2008.4621285. ISBN   978-1-4244-2568-6. S2CID   12477544.
  3. ↑ "Assistenzsystem von Opel – Das magische Auge". 18 June 2008. Retrieved 17 December 2010.
  4. ↑ "Phaeton debuts with new design and new technologies". Archived from the original on 20 July 2011. Retrieved 22 April 2010.
  5. ↑ "Road Sign Information" . Retrieved 19 February 2013.
  6. ↑ "EUR-Lex - 2018_145 - EN - EUR-Lex". eur-lex.europa.eu. Retrieved 2020-08-30.
  7. ↑ "Briefing: Intelligent Speed Assistance (ISA) | ETSC". etsc.eu. Retrieved 2020-08-30.
  8. ↑ "L_2021409FR.01000101.XML".
  9. ↑ "Whoever Owns the Maps Owns the Future of Self-Driving Cars". July 2016.
  10. ↑ Lim, K.; Hong, Y.; Choi, Y.; Byun, H. (2017). "Lim K, Hong Y, Choi Y, Byun H (2017) Real-time traffic-sign recognition based on a general-purpose GPU and deep learning. PLoS ONE 12(3): e0173317". PLOS ONE. 12 (3): e0173317. doi: 10.1371/journal.pone.0173317 . PMC   5338798 . PMID   28264011.
  11. ↑ "ADAS Map Speed Limits Improve mandatory Intelligent Speed Assistance and vehicle safety ratings" (PDF).
  12. ↑ "Tesla Model 3 user's guide to autopilot".
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.