Automotive night vision

Last updated
Audi A8 Night Vision Assistant Audi A8 2013 (11209949525).jpg
Audi A8 Night Vision Assistant

An automotive night vision system uses a thermographic camera to increase a driver's perception and seeing distance in darkness or poor weather beyond the reach of the vehicle's headlights. Such systems are offered as optional equipment on certain premium vehicles. The technology was first introduced in the year 2000 on the Cadillac Deville. [1] This technology is based on the night vision devices (NVD), which generally denotes any electronically enhanced optical devices operate in three modes: image enhancement, thermal imaging, and active illumination. [2] The automotive night vision system is a combination of NVDs such as infrared cameras, GPS, Lidar, and Radar, among others to sense and detect objects. [2]

Contents

Display type

There are two types of systems, either passive or active systems, both have advantages and disadvantages when compared to the other. [3] [4] [5] The passive system pertains to the technologies that detect thermal radiation emitted by humans, animals, and other objects in the road while the active systems illuminate objects as a significant distance ahead using infrared light sources. [2]

Active systems

Active systems use an infrared light source built into the car to illuminate the road ahead with light that is invisible to humans. There are two kinds of active systems: gated and non-gated. The gated system uses a pulsed light source and a synchronized camera that enable long ranges (250m) and high performance in rain and snow.

Near Infrared wavelength is 0.75–1.4 µm is smaller and can pass between the typical fog particles. Fog particles sizes are typically 10 to 15 microns and ranges is sizes from 1 to 100 microns. [6] Far infrared has a wavelength of 15 micrometers (µm) to 1 mm. During night-time operations, police officers with range gated near infrared cameras can read license plates at a distance of up to 1.2 km. [7] Near Infrared (NIR) cameras are available to see 50 km through fog, haze, smoke, rain. [8]

Mercedes-Benz

Night View Assist infrared projector visible next to Bi-Xenon HID main headlight, Mercedes-Benz S-Class (W221) IAA-2005-S-Class Light.jpg
Night View Assist infrared projector visible next to Bi-Xenon HID main headlight, Mercedes-Benz S-Class (W221)

Night View Assist prototype was shown in 2003 on the Mercedes-Benz F500 concept.

Series production Night View Assist system introduced in 2005 on the redesigned Mercedes-Benz S-Class (W221). It was the first system to use the instrument cluster's LCD as a display. [9]

2009: Night View Assist Plus added a pedestrian detection function calling the revised system on the redesigned Mercedes-Benz E-Class (W212) and refreshed S-class, [10] however, the E-class uses the navigation screen's display.

2011: Night View Assist Plus with Spotlight Function premiere: the Mercedes-Benz CL-Class (C216) became the first series production car with night vision-guided pedestrian spotlighting (HID version) [11] can flash at any pedestrians it detects in order to warn both the driver and the pedestrians. The flashing light is directed in such a way that vehicles in front and oncoming traffic are not dazzled. [12]

2013: Night View Assist Plus with animal detection on the W222 S-Class. [13]

Toyota

Night View system on the 2003 Lexus LX 470 Lexus night vision HUD.jpg
Night View system on the 2003 Lexus LX 470

In 2002 Toyota Night View was the first worldwide series production active automotive night vision system, introduced on the Toyota Landcruiser Cygnus or Lexus LX470. This system uses the headlight projectors emitting near infrared light aimed like the car's highbeam headlights and a CCD camera then captures that reflected radiation, this signal is then processed by computer which produces a black-and-white image which is projected on the lower section of the windshield. [14] [15]

In February 2008 the Toyota Crown Hybrid added a feature which highlights pedestrians [16] and presents them in a box on an LCD display in front of the driver. [17] This was the first pedestrian detection feature for an active system. [18]

In 2009, Lexus introduced Night View on the LS, but only in Japan.

In 2012 Lexus introduced Night View worldwide, on LS [19] and GS. The Night View system combines a windshield mounted near infra-red camera and near infra-red projectors within the headlamps with a Night View ECU to display an image of the road ahead on center console display screen. Moving the image from the driver’s instrument display to the center console offers drivers a larger display and an easier viewing angle. With the camera constantly in operation and the near infra-red projectors activating at speeds over 10 MPH to enhance system efficiency, night view will display an area up to 65 feet in front of the vehicle. [19] [20] This system was discontinued for 2014 in the US. [21]

Passive systems

Passive infrared systems do not use an infrared light source, instead they capture thermal radiation already emitted by the objects, using a thermographic camera.

Audi

Night Vision Assistant infrared camera visible on Audi A8 grill, right circle Audi A8 W12 L (8159307793).jpg
Night Vision Assistant infrared camera visible on Audi A8 grill, right circle

Night Vision Assistant was introduced in 2010 on the Audi A8. It uses a thermal imaging camera behind the four rings at the front of the car which can "see" 300 meters (984 ft) ahead. The display in the instrument cluster highlights humans with yellow markings. More importantly, the computer can determine if the person on the road moves in a way that could lead to a collision with the car. In that case the pedestrian is being marked in red color and the driver of the car receives an audible warning. [22]

2013 update added animal detection. [23] and Pedestrian Marker Lights: As soon as a pedestrian is detected by the Night Vision Assistant in a critical range in front of the vehicle, individual Matrix LEDs flash briefly 3 times in succession to alert that person, who is then clearly visible to the driver. [24]

BMW

BMW Night Vision introduced in 2005 on the BMW 7 Series (E65). This system processes far infrared radiation, which minimizes non-essential information placing a greater emphasis on pedestrians and animals, allows for a range of 300 meters or nearly 1,000 feet, and avoids "dazzle" from headlights, road lights and similar intense light sources. [25]

2008 update added pedestrian detection system on the redesigned BMW 7 Series (F01), which flashes a caution symbol on the navigation/information screen and automotive head-up display when it detects pedestrians. [26]

2013 update added Dynamic Light Spot.

2013 update added animal detection. The system provides a real-time video image that also depicts on the Control Display persons, animals and other objects emitting heat when they are outside of the light beam and warns in the event of an impending collision. The Dynamic Light Spot is produced by a special headlight that directs the light beam onto the recognised persons or animals respectively, thus drawing the driver’s attention to possible hazards in good time. As soon as the remote infrared detects pedestrians or larger animals on course for collision in the dark, the system directs two separately controlled Dynamic Light Spots at them without creating an unpleasant glare. In the event of an acute risk, an acoustic warning signal is also sounded and the brakes are set to maximum standby. For the model year 2014, the BMW 5 Series will also have these new features.

Cadillac

First worldwide series production automotive night vision on 2000 Cadillac Deville: Night Vision, however it was discontinued in 2004. [27] This system was developed with Raytheon and worked by using a passive infrared sensor camera mounted behind the vehicle's grille. Infrared radiation is picked up by the sensor, processed by computer and then displayed on the windshield using a head-up display. Information is displayed as a black-and-white image with warmer objects in white, while cooler objects appear black. [28] [29] [30] Because this system outputs a standard NTSC composite video signal and the used parts are somewhat easy and inexpensive to find, it has become a popular choice for fitting thermal night vision to other vehicles. [31] After a long hiatus, the 2016 flagship Cadillac CT6 was equipped with an improved version of the Enhanced Night Vision, in which the images are displayed and embedded in the instrument panel instead of being displayed as a reflection on the windshield. [32]

Honda

In 2004, Honda introduced first worldwide system with pedestrian detection on redesigned Honda Legend: Intelligent Night Vision. It detected far infrared radiation. The pedestrian detection feature alerted the driver with an audio warning and visually enclosed the pedestrian in a box on the display which was presented via head-up display. [33] [34] The night vision system uses a separate heads up type display projected on the center bottom of the windshield. The infrared cameras do not require a light source, and the software is able to detect human like figures, surround the image with a red box and give audible caution tones.

DS Automobiles

DS Night Vision offers road visibility by night. An infrared camera in the front grill identifies objects, pedestrians and animals on the road at a distance of up to 100m.[ citation needed ] A digital instrument cluster shows the driver the area around the car in infrared, with a yellow line around any sources of potential danger. For critical danger, the line becomes red, allowing the driver to react to the situation. [35] The DS 7 Crossback is the first DS vehicle to include Night Vision.

Peugeot

On the Peugeot 508, an optional night vision system helps to see pedestrians and animals during the night and alert the driver. [36]

Automobiles

Active

Passive

1includes pedestrian and animal detection

See also

Related Research Articles

<span class="mw-page-title-main">North American International Auto Show</span> Annual auto show in Detroit, Michigan

The North American International Auto Show (NAIAS), also known as the Detroit Auto Show as of 2022 and prior to NAIAS, is an annual auto show held in Detroit, Michigan, U.S., at Huntington Place. The show was held in January from 1989 to 2019. It was intended to move to the summer in 2020, but was canceled due to the COVID-19 pandemic that year and 2021, before returning in September 2022. It is among the largest auto shows in North America. UPI says the show is "regarded as the foremost venue for [car] manufacturers to unveil new products".

<span class="mw-page-title-main">Dashboard</span> Control panel placed in front of the driver/pilot of a vehicle/small aircraft

A dashboard is a control panel set within the central console of a vehicle or small aircraft. Usually located directly ahead of the driver, it displays instrumentation and controls for the vehicle's operation. An electronic equivalent may be called an electronic instrument cluster, digital instrument panel, digital dash, digital speedometer or digital instrument cluster.

<span class="mw-page-title-main">Lexus LS</span> Motor vehicle

The Lexus LS is a full-size luxury sedan serving as the flagship model of Lexus, the luxury division of Toyota. For the first four generations, all LS models featured V8 engines and were predominantly rear-wheel-drive. In the fourth generation, Lexus offered all-wheel-drive, hybrid, and long-wheelbase variants. The fifth generation changed to using a V6 engine with no V8 option, and only one length was offered.

<i>Automobile</i> (magazine) American automotive magazine

Automobile was an American automobile magazine published by the Motor Trend Group. A group of former employees of Car and Driver led by David E. Davis founded Automobile in 1986 with support from Rupert Murdoch's News Corporation, using the credo No Boring Cars.Automobile distinguished itself as more of a lifestyle magazine than the other automotive publications, an editorial theme that Davis greatly expanded upon from his tenure as the editor of Car and Driver, though it was a sister publication to Motor Trend.

<span class="mw-page-title-main">Lane departure warning system</span> Mechanism designed to warn a driver when the vehicle begins to move out of its lane

In road-transport terminology, a lane departure warning system (LDWS) is a mechanism designed to warn the driver when the vehicle begins to move out of its lane on freeways and arterial roads. These systems are designed to minimize accidents by addressing the main causes of collisions: driver error, distractions and drowsiness. In 2009 the U.S. National Highway Traffic Safety Administration (NHTSA) began studying whether to mandate lane departure warning systems and frontal collision warning systems on automobiles.

<span class="mw-page-title-main">New York International Auto Show</span> Annual US auto show

The New York International Auto Show is an annual auto show that is held in Manhattan, New York City in late March or early April. It is held at the Jacob Javits Convention Center. It usually opens on or just before Easter weekend and closes on the first Sunday after Easter.

<span class="mw-page-title-main">Geneva International Motor Show</span> Annual Swiss auto show

The Geneva International Motor Show is an annual auto show held in March in the Swiss city of Geneva.

<span class="mw-page-title-main">International Motor Show Germany</span> Annual German motor show

The International Motor Show Germany or International Mobility Show Germany, in German known as the Internationale Automobil-Ausstellung, is one of the world's largest mobility trade fairs. It consists of two separate fairs, that subdivided in 1991. While the IAA MOBILITY displays passenger vehicles, motorcycles and bikes, the IAA TRANSPORTATION specializes in commercial vehicles. Before the separation, the show was held solely at the Messe Frankfurt.

<span class="mw-page-title-main">LA Auto Show</span> Annual US auto show

The Los Angeles Auto Show, also known as the LA Auto Show, is an auto show held annually at the Los Angeles Convention Center in Los Angeles, California, United States. It is open to the public for ten days, filling 760,000 square feet (71,000 m2) of exhibit space. Since 2006 the event is held in November or December.

<span class="mw-page-title-main">Adaptive cruise control</span> Cruise control advanced driver-assistance system

Adaptive cruise control (ACC) is a type of advanced driver-assistance system for road vehicles that automatically adjusts the vehicle speed to maintain a safe distance from vehicles ahead. As of 2019, it is also called by 20 unique names that describe that basic functionality. This is also known as Dynamic cruise control.

<span class="mw-page-title-main">D-segment</span> Car size classification in Europe

The D-segment is the 4th category of the European segments for passenger cars, and is described as "large cars".

An official state car is a vehicle used by a government to transport its head of state or head of government in an official capacity, which may also be used occasionally to transport other members of the government or visiting dignitaries from other countries. A few countries bring their own official state car for state visits to other countries, for instance, the United States, Russia, the United Kingdom, South Korea, Germany and Japan. It also may serve as an automotive symbol of the head of state and their country. An official state car must have adequate security, capability and stateliness for its duty. A limousine or other high-end vehicle is usually selected.

<span class="mw-page-title-main">Driver monitoring system</span> Vehicle safety system

The driver monitoring system, also known as driver attention monitor, is a vehicle safety system to assess the driver's alertness and warn the driver if needed and eventually apply the brakes. It was first introduced by Toyota in 2006 for its and Lexus' latest models. It was first offered in Japan on the GS 450h. The system's functions co-operate with the pre-collision system (PCS). The system uses infrared sensors to monitor driver attentiveness. Specifically, the driver monitoring system includes a CCD camera placed on the steering column which tracks the face, via infrared LED detectors. If the driver is not paying attention to the road ahead and a dangerous situation is detected, the system will warn the driver by flashing lights, warning sounds. If no action is taken, the vehicle will apply the brakes. This system is said to be the first of its kind.

<span class="mw-page-title-main">Auto Shanghai</span> Chinese biennial automobile show

Auto Shanghai, officially known as the Shanghai International Automobile Industry Exhibition, is a biennial international automobile show that alternates with the Beijing Auto Show as China's yearly international automotive exhibition. First held in 1985, Auto Shanghai is the nation's oldest auto exhibition, and is considered as an important major international auto show.

<span class="mw-page-title-main">Collision avoidance system</span> Motorcar safety system

A collision avoidance system (CAS), also known as a pre-crash system, forward collision warning system (FCW), or collision mitigation system, is an advanced driver-assistance system designed to prevent or reduce the severity of a collision. In its basic form, a forward collision warning system monitors a vehicle's speed, the speed of the vehicle in front of it, and the distance between the vehicles, so that it can provide a warning to the driver if the vehicles get too close, potentially helping to avoid a crash. Various technologies and sensors that are used include radar (all-weather) and sometimes laser (LIDAR) and cameras to detect an imminent crash. GPS sensors can detect fixed dangers such as approaching stop signs through a location database. Pedestrian detection can also be a feature of these types of systems.

<span class="mw-page-title-main">Traffic-sign recognition</span> Technology

Traffic-sign recognition (TSR) is a technology by which a vehicle is able to recognize the traffic signs put on the road e.g. "speed limit" or "children" or "turn ahead". This is part of the features collectively called ADAS. The technology is being developed by a variety of automotive suppliers. It uses image processing techniques to detect the traffic signs. The detection methods can be generally divided into color based, shape based and learning based methods.

<span class="mw-page-title-main">Remote Touch</span>

Remote Touch is a vehicle interface system present in some Lexus cars for use in conjunction with in-car information, configuration, and entertainment systems. The Remote Touch controller, which is similar to a computer mouse or joystick, allows the driver to operate an on-screen cursor on the vehicle's GPS navigation system screen.

Driver drowsiness detection is a car safety technology which helps prevent accidents caused by the driver getting drowsy. Various studies have suggested that around 20% of all road accidents are fatigue-related, up to 50% on certain roads.

<span class="mw-page-title-main">Automotive head-up display</span> Advanced driver assistance system

An automotive head-up display or automotive heads-up display — also known as a auto-HUD — is any transparent display that presents data in the automobile without requiring users to look away from their usual viewpoints. The origin of the name stems from a pilot being able to view information with the head positioned "up" and looking forward, instead of angled down looking at lower instruments. At this time, there are three different approaches to OEM HUDs in automobiles. The first is to treat the back of the windshield in such a way that an image projected onto it will reflect to the driver. The second is to have a small combiner that is separate from the windshield. Combiners can be retracted. The third is to laminate a transparent display in between layers of the windshield glass.

References

  1. "What are LED taillights?". Cars.com. Archived from the original on September 22, 2008.
  2. 1 2 3 Suh, Sang; Anthony, Thomas (2018). Big Data and Visual Analytics. Cham: Springer. p. 39. ISBN   9783319639154.
  3. 1 2 Jones, Willie D. (March 2006). "Safer Driving in The Dead of Night". IEEE Spectrum. Spectrum.ieee.org. Archived from the original on 2008-07-04. Retrieved 2009-12-08.
  4. "Night vision enhancement systems". I-CAR Advantage Online. I-car.com. 2006-05-15. Retrieved 2009-12-08.
  5. Austin, Ian (October 31, 2005). "Illuminating Road Hazards That Lurk Beyond Lights". New York Times.
  6. Atmospheric Optics | Clouds, fog & water droplets
  7. Obzerv | ACTIVE RANGE-GATED Night Vision Cameras
  8. Ascendent Technology Group | Fog Penetrating NIR Near Infrared & Thermal Infrared Zoom Surveillance Cameras
  9. "Be ahead: the new Mercedes-Benz S-Class - Superlative in design and technology" (Press release). Stuttgart: Daimler. June 20, 2005. Archived from the original on March 4, 2016.
  10. "The 2009 Mercedes-Benz S-Class: Pacemaker in automotive development" (Press release). Stuttgart: Daimler. May 11, 2009. Archived from the original on March 4, 2016.
  11. "New spotlight function for Active Night View Assist Plus: Enhanced safety for pedestrians" (Press release). Stuttgart: Daimler. December 8, 2010. Archived from the original on December 29, 2014.
  12. "Night View Assist Plus". Mercedes Benz Tech Center. Archived from the original on 29 December 2014.
  13. "The new Mercedes-Benz S-Class - The aspiration: the best automobile in the world" (Press release). Stuttgart/Hamburg: Daimler. May 15, 2013. Archived from the original on December 29, 2014.
  14. Romans, Brent (2002-10-31). "Follow-Up Test: 2003 Lexus LX 470". Edmunds.com. Archived from the original on 2009-05-31. Retrieved 2009-12-08.
  15. "Safety Presentation". Toyota.Co.Jp. Archived from the original on 2008-03-25. Retrieved 2009-12-08.
  16. "75 Years of TOYOTA - Technical Development - Electronics Parts". TOYOTA MOTOR CORPORATION GLOBAL WEBSITE. Retrieved 6 April 2015.
  17. "Technology File - Night View". Toyota Global. Archived from the original on 31 December 2014. Retrieved 6 April 2015.
  18. Korzeniewski, Jeremy (2008-05-31). "Toyota introduces Night View on Japanese Crown Hybrid". Autoblog Green. Retrieved 2009-12-08.
  19. 1 2 http://www.toyota.com/esq/pdf/The%202013%20LS%20Advanced%20Active%20Safety%20%282%290.pdf%5B%5D 2013 Lexus LS Advanced Active Safety Features
  20. "NEW LEXUS LS: WORLD-FIRST TECHNOLOGY AS STANDARD". October 17, 2012. Archived from the original on October 23, 2012.
  21. Luke Vandezande (September 26, 2013). "Lexus Drops Night Vision Tech". AutoGuide.
  22. "The new Audi A8" (PDF). Archived from the original (PDF) on 3 August 2017. Retrieved 17 February 2010.
  23. "Composure redefined – the Audi A8" (Press release). Archived from the original on 2014-12-29.
  24. "Audi Matrix LED". Audi. Archived from the original on 25 August 2016.
  25. "BMW Night Vision Available in the 5 and 6 Series as of March" (Press release). Worldcarfans.com. 2006-01-30. Archived from the original on 11 February 2013. Retrieved 2009-12-08.
  26. "Improved Night-Vision for next 2009 BMW 7-series". BMWBlog. 2008-12-31. Retrieved 2009-12-08.
  27. Keegan, Walter J (2004-11-17). "Cadillac kills passive night-vision system". Autoblog. Retrieved 2009-12-08.
  28. Romans, Brent (1999-01-01). "Full Test: 2000 Cadillac DeVille DTS". Edmunds.com. Archived from the original on 2005-11-25. Retrieved 2009-12-08.
  29. Vale, Frank (2006-12-13). "21st-Cadillac Night Vision". Vxm.com. Archived from the original on 9 January 2010. Retrieved 2009-12-08.
  30. "Cadillac Introduces "Night Vision" Technology" (Press release). GM. January 16, 2000. Archived from the original on 2 July 2017.
  31. "Video: DIY'er Fits Cadillac Thermal Image Night Vision to his C6". Corvette Online. March 25, 2014.
  32. "Cadillac Extends the Top of its Range with CT6". Cadillac Pressroom (Press release). 31 March 2015. Retrieved 6 April 2015.
  33. "Honda Develops World's First Intelligent Night Vision System Able to Detect Pedestrians and Provide Driver Cautions" (Press release). Honda Worldwide. 2004-08-24. Archived from the original on 2009-09-28. Retrieved 2009-12-08.
  34. "Intelligent Night Vision". Honda Worldwide. Archived from the original on 8 November 2009. Retrieved 2009-12-08.
  35. DS 7 CROSSBACK | DS NIGHT VISION - Technology. DS Automobiles UK. 2017-04-03. Retrieved 2018-01-11.
  36. "The technology behind the new Peugeot 508".
  37. "The new Audi Q7 – Sportiness, efficiency, premium comfort" (Press release). Archived from the original on 2015-05-01.