PMD Technologies

Last updated
PMD Technologies ag
FormerlyS-Tec (since 1996)
Industry Fabless Semiconductor
Founded2002 (2002)
FoundersProf. Dr. Rudolf Schwarte,
Audi Electronics Venture GmbH
Headquarters
Siegen
,
Germany
Key people
Prof. Dr. Bernd Buxbaum
Dr. Thomas May
Jochen Penne
Products 3D CMOS Image sensors
Number of employees
150 (2021) [1]
Website www.pmdtec.com

PMD Technologies (stylised as pmdtechnologies) is a developer of CMOS semiconductor 3D time-of-flight (ToF) components and a provider of engineering support in the field of digital 3D imaging. [2] The company is named after the Photonic Mixer Device (PMD) technology used in its products to detect 3D data in real time. The corporate headquarters of the company is located in Siegen, Germany.

Contents

History

PMD Technologies was founded in 2002 by Rudolf Schwarte and the Audi Electronics Venture GmbH [3] as a spin-off of the Center for Sensor Systems (ZESS) at the University of Siegen, Germany. It was the result of over 10 years of scientific research on 3D ToF imaging. [4] Another ZESS spin-off, S-Tec Sensor GmbH, founded in 1996, began developing PMD products in 1997. This company was acquired by PMD Technologies in 2002.

Basic patents for TOF-chips with new Photomischelemente (i.e. Photonic Mixer Elements resp. Devices) were filed in 1996 onwards by Prof. Rudolf Schwarte. [5] A 3D Depth Camera with Time of Flight PMD sensors was available in the year 2000. [6]

In 2002, together with three other nominees, the developing team of PMD Technologies, represented by Rudolf Schwarte, Bernd Buxbaum, and Torsten Gollewski was nominated for the German Future Prize, which is issued by the President of Germany, at that time Johannes Rau. [7] [8]

At the Hanover Fair in 2005 PMD Technologies was awarded with the innovation prize called Hermes Award for its Efector PMD. [9]

In 2009, PMD Technologies received the 2009 European Real-Time 3D Imaging Enabling Technology Innovation Award by Frost & Sullivan. [10]

PMD Technologies took part in Google's Project Tango in 2015. [11] Resulting in the first Lenovo device being released in 2016 with PMD's 3D technology. [12]

In 2019, new offices were opened in Seoul, Korea and Shanghai, China. [13]

Products

After initially focusing on industrial applications, [14] [15] PMD Technologies began to spread their application areas into other fields, including the automotive sector, [16] [17] consumer electronics, gaming, [18] security & surveillance, medical technology [19] and live sciences.

In 2013 PMD Technologies cooperated with Infineon Technologies to produce 3-D image sensor chips for touchless gesture recognition. [20]

PMD sensors are used in the exteroceptive sensor suite of NASA's robot Valkyrie. [21]

The autonomous humanoid robot Justin by the German Aerospace Center (DLR) is equipped with PMD-sensors. [22]

A collaboration between PMD and Infineon Technologies resulted in a 3D iToF technology which was used in the Magic Leap 2. [23] [24]

In 2023 PMD and Infineon Technologies launched the IRS2976C, a ToF VGA sensor, which was the first sensor to be located under the display and to pass Googles Class 3 Face ID certification. [25] [26]

Related Research Articles

<span class="mw-page-title-main">German Aerospace Center</span> German research center for aerospace and power engineering

The German Aerospace Center is the national center for aerospace, energy and transportation research of Germany, founded in 1969. It is headquartered in Cologne with 35 locations throughout Germany. The DLR is engaged in a wide range of research and development projects in national and international partnerships.

<span class="mw-page-title-main">Simultaneous localization and mapping</span> Computational navigational technique used by robots and autonomous vehicles

Simultaneous localization and mapping (SLAM) is the computational problem of constructing or updating a map of an unknown environment while simultaneously keeping track of an agent's location within it. While this initially appears to be a chicken or the egg problem, there are several algorithms known to solve it in, at least approximately, tractable time for certain environments. Popular approximate solution methods include the particle filter, extended Kalman filter, covariance intersection, and GraphSLAM. SLAM algorithms are based on concepts in computational geometry and computer vision, and are used in robot navigation, robotic mapping and odometry for virtual reality or augmented reality.

<span class="mw-page-title-main">Arburg</span>

Arburg GmbH + Co KG is a German machine manufacturing company. It is owned by the Hehl and Keinath families and, with its electric, hybrid and hydraulic plastic injection moulding machines, turnkey systems and its industrial additive manufacturing system, is among the industry leaders worldwide. With approximately 2,500 employees in Germany and a further 500 worldwide, Arburg serves sales markets for machines with clamping forces ranging from 125 to 6,500 kN.

<span class="mw-page-title-main">3D scanning</span> Scanning of an object or environment to collect data on its shape

3D scanning is the process of analyzing a real-world object or environment to collect three dimensional data of its shape and possibly its appearance. The collected data can then be used to construct digital 3D models.

OmniVision Technologies Inc. is an American subsidiary of Chinese semiconductor device and mixed-signal integrated circuit design house Will Semiconductor. The company designs and develops digital imaging products for use in mobile phones, laptops, netbooks webcams, security, entertainment, automotive and medical imaging systems. Headquartered in Santa Clara, California, OmniVision Technologies has offices in the US, Western Europe and Asia.

Canesta was a fabless semiconductor company that was founded in April 1999, by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi.

A vision-guided robot (VGR) system is basically a robot fitted with one or more cameras used as sensors to provide a secondary feedback signal to the robot controller to more accurately move to a variable target position. VGR is rapidly transforming production processes by enabling robots to be highly adaptable and more easily implemented, while dramatically reducing the cost and complexity of fixed tooling previously associated with the design and set up of robotic cells, whether for material handling, automated assembly, agricultural applications, life sciences, and more.

<span class="mw-page-title-main">Time-of-flight camera</span> Range imaging camera system

A time-of-flight camera, also known as time-of-flight sensor, is a range imaging camera system for measuring distances between the camera and the subject for each point of the image based on time-of-flight, the round trip time of an artificial light signal, as provided by a laser or an LED. Laser-based time-of-flight cameras are part of a broader class of scannerless LIDAR, in which the entire scene is captured with each laser pulse, as opposed to point-by-point with a laser beam such as in scanning LIDAR systems. Time-of-flight camera products for civil applications began to emerge around 2000, as the semiconductor processes allowed the production of components fast enough for such devices. The systems cover ranges of a few centimeters up to several kilometers.

<span class="mw-page-title-main">Silicon Saxony</span> Registered industry association

Silicon Saxony is a registered industry association of 555 companies in the microelectronics and related sectors in Saxony, Germany, with around 40,000 employees. Many, but not all, of those firms are situated in the north of Dresden.

<span class="mw-page-title-main">Eye tracking on the International Space Station</span>

The eye-tracking device (ETD) is a headmounted device, designed for measurement of 3D eye and head movements under experimental and natural conditions. The tracker permits comprehensive measurement of eye movement and optionally head movement. It represents a tool for the investigation of sensorimotor behaviour, particularly of the vestibular and oculomotor systems in both health and disease.

<span class="mw-page-title-main">MetraLabs GmbH</span>

MetraLabs GmbH is a German robotics company, specializing in the development and production of service robots for industrial, commercial, and retail markets. MetraLabs was founded by graduates of the Ilmenau University of Technology and has a connection with the University Neuroinformatics and Cognitive Robotics Lab, headed by Professor Groß. Together, they have worked on multiple projects, including the development of a senior citizen assistant robot.

Planetary Transportation Systems (PTS), formerly known as PTScientists and Part-Time Scientists, is a Berlin-based aerospace company. They developed the robotic lunar lander "ALINA" and seek to land on the Moon with it. They became the first German team to officially enter the Google Lunar X-Prize competition on June 24, 2009, but failed to reach the finals in 2017 for lack of a launch contract. During the summer of 2019, the company filed for bankruptcy, and the ALINA project was put on hold. In July 2021, PTS was selected with ArianeGroup to build ESA's ASTRIS kick-stage.

<span class="mw-page-title-main">PrimeSense</span> Former Israeli company

PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

<span class="mw-page-title-main">Justin (robot)</span> Humanoid robot

Justin is an autonomous and programmable humanoid robot with two arms, developed by the German Aerospace Center (DLR) at the Institute of Robotics and Mechatronics, located in Wessling, Germany. Introduced in 2009, this wireless robot is controllable through telepresence, a type of technology that allows a person to feel as if they were present from a location other than their true location.

<span class="mw-page-title-main">Sabina Jeschke</span> German computer scientist

Sabina Jeschke is a German university professor for information sciences in mechanical engineering at the RWTH Aachen University. As of 10 November 2017, she was named member of the management board of Deutschen Bahn AG for digitalization and technology. She is also the director of the Cybernetics Lab IMA/ZLW & IfU. In the summer semester of 2017, she is on sabbatical leave to develop her research in the area of artificial consciousness, and is involved in building a think tank "Strong Artificial Intelligence" at the Volvo Car Corporation in Göteborg. Since May 2015, Jeschke has been a member of the supervisory board of Körber AG, since April 2012 chairman of the board of VDI Aachen. Beginning of January 2023 she took on an additional position as a senior advisor at Arthur D. Little.

<span class="mw-page-title-main">Fourth Industrial Revolution</span> Current trend of manufacturing technology

"Fourth Industrial Revolution", "4IR", or "Industry 4.0" is a neologism describing rapid technological advancement in the 21st century. It follows the Third Industrial Revolution. The term was popularised in 2016 by Klaus Schwab, the World Economic Forum founder and executive chairman, who asserts that these developments represent a significant shift in industrial capitalism.

<span class="mw-page-title-main">Workerbot</span>

The workerbot is a trademark, which was developed by the pi4 robotics GmbH to describe an industrial robot, which was modeled with its possibilities of movement and its sensory abilities of a human.

Gestigon is a software development company founded in September 2011, to develop software for gesture control and body tracking based on 3D depth data.

Telespazio Germany GmbH is a European aerospace company, founded in 1978. The company provides consulting, technology and engineering services in aerospace missions for ESOC, EUMETSAT and the German Aerospace Center (DLR).

<span class="mw-page-title-main">Hofmann GmbH</span>

Hofmann GmbH Maschinenfabrik und Vertrieb is a family-owned German company, based in Rellingen. That develops, produces and distributes road marking machines. The company was founded in 1952 in Hamburg.

References

  1. "PMD - Infineon Technologies".
  2. "Small and Inexpensive 3D Image Sensor". frost.com.
  3. Audi Technologiemagazin Dialoge 1/2011 (in German) Die sehende Diode, Johannes Köbler.
  4. VDI Nachrichten (in German) (http://www.vdi-nachrichten.com/vdi-nachrichten/startzeit/article.asp?id=61%5B%5D)
  5. Verfahren und Vorrichtung zur Bestimmung der Phasen- und/oder Amplitudeninformation einer elektromagnetischen Welle, Google Patents
  6. Ling Shao, Jungong Han, Pushmeet Kohli, Zhengyou Zhang (editors) (2014). Computer Vision and Machine Learning with RGB-D Sensors. Springer Science+Business Media. p. 15. ISBN   978-3319086507.{{cite book}}: |author= has generic name (help)CS1 maint: multiple names: authors list (link) ISBN   9783319086507
  7. Team 3 | Deutscher Zukunftspreis, Kamerapixel mit Tiefgang: Durchbruch zum schnellen 3D-Sehen Archived 2015-09-23 at the Wayback Machine , Official Site of the German Future Prize
  8. 3D-Kamera erfasst ihr räumliches Umfeld in Echtzeit, Dr. Norbert Lossau, Die Welt, 12/03/2002
  9. "Einfachheit ist so wichtig wie Zuverlässigkeit", VDI News No. 47 (Association of German Engineers), Heike Freimann, 11/22/2013
  10. Frost & Sullivan Bestows European Enabling Technology Award in Real-Time 3D Imaging on PMDTechnologies GmbH, Frost & Sullivan
  11. Google I/O 2015 - Project Tango - Mobile 3D tracking and perception, 29 May 2015, retrieved 2023-11-08
  12. "Sensing the world the way we do - the world's first Project Tango Smartphone". www.pressebox.com. 2016-06-09. Retrieved 2023-11-08.
  13. "pmdtechnologies ag Opens Offices in Seoul and Shanghai". FinanzNachrichten.de. Retrieved 2023-11-08.
  14. pmdtechnologies timeline up to 2009 (http://www.ifm.com/ifmus/web/pmd_prd_timeline.htm)
  15. Example for a PMD based Automation Product 3D Image Sensor Evaluates Size, Shape and Level Archived 2009-12-22 at the Portuguese Web Archive
  16. First PMDvision Day – Automotive (in German)
  17. Free space determination for parking slots using a 3D PMD sensor – Scheunert, U. Fardi, B. Mattern, N. Wanielik, G. Keppeler, N. – Intelligent Vehicles Symposium, 2007 IEEE [ dead link ], Istanbul, 13–15 June 2007
  18. Minority Report – Futuristic Interface Technologies by 3D Vision Inspect Online, July 2009
  19. Time-of-Flight sensor for patient positioning Medical Imaging 2009: Visualization, Image-Guided Procedures, and Modeling; Schaller, Adelt, Penne, Hornegger; Proceedings of the SPIE, Volume 7261 (2009)
  20. Clarke, Peter (May 29, 2013). "Infineon launches 3-D sensor for gesture recognition". EE Times . Retrieved August 13, 2015.
  21. Radford, Strawser, Hambuchen, Mehling, Verdeyen, Donnan, Holley, Sanchez, Nguyen, Bridgwater, Berka, Ambrose, McQuin, Yamokoski, Hart, Guo, Parsons, Wightman, Dinh, Ames, Blakely, Edmonson, Sommers, Rea, Tobler, Bibby, Howard, Nui, Lee, Conover, Truong, Chesney, Platt Jr., Johnson, Fok, Paine, Sentis, Cousineau, Sinnet, Lack, Powell, Morris, Ames. "Valkyrie: NASA's First Bipedal Humanoid Robot" (PDF). Prof. Aaron D. Ames, Texas A&M University . Retrieved August 13, 2015.{{cite news}}: CS1 maint: multiple names: authors list (link)[ permanent dead link ]
  22. Mobiler humanoider Oberkörper "JUSTIN", Official Site of the DLR Institut für Robotik und Mechatronik
  23. "Infineon, Pmdtechnologies Bring 3D iToF Depth Sensing to Magic Leap 2". eetimes.eu. 2022-07-08. Retrieved 2024-01-03.
  24. "Infineon and pmdtechnologies develop 3D depth-sensing technology for Magic Leap 2 – enabling advanced cutting-edge industrial and medical applications". infineon.com. 2022-05-30. Retrieved 2024-01-03.
  25. "Infineon Introduces New i-ToF VGA Sensor for Long-Range, Low-Power 3D Camera Systems". embeddedcomputing.com. 2023-03-06. Retrieved 2024-01-03.
  26. "ToF VGA sensor enables tiny 3D cameras". electronicproducts.com. 2023-02-28. Retrieved 2024-01-03.

Further reading