ZCam

Last updated

ZCam is a brand of time-of-flight camera products for video applications by Israeli developer 3DV Systems. The ZCam supplements full-color video camera imaging with real-time range imaging information, allowing for the capture of video in 3D.

Contents

The original ZCam, [fn 1] released in 2000, [4] was an ENG video camera add-on used for digital video compositing. [5] [6] Before agreeing in March 2009 [7] to sell its assets to Microsoft, [8] 3DV had planned to release a ranging video webcam (previously called the Z-Sense), also under the name ZCam. [fn 1] The ZCam webcam was one of several competing real-time range imaging camera products in development that target home game controller applications. [fn 2]

Technology

The ZCam's time-of-flight camera system features a near-infrared (NIR) pulse illumination component, as well as an image sensor with a fast gating mechanism. Based on the known speed of light, ZCam coordinates the timing of NIR pulse wave emissions from the illuminator with the gating of the image sensor, so that the signal reflected from within a desired depth range is captured exclusively. The amount of pulse signal collected for each pixel corresponds to where within the depth range the pulse was reflected from, and can thus be used to calculate the distance to a corresponding point on the captured subject. [11] [12]

Due to the fast timing required for light-based time-of-flight, the ZCam uses custom hardware for illumination and gating. The illuminator is a series of NIR laser diodes around the lens barrel, switched by special high-speed driver circuits that produce pulses with a rise time and fall time of less than one nanosecond. [12] Previously using an image intensifier for gating the image sensor, [12] 3DV later developed a special solid-state image shutter, in the form of a gallium arsenide-based electro-optical chip that is mounted atop the image sensor. [13] The company was reportedly developing a gating solution based on less-expensive CMOS-process fabrication. [9]

The time-of-flight camera is optically matched with a corresponding video camera, allowing the RGB video and range imaging to integrated together. 3DV refers to the combination as "RGBD" (or RGB-D), in which "D" refers to a "depth" or "distance" channel. [12]

Webcam

Targeted primarily at the video game market, the ZCam webcam was designed to be used as a game controller like the EyeToy, using gesture recognition to interpret hand and body gestures for controlling the interface, but without many of the complications of a purely 2D-based computer vision approach. [14] Developing the device since 2005, 3DV completed the initial prototype in late 2006, and officially announced the product in late 2007. [15]

The ZCam webcam had a 60-degree field of view, [16] a frame rate of 60 Hz, [4] a 1.3 megapixel full color video resolution, [4] and an 8-bit [17] Quarter VGA [14] ranging resolution (320x240 pixels with 256 depth levels per pixel). Precision was fine as 1-2 centimeters, with a practical ranging limit of 0.5–2.5 meters distance. [16] The webcam connected via a USB 2.0 interface. [18] Demonstrations included a boxing game, [19] an airplane demo, [18] Windows Media Center hand-gesture control, [18] and a body-gesture Second Life interface. [20]

3DV stated that the webcam would be priced comparably to other peripherals in the gaming market such as the PlayStation Eye: less than US$100, [17] with a bundled US$69.99 price mentioned as a possibility. [14] The webcam was to include software development kits for camera control and gesture recognition. [16] 3DV originally projected the ZCam to be released before the end of 2008, [14] then later revised the projection to 2009. [21] In March 2009, the company agreed to sell its assets including the ZCam to a third party, [7] later confirmed to be Microsoft. [8] [22] Following these reports, it was speculated that Microsoft would use the ZCam technology for a motion-sensing controller system for the Xbox 360 video game console or its successor. This speculation increased in the month leading up to Microsoft's announcement of the Kinect 3D depth-sensing device at the 2009 Electronic Entertainment Expo, during which leaked information about that device prompted frequent comparisons with the ZCam. [23]

See also

Footnotes

  1. 1 2 The name has been formatted several different ways, including "ZCAM" [1] and "Zcam". [2] Although the "ZCam" styling had been used for the studio camera add-on, [3] the 3DV website currently refers to the original product as "Z-Cam", and the webcam product as "ZCam". [4]
  2. ↑ Other companies developing competing cameras included Canesta and PrimeSense. [9] [10]

Related Research Articles

<span class="mw-page-title-main">Computer mouse</span> Pointing device used to control a computer

A computer mouse is a hand-held pointing device that detects two-dimensional motion relative to a surface. This motion is typically translated into the motion of the pointer on a display, which allows a smooth control of the graphical user interface of a computer.

<span class="mw-page-title-main">Webcam</span> Video camera connected to a computer or network

A webcam is a video camera which is designed to record or stream to a computer or computer network. They are primarily used in video telephony, live streaming and social media, and security. Webcams can be built-in computer hardware or peripheral devices, and are commonly connected to a device using USB or wireless protocols.

<span class="mw-page-title-main">EyeToy</span> Webcam for the PlayStation 2

The EyeToy is a color webcam for use with the PlayStation 2. Supported games use computer vision and gesture recognition to process images taken by the EyeToy. This allows players to interact with the games using motion, color detection, and also sound, through its built-in microphone. It was released in 2003 and in total, it has 6 million games.

<span class="mw-page-title-main">Gesture recognition</span> Topic in computer science and language technology

Gesture recognition is an area of research and development in computer science and language technology concerned with the recognition and interpretation of human gestures. A subdiscipline of computer vision, it employs mathematical algorithms to interpret gestures.

<span class="mw-page-title-main">Stereo camera</span> Camera with two or more lenses for capturing stereo views

A stereo camera is a type of camera with two or more lenses with a separate image sensor or film frame for each lens. This allows the camera to simulate human binocular vision, and therefore gives it the ability to capture three-dimensional images, a process known as stereo photography. Stereo cameras may be used for making stereoviews and 3D pictures for movies, or for range imaging. The distance between the lenses in a typical stereo camera is about the distance between one's eyes and is about 6.35 cm, though a longer base line produces more extreme 3-dimensionality.

<span class="mw-page-title-main">Wired glove</span> Input device for human–computer interaction

A wired glove is an input device for human–computer interaction worn like a glove.

<span class="mw-page-title-main">LifeCam</span> Webcam for PCs

The LifeCam is a lineup of webcams from Microsoft for PC users marketed since 2006. Various models and series of webcams are designed for either laptops or desktops.

<span class="mw-page-title-main">Multi-touch</span> Touchscreen interactions using multiple fingers

In computing, multi-touch is technology that enables a surface to recognize the presence of more than one point of contact with the surface at the same time. The origins of multitouch began at CERN, MIT, University of Toronto, Carnegie Mellon University and Bell Labs in the 1970s. CERN started using multi-touch screens as early as 1976 for the controls of the Super Proton Synchrotron. Capacitive multi-touch displays were popularized by Apple's iPhone in 2007. Multi-touch may be used to implement additional functionality, such as pinch to zoom or to activate certain subroutines attached to predefined gestures using gesture recognition.

<span class="mw-page-title-main">PlayStation Eye</span> Digital camera device for the PlayStation 3

The PlayStation Eye is a digital camera device, similar to a webcam, for the PlayStation 3. The technology uses computer vision and gesture recognition to process images taken by the camera. This allows players to interact with games using motion and color detection as well as sound through its built-in microphone array. It is the successor to the EyeToy for the PlayStation 2, which was released in 2003.

Canesta was a fabless semiconductor company that was founded in April 1999, by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi.

<span class="mw-page-title-main">Time-of-flight camera</span> Range imaging camera system

A time-of-flight camera, also known as time-of-flight sensor, is a range imaging camera system for measuring distances between the camera and the subject for each point of the image based on time-of-flight, the round trip time of an artificial light signal, as provided by a laser or an LED. Laser-based time-of-flight cameras are part of a broader class of scannerless LIDAR, in which the entire scene is captured with each laser pulse, as opposed to point-by-point with a laser beam such as in scanning LIDAR systems. Time-of-flight camera products for civil applications began to emerge around 2000, as the semiconductor processes allowed the production of components fast enough for such devices. The systems cover ranges of a few centimeters up to several kilometers.

Sony Depthsensing Solutions SA/NV, formerly known as SoftKinetic Systems, is a Belgian company originating from the merger of Optrima NV, founded by André Miodezky, Maarten Kuijk, Daniël Van Nieuwenhove, Ward Van der Tempel, Riemer Grootjans and Tomas Van den Hauwe and SoftKinetic SA founded by Eric Krzeslo, Thibaud Remacle, Gilles Pinault and Xavier Baele. Sony Depthsensing Solutions develops gesture recognition hardware and software for real-time range imaging (3D) cameras. SoftKinetic was founded in July 2007 providing gesture recognition solutions based on its technology to the interactive digital entertainment, consumer electronics, health & fitness, and serious game industries. SoftKinetic technology has been applied to interactive digital signage and advergaming, interactive television, and physical therapy.

GestureTek is an American-based interactive technology company headquartered in Silicon Valley, California, with offices in Toronto and Ottawa, Ontario and Asia.

<span class="mw-page-title-main">Kinect</span> Motion-sensing input device for the Xbox 360 and Xbox One

Kinect is a discontinued line of motion sensing input devices produced by Microsoft and first released in 2010. The devices generally contain RGB cameras, and infrared projectors and detectors that map depth through either structured light or time of flight calculations, which can in turn be used to perform real-time gesture recognition and body skeletal detection, among other capabilities. They also contain microphones that can be used for speech recognition and voice control.

<span class="mw-page-title-main">Elron Electronic Industries</span> Israeli technology holding company

Elron Electronic Industries Ltd. is an Israeli technology holding company based in Tel Aviv; since 1962 the company has been involved in setting up, funding and developing over 30 companies and is considered one of the foundation stones of the high-tech industry in Israel. The company's sectors of interest include clean technology, software, semiconductors, medical technology, telecommunications, defence and aerospace. Today, the combined annual revenues of the companies established by Elron are approximately $5 billion.

<span class="mw-page-title-main">PrimeSense</span> Former Israeli company

PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

<span class="mw-page-title-main">Omek Interactive</span> Former technology company

Omek Interactive was a venture-backed technology company developing advanced motion-sensing software for human-computer interaction. Omek was co-founded in 2006 by Janine Kutliroff and Gershom Kutliroff.

Project Digits is a Microsoft Research Project under Microsoft's computer science laboratory at the University of Cambridge; researchers from Newcastle University and University of Crete are also involved in this project. Project is led by David Kim, a Microsoft Research PhD and also a PhD student in computer science at Newcastle University. Digits is an input device which can be mounted on the wrist of human hand and it captures and displays a complete 3D graphical representation of the user's hand on screen without using any external sensing device or hand covering material like data gloves. This project aims to make gesture-controlled interfaces completely hands free with greater mobility and accuracy. It allows user to interact with whatever hardware while moving from room to room or walking down the street without any line of sight connection with the hardware.

<span class="mw-page-title-main">Intel RealSense</span> Suite of depth and tracking technologies

Intel RealSense Technology, formerly known as Intel Perceptual Computing, is a product range of depth and tracking technologies designed to give machines and devices depth perception capabilities. The technologies, owned by Intel are used in autonomous drones, robots, AR/VR, smart home devices amongst many others broad market products.

<span class="mw-page-title-main">PMD Technologies</span> German company using photonic mixer devices

PMD Technologies is a developer of CMOS semiconductor 3D time-of-flight (ToF) components and a provider of engineering support in the field of digital 3D imaging. The company is named after the Photonic Mixer Device (PMD) technology used in its products to detect 3D data in real time. The corporate headquarters of the company is located in Siegen, Germany.

References

  1. ↑ "3DV Systems Ltd. Introduces ZCAM, World's First Real-Time 3D Studio Camera". 3DV Systems. 1999-04-19. Archived from the original on 2005-02-11. Retrieved 2009-02-19.
  2. ↑ "JVC enters strategic alliances with cutting edge technology leaders". JVC. 2000-04-10. Archived from the original on 2011-07-13. Retrieved 2009-02-19.
  3. ↑ "Products". 3DV Systems. Archived from the original on 2006-11-02. Retrieved 2009-02-19.
  4. 1 2 3 4 "Product Evolution". 3DV Systems. Archived from the original on 2009-02-28. Retrieved 2009-02-19.
  5. ↑ "ZCAM 3D Camera". JVC Professional. JVC. 2003-09-24. Archived from the original on 2010-09-06. Retrieved 2009-06-20.
  6. ↑ Richard Marks (2004-01-21). EyeToy: A New Interface for Interactive Entertainment. Stanford University. Event occurs at 58:24. Archived from the original (Windows Media v7) on 2011-04-15. Retrieved 2009-06-20.
  7. 1 2 "Elron Group company 3DV signs definitive asset sale agreement" (PDF). Elron Electronic Industries. 2009-03-29. Archived (PDF) from the original on 2011-07-10. Retrieved 2009-03-30.
  8. 1 2 Shelah, Shmulik (2009-06-22). "Microsoft confirms 3DV acquisition". Globes . Tel Aviv: Globes Publisher Itonut. Archived from the original on 2009-06-26. Retrieved 2009-06-23. [Microsoft corporate vice president of Israel Research & Development Moshe Lichtman] said, for the first time officially, that "the R&D center helped Microsoft in buying the intellectual property of 3DV Systems, and in the wake of that dozens of the company's employees were recruited to work at the development center." Alt URL Archived 2012-02-18 at the Wayback Machine
  9. 1 2 Takahashi, Dean (2009-05-29). "Peeling back another layer of detail on Microsoft's secret gesture-control system for games". VentureBeat. Archived from the original on 2009-06-01. Retrieved 2009-06-15.
  10. ↑ Johnson, R. Colin (2009-02-04). "3D sensor moves from car to CE". EE Times . TechInsights . Retrieved 2009-06-15.
  11. ↑ Katz, Sagi (2008-02-28). "Boxing with ZCam (part 1)". Engineering TV. Penton Media. Archived from the original on 2008-03-03. Retrieved 2009-03-12. Alt URL Archived 2016-12-20 at the Wayback Machine
  12. 1 2 3 4 Iddan, Gavriel J.; Yahav, Giora (2001-01-24). "3D imaging in the studio (and elsewhere…)" (PDF). Proceedings of SPIE. Vol. 4298. San Jose, CA: SPIE (published 2003-04-29). p. 48. doi:10.1117/12.424913. Archived from the original (PDF) on 2009-06-12. Retrieved 2009-02-19.
  13. ↑ Captain, Sean (2008-05-01). "Out of Control Gaming". PopSci.com. Popular Science. Archived from the original on 2024-07-17. Retrieved 2009-06-15.
  14. 1 2 3 4 Nutt, Christian (2008-01-17). "Q&A: 3DV's Barel On The Future Of Camera-Based Game Control". Gamasutra. Think Services. Archived from the original on 2012-05-13. Retrieved 2009-02-19.
  15. ↑ "3DV Systems announces ZCam, low cost real-time depth sensing camera". 3DV Systems. 2007-12-02. Archived from the original (PDF) on 2009-02-10. Retrieved 2009-02-19.
  16. 1 2 3 "ZCam Product Data Sheet" (JPEG). StudioGE. p. 2. Retrieved 2009-06-03.
  17. 1 2 "3DV Announces ZCam Real Time 3D Camera for the PC". PC Magazine. Ziff Davis. 2008-01-08. Archived from the original on 2008-07-25. Retrieved 2009-02-19.
  18. 1 2 3 Barel, Tomer (2008-02-07). "ZCam - CES 2008: Interview" (Flash Video). GameTrailers. Archived from the original on 2009-03-08. Retrieved 2009-02-19.
  19. ↑ Flier, Rich (2008-02-28). "Boxing with ZCam (part 2)". Engineering TV. Penton Media. Archived from the original on 2008-03-03. Retrieved 2009-03-12. Alt URL
  20. ↑ Markoff, John (2008-04-11). "The Coming of the Holodeck". Bits Blog. The New York Times Company. Archived from the original on 2008-04-22. Retrieved 2009-02-19.
  21. ↑ Takahashi, Dean (2008-07-10). "3DV fleshes out gesture-based gaming plans, hires North American chief". VentureBeat. Archived from the original on 2024-07-17. Retrieved 2008-12-02.
  22. ↑ Takahashi, Dean (2009-02-21). "Sources confirm Microsoft is buying 3DV Systems". VentureBeat. Archived from the original on 2009-02-22. Retrieved 2009-02-23.
  23. ↑ Thorsen, Tor (May 12, 2009). "Xbox 360 motion-sensing camera in development - WSJ". Gamespot. Archived from the original on 2009-05-16. Retrieved 2009-05-13.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.