ZCam

Last updated

ZCam is a brand of time-of-flight camera products for video applications by Israeli developer 3DV Systems. The ZCam supplements full-color video camera imaging with real-time range imaging information, allowing for the capture of video in 3D.

Contents

The original ZCam, [fn 1] released in 2000, [4] was an ENG video camera add-on used for digital video compositing. [5] [6] Before agreeing in March 2009 [7] to sell its assets to Microsoft, [8] 3DV had planned to release a ranging video webcam (previously called the Z-Sense), also under the name ZCam. [fn 1] The ZCam webcam was one of several competing real-time range imaging camera products in development that target home game controller applications. [fn 2]

Technology

The ZCam's time-of-flight camera system features a near-infrared (NIR) pulse illumination component, as well as an image sensor with a fast gating mechanism. Based on the known speed of light, ZCam coordinates the timing of NIR pulse wave emissions from the illuminator with the gating of the image sensor, so that the signal reflected from within a desired depth range is captured exclusively. The amount of pulse signal collected for each pixel corresponds to where within the depth range the pulse was reflected from, and can thus be used to calculate the distance to a corresponding point on the captured subject. [11] [12]

Due to the fast timing required for light-based time-of-flight, the ZCam uses custom hardware for illumination and gating. The illuminator is a series of NIR laser diodes around the lens barrel, switched by special high-speed driver circuits that produce pulses with a rise time and fall time of less than one nanosecond. [12] Previously using an image intensifier for gating the image sensor, [12] 3DV later developed a special solid-state image shutter, in the form of a gallium arsenide-based electro-optical chip that is mounted atop the image sensor. [13] The company was reportedly developing a gating solution based on less-expensive CMOS-process fabrication. [9]

The time-of-flight camera is optically matched with a corresponding video camera, allowing the RGB video and range imaging to integrated together. 3DV refers to the combination as "RGBD" (or RGB-D), in which "D" refers to a "depth" or "distance" channel. [12]

Webcam

Targeted primarily at the video game market, the ZCam webcam was designed to be used as a game controller like the EyeToy, using gesture recognition to interpret hand and body gestures for controlling the interface, but without many of the complications of a purely 2D-based computer vision approach. [14] Developing the device since 2005, 3DV completed the initial prototype in late 2006, and officially announced the product in late 2007. [15]

The ZCam webcam had a 60-degree field of view, [16] a frame rate of 60 Hz, [4] a 1.3 megapixel full color video resolution, [4] and an 8-bit [17] Quarter VGA [14] ranging resolution (320x240 pixels with 256 depth levels per pixel). Precision was fine as 1-2 centimeters, with a practical ranging limit of 0.5–2.5 meters distance. [16] The webcam connected via a USB 2.0 interface. [18] Demonstrations included a boxing game, [19] an airplane demo, [18] Windows Media Center hand-gesture control, [18] and a body-gesture Second Life interface. [20]

3DV stated that the webcam would be priced comparably to other peripherals in the gaming market such as the PlayStation Eye: less than US$100, [17] with a bundled US$69.99 price mentioned as a possibility. [14] The webcam was to include software development kits for camera control and gesture recognition. [16] 3DV originally projected the ZCam to be released before the end of 2008, [14] then later revised the projection to 2009. [21] In March 2009, the company agreed to sell its assets including the ZCam to a third party, [7] later confirmed to be Microsoft. [8] [22] Following these reports, it was speculated that Microsoft would use the ZCam technology for a motion-sensing controller system for the Xbox 360 video game console or its successor. This speculation increased in the month leading up to Microsoft's announcement of the Kinect 3D depth-sensing device at the 2009 Electronic Entertainment Expo, during which leaked information about that device prompted frequent comparisons with the ZCam. [23]

See also

Footnotes

  1. 1 2 The name has been formatted several different ways, including "ZCAM" [1] and "Zcam". [2] Although the "ZCam" styling had been used for the studio camera add-on, [3] the 3DV website currently refers to the original product as "Z-Cam", and the webcam product as "ZCam". [4]
  2. ↑ Other companies developing competing cameras included Canesta and PrimeSense. [9] [10]

Related Research Articles

<span class="mw-page-title-main">Lidar</span> Method of spatial measurement using laser

Lidar is a method for determining ranges by targeting an object or a surface with a laser and measuring the time for the reflected light to return to the receiver. Lidar may operate in a fixed direction or it may scan multiple directions, in which case it is known as lidar scanning or 3D laser scanning, a special combination of 3-D scanning and laser scanning. Lidar has terrestrial, airborne, and mobile applications.

<span class="mw-page-title-main">Webcam</span> Video camera connected to a computer or network

A webcam is a video camera which is designed to record or stream to a computer or computer network. They are primarily used in video telephony, live streaming and social media, and security. Webcams can be built-in computer hardware or peripheral devices, and are commonly connected to a device using USB or wireless protocols.

<span class="mw-page-title-main">Time of flight</span> Timing of substance within a medium

Time of flight (ToF) is the measurement of the time taken by an object, particle or wave to travel a distance through a medium. This information can then be used to measure velocity or path length, or as a way to learn about the particle or medium's properties. The traveling object may be detected directly or indirectly. Time of flight technology has found valuable applications in the monitoring and characterization of material and biomaterials, hydrogels included.

<span class="mw-page-title-main">Motion capture</span> Process of recording the movement of objects or people

Motion capture is the process of recording the movement of objects or people. It is used in military, entertainment, sports, medical applications, and for validation of computer vision and robots. In filmmaking and video game development, it refers to recording actions of human actors and using that information to animate digital character models in 2D or 3D computer animation. When it includes face and fingers or captures subtle expressions, it is often referred to as performance capture. In many fields, motion capture is sometimes called motion tracking, but in filmmaking and games, motion tracking usually refers more to match moving.

<span class="mw-page-title-main">Gesture recognition</span> Topic in computer science and language technology

Gesture recognition is an area of research and development in computer science and language technology concerned with the recognition and interpretation of human gestures. A subdiscipline of computer vision, it employs mathematical algorithms to interpret gestures.

<span class="mw-page-title-main">Stereo camera</span>

A stereo camera is a type of camera with two or more lenses with a separate image sensor or film frame for each lens. This allows the camera to simulate human binocular vision, and therefore gives it the ability to capture three-dimensional images, a process known as stereo photography. Stereo cameras may be used for making stereoviews and 3D pictures for movies, or for range imaging. The distance between the lenses in a typical stereo camera is about the distance between one's eyes and is about 6.35 cm, though a longer base line produces more extreme 3-dimensionality.

<span class="mw-page-title-main">LifeCam</span> Webcam for PCs

The LifeCam is a lineup of webcams from Microsoft for PC users marketed since 2006. Various models and series of webcams are designed for either laptops or desktops.

OmniVision Technologies Inc. is an American subsidiary of Chinese semiconductor device and mixed-signal integrated circuit design house Will Semiconductor. The company designs and develops digital imaging products for use in mobile phones, laptops, netbooks and webcams, security and surveillance cameras, entertainment, automotive and medical imaging systems. Headquartered in Santa Clara, California, OmniVision Technologies has offices in the US, Western Europe and Asia.

<span class="mw-page-title-main">Proximity sensor</span> About proximity sensor

A proximity sensor is a sensor able to detect the presence of nearby objects without any physical contact.

Range imaging is the name for a collection of techniques that are used to produce a 2D image showing the distance to points in a scene from a specific point, normally associated with some type of sensor device.

Canesta was a fabless semiconductor company that was founded in April, 1999, by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi.

<span class="mw-page-title-main">Time-of-flight camera</span> Range imaging camera system

A time-of-flight camera, also known as time-of-flight sensor, is a range imaging camera system for measuring distances between the camera and the subject for each point of the image based on time-of-flight, the round trip time of an artificial light signal, as provided by a laser or an LED. Laser-based time-of-flight cameras are part of a broader class of scannerless LIDAR, in which the entire scene is captured with each laser pulse, as opposed to point-by-point with a laser beam such as in scanning LIDAR systems. Time-of-flight camera products for civil applications began to emerge around 2000, as the semiconductor processes allowed the production of components fast enough for such devices. The systems cover ranges of a few centimeters up to several kilometers.

Sony Depthsensing Solutions SA/NV, formerly known as SoftKinetic, is a Belgian company founded by Eric Krzeslo, Thibaud Remacle, Gilles Pinault and Xavier Baele which develops gesture recognition hardware and software for real-time range imaging (3D) cameras. It was founded in July 2007. SoftKinetic provides gesture recognition solutions based on its technology to the interactive digital entertainment, consumer electronics, health & fitness, and serious game industries. SoftKinetic technology has been applied to interactive digital signage and advergaming, interactive television, and physical therapy.

GestureTek is an American-based interactive technology company headquartered in Silicon Valley, California, with offices in Toronto and Ottawa, Ontario and Asia.

<span class="mw-page-title-main">Kinect</span> Motion-sensing input device for the Xbox 360 and Xbox One

Kinect is a line of motion sensing input devices produced by Microsoft and first released in 2010. The devices generally contain RGB cameras, and infrared projectors and detectors that map depth through either structured light or time of flight calculations, which can in turn be used to perform real-time gesture recognition and body skeletal detection, among other capabilities. They also contain microphones that can be used for speech recognition and voice control.

<span class="mw-page-title-main">PrimeSense</span> Former Israeli company

PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

<span class="mw-page-title-main">Omek Interactive</span> Former technology company

Omek Interactive was a venture-backed technology company developing advanced motion-sensing software for human-computer interaction. Omek was co-founded in 2007 by Janine Kutliroff and Gershom Kutliroff.

Project Digits is a Microsoft Research Project under Microsoft's computer science laboratory at the University of Cambridge; researchers from Newcastle University and University of Crete are also involved in this project. Project is led by David Kim a Microsoft Research PhD and also a PhD Student in computer science at Newcastle University. Digits is an input device which can be mounted on the wrist of human hand and it captures and displays a complete 3D graphical representation of the user's hand on screen without using any external sensing device or hand covering material like data gloves. This project aims to make gesture controlled interfaces completely hands free with greater mobility and accuracy. It allows user to interact with whatever hardware while moving from room to room or walking down the street without any line of sight connection with the hardware.

<span class="mw-page-title-main">Intel RealSense</span> Suite of depth and tracking technologies

Intel RealSense Technology, formerly known as Intel Perceptual Computing, is a product range of depth and tracking technologies designed to give machines and devices depth perception capabilities. The technologies, owned by Intel are used in autonomous drones, robots, AR/VR, smart home devices amongst many others broad market products.

<span class="mw-page-title-main">PMD Technologies</span> German company using photonic mixer devices

PMD Technologies is a developer of CMOS semiconductor 3D time-of-flight (ToF) components and a provider of engineering support in the field of digital 3D imaging. The company is named after the Photonic Mixer Device (PMD) technology used in its products to detect 3D data in real time. The corporate headquarters of the company is located in Siegen, Germany.

References

  1. ↑ "3DV Systems Ltd. Introduces ZCAM, World's First Real-Time 3D Studio Camera". 3DV Systems. 1999-04-19. Archived from the original on 2005-02-11. Retrieved 2009-02-19.
  2. ↑ "JVC enters strategic alliances with cutting edge technology leaders". JVC. 2000-04-10. Retrieved 2009-02-19.
  3. ↑ "Products". 3DV Systems. Archived from the original on 2006-11-02. Retrieved 2009-02-19.
  4. 1 2 3 4 "Product Evolution". 3DV Systems. Archived from the original on 2009-02-28. Retrieved 2009-02-19.
  5. ↑ "ZCAM 3D Camera". JVC Professional. JVC. 2003-09-24. Retrieved 2009-06-20.
  6. ↑ Richard Marks (2004-01-21). EyeToy: A New Interface for Interactive Entertainment (Windows Media v7). Stanford University. Event occurs at 58:24. Retrieved 2009-06-20.
  7. 1 2 "Elron Group company 3DV signs definitive asset sale agreement" (PDF). Elron Electronic Industries. 2009-03-29. Retrieved 2009-03-30.
  8. 1 2 Shelah, Shmulik (2009-06-22). "Microsoft confirms 3DV acquisition". Globes . Tel Aviv: Globes Publisher Itonut. Archived from the original on 2009-06-26. Retrieved 2009-06-23. [Microsoft corporate vice president of Israel Research & Development Moshe Lichtman] said, for the first time officially, that "the R&D center helped Microsoft in buying the intellectual property of 3DV Systems, and in the wake of that dozens of the company's employees were recruited to work at the development center." Alt URL Archived 2012-02-18 at the Wayback Machine
  9. 1 2 Takahashi, Dean (2009-05-29). "Peeling back another layer of detail on Microsoft's secret gesture-control system for games". VentureBeat. Retrieved 2009-06-15.
  10. ↑ Johnson, R. Colin (2009-02-04). "3D sensor moves from car to CE". EE Times . TechInsights . Retrieved 2009-06-15.
  11. ↑ Katz, Sagi (2008-02-28). "Boxing with ZCam (part 1)". Engineering TV. Penton Media. Archived from the original on 2008-03-03. Retrieved 2009-03-12. Alt URL
  12. 1 2 3 4 Iddan, Gavriel J.; Yahav, Giora (2001-01-24). "3D imaging in the studio (and elsewhere…)" (PDF). Proceedings of SPIE. Vol. 4298. San Jose, CA: SPIE (published 2003-04-29). p. 48. doi:10.1117/12.424913. Archived from the original (PDF) on 2009-06-12. Retrieved 2009-02-19.
  13. ↑ Captain, Sean (2008-05-01). "Out of Control Gaming". PopSci.com. Popular Science. Retrieved 2009-06-15.
  14. 1 2 3 4 Nutt, Christian (2008-01-17). "Q&A: 3DV's Barel On The Future Of Camera-Based Game Control". Gamasutra. Think Services. Retrieved 2009-02-19.
  15. ↑ "3DV Systems announces ZCam, low cost real-time depth sensing camera". 3DV Systems. 2007-12-02. Archived from the original (PDF) on 2009-02-10. Retrieved 2009-02-19.
  16. 1 2 3 "ZCam Product Data Sheet" (JPEG). StudioGE. p. 2. Retrieved 2009-06-03.
  17. 1 2 "3DV Announces ZCam Real Time 3D Camera for the PC". PC Magazine. Ziff Davis. 2008-01-08. Retrieved 2009-02-19.
  18. 1 2 3 Barel, Tomer (2008-02-07). "ZCam - CES 2008: Interview" (Flash Video). GameTrailers. Retrieved 2009-02-19.
  19. ↑ Flier, Rich (2008-02-28). "Boxing with ZCam (part 2)". Engineering TV. Penton Media. Archived from the original on 2008-03-03. Retrieved 2009-03-12. Alt URL
  20. ↑ Markoff, John (2008-04-11). "The Coming of the Holodeck". Bits Blog. The New York Times Company. Retrieved 2009-02-19.
  21. ↑ Takahashi, Dean (2008-07-10). "3DV fleshes out gesture-based gaming plans, hires North American chief". VentureBeat. Retrieved 2008-12-02.
  22. ↑ Takahashi, Dean (2009-02-21). "Sources confirm Microsoft is buying 3DV Systems". VentureBeat. Retrieved 2009-02-23.
  23. ↑ Thorsen, Tor (May 12, 2009). "Xbox 360 motion-sensing camera in development - WSJ". Gamespot. Retrieved 2009-05-13.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.