Canesta

Last updated
Canesta Ltd
Company type Subsidiary
Industry Fabless Semiconductor
Founded1999
Headquarters,
USA
Key people
Jim Spare, CEO
Abbas Rafii, Executive VP
Cyrus Bamji, CTO
Patrick O'Connor, VP Eng.
Tim Droz, VP Platform Eng.
Tony Zuccarino, VP Mktg/Sales
Sakuya Morimoto, Sr. Dir. Asia
Albert Lee, VP Finance
Products 3D CMOS Image sensors
Owner Microsoft Corporation
Number of employees
60+ (2010)
Website www.canesta.com   OOjs UI icon edit-ltr-progressive.svg

Canesta was a fabless semiconductor company that was founded in April, 1999, by Cyrus Bamji, Abbas Rafii, and Nazim Kareemi. [1] [2]

Contents

The company manufactured CMOS-based single chip 3D sensors, which can be used as part of input systems for electronic devices.

On October 29, 2010, Canesta announced that it would be acquired by Microsoft for an undisclosed amount. [3]

History

The company launched publicly at PC Forum in 2002, where it also announced its CMOS-based single chip 3D image sensing technology using the Time of flight principle. [4] [5] Described as “electronic perception technology", the company promotes its technology as enabling everyday machines and digital devices with the ability to “see”. [6] [7]

In 2002, at Demo Mobile, the company announced its first application, a projection keyboard for mobile devices. In this application, a keyboard made of light is projected onto a flat surface, the user types on the flat surface, and Canesta's electronic perception technology translates finger movements into keystrokes in the device. [1] [8] [9] The company subsequently licensed the technology to Celluon of Korea. [10] [11]

The company later focused on the automotive applications of its technology, [12] [13] securing investment from Honda, [10] [14] and promoting its technology at public automotive industry forums such as Convergence 2006. Interior occupant sensing for advanced airbag deployment and rear obstacle detection are two example applications.

The company recently turned its attention to the video game space where its technology forms the basis of a unique input mechanism that enables new immersive game experiences. [15] [16]

On October 29, 2010, it was announced that Microsoft would acquire Canesta for an undisclosed amount, stating that their partnership would assist in the development of natural user interfaces and spread the adoption of their technology into a wider array of products. Microsoft had developed a motion controller for its Xbox 360 game console, using PrimeSense technology and the current Kinect for Xbox One switched over to the Canesta Time-of-flight camera core technology. [17]

Finances

The company has raised $70 Million to date in subsequent rounds of investment. [15]

The company's investors include The Carlyle Group, [4] Venrock Associates, KGIF, Hotung Capital, Honda Motor Company, Ltd., [2] Optex, Ltd., [15] Quanta Computer Inc. (2382.TW), and SMSC (NASDAQ: SMSC).

Products

Canesta provides its electronic perception technology in the form of CMOS 3D image sensors [18] to multiple OEM (Original Equipment Manufacturer) markets, including consumer electronics, video gaming, automotive, security, and industrial. As of Q3 2010, the latest generation of Canesta sensor was the 'Cobra' 3D ToF CMOS sensor. This sensor uses a standard CMOS image sensor process and has a ToF pixel array with XY resolution of 320x200. The range accuracy is characterized by the noise around the correct range data, and in this 'Cobra' device, this noise is around the single digit millimeter.

The company also provides reference designs, functioning sensor modules, and developer's toolkits. [15]

Technology

Canesta's time-of-flight technology consists of an array of pixels where every pixel can independently determine the distance to the object it sees. This array is in effect a massively parallel LIDAR on a single CMOS chip. At the heart of the technology is a proprietary silicon photo collection structure in each pixel that allows accurate measurement of the arrival time of the collected photons. This photo collection structure is substantially immune to CMOS surface defects that ordinarily adversely affect time of flight operation. This enables time of flight ranging using a low cost CMOS process. [14] [19]

Using Canesta technology a 3D time-of-flight camera can be constructed from a Canesta CMOS time of flight sensor, an imaging lens to focus the light from the scene onto the sensor and an LED or laser diode based light source controlled by the sensor to illuminate the scene with near infrared light. [14]

Related Research Articles

<span class="mw-page-title-main">Charge-coupled device</span> Device for the movement of electrical charge

A charge-coupled device (CCD) is an integrated circuit containing an array of linked, or coupled, capacitors. Under the control of an external circuit, each capacitor can transfer its electric charge to a neighboring capacitor. CCD sensors are a major technology used in digital imaging.

<span class="mw-page-title-main">Digital camera</span> Camera that captures photographs or video in digital format

A digital camera, also called a digicam, is a camera that captures photographs in digital memory. Most cameras produced today are digital, largely replacing those that capture images on photographic film or film stock. Digital cameras are now widely incorporated into mobile devices like smartphones with the same or more capabilities and features of dedicated cameras. High-end, high-definition dedicated cameras are still commonly used by professionals and those who desire to take higher-quality photographs.

<span class="mw-page-title-main">Webcam</span> Video camera connected to a computer or network

A webcam is a video camera which is designed to record or stream to a computer or computer network. They are primarily used in video telephony, live streaming and social media, and security. Webcams can be built-in computer hardware or peripheral devices, and are commonly connected to a device using USB or wireless protocols.

A staring array, also known as staring-plane array or focal-plane array (FPA), is an image sensor consisting of an array of light-sensing pixels at the focal plane of a lens. FPAs are used most commonly for imaging purposes, but can also be used for non-imaging purposes such as spectrometry, LIDAR, and wave-front sensing.

<span class="mw-page-title-main">High-speed photography</span> Photography genre

High-speed photography is the science of taking pictures of very fast phenomena. In 1948, the Society of Motion Picture and Television Engineers (SMPTE) defined high-speed photography as any set of photographs captured by a camera capable of 69 frames per second or greater, and of at least three consecutive frames. High-speed photography can be considered to be the opposite of time-lapse photography.

<span class="mw-page-title-main">Image sensor</span> Device that converts images into electronic signals

An image sensor or imager is a sensor that detects and conveys information used to form an image. It does so by converting the variable attenuation of light waves into signals, small bursts of current that convey the information. The waves can be light or other electromagnetic radiation. Image sensors are used in electronic imaging devices of both analog and digital types, which include digital cameras, camera modules, camera phones, optical mouse devices, medical imaging equipment, night vision equipment such as thermal imaging devices, radar, sonar, and others. As technology changes, electronic and digital imaging tends to replace chemical and analog imaging.

The following are common definitions related to the machine vision field.

<span class="mw-page-title-main">Active-pixel sensor</span> Image sensor, consisting of an integrated circuit

An active-pixel sensor (APS) is an image sensor, which was invented by Peter J.W. Noble in 1968, where each pixel sensor unit cell has a photodetector and one or more active transistors. In a metal–oxide–semiconductor (MOS) active-pixel sensor, MOS field-effect transistors (MOSFETs) are used as amplifiers. There are different types of APS, including the early NMOS APS and the now much more common complementary MOS (CMOS) APS, also known as the CMOS sensor. CMOS sensors are used in digital camera technologies such as cell phone cameras, web cameras, most modern digital pocket cameras, most digital single-lens reflex cameras (DSLRs), mirrorless interchangeable-lens cameras (MILCs), and lensless imaging for cells.

<span class="mw-page-title-main">Projection keyboard</span> Virtual device projected onto a surface

A projection keyboard is a form of computer input device whereby the image of a virtual keyboard is projected onto a surface: when a user touches the surface covered by an image of a key, the device records the corresponding keystroke. Some connect to Bluetooth devices, including many of the latest smartphone, tablet, and mini-PC devices with Android, iOS or Windows operating system.

OmniVision Technologies Inc. is an American subsidiary of Chinese semiconductor device and mixed-signal integrated circuit design house Will Semiconductor. The company designs and develops digital imaging products for use in mobile phones, laptops, netbookswebcams, security, entertainment, automotive and medical imaging systems. Headquartered in Santa Clara, California, OmniVision Technologies has offices in the US, Western Europe and Asia.

ZCam is a brand of time-of-flight camera products for video applications by Israeli developer 3DV Systems. The ZCam supplements full-color video camera imaging with real-time range imaging information, allowing for the capture of video in 3D.

<span class="mw-page-title-main">Time-of-flight camera</span> Range imaging camera system

A time-of-flight camera, also known as time-of-flight sensor, is a range imaging camera system for measuring distances between the camera and the subject for each point of the image based on time-of-flight, the round trip time of an artificial light signal, as provided by a laser or an LED. Laser-based time-of-flight cameras are part of a broader class of scannerless LIDAR, in which the entire scene is captured with each laser pulse, as opposed to point-by-point with a laser beam such as in scanning LIDAR systems. Time-of-flight camera products for civil applications began to emerge around 2000, as the semiconductor processes allowed the production of components fast enough for such devices. The systems cover ranges of a few centimeters up to several kilometers.

Sony Depthsensing Solutions SA/NV, formerly known as SoftKinetic Systems, is a Belgian company originating from the merger of Optrima NV, founded by André Miodezky, Maarten Kuijk, Daniël Van Nieuwenhove, Ward Van der Tempel and Tomas Van den Hauwe and SoftKinetic SA founded by Eric Krzeslo, Thibaud Remacle, Gilles Pinault and Xavier Baele. Sony Depthsensing Solutions develops gesture recognition hardware and software for real-time range imaging (3D) cameras. SoftKinetic was founded in July 2007 providing gesture recognition solutions based on its technology to the interactive digital entertainment, consumer electronics, health & fitness, and serious game industries. SoftKinetic technology has been applied to interactive digital signage and advergaming, interactive television, and physical therapy.

<span class="mw-page-title-main">MESA Imaging</span> Swiss time-of-flight camera company

MESA Imaging is a time-of-flight camera company. As privately financed organization, MESA was founded in July 2006 as a spin out from the Swiss Center for Electronics and Microtechnology (CSEM) to commercialize its time-of-flight camera technologies. As of 2009, its primary product line, the SwissRanger, is in its fourth generation with the SwissRanger SR4000. In 2014 MESA was bought by Heptagon

<span class="mw-page-title-main">PrimeSense</span> Former Israeli company

PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.

<span class="mw-page-title-main">InVisage Technologies</span> American semiconductor company

InVisage Technologies is a fabless semiconductor company known for producing a technology called QuantumFilm, an image sensor technology that improves the quality of digital photographs taken with a cell phone camera. The company is based in Menlo Park, CA.

<span class="mw-page-title-main">Intel RealSense</span> Suite of depth and tracking technologies

Intel RealSense Technology, formerly known as Intel Perceptual Computing, is a product range of depth and tracking technologies designed to give machines and devices depth perception capabilities. The technologies, owned by Intel are used in autonomous drones, robots, AR/VR, smart home devices amongst many others broad market products.

<span class="mw-page-title-main">PMD Technologies</span> German company using photonic mixer devices

PMD Technologies is a developer of CMOS semiconductor 3D time-of-flight (ToF) components and a provider of engineering support in the field of digital 3D imaging. The company is named after the Photonic Mixer Device (PMD) technology used in its products to detect 3D data in real time. The corporate headquarters of the company is located in Siegen, Germany.

<span class="mw-page-title-main">Google ATAP</span> Skunkworks team and in-house technology incubator

Google's Advanced Technology and Projects group (ATAP) is a skunkworks team and in-house technology incubator, created by former DARPA director Regina Dugan. ATAP is similar to X, but works on projects, granting project leaders time—previously only two years—in which to move a project from concept to proven product. According to Dugan, the ideal ATAP project combines technology and science, requires a certain amount of novel research, and creates a marketable product. Historically, the ATAP team was born at Motorola Mobility and kept when Google sold Motorola Mobility to Lenovo in 2014; for this reason, ATAP ideas have tended to involve mobile hardware technology.

References

  1. 1 2 Marriott, Michel (September 19, 2002). “No Keys, Just Soft Light and You”. The New York Times.
  2. 1 2 “Honda invests in Canesta”. (September 21, 2006). Sensors.
  3. "Canesta Announces Definitive Agreement to Be Acquired by Microsoft". www.businesswire.com. 2010-10-29. Retrieved 2020-01-23.
  4. 1 2 Shim, Richard (March 25, 2002). “Start-up adds depth to 3D imaging”. CNET News.
  5. Rupley, Sebastian (August 10, 2004). “Canesta: Bringing Sight to Devices”. PC Magazine.
  6. Arnst, Catherine, ed. (April 15, 2002). “The Vision Thing Gets Closer for Computers”. Business Week.
  7. Baig, Edward C. (September 24, 2002). “New technologies showcase the not-too-distant future”. USA Today.
  8. Hesseldahl, Arik (September 18, 2002). “Typing on the table”. Forbes.
  9. Shiels, Maggie (October 15, 2002). “The keyboard that isn’t there”. BBC News.
  10. 1 2 Kanellos, Michael (September 19, 2006). “Honda investing in chips to help cars see". CNET News.
  11. "++Celluon ++". Archived from the original on 2012-03-26. Retrieved 2011-06-25.
  12. Kanellos, Michael (August 9, 2004). "Eye robot: Start-up offers vision to machines. Some work to bring eyesight to blind people. Canesta works to bring it to cars and automatic doors”. CNET News.
  13. Maloney, Lawrence D. (March 19, 2007). “Drumbeat Quickens for Safer Cars” Archived 2009-07-13 at the Wayback Machine . Design News.
  14. 1 2 3 Wilson, Andrew (July 1, 2004). “CMOS single-chip sensor captures 3-D images”. Vision Systems.
  15. 1 2 3 4 “Tower Semiconductor ramps production of Canesta’s breakthrough 3D image sensors” Archived 2013-02-01 at archive.today . (April 15, 2008). Press release.
  16. “Game developers to benefit from Canesta’s 3D camera – Softkinetic’s 3D software collaboration” Archived 2009-09-26 at the Wayback Machine . (February 21, 2008). Press release.
  17. Ogg, Erica. "Microsoft to acquire gesture control maker Canesta". CNET. Retrieved 30 October 2010.
  18. "3D Image sensors — what are they?". eetimes.com. 2008-04-25. Retrieved 2024-05-31.
  19. Spare, James (August, 2004). “Machine vision: Adding the Third Dimension. Electronic perception technology is a new way to make direct, rather than derived, depth measurements of target objects” Archived 2006-10-18 at the Wayback Machine . Sensors.

Further reading