|Generation||Seventh and eighth-generation eras|
|Units sold||35 million (as of October 25, 2017)|
|Camera||640×480 pixels @ 30 Hz (RGB camera)|
640×480 pixels @ 30 Hz (IR depth-finding camera)
|Connectivity||USB 2.0 (type-A for original model; proprietary for Xbox 360 S)|
|Platform|| Xbox 360 |
Microsoft Windows (Windows 7 onwards)
|Predecessor||Xbox Live Vision|
Kinect (codenamed Project Natal during development) is a line of motion sensing input devices produced by Microsoft and first released in 2010. The technology includes a set of hardware originally developed by PrimeSense, incorporating RGB cameras, infrared projectors and detectors that mapped depth through either structured light or time of flight calculations, and a microphone array, along with software and artificial intelligence from Microsoft to allow the device to perform real-time gesture recognition, speech recognition and body skeletal detection for up to four people, among other capabilities. This enables Kinect to be used as a hands-free natural user interface device to interact with a computer system. Kinect is a peripheral that sits atop the user's display similar to a webcam.
Kinect originated as a means to eliminate the game controller from Microsoft's Xbox video game hardware, competing with the Nintendo Wii's own motion-sensing capabilities, hoping to draw a larger audience beyond traditional video game players to the Xbox. Kinect first launched as an add-on for the Xbox 360 in November 2010, and within a few months more than 10 million units had been sold, making it one of the fastest-selling computer hardware products at the time. However, video games had to be developed to specifically incorporate the Kinect's features, and the bulk of games released with Kinect support were family-friendly titles. As Microsoft developed the successor console, the Xbox One, the company had planned to make the second generation of Kinect hardware a required component of the console, giving a reason for developers to seek to take advantage of it. However, the forced inclusion of Kinect raised concerns related to privacy, and among other major changes, Microsoft eventually eliminated the requirement for Kinect to be always connected to the Xbox One, though still bundled Kinect with the console on its release in November 2013. A market for Kinect-based games still did not emerge after the Xbox One's launch, and Microsoft eventually eliminated the Kinect from the Xbox One bundles, while later hardware revisions eliminated the Kinect-specific ports on the console, requiring a special USB adapter instead. By 2018, Microsoft had discontinued all Kinect hardware for video games.
However, Kinect had found an unexpected home for Microsoft in academics and commercial applications, as the Kinect sensor, at the time, was cheaper and more robust compared to other depth-sensing technology applications. Microsoft now considers non-gaming applications, such as in robotics, medicine, and health care, the primary market for Kinect. Shortly after the November 2010 release, users were able to hack into the Kinect and develop hardware drivers and software interfaces to be used on Microsoft Windows personal computers and other systems. Microsoft, after initially objecting to the potential security issues raised by these hacks, changed course and endorsed these efforts, and released its own software development kit for non-commercial applications. The company later rebranded the Kinect hardware into Kinect for Windows in 2012, allowing for commercial applications. A second-generation Kinect for Windows, based on the Xbox One unit, was released in 2014, though Microsoft ultimately terminated this line and directed users to use the Xbox One Kinect as it was functionally equivalent. Following the discontinuation of the Xbox line of Kinect sensors, Microsoft released a non-gaming version as the Azure Kinect, which incorporates Microsoft Azure cloud computing applications among the device's functionalities. Part of the Kinect technology was also used within Microsoft's Hololens project.
|2006||PrimeSense technology shown at GDC|
|2009||"Project Natal" announced|
|2010||Kinect for Xbox 360 released|
|2011||Non-commercial SDK released|
|Commercial SDK released|
|2012||Kinect for Windows released|
|2013||Kinect for Xbox One released with console|
|2014||Kinect 2 for Windows released|
|2017||Discontinuation of Kinect for Xbox hardware|
|2019||Azure Kinect released|
The origins of the Kinect started around 2005, at a point where technology vendors were starting to develop depth-sensing cameras. Microsoft had been interested in a 3D camera for the Xbox line earlier but because the technology had not been refined, had placed it in the "Boneyard", a collection of possible technology they could not immediately work on.
In 2005, PrimeSense was founded by tech-savvy mathematicians and engineers from Israel to develop the "next big thing" for video games, incorporating cameras that were capable of mapping a human body in front of them and sensing hand motions. They showed off their system at the 2006 Game Developers Conference, where Microsoft's Alex Kipman, the general manager of hardware incubation, saw the potential in PrimeSense's technology for the Xbox system. Microsoft began discussions with PrimeSense about what would need to be done to make their product more consumer-friendly: not only improvements in the capabilities of depth-sensing cameras, but a reduction in size and cost, and a means to manufacturer the units at scale was required. PrimeSense spent the next few years working at these improvements.
Nintendo released the Wii in November 2006. The Wii's central feature was the Wii Remote, a handheld device that was detected by the Wii through a motion sensor bar mounted onto a television screen to enable motion controlled games. Microsoft felt pressure from the Wii, and began looking into depth-sensing in more detail with PrimeSense's hardware, but could not get to the level of motion tracking they desired. While they could determine hand gestures, and sense the general shape of a body, they could not do skeletal tracking. A separate path within Microsoft looked to create an equivalent of the Wii Remote, considering that this type of unit may become standardized similar to how two-thumbstick controllers became a standard feature.However, it was still ultimately Microsoft's goal to remove any device between the player and the Xbox.
Kudo Tsunoda and Darren Bennett joined Microsoft in 2008, and began working with Kipman on a new approach to depth-sensing aided by machine learning to improve skeletal tracking. They internally demonstrated this and established where they believed the technology could be in a few years, which led to the strong interest to fund further development of the technology; this has also occurred at a time that Microsoft executives wanted to abandon the Wii-like motion tracking approach, and favored the depth-sensing solution to present a product that went beyond the Wii's capabilities. The project was greenlit by late 2008 with work started in 2009.
The project was codenamed "Natal" after the Brazilian city Natal, Kipman's birthplace. Additionally, Kipman recognized the Latin origins of the word "natal" to mean "to be born", reflecting the new types of audiences they hoped to draw with the technology.Much of the initial work was related to ethnographic research to see how video game players' home environments were laid out, lit, and how those with Wiis used the system to plan how Kinect units would be used. The Microsoft team discovered from this research that the up-and-down angle of the depth-sensing camera would either need to be adjusted manually, or would require an expensive motor to move automatically. Upper management at Microsoft opted to include the motor despite the increased cost to avoid breaking game immersion. Kinect project work also involved packaging the system for mass production and optimizing its performance. Hardware development took around 22 months.
During hardware development, Microsoft engaged with software developers to use Kinect. Microsoft wanted to make games that would be playable by families since Kinect could sense multiple bodies in front of it. One of the first internal titles developed for the device was the pack-in game Kinect Adventures developed by Good Science Studio that was part of Microsoft Studios. One of the game modes of Kinect Adventures was "Reflex Ridge", based on the Japanese Brain Wall game where players attempt to contort their bodies in a short time to match cutouts of a wall moving at them. This type of game was a key example of the type of interactivity they wanted with Kinect, and its development helped feed into the hardware improvements.
Nearing the planned release, the problem of widespread testing of Kinect in various room types and different bodies accounting for age, gender, and race among other factors, while keeping the details of the unit confidential. Microsoft engaged in a company-wide program offering employees to take home Kinect units to test them. Microsoft also brought other non-gaming divisions, including its Microsoft Research, Microsoft Windows, and Bing teams to help complete the system. Microsoft established its own large-scale manufacturing facility to bulk product Kinect units and test them.
Kinect was first announced to the public as "Project Natal" on June 1, 2009, during Microsoft's press briefing at E3 2009; film director Steven Spielberg had joined Microsoft's Don Mattrick to introduce the technology and its potential. —Microsoft's Ricochet and Paint Party, and Lionhead Studios' Milo & Kate created by Peter Molyneux —while a Kinect-enabled version of Criterion Games' Burnout Paradise was shown during the E3 exhibition. By E3 2009, the skeletal mapping technology was capable of simultaneously tracking four people, with a feature extraction of 48 skeletal points on a human body at 30 Hz. Microsoft had not committed to a release date for Kinect at E3 2009, but affirmed it would be after 2009, and likely in 2010 to stay competitive with the Wii and the PlayStation Move (Sony Interactive Entertainment's own motion-sensing system using hand-held devices).Three demos were shown to showcase Kinect during the briefing
In the months following E3 2009, rumors that a new Xbox 360 console associated with Kinect emerged, either a retail configuration that incorporated Project Natal,or as a hardware revision or upgrade to support Kinect. Microsoft dismissed the reports in public and repeatedly emphasized that Kinect would be fully compatible with all Xbox 360 consoles. Microsoft indicated that the company considered Kinect to be a significant initiative, as fundamental to Xbox brand as Xbox Live, and with a planned launch akin to that of a new Xbox console platform. Microsoft's vice president Shane Kim said the company did not expect Kinect would extend the anticipated lifetime of the Xbox 360, which had been planned to last ten years through 2015, nor delay the launch of the successor to the Xbox 360.
Following the E3 2009 show and through 2010, the Kinect team members experimentally adapted numerous games to Kinect-based control schemes to help evaluate usability. Among these games were Beautiful Katamari and Space Invaders Extreme , which were demonstrated at Tokyo Game Show in September 2009.According to Tsunoda, adding Project Natal-based control to pre-existing games involved significant code alterations, and made it unlikely that existing games could be patched through software updates to support the unit. Microsoft also expanded its draw to third-party developers to encourage them to develop Kinect-based games. Companies like Harmonix and Double Fine quickly took to the Kinect and saw the potential in it, and committed to developing games for the unit, such as the launch title Dance Central from Harmonix.
Although the Kinect's sensor unit was originally planned to contain a microprocessor that would perform operations such as the system's skeletal mapping, Microsoft reported in January 2010 that the sensor would no longer feature a dedicated processor. Instead, processing would be handled by one of the processor cores of Xbox 360's Xenon CPU.Around this time, Kipmen estimated that the Kinect would only take about 10 to 15% of the Xbox 360's processing power. While this was a small fraction of the Xbox 360's capabilities, industry observed believed this further pointed to difficulties in adapting pre-existing games to use Kinect, as the motion-tracking would add to a game's high computational load and exceed the Xbox 360's capabilities. These observed believed that instead the industry would develop games specific to the Kinect features.
At the following E3 2010, Microsoft used its press conference on June 13, 2010, to fully premiere the Kinect hardware, along with a performance by Cirque du Soleil. During the conference, Microsoft revealed the rebranding of Project Natal as "Kinect", which Xbox Live director Stephen Toulouse explained was a portmanteau of the words "kinetic" and "connection", key aspects of the Kinect initiative. GB hard drive, and had a Kinect-ready port: this unit later became known as the Xbox 360 S. In addition to hardware, Microsoft and several other game developers and publishers showed off Kinect-ready titles during the E3 2010 exhibition.Launch dates were also given, with the Kinect to arrive first in North America on November 4, 2010. Microsoft also introduced a revision of the Xbox 360 that was slimmer than the existing model, included a larger 250
Microsoft continued to refine the Kinect technology in the months leading to the Kinect launch in November 2010. By launch, Kipman reported they had been able to reduce the Kinect's use of the Xbox 360's processor from 10 to 15% as reported in January 2010 to a "single-digit percentage".
Microsoft heavily advertised and promoted the Kinect launch. According to The New York Post , Microsoft had a $500 million budget for this marketing.While this claim was widely re-reported, The marketing campaign You Are the Controller, aiming to reach new audiences, included advertisements on Kellogg's cereal boxes and Pepsi bottles, commercials during shows such as Dancing with the Stars and Glee as well as print ads in various magazines such as People and InStyle .
Microsoft gave away Kinect units and Xbox 360 consoles to all members of the audience at the October 19, 2010 The Oprah Winfrey Show ,and similarly followed suit two weeks later for Late Night with Jimmy Fallon .
On October 23, 2010, Microsoft held a pre-launch party for Kinect in Beverly Hills. The party was hosted by Ashley Tisdale and was attended by soccer star David Beckham and his three sons, Cruz, Brooklyn, and Romeo. Guests were treated to sessions with Dance Central and Kinect Adventures , followed by Tisdale having a Kinect voice chat with Nick Cannon.Between November 1 and 28, Burger King gave away a free Kinect bundle to a random in-store customer every 15 minutes. A major event was organized on November 3 in Times Square, where singer Ne-Yo performed with hundreds of dancers in anticipation of Kinect's midnight launch.
Kinect was launched in North America on November 4, 2010; GB or 250 GBin Europe on November 10, 2010; in Australia, New Zealand, and Singapore on November 18, 2010; and in Japan on November 20, 2010. Purchase options for the sensor peripheral include a bundle with the game Kinect Adventures , and as a hardware bundle with Kinect Adventures and the redesigned Xbox 360 S console with either a 4
The Kinect sensor was typical a gloss-black; a Star Wars bundle for the Xbox 360 was released on July 21, 2011 which include the first all-white Kinect unit to match with the themed-console along with the games Kinect Adventures and Kinect Star Wars .
The Kinect release for the Xbox 360 was estimated to have sold eight million units in the first sixty days of release, earning the hardware the Guinness World Record for the "Fastest-Selling Consumer Electronics Device".Over 10 million had been sold by March 2011. While seemingly successful, the Kinect had a number of downsides: its launch titles were primarily family-oriented games which may have drawn new audience but did not have the selling power of major video games like Battlefield and Call of Duty , and thus did not have a high attach rate, with only around 20% of the 55 million Xbox 360 users having purchased the unit. It had also been difficult to engage with developers and publishers of these more popular series, since altering their game play away from the controller would be disruptive, even with the added advantages Kinect could provide. The Kinect team recognized some of the downsides with more traditional games and Kinect, and continued ongoing development of the unit to be released as a second-generation unit, such as reducing the latency of motion detection and improving speech recognition. Microsoft provided news of these changes to the third-party developers to help them anticipate how the improvements can be integrated into the games.
Microsoft announced in August 2013 that they had made several changes to the planned Xbox One release in response to the backlash. Among these was that the system would no longer require a Kinect unit to be plugged in to work, though it was still planned to package the Kinect with all Xbox One systems. However, this also required Microsoft to establish a US$500 price-point for the Xbox One/Kinect system at its November 2013 launch, US$100 more than the competing PlayStation 4 launched in the same time frame, which did not include any motion-sensing hardware. In the months after the Xbox One release, Microsoft decided to launch a Kinect-less Xbox One system in March 2014 at the same price as the PlayStation 4, after considering that the Kinect for Xbox One had not gotten the developer support, and sales of the Xbox One were lagging due to the higher price tag of the Kinect-bundled system. Richard Irving, a program group manager that oversaw Kinect, said that Microsoft had felt that it was more important to give developers and consumers the option of developing for or purchasing the Kinect rather than forcing the unit on them.
The removal of Kinect from the Xbox One retail package was the start of the rapid decline and phase-out of the unit within Microsoft. Developers like Harmonix that had been originally targeting games to use the Xbox One had put these games on hold until they knew there was enough of a Kinect install base to justify release, which resulted in a lack of games for the Kinect and reducing any consumer drive to buy the separate unit.Microsoft became bearish on the Kinect, making no mention of the unit at E3 2015 and announcing at E3 2016 that the upcoming Xbox One hardware revision, the Xbox One S, would not have a dedicated Kinect port; Microsoft offered a USB adapter for the Kinect, provided free during an initial promotional period after the console's launch. The more powerful Xbox One X also lacked the Kinect port and required this adapter. Even though developers still released Kinect-enabled games for the Xbox One, Microsoft's lack of statements related to the Kinect during this period led to claims that the Kinect was a dead project at Microsoft.
Microsoft formally announced it would stop manufacture of the Kinect for Xbox One on October 25, 2017.Microsoft eventually discontinued the adapter in January 2018, stating that they were shifting to manufacture other accessories for the Xbox One and personal computers that were more in demand. This is considered by the media to be the point where Microsoft forgone any further work on the Kinect for the Xbox platform.
While the Kinect unit for the Xbox platform had petered out, the Kinect had found new life in academia and other applications since around 2011. The functionality of the unit along with its low US$150 cost was seen to be an inexpensive means to add depth-sensing to existing applications, offsetting the high cost and unreliability of other 3D camera options at the time. In robotics, Kinect's depth-sensing would enable robots to determine the shape and approximate distances to obstacles and maneuver around them. Within the medical field, the Kinect could be used to monitor the shape and posture of a body in a quantifiable manner to enable improved health-care decisions.
Around November 2010, after the Kinect's launch, scientists, engineers, and hobbyists had been able to hack into the Kinect to determine what hardware and internal software it had used, leading to users finding how to connect and operate the Kinect with Microsoft Windows and OS X over USB, which has unsecured data from the various camera elements that could be read. This further led to prototype demos of other possible applications, such as a gesture-based user interface for the operating system similar to that shown in the film Minority Report , as well as pornographic applications.This mirrored similar work to hack the Wii Remote a few years earlier to use its low-cost hard for more advanced applications beyond gaming.
Adafruit Industries, having envisioned some of the possible applications of the Kinect outside of gaming, issued a security challenge related to the Kinect, offering prize money for the successful development of an open source software development kit (SDK) and hardware drivers for the Kinect, which came to be known as Open Kinect.Adafruit named the winner, Héctor Martín, by November 10, 2010, who had produced a Linux driver that allows the use of both the RGB camera and depth sensitivity functions of the device. It was later discovered that Johnny Lee, a core member of Microsoft's Kinect development team, had secretly approached Adafruit with the idea of a driver development contest and had personally financed it. Lee had said of the efforts to open the Kinect that "This is showing us the future...This is happening today, and this is happening tomorrow." and had engaged Adafruit with the contest as he been frustrated with trying to convince Microsoft's executives to explore the non-gaming avenue for the Kinect.
Microsoft initially took issue with users hacking into the Kinect, stating they would incorporate additional safeguards into future iterations of the unit to prevent such hacks.However, by the end of November 2010, Microsoft had turned on their original position and embraced the external efforts to develop the SDK. Kipman, in an interview with NPR, said
The first thing to talk about is, Kinect was not actually hacked. Hacking would mean that someone got to our algorithms that sit inside of the Xbox and was able to actually use them, which hasn't happened. Or, it means that you put a device between the sensor and the Xbox for means of cheating, which also has not happened. That's what we call hacking, and that's what we have put a ton of work and effort to make sure doesn't actually occur. What has happened is someone wrote an open-source driver for PCs that essentially opens the USB connection, which we didn't protect, by design, and reads the inputs from the sensor. The sensor, again, as I talked earlier, has eyes and ears, and that's a whole bunch of noise that someone needs to take and turn into signal.
PrimeSense along with robotics firm Willow Garage and game developer Side-Kick launched OpenNI, a not-for-profit group to develop portable drivers for the Kinect and other natural interface (NI) devices, in November 2010. Its first set of drivers named NITE were released in December 2010.PrimeSense had also worked with ASUS to develop a version Kinect for personal computers for China. The resulting product, the Wavi Xtion, was released in October 2011.
Microsoft announced in February 2011 that it was planning on releasing its own SDK for the Kinect within a few months, and which was officially released on June 16, 2011, but which was limited to non-commercial uses. 50 centimetres (20 in) in front of the cameras. The Kinect for Windows device was listed at US$250, US$100 more than the original Kinect since Microsoft had considered the Xbox 360 Kinect was subsidized through game purchases, Xbox Live subscriptions, and other costs. At the launch, Microsoft stated that more than 300 companies from over 25 countries were working on Kinect-ready apps with the new unit.The SDK enabled users to access the skeletal motion recognition system for up to two persons and the Kinect microphone array, features that had not been part of the prior Open Kinect SDK. Commercial interest in Kinect was still strong, with David Dennis, a product manager at Microsoft, stating "There are hundreds of organizations we are working with to help them determine what's possible with the tech". Microsoft launched its Kinect for Windows program on October 31, 2011, releasing a new SDK to a small number of companies, including Toyota, Houghton Mifflin, and Razorfish, to explore what was possible. At the 2012 Consumer Electronics Show in January, Microsoft announced that it would release a dedicated Kinect for Windows unit along with the commercial SDK on February 1, 2012. the device included some hardware improvements, including support for "near mode" to recognize objects about
With the original announcement of the revised Kinect for Xbox One in 2013, Microsoft also confirmed it would have a second generation of Kinect for Windows based on the updated Kinect technology by 2014. US$200 price. Microsoft opted to discontinue the original Kinect for Windows by the end of 2014. However, in April 2015, Microsoft announced they were also discontinuing the Kinect 2 for Windows, and instead directing commercial users to use the Kinect for Xbox One, which Microsoft said "perform identically". Microsoft stated that the demand for the Kinect 2 for Windows demand was high and difficult to keep up while also fulfilling the Kinect for Xbox One orders, and that they had found commercial developers successfully using the Kinect for Xbox One in their applications without issue.The new Kinect 2 for Windows was launched on July 15, 2014 at a
With Microsoft's waning focus on Kinect, PrimeSense was bought by Apple, Inc. in 2013, which incorporated parts of the technology into its Face ID system for iOS devices.
Microsoft had abandoned the idea of Kinect for video games, but still explored the potential of Kinect beyond that. Microsoft's Director of Communications Greg Sullivan stated in 2018 that "I think one of the things that is beginning to be understood is that Kinect was never really just the gaming peripheral...It was always more."Part of Kinect technology was integrated into Microsoft's Hololens, first released in 2016.
Microsoft announced that it was working on a new version of a hardware Kinect model for non-game applications that would integrate with their Azure cloud computing services in May 2018. The use of cloud computing to offload some of the computational work from Kinect, as well as more powerful features enable by Azure such as artificial intelligence would improve the accuracy of the depth-sensing and reduce the power demand and would lead to more compact units, Microsoft had envisioned. US$400, while the SDK for the unit had been released in February 2019.The Azure Kinect device was released on June 27, 2019 at a price of
The depth and motion sensing technology at the core of the Kinect is enabled through its depth-sensing. The original Kinect for Xbox 360 used structured light for this: the unit used a near-infrared pattern projected across the space in front of the Kinect, while an infrared sensor captured the reflected light pattern. The light pattern is deformed by the relative depth of the objects in front it, and mathematics can be used to estimate that depth based on several factors related to the hardware layout of the Kinect. While other structure light depth-sensing technologies used multiple light patterns, Kinect used as few as one as to achieve a high rate of 30 frames per second of depth sensing. Kinect for Xbox One switched over to using time of flight measurements. The infrared projector on the Kinect sends out modulated infrared light which is then captured by the sensor. Infrared light reflecting off closer objects will have a shorter time of flight than those more distant, so the infrared sensor captures how much the modulation pattern had been deformed from the time of flight, pixel-by-pixel. Time of flight measurements of depth can be more accurate and calculated in a shorter amount of time, allowing for more frames-per-second to be detected.
Once Kinect has a pixel-by-pixel depth image, Kinect uses a type of edge detection here to delineate closer objects from the background of the shot, incorporating input from the regular visible light camera. The unit then attempts to track any moving objects from this, with the assumption that only people will be moving around in the image, and isolates the human shapes from the image. The unit's software, aided by artificial intelligence, performs segmentation of the shapes to try to identify specific body parts, like the head, arms, and hands, and track those segments individually. Those segments are used to construct a 20-point skeleton of the human body, which then can be used by game or other software to determine what actions the person has performed.
Kinect for Xbox 360 was a combination of Microsoft built software and hardware. The hardware included a range chipset technology by Israeli developer PrimeSense, which developed a system consisting of an infrared projector and camera and a special microchip that generates a grid from which the location of a nearby object in 3 dimensions can be ascertained.This 3D scanner system called Light Coding employs a variant of image-based 3D reconstruction.
The Kinect sensoris a horizontal bar connected to a small base with a motorized pivot and is designed to be positioned lengthwise above or below the video display. The device features an "RGB camera, depth sensor and microphone array running proprietary software", which provide full-body 3D motion capture, facial recognition and voice recognition capabilities. At launch, voice recognition was only made available in Japan, United Kingdom, Canada and United States. Mainland Europe received the feature later in spring 2011. Currently voice recognition is supported in Australia, Canada, France, Germany, Ireland, Italy, Japan, Mexico, New Zealand, United Kingdom and United States. The Kinect sensor's microphone array enables Xbox 360 to conduct acoustic source localization and ambient noise suppression, allowing for things such as headset-free party chat over Xbox Live.
The depth sensor consists of an infrared laser projector combined with a monochrome CMOS sensor, which captures video data in 3D under any ambient light conditions.The sensing range of the depth sensor is adjustable, and Kinect software is capable of automatically calibrating the sensor based on gameplay and the player's physical environment, accommodating for the presence of furniture or other obstacles.
Described by Microsoft personnel as the primary innovation of Kinect,the software technology enables advanced gesture recognition, facial recognition and voice recognition. According to information supplied to retailers, Kinect is capable of simultaneously tracking up to six people, including two active players for motion analysis with a feature extraction of 20 joints per player. However, PrimeSense has stated that the number of people the device can "see" (but not process as players) is only limited by how many will fit in the field-of-view of the camera.
Reverse engineering Hz to 30 Hz depending on resolution. The default RGB video stream uses 8-bit VGA resolution (640 × 480 pixels) with a Bayer color filter, but the hardware is capable of resolutions up to 1280x1024 (at a lower frame rate) and other colour formats such as UYVY. The monochrome depth sensing video stream is in VGA resolution (640 × 480 pixels) with 11-bit depth, which provides 2,048 levels of sensitivity. The Kinect can also stream the view from its IR camera directly (i.e.: before it has been converted into a depth map) as 640x480 video, or 1280x1024 at a lower frame rate. The Kinect sensor has a practical ranging limit of 1.2–3.5 m (3.9–11.5 ft) distance when used with the Xbox software. The area required to play Kinect is roughly 6 m2, although the sensor can maintain tracking through an extended range of approximately 0.7–6 m (2.3–19.7 ft). The sensor has an angular field of view of 57° horizontally and 43° vertically, while the motorized pivot is capable of tilting the sensor up to 27° either up or down. The horizontal field of the Kinect sensor at the minimum viewing distance of ≈0.8 m (2.6 ft) is therefore ≈87 cm (34 in), and the vertical field is ≈63 cm (25 in), resulting in a resolution of just over 1.3 mm (0.051 in) per pixel. The microphone array features four microphone capsules and operates with each channel processing 16-bit audio at a sampling rate of 16 kHz.has determined that the Kinect's various sensors output video at a frame rate of ≈9
Because the Kinect sensor's motorized tilt mechanism requires more power than the Xbox 360's USB ports can supply,the device makes use of a proprietary connector combining USB communication with additional power. Redesigned Xbox 360 S models include a special AUX port for accommodating the connector, while older models require a special power supply cable (included with the sensor) that splits the connection into separate USB and power connections; power is supplied from the mains by way of an AC adapter.
Kinect for Windows is a modified version of the Xbox 360 unit which was first released on February 1, 2011, alongside the SDK for commercial use. 50 centimetres (20 in), in the new "Near Mode".The hardware included better components to eliminate noise along the USB and other cabling paths, and improvements in the depth-sensing camera system for detection of objects at close range, as close as
The SDK included Windows 7 compatible PC drivers for Kinect device. It provided Kinect capabilities to developers to build applications with C++, C#, or Visual Basic by using Microsoft Visual Studio 2010 and included the following features:
In March 2012, Craig Eisler, the general manager of Kinect for Windows, said that almost 350 companies are working with Microsoft on custom Kinect applications for Microsoft Windows.
In March 2012, Microsoft announced that next version of Kinect for Windows SDK would be available in May 2012. Kinect for Windows 1.5 was released on May 21, 2012. It adds new features, support for many new languages and debut in 19 more countries.
Kinect for Windows SDK for the first-generation sensor was updated a few more times, with version 1.6 released October 8, 2012,version 1.7 released March 18, 2013, and version 1.8 released September 17, 2013.
An upgraded iteration of Kinect was released on November 22, 2013 for Xbox One. It uses a wide-angle time-of-flight camera, and processes 2 gigabits of data per second to read its environment. The new Kinect has greater accuracy with three times the fidelity over its predecessor and can track without visible light by using an active IR sensor. It has a 60% wider field of vision that can detect a user up to 3 feet from the sensor, compared to six feet for the original Kinect, and can track up to 6 skeletons at once. It can also detect a player's heart rate, facial expression, the position and orientation of 25 individual joints (including thumbs), the weight put on each limb, speed of player movements, and track gestures performed with a standard controller. The color camera captures 1080p video that can be displayed in the same resolution as the viewing screen, allowing for a broad range of scenarios. In addition to improving video communications and video analytics applications, this provides a stable input on which to build interactive applications. Kinect's microphone is used to provide voice commands for actions such as navigation, starting games, and waking the console from sleep mode.The recommended player's height is at least 40 inches, which roughly corresponds to children of 4 and a half years old and up.
All Xbox One consoles were initially shipped with Kinect included.In June 2014, bundles without Kinect were made available, along with an updated Xbox One SDK allowing game developers to explicitly disable Kinect skeletal tracking, freeing up system resources that were previously reserved for Kinect even if it was disabled or unplugged. As interest in Kinect waned in 2014, later revisions of the Xbox One hardware, including the Xbox One S and Xbox One X, dropped the dedicated Kinect port, requiring users to purchase a USB 3.0 and AC adapter to use the Kinect for Xbox One.
A standalone Kinect for Xbox One, bundled with a digital copy of Dance Central Spotlight , was released on October 7, 2014.
Considered a market failure compared to the Kinect for Xbox 360, the Kinect for Xbox One product was discontinued by October 25, 2017. Production of the adapter cord also ended by January 2018.
Released on 15 July 2014, Kinect 2 for Windows is based on the Kinect for Xbox One and considered a replacement of the original Kinect for Windows. It was also repackaged as "Kinect for Windows v2". It is nearly identical besides the removal of Xbox branding, and included a USB 3.0/AC adapter. It released alongside version 2.0 of the Windows SDK for the platform. The MSRP was US$199. Microsoft considers the Kinect 2 for Windows equivalent in performance to the Xbox One version.
In April 2015 having difficulty in keeping up manufacturing demand for the Kinect for Xbox One this edition was discontinued. Microsoft directed commercial users to use the Xbox One version with a USB adapter instead.
On May 7, 2018, Microsoft announced a new iteration of Kinect technology designed primarily for enterprise software and artificial intelligence usage. It is designed around the Microsoft Azure cloud platform, and is meant to "leverage the richness of Azure AI to dramatically improve insights and operations".It has a smaller form factor than the Xbox iterations of Kinect, and features a 12-megapixel camera, a time-of-flight depth sensor also used on the HoloLens 2, and seven microphones. A development kit was announced in February 2019.
Requiring at least 190 MB of available storage space,Kinect system software allows users to operate Xbox 360 Dashboard console user interface through voice commands and hand gestures. Techniques such as voice recognition and facial recognition are employed to automatically identify users. Among the applications for Kinect is Video Kinect, which enables voice chat or video chat with other Xbox 360 users or users of Windows Live Messenger. The application can use Kinect's tracking functionality and Kinect sensor's motorized pivot to keep users in frame even as they move around. Other applications with Kinect support include ESPN, Zune Marketplace, Netflix, Hulu Plus and Last.fm. Microsoft later confirmed that all forthcoming applications would be required to have Kinect functionality for certification.
The Xbox One originally shipped in bundles with the Kinect; the original Xbox One user interface software had similar support for Kinect features as the Xbox 360 software, such as voice commands, user identification via skeletal or vocal recognition, and gesture-driven commands, though these features could be fully disabled due to privacy concerns.However, this had left the more traditional navigation using a controller haphazard. In May 2014, when Microsoft announced it would be releasing Xbox One systems without a Kinect, the company also announced plans to alter the Xbox One system software to remove Kinect features. Kinect support in the software was fully removed by November 2015.
Xbox 360 games that require Kinect are packaged in special purple cases (as opposed to the green cases used by all other Xbox 360 games), and contain a prominent "Requires Kinect Sensor" logo on their front cover. Games that include features utilizing Kinect, but do not require it for standard gameplay, contain a "Better with Kinect Sensor" branding on their front covers.
Kinect launched on November 4, 2010 with 17 titles.Third-party publishers of available and announced Kinect games include, among others, Ubisoft, Electronic Arts, LucasArts, THQ, Activision, Konami, Sega, Capcom, Namco Bandai and MTV Games. Along with retail games, there are also select Xbox Live Arcade titles which require the peripheral.
At E3 2011, Microsoft announced Kinect Fun Labs: a collection of various gadgets and minigames that are accessible from Xbox 360 Dashboard. These gadgets includes Build A Buddy, Air Band, Kinect Googly Eyes, Kinect Me, Bobblehead, Kinect Sparkler, Junk Fuand Avatar Kinect.
Numerous developers are researching possible applications of Kinect that go beyond the system's intended purpose of playing games, further enabled by the release of the Kinect SDK by Microsoft.
Alexandre Alahi from EPFL presented a video surveillance system that combines multiple Kinect devices to track groups of people even in complete darkness.Companies So touch and Evoluce have developed presentation software for Kinect that can be controlled by hand gestures; among its features is a multi-touch zoom mode. In December 2010, the free public beta of HTPC software KinEmote was launched; it allows navigation of Boxee and XBMC menus using a Kinect sensor. Soroush Falahati wrote an application that can be used to create stereoscopic 3D images with a Kinect sensor.
In human motion tracking, Kinect might suffer from occlusion which is when some human body joints are occluded and cannot be tracked accurately by Kinect's skeletal model. Hz (compared to ~30 Hz for Kinect), the improvement of skeletal position was more evident during fast and dynamic movements.Therefore, fusing its data with other sensors can provide a more robust tracking of the skeletal model. For instance, in a study, an Unscented Kalman filter (UKF) was used to fuse Kinect 3D position data of shoulder, elbow, and wrist joints to those obtained from two inertial measurement units (IMUs) placed on the upper and lower arm of a person. The results showed an improvement of up to 50% in the accuracy of the position tracking of the joints. In addition to solving the occlusion problem, as the sampling frequency of the IMUs was 100
Kinect also shows compelling potential for use in medicine. Researchers at the University of Minnesota have used Kinect to measure a range of disorder symptoms in children, creating new ways of objective evaluation to detect such conditions as autism, attention-deficit disorder and obsessive-compulsive disorder.Several groups have reported using Kinect for intraoperative, review of medical imaging, allowing the surgeon to access the information without contamination. This technique is already in use at Sunnybrook Health Sciences Centre in Toronto, where doctors use it to guide imaging during cancer surgery. At least one company, GestSure Technologies, is pursuing the commercialization of such a system.
NASA's Jet Propulsion Laboratory (JPL) signed up for the Kinect for Windows Developer program in November 2013 to use the new Kinect to manipulate a robotic arm in combination with an Oculus Rift virtual reality headset, creating "the most immersive interface" the unit had built to date.
|The Washington Post|
Upon its release, the Kinect garnered generally positive opinions from reviewers and critics. IGN gave the device 7.5 out of 10, saying that "Kinect can be a tremendous amount of fun for casual players, and the creative, controller-free concept is undeniably appealing", though adding that for "$149.99, a motion-tracking camera add-on for Xbox 360 is a tough sell, especially considering that the entry level variation of Xbox 360 itself is only $199.99".Game Informer rated Kinect 8 out of 10, praising the technology but noting that the experience takes a while to get used to and that the spatial requirement may pose a barrier. Computer and Video Games called the device a technological gem and applauded the gesture and voice controls, while criticizing the launch lineup and Kinect Hub.
CNET's review pointed out how Kinect keeps players active with its full-body motion sensing but criticized the learning curve, the additional power supply needed for older Xbox 360 consoles and the space requirements.Engadget, too, listed the large space requirements as a negative, along with Kinect's launch lineup and the slowness of the hand gesture UI. The review praised the system's powerful technology and the potential of its yoga and dance games. Kotaku considered the device revolutionary upon first use but noted that games were sometimes unable to recognize gestures or had slow responses, concluding that Kinect is "not must-own yet, more like must-eventually own." TechRadar praised the voice control and saw a great deal of potential in the device whose lag and space requirements were identified as issues. Gizmodo also noted Kinect's potential and expressed curiosity in how more mainstream titles would utilize the technology. Ars Technica's review expressed concern that the core feature of Kinect, its lack of a controller, would hamper development of games beyond those that have either stationary players or control the player's movement automatically.
The mainstream press also reviewed Kinect. USA Today compared it to the futuristic control scheme seen in Minority Report , stating that "playing games feels great" and giving the device 3.5 out of 4 stars.David Pogue from The New York Times predicted players will feel a "crazy, magical, omigosh rush the first time you try the Kinect." Despite calling the motion tracking less precise than Wii's implementation, Pogue concluded that "Kinect’s astonishing technology creates a completely new activity that’s social, age-spanning and even athletic." The Globe and Mail titled Kinect as setting a "new standard for motion control." The slight input lag between making a physical movement and Kinect registering it was not considered a major issue with most games, and the review called Kinect "a good and innovative product," rating it 3.5 out of 4 stars.
Although featuring improved performance over the original Kinect, its successor has been subject to mixed responses. In its Xbox One review, Engadget praised Xbox One's Kinect functionality, such as face recognition login and improved motion tracking, but that whilst "magical", "every false positive or unrecognized [voice] command had us reaching for the controller."The Kinect's inability to understand some accents in English was criticized. Writing for Time , Matt Peckham described the device as being "chunky" in appearance, but that the facial recognition login feature was "creepy but equally sci-fi-future cool", and that the new voice recognition system was a "powerful, addictive way to navigate the console, and save for a few exceptions that seem to be smoothing out with use". However, its accuracy was found to be affected by background noise, and Peckham further noted that launching games using voice recognition required that the full title of the game be given rather than an abbreviated name that the console "ought to semantically understand", such as Forza Motorsport 5 rather than "Forza 5".
While announcing Kinect's discontinuation in an interview with Fast Co. Design on October 25, 2017, Microsoft stated that 35 million units had been sold since its release.24 million units of Kinect had been shipped by February 2013. Having sold 8 million units in its first 60 days on the market, Kinect claimed the Guinness World Record of being the "fastest selling consumer electronics device". According to Wedbush analyst Michael Pachter, Kinect bundles accounted for about half of all Xbox 360 console sales in December 2010 and for more than two-thirds in February 2011. More than 750,000 Kinect units were sold during the week of Black Friday 2011.
Kinect competes with several motion controllers on other home consoles, such as Wii Remote, Wii Remote Plus and Wii Balance Board for the Wii and Wii U, PlayStation Move and PlayStation Eye for the PlayStation 3, and PlayStation Camera for the PlayStation 4.
Microsoft DirectX is a collection of application programming interfaces (APIs) for handling tasks related to multimedia, especially game programming and video, on Microsoft platforms. Originally, the names of these APIs all began with "Direct", such as Direct3D, DirectDraw, DirectMusic, DirectPlay, DirectSound, and so forth. The name DirectX was coined as a shorthand term for all of these APIs and soon became the name of the collection. When Microsoft later set out to develop a gaming console, the X was used as the basis of the name Xbox to indicate that the console was based on DirectX technology. The X initial has been carried forward in the naming of APIs designed for the Xbox such as XInput and the Cross-platform Audio Creation Tool (XACT), while the DirectX pattern has been continued for Windows APIs such as Direct2D and DirectWrite.
The Xbox network, formerly Xbox Live, is an online multiplayer gaming and digital media delivery service created and operated by Microsoft. It was first made available to the Xbox system on November 15, 2002. An updated version of the service became available for the Xbox 360 console at the system's launch in November 2005, and a further enhanced version was released in 2013 with the Xbox One. This same version is also used with Xbox Series X and Series S.
The Xbox 360 launch marked the release of the first high-profile seventh generation video game console. It was Microsoft's second foray in console development succeeding their 2001 launch of the original Xbox.
The Xbox 360 video game console is subject to a number of technical problems and failures that can render it unusable. However, many of the issues can be identified by a series of glowing red lights flashing on the face of the console; the three flashing red lights being the most infamous. There are also other issues that arise with the console, such as discs becoming scratched in the drive and "bricking" of consoles due to dashboard updates. Since its release on November 22, 2005, many articles have appeared in the media portraying the Xbox 360's failure rates, with the latest estimate by warranty provider SquareTrade to be 23.7% in 2009, and currently the highest estimate being 54.2% by a Game Informer survey.
The Xbox 360 is a home video game console developed by Microsoft. As the successor to the original Xbox, it is the second console in the Xbox series. It competed with Sony's PlayStation 3 and Nintendo's Wii as part of the seventh generation of video game consoles. It was officially unveiled on MTV on May 12, 2005, with detailed launch and game information announced later that month at the 2005 Electronic Entertainment Expo.
The seventh generation of home video game consoles began on November 22, 2005, with the release of Microsoft's Xbox 360 home console. This was followed by the release of Sony Computer Entertainment's PlayStation 3 on November 17, 2006 and Nintendo's Wii on November 19, 2006, the following year. Each new console introduced new technologies. The Xbox 360 offered games rendered natively at high-definition video (HD) resolutions, the PlayStation 3 offered HD movie playback via a built-in 3D Blu-ray Disc player, and the Wii focused on integrating controllers with movement sensors as well as joysticks. Some Wii controllers could be moved about to control in-game actions, which enabled players to simulate real-world actions through movement during gameplay. By this generation, video game consoles had become an important part of the global IT infrastructure; it is estimated that video game consoles represented 25% of the world's general-purpose computational power in 2007.
The Xbox 360 controller is the primary game controller for Microsoft's Xbox 360 home video game console that was introduced at E3 2005. The Xbox 360 controller comes in both wired and wireless versions. The Xbox controller is not compatible with the Xbox 360. The wired and wireless versions are also compatible with Microsoft PC operating systems, such as Windows XP, Windows Vista, Windows 7, Windows 8, and Windows 10.
In video games and entertainment systems, a motion controller is a type of game controller that uses accelerometers or other sensors to track motion and provide input.
The Xbox is a home video game console and the first installment in the Xbox series of video game consoles manufactured by Microsoft. It was released as Microsoft's first foray into the gaming console market on November 15, 2001, in North America, followed by Australia, Europe and Japan in 2002. It is classified as a sixth-generation console, competing with Sony's PlayStation 2 and Nintendo's GameCube. It was also the first major console produced by an American company since the release of the Atari Jaguar in 1993.
Xbox Avatars are avatars and characters that represent users of the Xbox Live service on the Xbox 360, Xbox One, and Xbox Series X and Series S video game consoles, Windows 10, and Windows 10 Mobile. Avatars originally debuted on the Xbox 360 as part of the "New Xbox Experience" system update released on November 19, 2008, updated on Xbox One with "New Xbox One Experience" Xbox One System Software on November 12, 2015, and reimagined with the release of the next generation character for Xbox One on October 11, 2018.
BigPark was a Canadian video game developer owned by Microsoft Studios.
PrimeSense was an Israeli 3D sensing company based in Tel Aviv. PrimeSense had offices in Israel, North America, Japan, Singapore, Korea, China and Taiwan. PrimeSense was bought by Apple Inc. for $360 million on November 24, 2013.
OpenNI or Open Natural Interaction is an industry-led non-profit organization and open source software project focused on certifying and improving interoperability of natural user interfaces and organic user interfaces for Natural Interaction (NI) devices, applications that use those devices and middleware that facilitates access and use of such devices.
The eighth generation of video game consoles began in 2012, and consists of four home video game consoles: the Wii U released in 2012, the PlayStation 4 family in 2013, the Xbox One family in 2013, and the Nintendo Switch in 2017.
Xbox is a video gaming brand created and owned by Microsoft. The brand consists of five video game consoles, as well as applications (games), streaming services, an online service by the name of Xbox network, and the development arm by the name of Xbox Game Studios. The brand was first introduced in the United States in November 2001, with the launch of the original Xbox console.
The Xbox One is a line of home video game consoles developed by Microsoft. Announced in May 2013, it is the successor to Xbox 360 and the third base console in the Xbox series of video game consoles. It was first released in North America, parts of Europe, Australia, and South America in November 2013 and in Japan, China, and other European countries in September 2014. It is the first Xbox game console to be released in China, specifically in the Shanghai Free-Trade Zone. Microsoft marketed the device as an "all-in-one entertainment system", hence the name "Xbox One". An eighth-generation console, it mainly competed against Sony's PlayStation 4 and Nintendo's Wii U and later the Switch.
The Xbox system software is the operating system developed exclusively for the Xbox consoles. Across the four generations of Xbox consoles, the software has been based on a version of Microsoft Windows and incorporating DirectX features optimized for the gaming console. The user interface, the Xbox Dashboard, provides access to games, media players, and applications, and integrates with Xbox Live for online functionality.
The Xbox Series X and the Xbox Series S are home video game consoles developed by Microsoft. They were both released on November 10, 2020 as the fourth generation of the Xbox console family, succeeding the Xbox One family. Along with Sony's PlayStation 5, also released in November 2020, the Xbox Series X and Series S are part of the ninth generation of video game consoles.
It will hit the shelves on 10 November, five days after the US.
The companies are doing a lot of great work with the cameras. But the magic is in the software. It’s a combination of partners and our own software.
We actually built a software platform that was what we wanted to have as content creators. And then [asked], 'OK, are there hardware solutions out there that plug in?' But the amount of software and the quality of software are really the innovation in Natal.
Essentially we do a 3D body scan of you. We graph 48 joints in your body and then those 48 joints are tracked in real-time, at 30 frames per second. So several for your head, shoulders, elbows, hands, feet...
The companies are doing a lot of great work with the cameras. But the magic is in the software. It’s a combination of partners and our own software.
November 2010 release, 5m units global ship, 14 games, and super-low sub-£50 price [...] Microsoft is planning to manufacture 5m units for day one release, with a mix of console and camera plus solus SKUs expected. [...] The device should cost under £100,00 when sold solo. The somewhat confirmed price is stated to be at 150$ (USD)when sold alone this is 50$ higher than the original 99$ projected price. [...] Another even says the camera could even retail for just £30.
And you know, I think they said they were going to ship Natal with every Xbox when they actually launch the thing, so everybody will have one.
Since the NES, every five years or so a distinct new wave of technology has washed across the industry, bringing with it new power and functions to a market galvanised by the promise of faster, better, more.
Euro prices are 149.99 Euro for the camera + Kinect Adventures, 299.99 Euro for the 4GB console bundle.Alt URL
This information is based on specifications supplied by manufacturers and should be used for guidance only.
Array of 4 microphones supporting single speaker voice recognition
|Wikimedia Commons has media related to Kinect .|