Integrated Visual Augmentation System

Last updated

Integrated Visual Augmentation System
IVAS 1.2 Prototype.jpg
Soldier dons IVAS 1.2 Prototype during user assessment.
TypeAugmented reality headset
Place of originUnited States
Production history
DesignerMicrosoft
Designed2018
Specifications
Weight3.4 lb (1.5 kg)

The Integrated Visual Augmentation System (IVAS) is an augmented reality headset being developed by Microsoft for the United States Army. It is intended to improve situational awareness by overlaying sensor imagery and other information on the soldier's field of view. Originally developed for infantry, it is also being adapted for use by mounted soldiers and aircrew.

Contents

Its development begun in 2018 and is currently undergoing testing. Initially intended to be fielded in 2021, ergonomic and reliability issues have pushed this date back to 2025. Soldiers and offices of the Department of Defense and Congress have repeatedly criticized the device and its development process for issues with technology and project management.

Design

IVAS is an augmented reality system based on the Microsoft Hololens 2 headset. [1] It intends to provide soldiers with "improved situational awareness, target engagement, and informed decision-making". [2]

The system consists of a display, a computer known as a "puck", a networked data radio, and three conformal batteries. The display can augment the soldier's vision with imagery from thermal imaging and low-light imaging sensors. The radio allows data from the soldiers' individual IVAS headsets to be passed among members of the company. [3]

Mounted soldier wearing IVAS Mounted IVAS.jpg
Mounted soldier wearing IVAS

The latest version of IVAS, version 1.2, weighs 3.4 pounds (1.5 kg), although developers are working to reduce this to the target weight of 2.9 pounds (1.3 kg). The computer is attached to the back of the helmet to distribute weight and move the center of mass. The display has a field of view of 60 degrees, using a flat display that can be flipped upwards. [4]

Software installed in the computer allows IVAS to perform many functions. Version 1.2 introduced an embedded training tool known as the "Squad Immersive Virtual Trainer", a piece of software that can project holographic and mixed reality imagery via the IVAS headset to help train soldiers in combat. [5] Navigation applications can display maps of terrain and interiors of buildings, and show the positions of friendly and enemy forces. New kinds of software can also be developed and uploaded to expand IVAS's capabilities; examples include designating fields of fire for machine gunners, generating medivac reports, and conducting field surgery assisted by augmented reality. [6]

In March 2021, the U.S. Army announced that IVAS was being tested with mounted soldiers, such as on Bradley Fighting Vehicle and Stryker teams. [7] By June 2021, the US Army announced it was expanding IVAS tests to include aircrews for helicopters and drones. [8] In comparison to the US$400,000 purely-slaved and aircraft-dependent F-35 helmet that must be custom-built for each pilot, [9] IVAS attached to any helmet, was estimated to cost US$29,205 per unit, and could optionally work independently of the aircraft when the crew dismounts. [10]

Development

Although it is unknown when the idea for IVAS was first conceived, the Army Acquisition Executive first approved IVAS's development effort on 25 September 2018, and an Other Transaction Agreement for the development of IVAS was issued to Microsoft in November 2018. Initial testing began in March 2019. [11]

2020

Early models of IVAS were very similar to civilian HoloLens 2 headsets, which were not resistant to inclement weather and could not even function in rain. [1] [12] IVAS entered its third iteration in October 2020, the first version to be ruggedized for military use. The system was tested in late October 2020 at Fort Pickett by some Marines and members of the 82nd Airborne Division. The test was to get soldier feedback and refine the system for eventual battlefield use. [1]

2021

IVAS Capability Set 4 during testing at Fort Greely, Alaska IVAS CS4 Testing Alaska 1.jpg
IVAS Capability Set 4 during testing at Fort Greely, Alaska

After nearly 2 years in development, the final IVAS Capability Set 4 system was scheduled to be fielded in 2021. Over 40,000 sets were planned to be issued. [1]

On 26 March 2021, Microsoft was awarded a "fixed price production agreement" by the United States Army to manufacture and supply IVAS headsets. [13] Microsoft would produce headsets for at least 120,000 members of the Army Close Combat Force. [14] The contract was worth up to US$21.88 billion. [15]

In September 2021, an "Adversarial Electronic Warfare and Cybersecurity Test" of IVAS was conducted. [16] In mid-October, the system's "Operational Test and fielding" was moved to 2022. David Patterson, PEO Soldier Director of Public Affairs, said: "The Army intends to continue developing and fielding this revolutionary, first-of-its-kind technology in FY22." [16]

2022

Initial operational testing of IVAS began in May 2022 and concluded in late June, although at the time it was believed that the fielding of IVAS in September was unlikely. [17] [18] Nevertheless, in September 2022, the US Army began accepting 5,000 units of the IVAS and was planning to field them, even though these units were still early versions of the IVAS and would require future software upgrades. [19] However, in November 2022, the US Army announced a "course correction" to the program, due to soldiers reporting physical ailments after using IVAS in the field. [20] The main symptoms were headaches, eye strain, and nausea. A report by the Department of Defense Office of Inspector General raised concerns that these problems may lead to soldiers not using the system even if it was issued to them. [21] The US Army and Microsoft decided to renegotiate their contract and redesign the form factor while still planning to field 10,000 initial units. [20]

2023

Version 1.2 with flat display and computer on the rear of the helmet IVAS 1.2 Side View.jpg
Version 1.2 with flat display and computer on the rear of the helmet

In March 2023, following the "course correction" to the program with Microsoft, the US Army exhibited IVAS version 1.2. Although the new variant was still based on the civilian HoloLens headset, there had been some changes from previous versions, such as the separation of the controller from the computer, with the controller now able to be attached to any part of the upper torso and the computer being mounted on the rear of the helmet. [22] The previous helmet-like display was replaced by a flat display with better clarity, better line-of-sight, and also a hinge that allows the display to be flipped up. As a result, the field of view was reduced from 70 degrees to 60 degrees. The thermal camera was also being improved to increase clarity while reducing power consumption. [4]

Problems still existed in the new version. The newly added "Squad Immersive Virtual Trainer" encountered an issue known as "dynamic occlusion limitations", which was the inability of augmented reality devices to simulate how the user's view of virtual objects was blocked by real objects. Experts in the field had yet to find a general solution to the issue, although the US Army stated that it would work to fix it. [23]

Testing of IVAS 1.2 began in August after 20 prototypes were delivered to the US Army. [5] Microsoft was awarded another US$95 million for the next stage of the program, which included the delivery of 280 pre-production and "production representative" IVAS 1.2 systems for testing in Fiscal Year 2024, aiming to field an improved version of IVAS in Fiscal Year 2025. [24]

Reception

In February 2019, not long after the contract for developing IVAS was signed between Microsoft and the US Army, more than 50 employees signed a petition calling for Microsoft to cancel the contract, saying that they "didn't want to become war profiteers". [25] The petition stated that Microsoft had misled its engineers on how their products would be used; rather than being beneficial for civilians, they believed that the Hololens is now being used to "help people kill". [26] Satya Nadella, CEO of Microsoft, defended the contract, saying that the company is "not going to withhold technology from institutions that we have elected in democracies to protect the freedoms we enjoy". [27]

The various issues in the system's development have often caused concern in the United States Congress. In December 2020, Congress decided to cut US$230 million of the US$1.1 billion request for the Army's IVAS goggles. It also wanted the US Army to submit a report detailing the acquisition strategy for the IVAS program by 15 August 2021. [28] In March 2022, considering the numerous technical issues the program encountered, Congress again withheld approximately US$400 million in funding for the program until IVAS completed its initial operation testing and the Program Executive Office Soldier briefed the appropriations committees on the program's progress. [29] [30]

Soldiers involved in testing IVAS also expressed their dissatisfaction with the system. One soldier commented that "the devices would have gotten us killed", referring to the glow emitted by the headset that can be seen from hundreds of meters away. They were also concerned about the limited peripheral vision and the bulkiness of the system that restricted their movement. [31] In an "unusually stinging" report, the Department of Defense Inspector General stated that the US Army wasn't effectively measuring user satisfaction with IVAS and that it was "wasting money" if soldiers don't like the system. The Army contested the report's conclusions, describing them as "fundamentally flawed and inflammatory", although the Army partially agreed with recommendations to better measure acceptance of the system. [32]

The Director, Operational Test and Evaluation report published in January 2023 criticized the performance of IVAS 1.0 in tests. It stated that most soldiers testing the IVAS headset reported a wide range of physical impairments and numerous technical deficiencies that negatively impacted their performance. It found that soldiers accomplished their missions better with their current equipment than with IVAS. Furthermore, there were no improvements or even declines in the system's reliability throughout its development. [3]

Despite the numerous issues and criticisms, the US Army remained optimistic about the program. Doug Bush, the Assistant Secretary of the Army for Acquisition, Logistics, and Technology, believed that the program is "on a good track", saying: "I think early returns are positive, which is a good thing to see." [24] A news release from the US Army stated that despite the previous delays, IVAS will still be fielded "several years ahead of standard acquisition programs". [33]

Related Research Articles

<span class="mw-page-title-main">Wearable computer</span> Small computing device worn on the body

A wearable computer, also known as a body-borne computer, is a computing device worn on the body. The definition of 'wearable computer' may be narrow or broad, extending to smartphones or even ordinary wristwatches.

<span class="mw-page-title-main">Augmented reality</span> View of the real world with computer-generated supplementary features

Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. As such, it is one of the key technologies in the reality-virtuality continuum.

<span class="mw-page-title-main">Mixed reality</span> Merging of real and virtual worlds to produce new environments

Mixed reality (MR) is a term used to describe the merging of a real-world environment and a computer-generated one. Physical and virtual objects may co-exist in mixed reality environments and interact in real time.

<span class="mw-page-title-main">Head-mounted display</span> Type of display device

A head-mounted display (HMD) is a display device, worn on the head or as part of a helmet, that has a small display optic in front of one or each eye. HMDs have many uses including gaming, aviation, engineering, and medicine.

<span class="mw-page-title-main">Advanced Combat Helmet</span> Worn by army soldiers

The Advanced Combat Helmet (ACH) is the United States Army's current combat helmet, used since the early 2000s. It was developed by the United States Army Soldier Systems Center, the U.S. Army Special Operations Command, and the U.S. Army Research Laboratory to be the next generation of protective combat helmets for use by the American ground forces. The ACH is derived from the Modular Integrated Communications Helmet.

F-INSAS is India's programme to equip its infantry with state-of-the-art equipment, F-INSAS standing for Future Infantry Soldier As a System. However the Indian Army has decided to drop the F-INSAS program in favour of two separate projects. The new program will have two components: one to arm the future infantry soldier with the best available assault rifle, carbines and personal equipment, such as helmets and bulletproof vests. The second component is the Battlefield Management Systems (BMS).

<span class="mw-page-title-main">AN/PSQ-20</span> US military night vision goggle

The AN/PSQ-20 Enhanced Night Vision Goggle (ENVG) is a third-generation passive monocular night vision device developed for the United States Armed Forces by ITT Exelis. It fuses image-intensifying and thermal-imaging technologies, enabling vision in conditions with very little light. The two methods can be used simultaneously or individually. The ENVG was selected by the US Army's Program Executive Office Soldier as a supporting device for the Future Force Warrior program in 2004, and is intended to replace the older AN/PVS-7 and AN/PVS-14 systems. Although more expensive and heavier than previous models, US Special Forces began using the goggles in 2008 and the US Army's 10th Mountain Division began fielding the AN/PSQ-20 in 2009. Improvements to the goggles have been attempted to make them lighter, as well as enabling the transmission of digital images to and from the battlefield.

<span class="mw-page-title-main">Enhanced Combat Helmet (United States)</span> Combat helmet

The Enhanced Combat Helmet (ECH) is a combat helmet designed in conjunction of a joint program of the United States Marine Corps and United States Army to replace the current combat helmets in use by the U.S. Army, Marines, Navy, and Air Force. Although similar in shape of the Advanced Combat Helmet and its predecessor the Modular Integrated Communications Helmet, the ECH is instead constructed using thermoplastics instead of the ballistic fibers used on previous-generation combat helmets.

Vuzix is an American multinational technology company headquartered in Rochester, New York and founded by Paul Travers in 1997. Vuzix is a supplier of wearable virtual reality and augmented reality display technology. Vuzix manufactures and sells computer display devices and software. Vuzix head-mounted displays are marketed towards mobile and immersive augmented reality applications, such as 3D gaming, manufacturing training, and military tactical equipment. On January 5, 2015, Intel acquired 30% of Vuzix's stock for $24.8 million.

<span class="mw-page-title-main">Ratnik (program)</span> Russian military equipment system

Ratnik is a Russian future infantry combat system. Some components, including the communication systems and night vision technologies, have extremely limited military distribution. It is designed to improve the connectivity and combat effectiveness of combat personnel in the Russian Armed Forces. Improvements include modernised body armour, a helmet with a special eye monitor, communication systems, and special headphones. It includes 10 subsystems and 59 individual items.

<span class="mw-page-title-main">Magic Leap</span> American augmented reality hardware manufacturer

Magic Leap, Inc. is an American technology company that released a head-mounted augmented reality display, called Magic Leap One, which superimposes 3D computer-generated imagery over real world objects. It is attempting to construct a light-field chip using silicon photonics.

<span class="mw-page-title-main">Windows Mixed Reality</span> Mixed reality platform

Windows Mixed Reality (WMR) is a discontinued platform by Microsoft which provides augmented reality and virtual reality experiences with compatible head-mounted displays.

<span class="mw-page-title-main">Microsoft HoloLens</span> Mixed reality smartglasses

Microsoft HoloLens is an augmented reality (AR)/mixed reality (MR) headset developed and manufactured by Microsoft. HoloLens runs the Windows Mixed Reality platform under the Windows 10 operating system. Some of the positional tracking technology used in HoloLens can trace its lineage to the Microsoft Kinect, an accessory for Microsoft's Xbox 360 and Xbox One game consoles that was introduced in 2010.

<span class="mw-page-title-main">United States Army Futures Command</span> U.S. Army Command that runs modernization projects

The United States Army Futures Command (AFC) is a United States Army command that runs modernization projects. It is headquartered in Austin, Texas.

<span class="mw-page-title-main">Future Assault Shell Technology helmet</span> Combat helmet

The Ops-Core Future Assault Shell Technology (FAST) Helmet, also known as the FAST helmet, is an American combat helmet used by special operations forces and law enforcement organizations in various countries, as well as the current standard protective headgear of the Norwegian Armed Forces.

<span class="mw-page-title-main">HoloLens 2</span> 2019 mixed reality smartglasses

Microsoft HoloLens 2 is a mixed reality head-mounted display developed and manufactured by Microsoft. It is the successor to the original Microsoft HoloLens. The first variant of the device, The HoloLens 2 enterprise edition, debuted on February 24, 2019. This was followed by a developer edition that was announced on May 2, 2019. The HoloLens 2 was subsequently released in limited numbers on November 7, 2019.

<span class="mw-page-title-main">Long-Range Hypersonic Weapon</span> U.S. Navy prototype missile

The Long-Range Hypersonic Weapon (LRHW) is a medium-range surface-to-surface hypersonic weapon being developed for use by the United States Army. The United States Navy intends to procure a ship/submarine-launched variant of the missile as part of the service's Intermediate-Range Conventional Prompt Strike (IRCPS) program. The weapon consists of a large rocket booster that carries the unpowered Common-Hypersonic Glide Body (C-HGB) in a nose cone. Once the booster reaches significant altitude and speed, it releases the C-HGB, which glides at hypersonic speeds as it descends towards its target. Dynetics will build the hypersonic glide vehicle while Lockheed Martin will build the booster as well as assemble the missile and launch equipment.

<span class="mw-page-title-main">Mobile Protected Firepower</span> Program of United States Army

The Mobile Protected Firepower (MPF) is a U.S. Army program to procure a combat vehicle that is capable of providing mobile, protected, direct fire offensive capability. The projected vehicle has been designated the M10 Booker, and will according to description essentially serve the role of an assault gun. The program is part of the Next Generation Combat Vehicle program.

The US Army's Integrated Tactical Network (ITN) "is not a new or separate network but rather a concept"—PEO C3T. Avoid overspecifying the requirements for Integrated Tactical Network Information Systems Initial Capabilities Document. Instead, meet operational needs, such as interoperability with other networks, and release ITN capabilities incrementally.

References

  1. 1 2 3 4 Keller, Jared (3 November 2020). "The Army's next-generation headset is almost ready for prime time". Task & Purpose. Archived from the original on 17 November 2020. Retrieved 18 November 2020.
  2. ↑ "IVAS Production Contract Award". U.S. Army Program Executive Office Soldier. 31 March 2021. Archived from the original on 1 April 2021. Retrieved 5 May 2021.
  3. 1 2 "FY 2022 DOT&E Annual Report submitted to Congress" (PDF). Director Operational Test and Evaluation. January 2023. p. 110. Archived (PDF) from the original on 15 May 2023. Retrieved 15 May 2023.
  4. 1 2 Roque, Ashley (10 May 2023). "Last stand for IVAS? New challenges, delays as Army debates future of augmented reality goggles". Breaking Defense. Archived from the original on 4 November 2023. Retrieved 15 June 2023.
  5. 1 2 Shear, Frederick (1 August 2023). "Army accepts prototypes of the most advanced version of IVAS". U.S. Army. Archived from the original on 25 October 2023. Retrieved 25 October 2023.
  6. ↑ South, Todd (29 December 2023). "Army's mixed reality device nears fielding with final testing in 2024". Army Times. Retrieved 16 January 2024.
  7. ↑ Mizokami, Kyle (8 March 2021). "The Army's New Goggles Let Soldiers See Right Through Walls". Popular Mechanics. Archived from the original on 10 September 2021. Retrieved 10 September 2021.
  8. ↑ Cureton, Demond (30 June 2021). "US Army Integrates IVAS Headsets For Aircraft Crews". XRToday.com. Archived from the original on 10 September 2021. Retrieved 10 September 2021.
  9. ↑ Swarts, Phillip (26 October 2015). "F-35 helmet costs $400,000 — 4 times that of predecessor". Air Force Times. Archived from the original on 14 January 2024. Retrieved 10 September 2021.
  10. ↑ Roque, Ashley (1 June 2021). "Pentagon budget 2022: US Army plans to spend USD29,205 per IVAS unit". Janes.com. Archived from the original on 10 September 2021. Retrieved 10 September 2021.
  11. ↑ "Director, Operational Test and Evaluation FY 2019 Annual Report" (PDF). Director, Operational Test and Evaluation. 20 December 2019. p. 85. Archived (PDF) from the original on 1 December 2023. Retrieved 15 June 2023.
  12. ↑ Freedberg Jr., Sydney J. (5 October 2020). "From 'Frankengoggle' To Battle-Ready: Army IVAS". Breaking Defense. Archived from the original on 5 October 2023. Retrieved 5 December 2023.
  13. ↑ Patterson, David (31 March 2021). "IVAS Production Contract Award". U.S. Army Program Executive Office Soldier. Archived from the original on 31 March 2021. Retrieved 1 April 2021.
  14. ↑ O'Brien, Matt (31 March 2021). "Microsoft wins $22 billion deal making headsets for US Army". The Seattle Times. The Associated Press. Archived from the original on 22 April 2021. Retrieved 1 April 2021.
  15. ↑ Freedberg Jr, Sydney J. (31 March 2021). "IVAS: Microsoft Award By Army Worth Up To $21.9B". Breaking Defense. Archived from the original on 31 March 2021. Retrieved 1 April 2021.
  16. 1 2 Foley, Mary Jo (15 October 2021). "U.S. Army postpones its $22 billion Microsoft augmented-reality headset deliverables to late 2022". ZDNET. Archived from the original on 31 October 2021. Retrieved 31 October 2021.
  17. ↑ Roque, Ashley (5 May 2022). "US Army greenlights IVAS initial operational test and evaluation for mid-May". Janes Information Services . Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  18. ↑ Roque, Ashley (27 July 2022). "US Army weighing IVAS production decision, unlikely to meet September fielding date". Janes Information Services . Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  19. ↑ Roque, Ashley (9 September 2022). "US Army receiving early IVAS units, will roll out software upgrades". Janes Information Services . Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  20. 1 2 Roque, Ashley (9 November 2022). "Course correction: US Army renegotiating USD22 billion IVAS contract, eyeing path for different form factor". Janes Information Services . Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  21. ↑ Atherton, Kelsey D. (22 October 2022). "Why the Army hates AR goggles". Popular Science. Archived from the original on 15 May 2023. Retrieved 15 May 2023.
  22. ↑ South, Todd (5 April 2023). "Changes ahead in the next version of the Army's 'mixed reality' goggle". Army Times . Archived from the original on 9 April 2023. Retrieved 28 April 2023.
  23. ↑ Roque, Ashley (3 August 2023). "Army's pricey IVAS goggles meet a training obstacle: Doors". Breaking Defense. Archived from the original on 10 November 2023. Retrieved 25 October 2023.
  24. 1 2 Harper, Jon (21 September 2023). "Army awards Microsoft $95M for additional IVAS 1.2 headsets, virtual trainers". DefenseScoop. Archived from the original on 25 October 2023. Retrieved 25 October 2023.
  25. ↑ Wong, Julia Carrie (22 February 2019). "'We won't be war profiteers': Microsoft workers protest $480m army contract". The Guardian . Archived from the original on 23 February 2019. Retrieved 14 February 2024.
  26. ↑ Lee, Dave (22 February 2019). "Microsoft staff: Do not use HoloLens for war". BBC News . Archived from the original on 14 February 2024. Retrieved 14 February 2024.
  27. ↑ Riley, Charles; Burke, Samuel (25 February 2019). "Microsoft CEO defends US military contract that some employees say crosses a line | CNN Business". CNN Business . Archived from the original on 14 February 2024. Retrieved 14 February 2024.
  28. ↑ South, Todd (9 December 2020). "Congress cuts some funding for Army's cutting edge, do-it-all goggle". Army Times . Archived from the original on 4 April 2021. Retrieved 11 March 2021.
  29. ↑ Roque, Ashley (11 March 2022). "Lawmakers call for IVAS procurement cuts, US Army weighing implications". Janes Information Services . Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  30. ↑ Eversden, Andrew (11 March 2022). "Congress puts $349M for IVAS 'on hold,' but Army sees major boost to counter drones". Breaking Defense. Archived from the original on 23 November 2022. Retrieved 23 November 2022.
  31. ↑ Smith, Adam (13 October 2022). "Microsoft's smart goggles 'would have got us killed', army reportedly says". The Independent . Archived from the original on 5 December 2023. Retrieved 5 December 2023.
  32. ↑ Ferran, Lee (22 April 2022). "Army could be 'wasting' $22B if soldiers don't like IVAS: Inspector General". Breaking Defense. Archived from the original on 22 April 2022. Retrieved 5 December 2023.
  33. ↑ Shear, Frederick (14 March 2023). "IVAS' Campaign of Learning Ensures Development, Production and Fielding Remain on Track". U.S. Army. Archived from the original on 7 December 2023. Retrieved 6 December 2023.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.