VisionOS

Last updated
visionOS
VisionOS logo.svg
VisionOS Home Screenshot.jpg
Home View in visionOS
Developer Apple Inc.
OS family Unix-like, based on Darwin (BSD), iOS, iPadOS
Working stateCurrent
Initial releaseFebruary 2, 2024
Latest release 1.1.2 [1] (April 9, 2024;39 days ago (2024-04-09)) [±]
Latest preview 1.2 beta 5 [2] (May 7, 2024;11 days ago (2024-05-07)) [±]
Marketing target Mixed reality headsets, Apple Vision Pro
Platforms ARMv8-A
Kernel type Hybrid (XNU)
License Proprietary software with open-source components
Official website developer.apple.com/visionos/
Support status
Supported

visionOS is a mixed reality operating system derived primarily from iPadOS core frameworks (including UIKit, SwiftUI, ARKit and RealityKit), and MR-specific frameworks for foveated rendering and real-time interaction. [3] [4] It was developed by Apple Inc. exclusively for its Apple Vision Pro mixed reality headset. It was unveiled on June 5, 2023, at Apple's WWDC23 event alongside the reveal of the Apple Vision Pro. The software released on February 2, 2024, shipping with the Apple Vision Pro.

Contents

History

Apple has reportedly been working on and conceptualizing visionOS throughout the 2010s and early 2020s. [5] Internally codenamed Borealis, [6] it was officially revealed to the public at Apple's WWDC23 event alongside the Vision Pro. Apple stated the two would release in early 2024. [7]

During the event, The Walt Disney Company announced plans to develop spatial computing apps for visionOS; [8] Disney+ will offer features such as streaming of selected titles in stereoscopic 3D, and 3D environments based on the El Capitan Theatre and locations from Disney-owned franchises. [9]

The operating system was initially planned to be released as xrOS before the name was changed reportedly days before the release, after the WWDC23 keynote and developer sessions had already been filmed. [10] On January 8, 2024, Apple announced that the Vision Pro with visionOS would be available in the US on February 2, 2024, with pre-orders beginning on January 19. [11]

Developer tools

From June 5–12 2023, Apple released 35 free virtual sessions covering visionOS development as part of WWDC23. On June 21, 2023, Apple released Xcode 15 Beta 2, which was the first Xcode beta to include a software development kit for visionOS and Reality Composer Pro, a tool to create 3D content for visionOS. [12] Xcode 15 launched without these features, which were eventually added in Xcode 15.2 on January 8, 2024, [13] [14] the same day that Apple started accepting submissions for the visionOS App Store. [14]

During the WWDC23 keynote, Apple revealed it was working with Unity Technologies to support the Unity engine on visionOS, [15] [16] and that Unity would be releasing development tools for 3D games on Vision Pro, which launched in beta on July 19, 2023. [17]

Features

visionOS uses a 3D user interface navigated via finger tracking, eye tracking, and speech recognition. For example, the user can click an element by looking at it and pinching two fingers together, move the element by moving their pinched fingers, and scroll by flicking their wrist. Apps are displayed in floating windows that can be arranged in 3D space. visionOS supports a virtual keyboard for text input, the Siri virtual assistant, and external Bluetooth peripherals including Magic Keyboard, Magic Trackpad, and gamepads. [18] [19]

During visionOS setup, a user can create a digital persona by taking off the headset and scanning their face with it. Users can use this persona during FaceTime calls, and see other participants' personas if they are using visionOS. [20] From visionOS 1.1, the ability to see personas in 3D moving around and interacting with apps was added, dubbed 'Spatial Personas.' [21]

The Photos app supports presenting spatial video, depth-mapped 3D video recorded on Vision Pro or iPhone 15 Pro, by adapting the video's depth to the user's head movements. [22]

At launch, visionOS shipped with 13 pre-installed 3D 360° background animated environments with accompanying ambient sounds, including optional day and night scenes of Yosemite National Park, Haleakalā National Park, Joshua Tree National Park, Mount Hood National Forest, Lake Vrangla near Drammen, Norway, and the Moon. [23]

The Apple TV app offers 3D films; the company announced that over 150 films would be available in 3D at launch, at no additional charge to users that rent or purchase the films on iTunes Store. [24]

WebXR, an API for mixed reality experiences through web browsers, is supported in Safari. [25]

visionOS users can also access their Mac with a resizable 4K virtual display that appears after looking at the computer. [26] [27] [28] [29]

Supported apps

visionOS is backwards compatible with existing iOS and iPadOS apps, which are rendered in windows within the user environment and are automatically compatible with visionOS' input system. [11] [30] The developers of iOS and iPadOS apps have the option to opt out of visionOS compatibility. Apple claims that over 1 million apps from iOS and iPadOS are available on visionOS. [11] In addition to iPadOS and iOS apps, over 600 native visionOS apps have been developed specifically for the platform, according to Apple. [31] Apple also claims 100 Apple Arcade games will be compatible with visionOS at launch, the majority of which can make use of visionOS' gamepad compatibility. [19] [32] [33]

Many popular productivity apps have released fully-optimized visionOS versions, including Microsoft 365 apps (Teams, Word, Excel, PowerPoint, Outlook, etc.), Adobe Lightroom, Slack, Zoom, and Webex. [34] Many streaming apps are also optimized for the platform, such as Max, Disney+, Prime Video, Paramount+, and ESPN. [35]

Some of the most popular entertainment apps for iOS and iPadOS including Netflix, Spotify, and YouTube have not made their iOS or iPadOS apps available to run on visionOS, recommending users instead use their respective websites on Safari. [36] YouTube has announced that a visionOS app is "on [the] roadmap." [37]

Apple-made apps that come preinstalled on visionOS include Mail, Messages, Mindfulness, Apple Music, Apple TV, Notes, Photos, and Freeform.

Reception

Pre-launch

Before the February 2024 launch, Apple gave controlled demos of the Apple Vision Pro to many technology journalists, some of whom have praised its multitasking capabilities and input methods, while lamenting that the software is only available on expensive hardware. [38] Other reviewers have focused on the software's spatial videos feature and high resolution, while questioning what the software's main use case will be. [39] Speculation from journalists noted ongoing disputes from the developers of popular apps regarding the commissions charged by Apple for in-app purchases through apps distributed on the App Store as a potential cause for many not developing visionOS-native versions. [40]

Release

Many reviews praised visionOS even while criticizing the hardware. Some reviews even mentioned features more advanced than the Apple Vision Pro hardware, such as eye and hand tracking. [41] Almost all key reviews praised the window mechanics and experience. [42] [41]

Release history

Previous releaseCurrent releaseCurrent beta release
Release history
VersionBuildRelease dateFeatures
1.0 [43] 21N307Initial releaseInitial release on Apple Vision Pro.
  • 3D user interface
  • Window placement and management
  • Interact with eye tracking and hand gestures
1.0.1 [44] 21N311January 23, 2024Minor bug fixes
1.0.2 [45] 21N323January 31, 2024Patches WebKit flaw that could be exploited, leading to arbitrary code execution [46]
1.0.3 [47] 21N333February 12, 2024Bug fixes and adds an option to reset device if passcode is forgotten
1.1 [48] 21O211March 7, 2024
  • Allows users to get closer to objects in 3D space before it fades out
  • Enterprise device management support
  • Appearance updates to Personas, prompting users to recapture theirs after installing the update [49] [50]
  • Spacial Persona support in FaceTime added
1.1.1 [51] 21O224March 21, 2024Bug fixes and security updates [52]
1.1.2 [53] 21O231April 9, 2024Bug fixes [54]
1.2 beta 5 [55] 21O5587aMay 7, 2024Bug fixes [56]

See also

Related Research Articles

<span class="mw-page-title-main">Xcode</span> IDE including tools for developing software for Apple platforms

Xcode is Apple's integrated development environment (IDE) for macOS, used to develop software for macOS, iOS, iPadOS, watchOS, tvOS, and visionOS. It was initially released in late 2003; the latest stable release is version 15, released on September 18, 2023, and is available free of charge via the Mac App Store and the Apple Developer website. Registered developers can also download preview releases and prior versions of the suite through the Apple Developer website. Xcode includes command-line tools that enable UNIX-style development via the Terminal app in macOS. They can also be downloaded and installed without the GUI.

iOS is a mobile operating system developed by Apple Inc. and was first released as iPhone OS in June 2007, coinciding with the launch of the first generation iPhone. iPhone OS was renamed iOS following the release of the iPad, starting with iOS 4. With iOS 13, Apple began offering a separate operating system, iPadOS, for the iPad. iOS is also the foundation of the newer audioOS and tvOS, and shares some of its code with macOS. New iOS versions are released every year alongside new iPhone models. From its launch in 2007 until 2010, this occurred in June or July, since then, new major versions are released in September or October. Since the launch of the iPhone in June 2007, there have been 17 major releases of iOS. The current major version of iOS is iOS 17, released on September 18, 2023.

Submissions for mobile apps for iOS are subject to approval by Apple's App Review team, as outlined in the SDK agreement, for basic reliability testing and other analysis, before being published on the App Store. Applications may still be distributed ad hoc if they are rejected, by the author manually submitting a request to Apple to license the application to individual iPhones, although Apple may withdraw the ability for authors to do this at a later date.

<span class="mw-page-title-main">Messages (Apple)</span> Instant messaging software applications

Messages is a text messaging software application developed by Apple Inc. for its macOS, iOS, iPadOS, watchOS, and visionOS operating systems.

tvOS Operating system for the Apple TV

tvOS is an operating system developed by Apple Inc. for the Apple TV, a digital media player. In the first-generation Apple TV, Apple TV Software was based on Mac OS X. Starting with the second generation, the software is based on the iOS operating system and has many similar frameworks, technologies, and concepts.

The Apple TV app is a line of media player software programs developed by Apple Inc. for viewing television shows and films delivered by Apple to consumer electronic devices. It can stream content from the iTunes Store, the Apple TV Channels a la carte video on demand service, and the Apple TV+ original content subscription service. On iPhone, iPad, iPod Touch, Vision Pro, and Apple TV devices it can also index and access content from linked apps of other video on demand services.

iOS 12 2018 mobile operating system

iOS 12 is the twelfth major release of the iOS mobile operating system developed by Apple Inc. Aesthetically similar to its predecessor, iOS 11, it focuses more on performance than on new features, quality improvements and security updates. Announced at the company's Worldwide Developers Conference on June 4, 2018, iOS 12 was released to the public on September 17, 2018. It was succeeded for the iPhone and iPod Touch by iOS 13 on September 19, 2019, and for the iPad by iPadOS 13 on September 24, 2019. Security updates for iOS 12 continued for four years after the releases of iOS 13 and iPadOS 13 for devices unable to run the newer versions. The last update, 12.5.7, was released on January 23, 2023.

<span class="mw-page-title-main">Swift Playgrounds</span> Development environment for Swift

Swift Playgrounds is an educational tool and development environment for the Swift programming language developed by Apple Inc., initially announced at the WWDC 2016 conference. It was introduced as an iPad application alongside iOS 10, with a macOS version introduced in February 2020. It is available for free via Apple's App Store for iPadOS and Mac App Store for macOS.

iOS 13 2019 mobile operating system

iOS 13 is the thirteenth major release of the iOS mobile operating system developed by Apple Inc. for the iPhone, iPod Touch and HomePod. The successor to iOS 12, it was announced at the company's Worldwide Developers Conference (WWDC) on June 3, 2019, and released on September 19, 2019. It was succeeded by iOS 14, released on September 16, 2020.

iPad Pro (4th generation) Tablet computer made by Apple (2020–2021)

The fourth-generation iPad Pro is a line of tablet computers designed, developed and marketed by Apple Inc. Two models, with a 12.9 inch or 11 inch screen, were both announced on March 18, 2020, and released on March 25.

iOS 14 2020 mobile operating system

iOS 14 is the fourteenth major release of the iOS mobile operating system developed by Apple Inc. for the iPhone and iPod touch lines. Announced at the company's Worldwide Developers Conference on June 22, 2020 as the successor to iOS 13, it was released to the public on September 16, 2020. It was succeeded by iOS 15 on September 20, 2021.

<span class="mw-page-title-main">IPadOS 14</span> 2020 tablet operating system by Apple Inc.

iPadOS 14 is the second major release of the iPadOS operating system developed by Apple for their iPad line of tablet computers. It was announced on June 22, 2020 at the company's Worldwide Developers Conference (WWDC) as the successor to iPadOS 13, making it the second version of the iPadOS fork from iOS. It was released to the public on September 16, 2020. It was succeeded by iPadOS 15 on September 20, 2021.

iOS 15 2021 mobile operating system

iOS 15 is the fifteenth major release of the iOS mobile operating system developed by Apple for its iPhone and iPod Touch lines of products. It was announced at the company's Worldwide Developers Conference on June 7, 2021, as the successor to iOS 14 and released to the public on September 20, 2021.

macOS Monterey 18th major version of the macOS operating system

macOS Monterey is the eighteenth major release of macOS, Apple's desktop operating system for Macintosh computers. The successor to macOS Big Sur, it was announced at WWDC 2021 on June 7, 2021, and released on October 25, 2021. macOS Monterey was succeeded by macOS Ventura, which was released on October 24, 2022.

macOS Ventura 19th major version of the macOS operating system

macOS Ventura is the nineteenth major release of macOS, Apple's operating system for Macintosh computers. The successor to macOS Monterey, it was announced at WWDC 2022 on June 6, 2022, and launched on October 24, 2022. macOS Ventura was succeeded by macOS Sonoma, which was released on September 26, 2023.

iPadOS 16 2022 tablet operating system by Apple Inc.

iPadOS 16 is the fourth major release of the iPadOS operating system developed by Apple for its iPad line of tablet computers. The successor to iPadOS 15, it was announced at the company's Worldwide Developers Conference (WWDC) on June 6, 2022, along with iOS 16, macOS Ventura, watchOS 9, and tvOS 16. It received numerous new features, improving multitasking and many other aspects of the operating system, most notably on iPads with Apple's M1 SoC and later.

iOS 17 2023 mobile operating system

iOS 17 is the seventeenth and current major release of Apple's iOS operating system for the iPhone. It is the direct successor to iOS 16, which was released one year earlier. It was announced on June 5, 2023, at Apple's annual Worldwide Developers Conference alongside watchOS 10, iPadOS 17, and macOS Sonoma. It was made publicly available on September 18, 2023, as a free software update for supported iOS devices. iOS 17 has received security and bug-fix updates multiple times a month, and feature updates every few months. Beta builds are sent weekly or biweekly to members of the Apple Developer Program and public beta testers. As with every release since iOS 4, these updates are free to users.

SwiftUI is a declarative user interface framework for building user interfaces for iOS, iPadOS, watchOS, tvOS, visionOS and macOS, developed by Apple Inc. for the Swift programming language.

macOS Sonoma 20th major version of the macOS operating system

macOS Sonoma is the twentieth and latest major release of macOS, Apple's operating system for Macintosh computers. The successor to macOS Ventura, it was announced at WWDC 2023 on June 5, 2023, and released on September 26, 2023. It is named after the wine region located in California's Sonoma County.

<span class="mw-page-title-main">Apple Vision Pro</span> Mixed reality headset by Apple Inc.

Apple Vision Pro is a mixed-reality headset developed by Apple. It was announced on June 5, 2023, at Apple's Worldwide Developers Conference, and pre-orders began on January 19, 2024. It became available for purchase on February 2, 2024, in the United States. A worldwide launch has yet to be scheduled. Apple Vision Pro is Apple's first new major product category since the release of the Apple Watch in 2015.

References

  1. Clover, Juli (2024-04-09). "Apple Releases visionOS 1.1.2 With Bug Fixes and Revised visionOS 1.2 Beta". MacRumors . Retrieved 2024-04-09.
  2. "Apple Seeds visionOS 1.2 Beta 5 to Developers". MacRumors. May 7, 2024. Retrieved May 7, 2024.
  3. Wiggers, Kyle (June 5, 2023). "visionOS is Apple's latest operating system". TechCrunch. Retrieved June 7, 2023.
  4. "WWDC 2023 Biggest Reveals: Vision Pro Headset, iOS 17, MacBook Air and More". CNET . Retrieved June 7, 2023.
  5. Mickle, Tripp (2024-01-19). "Apple Takes a Humble Approach to Launching Its Newest Device". The New York Times. ISSN   0362-4331 . Retrieved 2024-01-20.
  6. "Apple Will Talk Up Its Mixed-Reality Headset in 2023 But Not Much Else". Bloomberg.com. 2023-01-08. Retrieved 2024-01-27.
  7. Robertson, Adi (2023-06-05). "Apple Vision Pro is Apple's new $3,499 AR headset". The Verge. Retrieved 2024-01-20.
  8. Weatherbed, Jess (June 5, 2023). "Disney Plus is coming to Apple's Vision Pro headset". The Verge . Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  9. Goldsmith, Jill (2024-01-16). "Apple Vision Pro Unveils Disney+ Features, More Streaming Apps & 3D Movies As Bob Iger Calls Mixed Reality Headset "A Revolutionary Platform"". Deadline. Retrieved 2024-01-16.
  10. "Apple visionOS was called 'xrOS' before last-minute change, WWDC23 keynote and developer sessions confirm it". The Apple Post. June 9, 2023. Retrieved October 13, 2023.
  11. 1 2 3 "Apple Vision Pro available in the U.S. on February 2". Apple Newsroom. Retrieved 2024-01-20.
  12. "visionOS SDK now available - Latest News - Apple Developer". developer.apple.com. Retrieved 2024-01-20.
  13. "Apple releases Xcode 15.2". AppleInsider. 2024-01-08. Retrieved 2024-01-20.
  14. 1 2 "Apple Releases New Versions of TestFlight and Xcode With Vision Pro Support, Starts Accepting visionOS Apps". MacRumors. 2024-01-08. Retrieved 2024-01-20.
  15. Novet, Jordan (June 5, 2023). "Unity stock jumps 17% on Apple Vision Pro partnership". CNBC. Retrieved June 7, 2023.
  16. Warren, Tom (June 5, 2023). "Microsoft Word, Excel, and Teams are all coming to Apple's new Vision Pro headset". The Verge . Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  17. "What you need to know about Unity PolySpatial and visionOS". Unity Blog. Retrieved 2024-01-20.
  18. Goode, Lauren (June 5, 2023). "Apple's Mixed-Reality Headset, Vision Pro, Is Here". Wired . Retrieved June 5, 2023.
  19. 1 2 Peters, Jay (June 5, 2023). "Apple announces visionOS, the operating system for its Vision Pro headset". The Verge . Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  20. Axon, Samuel (June 6, 2023). "Hands-on with Apple Vision Pro: This is not a VR headset". Ars Technica. Retrieved June 7, 2023.
  21. Song, Victoria (2024-04-02). "Now Apple Vision Pro Personas can float freely across different apps". The Verge. Retrieved 2024-04-04.
  22. Peters, Jay (2023-09-12). "The iPhone 15 Pro and Pro Max will let you film spatial video you can watch on the Vision Pro". The Verge. Retrieved 2024-01-20.
  23. "Apple's first visionOS beta outlines 13 VR 'Environments,' app limitations". Macworld. Retrieved 2024-02-05.
  24. Spangler, Todd (2024-01-16). "Apple Vision Pro Will Feature 150-Plus 3D Movies at Launch, Immersive Originals, Disney+, Amazon Prime Video and More". Variety. Retrieved 2024-01-26.
  25. Lang, Ben (June 20, 2023). "Apple Vision Pro Will Support WebXR for Fully Immersive Experiences in the Browser". Road to VR. Retrieved June 24, 2023.
  26. "Your Mac and Apple Vision Pro: What You Can Do (and What You Can't)". MacRumors. 2024-01-11. Retrieved 2024-01-22.
  27. "Mac Virtual Display is limited in Vision Pro – but there's a workaround". 9To5Mac. 2023-06-07. Retrieved 2024-01-22.
  28. "How Apple Vision Pro Works With the Mac". MacRumors. 2023-06-06. Retrieved 2024-01-22.
  29. ">With Mac Virtual Display, users can even bring the powerful capabilities of the... | Hacker News". news.ycombinator.com. Retrieved 2024-01-22.
  30. Roth, Emma (June 10, 2023). "The Vision Pro's biggest advantage isn't Apple's hardware". The Verge. Retrieved August 27, 2023.
  31. "Apple announces more than 600 new apps built for Apple Vision Pro". Apple Newsroom. Retrieved 2024-02-03.
  32. Peters, Jay (June 5, 2023). "Apple announces visionOS, the operating system for its Vision Pro headset". The Verge. Retrieved June 7, 2023.
  33. Parrish, Ash (June 5, 2023). "Apple's new VR headset will feature over 100 Apple Arcade games at launch". The Verge . Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  34. updated, James Bentley last (2024-01-08). "Every Apple Vision Pro app we've heard about so far". iMore. Retrieved 2024-01-20.
  35. "Apple Announces Streaming Services and Sports Apps Available on Vision Pro at Launch". MacRumors. 2024-01-16. Retrieved 2024-01-20.
  36. Gurman, Mark (2024-01-18). "Bloomberg - YouTube and Spotify Won't Launch Apple Vision Pro Apps, Joining Netflix". www.bloomberg.com. Retrieved 2024-01-20.
  37. Patel, Nilay (2024-02-05). "YouTube says a Vision Pro app is 'on the roadmap'". The Verge. Retrieved 2024-02-06.
  38. "I've Worn Apple's Vision Pro Headset 4 Times. Here's What You Need to Know Before Buying". CNET. Retrieved 2024-01-20.
  39. Song, Victoria (2024-01-16). "Apple Vision Pro hands-on, again, for the first time". The Verge. Retrieved 2024-01-20.
  40. Pierce, David (2024-01-20). "The Vision Pro's first killer app is the web, whether Apple likes it or not". The Verge. Retrieved 2024-01-24.
  41. 1 2 Patel, Nilay (2024-01-30). "Apple Vision Pro review: magic, until it's not". The Verge. Retrieved 2024-02-05.
  42. "Apple Vision Pro Review: A Mind-Blowing Look at an Unfinished Future". CNET. Retrieved 2024-02-05.
  43. "About visionOS 1 Updates". Apple Support. 2024-02-02. Retrieved 2024-02-11.
  44. "Apple Releases visionOS 1.0.1 Ahead of Vision Pro Launch". MacRumors. 2024-01-23. Retrieved 2024-02-11.
  45. Michael, Simon. "Vision Pro isn't out yet but Apple has already patched a serious zero-day flaw". Macworld. Retrieved 2024-02-11.
  46. "About visionOS 1 Updates". Apple Support. 2024-02-02. Retrieved 2024-02-11.
  47. "Apple Releases visionOS 1.0.3 With Reset Option for Forgotten Passcode". MacRumors. 2024-02-12. Retrieved 2024-02-12.
  48. Hall, Zac (2024-03-07). "visionOS 1.1 update for Apple Vision Pro now available with MDM support, improved Persona, more". 9to5Mac. Retrieved 2024-03-07.
  49. "Apple Starts Improving Vision Pro Personas in visionOS 1.1 Beta". MacRumors. 2024-02-06. Retrieved 2024-02-11.
  50. "visionOS 1.1 Beta 3 Release Notes". Apple Developer Documentation. Retrieved 2024-02-25.
  51. "Apple Releases visionOS 1.1.1 With Bug Fixes". MacRumors. 2024-03-21. Retrieved 2024-03-24.
  52. "About the security content of visionOS 1.1.1". Apple Support. 2024-03-25. Retrieved 2024-03-28.
  53. "Apple Releases visionOS 1.1.2 With Bug Fixes and Revised visionOS 1.2 Beta". MacRumors. 2024-04-09. Retrieved 2024-04-09.
  54. "About visionOS 1 Updates". Apple Support. 2024-04-09. Retrieved 2024-04-09.
  55. "Apple Seeds visionOS 1.2 Beta 5 to Developers". MacRumors. May 7, 2024. Retrieved May 7, 2024.
  56. "visionOS 1.2 Beta 5 Release Notes". Apple Developer Documentation. Retrieved May 7, 2024.