Developer | Apple Inc. |
---|---|
OS family | Unix-like, based on Darwin (BSD), iOS, iPadOS |
Working state | Current |
Initial release | February 2, 2024 |
Latest release | 2.0 [1] (September 16, 2024 ) [±] |
Marketing target | Mixed reality headsets, Apple Vision Pro |
Platforms | ARMv8-A |
Kernel type | Hybrid (XNU) |
License | Proprietary software with open-source components |
Official website | developer |
Support status | |
Supported |
visionOS is a mixed reality operating system derived primarily from iPadOS core frameworks (including UIKit, SwiftUI, ARKit and RealityKit), and MR-specific frameworks for foveated rendering and real-time interaction. [2] [3] It was developed by Apple Inc. exclusively for its Apple Vision Pro mixed reality headset. It was unveiled on June 5, 2023, at Apple's WWDC23 event alongside the reveal of the Apple Vision Pro. [4] The software released on February 2, 2024, shipping with the Apple Vision Pro. [5]
Apple has reportedly been working on and conceptualizing visionOS throughout the 2010s and early 2020s. [6] Internally codenamed Borealis, [7] it was officially revealed to the public at Apple's WWDC23 event alongside the Vision Pro. Apple stated the two would release in early 2024. [8] App Store guidelines for the operating system similarly state that developers should refer to visionOS software as "spatial computing experiences" or "vision apps", and avoid the use of terms such as "augmented reality" and "mixed reality". [9] [10]
During the event, The Walt Disney Company announced plans to develop spatial computing apps for visionOS; [11] Disney+ currently offers features such as streaming of selected titles in stereoscopic 3D, and they also offer 3D environments based on the El Capitan Theatre and locations from Disney-owned franchises. [12]
The operating system was initially planned to be released as xrOS before the name was changed reportedly days before the release, after the WWDC23 keynote and developer sessions had already been filmed. [13] On January 8, 2024, Apple announced that the Vision Pro with visionOS would be available in the US on February 2, 2024, with pre-orders beginning on January 19. [14]
From June 5–12, 2023, Apple released 35 free virtual sessions covering visionOS development as part of WWDC23. On June 21, 2023, Apple released Xcode 15 Beta 2, which was the first Xcode beta to include a software development kit for visionOS and Reality Composer Pro, a tool to create 3D content for visionOS. [15] Xcode 15 launched without these features, which were eventually added in Xcode 15.2 on January 8, 2024, [16] [17] the same day that Apple started accepting submissions for the visionOS App Store. [17]
During the WWDC23 keynote, Apple revealed it was working with Unity Technologies to support the Unity engine on visionOS, [18] [19] and that Unity would be releasing development tools for 3D games on Vision Pro, which launched in beta on July 19, 2023. [20]
visionOS uses a 3D user interface navigated via finger tracking, eye tracking, and speech recognition. For example, the user can click an element by looking at it and pinching two fingers together, move the element by moving their pinched fingers, and scroll by flicking their wrist. Apps are displayed in floating windows that can be arranged in 3D space. visionOS supports a virtual keyboard for text input, the Siri virtual assistant, and external Bluetooth peripherals including Magic Keyboard, Magic Trackpad, and gamepads. [21] [22]
During visionOS setup, a user can create a digital persona by taking off the headset and scanning their face with it. Users can use this persona during FaceTime calls, and see other participants' personas if they are using visionOS. [23] From visionOS 1.1, the ability to see personas in 3D moving around and interacting with apps was added, dubbed 'Spatial Personas.' [24]
The Photos app supports presenting spatial video, depth-mapped 3D video recorded on Vision Pro or iPhone 15 Pro, by adapting the video's depth to the user's head movements. [25]
At launch, visionOS shipped with 13 pre-installed 3D 360° background animated environments with accompanying ambient sounds, including optional day and night scenes of Yosemite National Park; Haleakalā National Park; Joshua Tree National Park; Mount Hood National Forest; Lake Vrangla near Drammen, Norway; and the Moon. [26]
The Apple TV app offers 3D films; the company announced that over 150 films would be available in 3D at launch, at no additional charge to users that rent or purchase the films on iTunes Store. [27]
WebXR, an API for mixed reality experiences through web browsers, is supported in Safari. [28]
visionOS users can also access their Mac with a resizable 4K virtual display that appears after looking at the computer; this will be extended to an 8K ultrawide display in late 2024, according to Apple. [29] [30] [31] [32] [33]
visionOS is backwards compatible with existing iOS and iPadOS apps, which are rendered in windows within the user environment and are automatically compatible with visionOS's input system. [14] [34] Although all apps are available on visionOS by default, the developers of iOS and iPadOS apps have the option to opt out of visionOS compatibility. Apple claims that over 1 million apps from iOS and iPadOS are available on visionOS. [14] In addition to iPadOS and iOS apps, over 600 native visionOS apps have been developed specifically for the platform at launch, according to Apple. [35] Apple also claims 100 Apple Arcade games will be compatible with visionOS at launch, the majority of which can make use of visionOS's gamepad compatibility. [22] [36] [37]
Many popular productivity apps have released fully-optimized visionOS versions, including Microsoft 365 apps (Teams, Word, Excel, PowerPoint, Outlook, etc.), Adobe Lightroom, Slack, Zoom, and Webex. [38] Many streaming apps are also optimized for the platform, such as Max, Disney+, Prime Video, Paramount+, and ESPN. [39]
Some of the most popular entertainment apps for iOS and iPadOS including Netflix, Spotify, and YouTube have not made their iOS or iPadOS apps available to run on visionOS, recommending users instead use their respective websites on Safari. [40] YouTube has announced that a visionOS app is "on [the] roadmap." [41]
Apple-made apps that come preinstalled on visionOS include Mail, Messages, Mindfulness, Apple Music, Apple TV, Notes, Photos, and Freeform.
Before the February 2024 launch, Apple gave controlled demos of the Apple Vision Pro to many technology journalists, some of whom have praised its multitasking capabilities and input methods, while lamenting that the software is only available on expensive hardware. [42] Other reviewers have focused on the software's spatial videos feature and high resolution, while questioning what the software's main use case will be. [43] Speculation from journalists noted ongoing disputes from the developers of popular apps regarding the commissions charged by Apple for in-app purchases through apps distributed on the App Store as a potential cause for many not developing visionOS-native versions. [44]
Many reviews praised visionOS even while criticizing the hardware. Some reviews even mentioned features more advanced than the Apple Vision Pro hardware, such as eye and hand tracking. [45] Almost all key reviews praised the window mechanics and experience. [46] [45]
Release | Initial release date |
---|---|
visionOS 1 | February 2, 2024 |
visionOS 2 | September 16, 2024 |
Previous release | Current release | Current beta release |
visionOS 1 is the first major version of visionOS. It was announced in WWDC 2023 on June 5, 2023, [47] and was released on February 2, 2024, pre-installed in the Apple Vision Pro upon its release. [48]
Table of versions: visionOS 1.x | ||||
---|---|---|---|---|
Version | Build | Release date | Features | |
1.0 [49] | 21N307 | Initial Release February 2, 2024 | Initial release of visionOS 1
| |
1.0.1 [50] | 21N311 | January 23, 2024 | Minor bug fixes | |
1.0.2 [51] | 21N323 | January 31, 2024 | Patches WebKit flaw that could be exploited, leading to arbitrary code execution [52] | |
1.0.3 [53] | 21N333 | February 12, 2024 | Bug fixes and adds an option to reset device if passcode is forgotten | |
1.1 [54] | 21O211 | March 7, 2024 | ||
1.1.1 [57] | 21O224 | March 21, 2024 | Bug fixes and security updates [58] | |
1.1.2 [59] | 21O231 | April 9, 2024 | Bug fixes [60] | |
1.2 [61] | 21O589 | June 10, 2024 | Bug fixes [62] | |
1.3 [63] | 21O771 | July 29, 2024 | Bug fixes and security improvements [64] |
visionOS 2 is the second major version of visionOS. It was announced in WWDC 2024 on June 10, 2024 and was released on September 16, 2024. [65] [66] [67]
Table of versions: visionOS 2.x | ||||
---|---|---|---|---|
Version | Build | Release date | Features | |
2.0 [68] | September 16, 2024 |
Xcode is Apple's integrated development environment (IDE) for macOS, used to develop software for macOS, iOS, iPadOS, watchOS, tvOS, and visionOS. It was initially released in late 2003; the latest stable release is version 16, released on September 16, 2024, and is available free of charge via the Mac App Store and the Apple Developer website. Registered developers can also download preview releases and prior versions of the suite through the Apple Developer website. Xcode includes command-line tools that enable UNIX-style development via the Terminal app in macOS. They can also be downloaded and installed without the GUI.
The Worldwide Developers Conference (WWDC) is an information technology conference held annually by Apple Inc. The conference is usually held at Apple Park in California. The event is usually used to showcase new software and technologies in the macOS, iOS, iPadOS, watchOS, tvOS, and visionOS families as well as other Apple software; new hardware products are sometimes announced as well. WWDC is also an event hosted for third-party software developers that work on apps for iPhones, iPads, Macs, and other Apple devices. Attendees can participate in hands-on labs with Apple engineers and attend in-depth sessions covering a wide variety of topics.
Dashcode was a software application created by Apple Inc. that was included with Mac OS X Leopard and facilitates the development of widgets for Dashboard. It was first included on new MacBooks shipping around the time of May 24, 2006, as part of the Xcode developer tools.
iOS is a mobile operating system developed by Apple exclusively for its smartphones. It was unveiled in January 2007 for the first-generation iPhone, launched in June 2007.
The App Store is an app marketplace developed and maintained by Apple, for mobile apps on its iOS and iPadOS operating systems. The store allows users to browse and download approved apps developed within Apple's iOS SDK. Apps can be downloaded on the iPhone, iPod Touch, or iPad, and some can be transferred to the Apple Watch smartwatch or 4th-generation or newer Apple TVs as extensions of iPhone apps.
Siri is the digital assistant that is part of Apple Inc., including iOS, iPadOS, watchOS, macOS, tvOS, audioOS, and visionOS operating systems. It uses voice queries, gesture based control, focus-tracking and a natural-language user interface to answer questions, make recommendations, and perform actions by delegating requests to a set of Internet services. With continued use, it adapts to users' individual language usages, searches, and preferences, returning individualized results.
Submissions for mobile apps for iOS are subject to approval by Apple's App Review team, as outlined in the SDK agreement, for basic reliability testing and other analysis, before being published on the App Store. Applications may still be distributed ad hoc if they are rejected, by the author manually submitting a request to Apple to license the application to individual iPhones, although Apple may withdraw the ability for authors to do this at a later date.
iPadOS is a mobile operating system developed by Apple Inc. for its iPad line of tablet computers. It was given a name distinct from iOS, the operating system used by Apple's iPhones to reflect the diverging features of the two product lines, such as multitasking. It was introduced as iPadOS 13 in 2019, reflecting its status as the successor to iOS 12 for the iPad, at the company's 2019 Worldwide Developers Conference.
tvOS is an operating system developed by Apple Inc. for the Apple TV, a digital media player. In the first-generation Apple TV, Apple TV Software was based on Mac OS X. Starting with the second generation, the software is based on the iOS operating system and has many similar frameworks, technologies, and concepts.
iOS 12 is the twelfth major release of the iOS mobile operating system developed by Apple. Aesthetically similar to its predecessor, iOS 11, it focuses more on performance than on new features, quality improvements and security updates. Announced at the company's Worldwide Developers Conference on June 4, 2018, iOS 12 was released to the public on September 17, 2018. It was succeeded for the iPhone and iPod Touch by iOS 13 on September 19, 2019, and for the iPad by iPadOS 13 on September 24, 2019. Security updates for iOS 12 continued for four years after the releases of iOS 13 and iPadOS 13 for devices unable to run the newer versions. The last update, 12.5.7, was released on January 23, 2023.
Swift Playgrounds is an educational tool and development environment for the Swift programming language developed by Apple Inc., initially announced at the WWDC 2016 conference. It was introduced as an iPad application alongside iOS 10, with a macOS version introduced in February 2020. It is available for free via Apple's App Store for iPadOS and Mac App Store for macOS.
iOS 13 is the thirteenth major release of the iOS mobile operating system developed by Apple for the iPhone, iPod Touch and HomePod. The successor to iOS 12, it was announced at the company's Worldwide Developers Conference (WWDC) on June 3, 2019, and released on September 19, 2019. It was succeeded by iOS 14, released on September 16, 2020.
AirPods Pro are wireless Bluetooth in-ear headphones designed by Apple, initially introduced on October 30, 2019. They are Apple's mid-range wireless headphones, available alongside the base-level AirPods and the highest-end AirPods Max.
The fourth-generation iPad Pro is a line of tablet computers designed, developed and marketed by Apple Inc. Two models, with an 11 inch or 12.9 inch screen, were both announced on March 18, 2020, and released on March 25, 2020.
macOS Monterey is the eighteenth major release of macOS, Apple's desktop operating system for Macintosh computers. The successor to macOS Big Sur, it was announced at WWDC 2021 on June 7, 2021, and released on October 25, 2021. macOS Monterey was succeeded by macOS Ventura, which was released on October 24, 2022.
macOS Ventura is the nineteenth major release of macOS, Apple's operating system for Macintosh computers. The successor to macOS Monterey, it was announced at WWDC 2022 on June 6, 2022, and launched on October 24, 2022. macOS Ventura was succeeded by macOS Sonoma, which was released on September 26, 2023.
iOS 18 is the eighteenth and current major release of Apple's iOS operating system for the iPhone. It was announced on June 10, 2024, at the 2024 Worldwide Developers Conference (WWDC). It was made publicly available on September 16, 2024, as a free software update for supported iOS devices. It is the direct successor to iOS 17 and was announced alongside iPadOS 18, macOS Sequoia, watchOS 11, visionOS 2, and tvOS 18.
SwiftUI is a declarative framework for building user interfaces for iOS, iPadOS, watchOS, tvOS, visionOS and macOS, developed by Apple Inc. for the Swift programming language.
The Apple Vision Pro is a mixed-reality headset developed by Apple. It was announced on June 5, 2023, at Apple's Worldwide Developers Conference, and pre-orders began on January 19, 2024. It became available for purchase on February 2, 2024, in the United States. It also became available for purchase in China, Hong Kong, Japan and Singapore on June 28, 2024 and in Australia, Canada, France, Germany and the UK on July 12, 2024. Apple Vision Pro is Apple's first new major product category since the release of the Apple Watch in 2015.