ARKit

Last updated

ARKit is an application programming interface (API) for iOS, iPadOS and VisionOS which lets third-party developers build augmented reality apps, taking advantage of a device's camera, CPU, GPU, and motion sensors. [1] [2] The ARKit functionality is only available to users of devices with Apple A9 and later processors. According to Apple, this is because "these processors deliver breakthrough performance that enables fast scene understanding and lets you build detailed and compelling virtual content on top of real-world scenes." [3] The SDK was first released for IOS 11 in 2017, and was preinstalled in the initial release of IPadOS 13 in 2019 and visionOS 1.0 in 2024. In visionOS, however, ARKit plays a lesser role in augmented reality than in iOS and iPadOS. ARKit in visionOS is focused on acquiring data about the person’s surroundings, while SwiftUI and RealityKit control the placement of any 2D or 3D content in the person’s surroundings, and SwiftUI or UIKit are used to build windows with an app's content. [4] [5]

Related Research Articles

<span class="mw-page-title-main">Safari (web browser)</span> Web browser by Apple

Safari is a web browser developed by Apple. It is built into several of Apple's operating systems, including macOS, iOS, iPadOS and visionOS, and uses Apple's open-source browser engine WebKit, which was derived from KHTML.

<span class="mw-page-title-main">Xcode</span> IDE including tools for developing software for Apple platforms

Xcode is Apple's integrated development environment (IDE) for macOS, used to develop software for macOS, iOS, iPadOS, watchOS, tvOS, and visionOS. It was initially released in late 2003; the latest stable release is version 16, released on September 16, 2024, and is available free of charge via the Mac App Store and the Apple Developer website. Registered developers can also download preview releases and prior versions of the suite through the Apple Developer website. Xcode includes command-line tools that enable UNIX-style development via the Terminal app in macOS. They can also be downloaded and installed without the GUI.

<span class="mw-page-title-main">AppKit</span> Graphical user interface toolkit

AppKit is a graphical user interface toolkit. It initially served as the UI framework for NeXTSTEP. Along with Foundation and Display PostScript, it became one of the core parts of the OpenStep specification of APIs. Later, AppKit and Foundation became part of Cocoa, the Objective-C API framework of macOS. GNUstep, GNU's implementation of the OpenStep/Cocoa API, also contains an implementation of the AppKit API.

<span class="mw-page-title-main">Virtual keyboard</span> Software component

A virtual keyboard is a software component that allows the input of characters without the need for physical keys. Interaction with a virtual keyboard happens mostly via a touchscreen interface, but can also take place in a different form when in virtual or augmented reality.

iOS Mobile operating system by Apple

iOS is a mobile operating system developed by Apple exclusively for its devices. It was unveiled in January 2007 for the first-generation iPhone, which launched in June 2007. Major versions of iOS are released annually; the current stable version, iOS 18, was released to the public on September 16, 2024.

UIKit is an application development environment and graphical user interface toolkit from Apple Inc. used to build apps for the iOS, iPadOS, and tvOS operating systems.

iOS SDK Software development kit for iOS

The iOS SDK, formerly the iPhone SDK, is a software development kit (SDK) developed by Apple Inc. The kit allows for the development of mobile apps on Apple's iOS and iPadOS operating systems.

<span class="mw-page-title-main">Tango (platform)</span> Mobile computer vision platform for Android developed by Google

Tango was an augmented reality computing platform, developed and authored by the Advanced Technology and Projects (ATAP), a skunkworks division of Google. It used computer vision to enable mobile devices, such as smartphones and tablets, to detect their position relative to the world around them without using GPS or other external signals. This allowed application developers to create user experiences that include indoor navigation, 3D mapping, physical space measurement, environmental recognition, augmented reality, and windows into a virtual world.

<span class="mw-page-title-main">Google Cardboard</span> Discontinued virtual reality platform

Google Cardboard is a discontinued virtual reality (VR) platform developed by Google. Named for its fold-out cardboard viewer into which a smartphone is inserted, the platform was intended as a low-cost system to encourage interest and development in VR applications. Users can either build their own viewer from simple, low-cost components using specifications published by Google, or purchase a pre-manufactured one. To use the platform, users run Cardboard-compatible mobile apps on their phone, place it into the back of the viewer, and view content through the lenses.

WebXR Device API is a Web application programming interface (API) that describes support for accessing augmented reality and virtual reality devices, such as the HTC Vive, Oculus Rift, Meta Quest, Google Cardboard, HoloLens, Apple Vision Pro, Magic Leap or Open Source Virtual Reality (OSVR), in a web browser. The WebXR Device API and related APIs are standards defined by W3C groups, the Immersive Web Community Group and Immersive Web Working Group. While the Community Group works on the proposals in the incubation period, the Working Group defines the final web specifications to be implemented by the browsers.

<span class="mw-page-title-main">Kubity</span> Cloud-based 3D communication tool

Kubity is a cloud-based 3D communication tool that works on desktop computers, the web, smartphones, tablets, augmented reality gear, and virtual reality glasses. Kubity is powered by several proprietary 3D processing engines including "Paragone" and "Etna" that prepare the 3D file for transfer over mobile devices.

iOS 11 2017 mobile operating system

iOS 11 is the eleventh major release of the iOS mobile operating system developed by Apple, being the successor to iOS 10. It was announced at the company's Worldwide Developers Conference on June 5, 2017, and was released on September 19, 2017. It was succeeded by iOS 12 on September 17, 2018.

ARCore, also known as Google Play Services for AR, is a software development kit developed by Google that allows for augmented reality (AR) applications to be built. ARCore has been integrated into a multitude of devices.

<span class="mw-page-title-main">Swift Playgrounds</span> Development environment for Swift

Swift Playgrounds is an educational tool and development environment for the Swift programming language developed by Apple Inc., initially announced at the WWDC 2016 conference. It was introduced as an iPad application alongside iOS 10, with a macOS version introduced in February 2020. It is available for free via Apple's App Store for iPadOS and Mac App Store for macOS.

iOS 13 2019 mobile operating system

iOS 13 is the thirteenth major release of the iOS mobile operating system developed by Apple for the iPhone, iPod Touch and HomePod. The successor to iOS 12, it was announced at the company's Worldwide Developers Conference (WWDC) on June 3, 2019, and released on September 19, 2019. It was succeeded by iOS 14, released on September 16, 2020.

iOS 14 2020 mobile operating system

iOS 14 is the fourteenth major release of the developed by Apple for the iPhone and iPod touch lines. Announced at the company's Worldwide Developers Conference on June 22, 2020 as the successor to iOS 13, it was released to the public on September 16, 2020. It was succeeded by iOS 15 on September 20, 2021.

iOS 15 2021 mobile operating system

iOS 15 is the fifteenth major release of the iOS mobile operating system developed by Apple for its iPhone and iPod Touch lines of products. It was announced at the company's Worldwide Developers Conference on June 7, 2021, as the successor to iOS 14 and released to the public on September 20, 2021.

SwiftUI is a declarative framework for building user interfaces for iOS, iPadOS, watchOS, tvOS, visionOS and macOS, developed by Apple Inc. for the Swift programming language.

<span class="mw-page-title-main">Apple Vision Pro</span> Mixed reality headset by Apple Inc.

The Apple Vision Pro is a mixed-reality headset developed by Apple. It was announced on June 5, 2023, at Apple's Worldwide Developers Conference. Pre-orders began on January 19, 2024 and became available for purchase on February 2, 2024, in the United States. It also became available for purchase in China, Hong Kong, Japan and Singapore on June 28, 2024, in Australia, Canada, France, Germany and the UK on July 12, 2024, and in South Korea and the UAE on November 15, 2024. Apple Vision Pro is Apple's first new major product category since the release of the Apple Watch in 2015.

visionOS Mixed reality operating system made by Apple

visionOS is a mixed reality operating system derived primarily from iPadOS core frameworks, and MR-specific frameworks for foveated rendering and real-time interaction. It was developed by Apple Inc. exclusively for its Apple Vision Pro mixed reality headset. It was unveiled on June 5, 2023, at Apple's WWDC23 event alongside the reveal of the Apple Vision Pro. The software released on February 2, 2024, shipping with the Apple Vision Pro.

References

  1. Potuck, Michael (June 5, 2017). "Apple announces ARKit for iOS 11". 9to5Mac. Archived from the original on June 5, 2017. Retrieved June 5, 2017.
  2. Robertson, Adi (June 5, 2017). "Apple is launching an iOS 'ARKit' for augmented reality apps". The Verge . Vox Media. Archived from the original on June 5, 2017. Retrieved June 5, 2017.
  3. Smith, Chris (June 8, 2017). "One of the hottest iOS 11 features will force you to buy a new iPhone". BGR . Penske Media Corporation. Archived from the original on June 8, 2017. Retrieved June 10, 2017.
  4. "Bringing your ARKit app to visionOS". Apple Developer Documentation. Retrieved 2024-02-22.
  5. "ARKit in visionOS". Apple Developer Documentation. Retrieved 2024-02-22.

See also