Apple Intelligence

Last updated

Apple Intelligence
Developer(s) Apple Inc.
Initial releaseJune 10 2024
Operating system iOS 18, iPadOS 18, macOS Sequoia
Platform ARM
Type Artificial intelligence
License Proprietary
Website https://www.apple.com/apple-intelligence/

Apple Intelligence is an artificial intelligence platform developed by Apple Inc. [1] Relying on a combination of on-device and server processing, it was announced on June 10, 2024 at WWDC 2024 as a feature of Apple's iOS 18, iPadOS 18, and macOS Sequoia operating systems, which were announced alongside Apple Intelligence. Apple Intelligence includes an integration with ChatGPT and will be free for all users with supported devices. It is scheduled to enter into a developer beta in the United States in late 2024 and will fully launch in 2025. [2] [3]

Contents

Models

Apple Intelligence consists of an on-device model as well as a cloud model running on servers using Apple silicon. Both models consist of a generic foundation model, as well as multiple adapter models that are more specialized to particular tasks like text summarization and tone adjustment. [4]

According to a human evaluation done by Apple's machine learning division, the on-device foundation model beat or tied equivalent small models by Mistral AI, Microsoft, and Google, while the server foundation models beat the performance of OpenAI's GPT-3, while roughly matching the performance of GPT-4. [5]

Functionality and features

Writing tools

Apple Intelligence features writing tools that are powered by AI, including Rewrite and Proofread. These features help enhance users' writing to make it more friendly, concise or professional, similar to Grammarly's AI writing features. It can also be used to generate summaries, key points, tables, and lists from an article or piece of writing. [6] [7] ChatGPT will be available as part of Writing Tools. [8]

Image Playground

Apple Intelligence can also be used to generate images on-device with the Image Playground app. Similarly to OpenAI's DALL-E, it can be used to generate images using AI, using phrases and descriptions to create an image with customizable styles such as Animation and Sketch. In Notes, users can access Image Playground on iPad through the Image Wand tool in the Apple Pencil palette without having to open the Image Playground app. Rough sketches can be transformed into images.

Genmoji

Using Apple Intelligence text-to-image models, users can create original Genmoji images by typing descriptions. [9] Users can pick people in photos and create Genmoji images that resemble them. [10] Similarly to emoji, Genmoji can be added inline to text messages and can be shared in Messages and in supported third-party apps as stickers or Tapback reactions. [11] [12]

Siri overhaul

Siri, Apple's virtual assistant, has been updated with enhanced capabilities made possible by Apple Intelligence. The latest iteration features an updated user interface, improved natural language processing, and the option to interact via text by double tapping the home bar without enabling the feature in the Accessibility menu. In addition, Apple Intelligence adds the ability for Siri to use personal context from device activities to make conversations feel more natural and fluid. [8]

Mail

Apple Intelligence adds a feature called Priority Messages to the Mail app. [8]

Photos

Apple's Photos app includes a feature to create custom memory movies and enhanced search capabilities. Users can describe a story , and using Apple Intelligence, selects matching photos and videos. It organizes these into a movie with a narrative arc based on identified themes. Additionally, users can search for specific photos or videos by description and/or keyword, and Apple Intelligence can pinpoint particular moments within video clips. [13]

Code completion

Apple Intelligence is integrated into Apple's Xcode IDE, starting with version 16. This includes a predictive code completion feature, similar to GitHub Copilot, that runs on-device, using a model specifically trained on the Swift language and APIs. A new Swift Assist chat feature, using cloud models, generates and edits Swift code based on a user's prompt. [14] The on-device code completion feature requires a Mac with at least 16GB of memory to run. [15]

ChatGPT integration

As a result of the company's partnership with OpenAI, Apple Intelligence also includes a system-wide integration with ChatGPT, allowing Siri to determine when to send certain complex user requests to ChatGPT. This system-wide integration is powered by GPT-4o. [8] Using ChatGPT features are free for all users without needing to sign in, however paid subscribers can sign in to gain access to paid features systemwide. Apple plans to integrate other models such as Google's Gemini into the system in the future. [16]

Development

Background

In October 2015, Apple Inc. acquired Perceptio, an on-device artificial intelligence modeling company. [17] Following the acquisition, Apple engaged in efforts to ensure its artificial intelligence operations remained covert; according to University of California, Berkeley professor Trevor Darrell, the company's secrecy deterred graduate students. [18]

The Private Cloud Compute platform powering Apple Intelligence is designed heavily with user privacy and end-to-end encryption in mind. [19]

Supported devices

All Macs and iPads with an M-series Apple silicon processor will support Apple Intelligence with the release of macOS Sequoia and iPadOS 18. iPhones with at least an A17 Pro or later will also be supported with the release of iOS 18. [20] Analyst Ming-Chi Kuo speculates that the RAM requirements of the on-device model prohibits Apple Intelligence from running on earlier iPhones. [21]

Macs

iPads

iPhones

See also

Related Research Articles

iOS Mobile operating system by Apple

iOS is a mobile operating system developed by Apple exclusively for its smartphones. It was unveiled in January 2007 for the first-generation iPhone, launched in June 2007.

iOS is a mobile operating system developed by Apple Inc. and was first released as iPhone OS in June 2007, coinciding with the launch of the first generation iPhone. iPhone OS was renamed iOS following the release of the iPad, starting with iOS 4. With iOS 13, Apple began offering a separate operating system, iPadOS, for the iPad. iOS is also the foundation of the newer audioOS and tvOS, and shares some of its code with macOS. New iOS versions are released every year alongside new iPhone models. From its launch in 2007 until 2010, this occurred in June or July, since then, new major versions are released in September or October. Since the launch of the iPhone in June 2007, there have been 17 major releases of iOS. The current major version of iOS is iOS 17, released on September 18, 2023.

<span class="mw-page-title-main">Siri</span> Software-based personal assistant from Apple Inc.

Siri is the digital assistant that is part of Apple Inc.'s iOS, iPadOS, watchOS, macOS, tvOS, audioOS, and visionOS operating systems. It uses voice queries, gesture based control, focus-tracking and a natural-language user interface to answer questions, make recommendations, and perform actions by delegating requests to a set of Internet services. With continued use, it adapts to users' individual language usages, searches, and preferences, returning individualized results.

iPadOS Mobile operating system for iPad tablets

iPadOS is a mobile operating system developed by Apple Inc. for its iPad line of tablet computers. It was given a name distinct from iOS, the operating system used by Apple's iPhones to reflect the diverging features of the two product lines, such as multitasking. It was introduced as iPadOS 13 in 2019, reflecting its status as the successor to iOS 12 for the iPad, at the company's 2019 Worldwide Developers Conference.

<span class="mw-page-title-main">Messages (Apple)</span> Instant messaging software applications

Messages is a text messaging software application developed by Apple Inc. for its macOS, iOS, iPadOS, watchOS, and visionOS operating systems.

<span class="mw-page-title-main">Control Center (Apple)</span> iOS, iPadOS, macOS feature

Control Center is a feature of Apple Inc.'s iOS, iPadOS, macOS, and visionOS operating systems. It was introduced as part of iOS 7, released on September 18, 2013. In iOS 7, it replaces the control pages found in previous versions. It gives iOS and iPadOS devices direct access to important settings for the device by swiping down from the top right corner on the iPhone X and newer, and on all iPad models starting with iOS 12 or iPadOS, with previous models using a swipe from the bottom of the screen. It is similar to the SBSettings tweak for iOS jailbreaking. Control Center was also added to Macs in macOS 11 Big Sur, released on November 12, 2020.

iPad Air 2 Tablet computer made by Apple (2014–2017)

The iPad Air 2 is the second-generation iPad Air tablet computer designed, developed, and marketed by Apple Inc. It was announced on October 16, 2014, alongside the iPad Mini 3, both of which were released on October 22, 2014. The iPad Air 2 is thinner, lighter and faster than its predecessor, the first-generation iPad Air, and features Touch ID with the height, width and screen size the same as the iPad Air.

iOS 10 2016 mobile operating system

iOS 10 is the tenth major release of the iOS mobile operating system developed by Apple Inc., being the successor to iOS 9. It was announced at the company's Worldwide Developers Conference on June 13, 2016, and was released on September 13, that year. It was succeeded by iOS 11 on September 19, 2017.

<span class="mw-page-title-main">Shortcuts (Apple)</span> Scripting application by Apple

Shortcuts is a visual scripting application developed by Apple and provided on its iOS, iPadOS, macOS, and watchOS operating systems. It allows users to create macros for executing specific tasks on their device(s). These task sequences can be created by the user and shared online through iCloud. A number of curated shortcuts can also be downloaded from the integrated Gallery.

iOS 11 2017 mobile operating system

iOS 11 is the eleventh major release of the iOS mobile operating system developed by Apple, being the successor to iOS 10. It was announced at the company's Worldwide Developers Conference on June 5, 2017, and was released on September 19, 2017. It was succeeded by iOS 12 on September 17, 2018.

iOS 12 2018 mobile operating system

iOS 12 is the twelfth major release of the iOS mobile operating system developed by Apple. Aesthetically similar to its predecessor, iOS 11, it focuses more on performance than on new features, quality improvements and security updates. Announced at the company's Worldwide Developers Conference on June 4, 2018, iOS 12 was released to the public on September 17, 2018. It was succeeded for the iPhone and iPod Touch by iOS 13 on September 19, 2019, and for the iPad by iPadOS 13 on September 24, 2019. Security updates for iOS 12 continued for four years after the releases of iOS 13 and iPadOS 13 for devices unable to run the newer versions. The last update, 12.5.7, was released on January 23, 2023.

iOS 13 2019 mobile operating system

iOS 13 is the thirteenth major release of the iOS mobile operating system developed by Apple for the iPhone, iPod Touch and HomePod. The successor to iOS 12, it was announced at the company's Worldwide Developers Conference (WWDC) on June 3, 2019, and released on September 19, 2019. It was succeeded by iOS 14, released on September 16, 2020.

iPadOS 13 2019 tablet operating system by Apple Inc.

iPadOS 13 is the first major release of the iPadOS mobile operating system developed by Apple Inc. for their iPad line of tablet computers. The successor to iOS 12 on those devices, it was announced at the company's 2019 Worldwide Developers Conference (WWDC) on June 3, 2019, as a derivation from iOS, with a greater emphasis on multitasking and tablet-centric features. It was released on September 24, 2019. It was succeeded by iPadOS 14, released on September 16, 2020.

iOS 15 2021 mobile operating system

iOS 15 is the fifteenth major release of the iOS mobile operating system developed by Apple for its iPhone and iPod Touch lines of products. It was announced at the company's Worldwide Developers Conference on June 7, 2021, as the successor to iOS 14 and released to the public on September 20, 2021.

macOS Monterey 18th major version of the macOS operating system

macOS Monterey is the eighteenth major release of macOS, Apple's desktop operating system for Macintosh computers. The successor to macOS Big Sur, it was announced at WWDC 2021 on June 7, 2021, and released on October 25, 2021. macOS Monterey was succeeded by macOS Ventura, which was released on October 24, 2022.

iOS 16 2022 mobile operating system

iOS 16 is the sixteenth major release of Apple's iOS mobile operating system for the iPhone. It is the successor of iOS 15, and was announced at the company's Worldwide Developers Conference (WWDC) on June 6, 2022, alongside iPadOS 16, and released on September 12, 2022. It was succeeded by iOS 17 on September 18, 2023.

iOS 18 Upcoming mobile operating system

iOS 18 is the upcoming eighteenth major release of Apple's iOS operating system for the iPhone. It was announced on June 10, 2024 at the 2024 Worldwide Developers Conference (WWDC). It is the direct successor to iOS 17 and was announced alongside watchOS 11, iPadOS 18, and macOS Sequoia.

macOS Sequoia Upcoming 21st major version of the macOS operating system

macOS Sequoia is the upcoming major release of Apple's macOS operating system. The successor to macOS Sonoma, it was announced at WWDC 2024 on June 10, 2024. It is named after Sequoia National Park, which is located in the Sierra Nevada mountain range.

References

  1. ↑ "Apple's AI plans, iOS 18, and more at WWDC 2024". The Verge . June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 10, 2024.
  2. ↑ "Apple Intelligence Preview". Apple. Retrieved June 14, 2024.
  3. ↑ Davis, Wes (June 16, 2024). "Apple won't wait until next year for some Siri improvements". The Verge. Retrieved June 17, 2024.
  4. ↑ "Introducing Apple's On-Device and Server Foundation Models". Apple Machine Learning Research. Retrieved June 15, 2024.
  5. ↑ Lambert, Nathan (June 12, 2024). "AI for the rest of us". Interconnects. Retrieved June 15, 2024.
  6. ↑ Chedraoui, Katelyn (June 11, 2024). "Did Apple Intelligence's 'Rewrite' Tool Just Kill Grammarly?". CNET . Retrieved June 12, 2024.
  7. ↑ Lovejoy, Ben (June 11, 2024). "Apple Intelligence: The features I can't wait to try". 9to5Mac. Retrieved June 12, 2024.
  8. 1 2 3 4 "Introducing Apple Intelligence for iPhone, iPad, and Mac". Apple Newsroom. June 10, 2024. Retrieved June 14, 2024.
  9. ↑ Rutherford, Sam (June 10, 2024). "In case there weren't enough emoji already, Apple's Genmoji uses AI to generate even more". Engadget. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
  10. ↑ Jones, D. Griffin (June 10, 2024). "Image Playground and Genmoji bring AI images to iMessage and more". Cult of Mac. Archived from the original on June 11, 2024. Retrieved June 24, 2024.
  11. ↑ Murphy, Darragh (June 10, 2024). "WWDC 2024: Genmoji lets you create your own emojis with 'Apple Intelligence'". Mashable. Archived from the original on June 12, 2024. Retrieved June 24, 2024.
  12. ↑ Joseph, Melwyn (June 11, 2024). "How to Use Genmoji - Steps Explained". Stealth Optional. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
  13. ↑ Perez, Sarah (June 10, 2024). "Apple revamps its Photos app for iOS 18". TechCrunch. Retrieved June 12, 2024.
  14. ↑ "Apple empowers developers and fuels innovation with new tools and resources". Apple Newsroom. June 10, 2024. Retrieved June 15, 2024.
  15. ↑ "Xcode 16 Beta Release Notes". Apple Developer Documentation. Retrieved June 15, 2024.
  16. ↑ Perry, Alex (June 11, 2024). "Apple plans to work with Google's Gemini, other AI models". Mashable. Retrieved June 15, 2024.
  17. ↑ Clark, Jack; Satariano, Adam (October 5, 2015). "Apple Acquires Startup Developing Advanced AI for Phones". Bloomberg News. Archived from the original on December 23, 2023. Retrieved June 10, 2024.
  18. ↑ Clark, Jack (October 29, 2015). "Apple's Deep Learning Curve". Bloomberg News. Archived from the original on May 26, 2023. Retrieved June 10, 2024.
  19. ↑ "Private Cloud Compute: A new frontier for AI privacy in the cloud". Apple Security Research. June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 11, 2024.
  20. ↑ Nield, David (June 11, 2024). "Apple Intelligence: here's a full list of the iPhones, iPads and Macs that'll get Apple's new AI powers". TechRadar. Retrieved June 15, 2024.
  21. ↑ Kuo, Ming-Chi (June 11, 2024). "How Apple defines on-device AI and future trends — from the perspective of analyzing supported models of Apple Intelligence". Medium. Retrieved June 15, 2024.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.