Apple Intelligence

Last updated

Apple Intelligence
Developer(s) Apple Inc.
Initial releaseOctober 28, 2024;2 days ago (2024-10-28) [1]
Operating system iOS 18, iPadOS 18, macOS Sequoia
Platform ARM
Type Artificial intelligence
License Proprietary
Website https://www.apple.com/apple-intelligence/

Apple Intelligence is an artificial intelligence developed by Apple Inc. [2] Relying on a combination of on-device and server processing, it was announced on June 10, 2024, at WWDC 2024, as a built-in feature of Apple's iOS 18, iPadOS 18, and macOS Sequoia operating systems, which were announced alongside Apple Intelligence. Apple Intelligence will be free for all users with supported devices. It launched for developers and testers on July 29, 2024 in U.S. English, with the iOS 18.1, macOS 15.1, and iPadOS 18.1 developer betas, will release partially in October 2024, and will fully launch by 2025. [3] [4] UK, Australia, Canada, New Zealand, and South African localized versions of English will have support by the end of 2024, while Chinese, English (India), English (Singapore), French, German, Italian, Japanese, Korean, Portuguese, Spanish, and Vietnamese will be added over the course of 2025. [5]

Contents

Models

Apple Intelligence consists of an on-device model as well as a cloud model running on servers using Apple silicon. Both models consist of a generic foundation model, as well as multiple adapter models that are more specialized to particular tasks like text summarization and tone adjustment. [6]

According to a human evaluation done by Apple's machine learning division, the on-device foundation model beat or tied equivalent small models by Mistral AI, Microsoft, and Google, while the server foundation models beat the performance of OpenAI's GPT-3, while roughly matching the performance of GPT-4. [7]

Apple's cloud models are built on a Private Cloud Compute platform which is designed heavily with user privacy and end-to-end encryption in mind. Unlike other generative AI services like ChatGPT which use servers from third-parties, Apple Intelligence's cloud models are run entirely on Apple servers with custom Apple silicon hardware built for end-to-end encryption. It was also designed to make sure that the software running on said servers matches the independently verifiable software accessible to researchers. In case of a software mismatch, Apple devices will refuse to connect to the servers. [8]

Functionality and features

Writing tools

Apple Intelligence features writing tools that are powered by AI, including Rewrite, and Proofread. These features help enhance users' writing to make it more friendly, concise or professional, similar to Grammarly's AI writing features. It can also be used to generate summaries, key points, tables, and lists from an article or piece of writing. [9] [10] GPT-4o will be available as an optional integrated part of Writing Tools. [11]

Image Playground

Apple Intelligence can be used to generate images on-device with the Image Playground app. Similarly to OpenAI's DALL-E, it can be used to generate images using AI, using phrases and descriptions to create an image with customizable styles such as Animation and Sketch. [12] In Notes, users can access Image Playground on iPad through the Image Wand tool in the Apple Pencil palette without having to open the Image Playground app. Rough sketches made with Apple Pencil can be transformed into images. [13]

Genmoji

Using Apple Intelligence text-to-image models, users can create original "Genmoji" images by typing descriptions. [14] Users can pick people in photos and create Genmoji images that resemble them. [15] Similarly to emoji, Genmoji can be added inline to text messages and can be shared in Messages and in supported third-party apps as stickers or Tapback reactions. [16] [17]

Siri overhaul

Siri, Apple's virtual assistant, has been updated with enhanced capabilities made possible by Apple Intelligence. The latest iteration features an updated user interface, improved natural language processing, and the option to interact via text by double tapping the home bar without enabling the feature in the Accessibility menu, or double-clicking the command key on macOS. In addition, Apple Intelligence adds the ability for Siri to use personal context from device activities to make conversations feel more natural and fluid. [11]

Mail

Apple Intelligence adds a feature called Priority Messages to the Mail app, which shows urgent emails such as same-day invitations or boarding passes, with AI generated summaries of the email. [11]

Photos

Apple's Photos app includes a feature to create custom memory movies and enhanced search capabilities. Users can describe a story, and using Apple Intelligence, selects matching photos, videos, and music. Users can also remove distractions in images with the Clean Up tool in the Photos app. Apple Intelligence identifies background objects and removes them with a tap. It organizes these into a movie with a narrative arc based on identified themes. Additionally, users can search for specific photos or videos by description and/or keyword, and Apple Intelligence can pinpoint particular moments within video clips. [18]

Notifications

Using the Notification Summary feature, Apple Intelligence can summarize notifications from messaging apps and groups of notifications from apps so that users don't have to examine large amounts of notifications. [19] A new Reduce Interruptions focus mode silences notifications deemed unimportant while letting important notifications go through. [20]

ChatGPT integration

As a result of the company's partnership with OpenAI, Apple Intelligence also includes a system-wide integration with ChatGPT, allowing Siri to determine when to send certain complex user requests to ChatGPT. This system-wide integration is powered by GPT-4o. [11] ChatGPT integration is opt-in by default, with users being prompted before any data or photos are sent to ChatGPT servers and IP addresses being obscured when requests are sent to OpenAI's servers. [21] Using ChatGPT features is free for all users without needing to sign in, however paid subscribers can sign in to gain access to paid features systemwide. Apple plans to integrate other models such as Google's Gemini into the system in the future. [22]

Development

Background

Apple first implemented artificial intelligence features in its products with the release of Siri in the iPhone 4S in 2011. [23] In the years after its release, Apple engaged in efforts to ensure its artificial intelligence operations remained covert; according to University of California, Berkeley professor Trevor Darrell, the company's secrecy deterred graduate students. [24] The company started expanding its artificial intelligence team in 2015, [25] opening up its operations by publishing more scientific papers and joining AI industry research groups. [26] Apple reportedly acquired more AI companies from 2016 to 2020. [27] In 2017, Apple released the iPhone 8 and the iPhone X with the A11 Bionic processor, which featured its first dedicated Neural Engine for accelerating common machine learning tasks. [28] Despite its investments in artificial intelligence, Siri was criticized both by reviewers [29] and internally at Apple [30] for lagging behind other AI assistants.

The rapid development of generative artificial intelligence and the release of ChatGPT in late 2022 reportedly blindsided Apple executives and forced the company to refocus its efforts on AI. [31] [32] In an interview with Good Morning America, Apple CEO Tim Cook stated that generative AI had "great promise" but had some potential dangers, and that it was "looking closely" at ChatGPT. It was first reported in July 2023 that Apple was creating its own internal large language model, codenamed "Ajax". [31] In October 2023, Apple was reportedly on track to release generative AI features into its operating systems by 2024, including a significantly redeveloped Siri. [32] In an earnings call in February 2024, Cook stated that the company was spending a "tremendous amount of time and effort" into AI features that would be shared "later that year". [33]

Supported devices

All Macs and iPads with an M-series Apple silicon chip will support Apple Intelligence with the release of macOS Sequoia and iPadOS 18. iPhones and iPads with the A17 Pro chip or later will also be supported with the release of iOS 18. [34] Analyst Ming-Chi Kuo speculates that the RAM requirements of the on-device model prohibits Apple Intelligence from running on older iPhone models. [35]

MacOS Apple Intelligence Siri Logo MacOS Apple Intelligence Logo.png
MacOS Apple Intelligence Siri Logo

Macs

iPads

iPhones

See also

Related Research Articles

iOS Mobile operating system by Apple

iOS is a mobile operating system developed by Apple exclusively for its devices. It was unveiled in January 2007 for the first-generation iPhone, which launched in June 2007. Major versions of iOS are released annually; the current stable version, iOS 18, was released to the public on September 16, 2024.

iOS is a mobile operating system developed by Apple Inc. and was first released as iPhone OS in June 2007, coinciding with the launch of the first generation iPhone. iPhone OS was renamed iOS following the release of the iPad, starting with iOS 4. With iOS 13, Apple began offering a separate operating system, iPadOS, for the iPad. iOS is also the foundation of the newer audioOS and tvOS, and shares some of its code with macOS. New iOS versions are released yearly, alongside new iPhone models. From the launch of the iPhone in 2007 until the launch of iPhone 4 in 2010, this occurred in June or July; since then, new major versions are usually released in September, with the exception of iOS 5, which released in October 2011. Since the launch of the iPhone in June 2007, there have been 18 major releases of iOS, with the current major version being iOS 18, released on September 16, 2024.

<span class="mw-page-title-main">Siri</span> Software-based personal assistant from Apple

Siri is a digital assistant purchased, developed, and popularized by Apple Inc., which included it in the iOS, iPadOS, watchOS, macOS, tvOS, audioOS, and visionOS operating systems. It uses voice queries, gesture based control, focus-tracking and a natural-language user interface to answer questions, make recommendations, and perform actions by delegating requests to a set of Internet services. With continued use, it adapts to users' individual language usages, searches, and preferences, returning individualized results.

iPadOS Mobile operating system for iPad tablets

iPadOS is a mobile operating system developed by Apple Inc. for its iPad line of tablet computers. It was given a name distinct from iOS, the operating system used by Apple's iPhones to reflect the diverging features of the two product lines, such as multitasking. It was introduced as iPadOS 13, reflecting its status as the successor to iOS 12 for the iPad, and first released to the public on September 24, 2019. Major versions of iPadOS are released annually; the current stable version, iPadOS 18, was released to the public on September 16, 2024.

iMessage Instant messaging service by Apple

iMessage is an instant messaging service developed by Apple Inc. and launched in 2011. iMessage functions exclusively on Apple platforms – including iOS, iPadOS, macOS, watchOS, and visionOS – as part of Apple's approach to inter-device integration, which has been described by media outlets as a means of achieving vendor lock-in. iMessage is accessed and used using the Messages app client.

<span class="mw-page-title-main">Messages (Apple)</span> Instant messaging software applications

Messages is a text messaging software application developed by Apple Inc. for its macOS, iOS, iPadOS, watchOS, and visionOS operating systems.

iOS 6 2012 mobile operating system

iOS 6 is the sixth major release of the iOS mobile operating system developed by Apple Inc, being the successor to iOS 5. It was announced at the company's Worldwide Developers Conference on June 11, 2012, and was released on September 19, 2012. It was succeeded by iOS 7 on September 18, 2013.

iOS 8 2014 mobile operating system

iOS 8 is the eighth major release of the iOS mobile operating system developed by Apple Inc., being the successor to iOS 7. It was announced at the company's Worldwide Developers Conference on June 2, 2014, and was released on September 17, 2014. It was succeeded by iOS 9 on September 16, 2015.

iOS 9 2015 mobile operating system

iOS 9 is the ninth major release of the iOS mobile operating system developed by Apple Inc., being the successor to iOS 8. It was announced at the company's Worldwide Developers Conference on June 8, 2015, and was released on September 16, 2015. It was succeeded by iOS 10 on September 13, 2016.

iOS 10 2016 mobile operating system

iOS 10 is the tenth major release of the iOS mobile operating system developed by Apple Inc., being the successor to iOS 9. It was announced at the company's Worldwide Developers Conference on June 13, 2016, and was released on September 13, 2016. It was succeeded by iOS 11 on September 19, 2017.

iOS 11 2017 mobile operating system

iOS 11 is the eleventh major release of the iOS mobile operating system developed by Apple, being the successor to iOS 10. It was announced at the company's Worldwide Developers Conference on June 5, 2017, and was released on September 19, 2017. It was succeeded by iOS 12 on September 17, 2018.

iOS 12 2018 mobile operating system

iOS 12 is the twelfth major release of the iOS mobile operating system developed by Apple. Aesthetically similar to its predecessor, iOS 11, it focuses more on performance than on new features, quality improvements and security updates. Announced at the company's Worldwide Developers Conference on June 4, 2018, iOS 12 was released to the public on September 17, 2018. It was succeeded for the iPhone and iPod Touch by iOS 13 on September 19, 2019, and for the iPad by iPadOS 13 on September 24, 2019. Security updates for iOS 12 continued for four years after the releases of iOS 13 and iPadOS 13 for devices unable to run the newer versions. The last update, 12.5.7, was released on January 23, 2023.

<span class="mw-page-title-main">Find My</span> Asset tracking app

Find My is an asset tracking service made by Apple Inc. that enables users to track the location of iOS, iPadOS, macOS, watchOS, visionOS, tvOS devices, AirPods, AirTags, and a number of supported third-party accessories through a connected iCloud account. Users can also show their primary device's geographic location to others, and can view the location of others who choose to share their location. Find My was released alongside iOS 13 on September 19, 2019, merging the functions of the former Find My iPhone and Find My Friends into a single app. On watchOS, Find My is separated into three different applications: Find Devices, Find People and Find Items.

The iOS mobile operating system developed by Apple has had a wide range of bugs and security issues discovered throughout its lifespan, including security exploits discovered in most versions of the operating system related to the practice of jailbreaking, bypassing the user's lock screen, issues relating to battery drain, crash bugs encountered when sending photos or certain Unicode characters via text messages sent through the Messages application, and general bugs and security issues later fixed in newer versions of the operating system.

iOS 15 2021 mobile operating system

iOS 15 is the fifteenth major release of the iOS mobile operating system developed by Apple for its iPhone and iPod Touch lines of products. It was announced at the company's Worldwide Developers Conference on June 7, 2021, as the successor to iOS 14 and released to the public on September 20, 2021.

iOS 16 2022 mobile operating system

iOS 16 is the sixteenth major release of Apple's iOS mobile operating system for the iPhone. It is the successor of iOS 15, and was announced at the company's Worldwide Developers Conference (WWDC) on June 6, 2022, alongside iPadOS 16, and released on September 13, 2022. It was succeeded by iOS 17 on September 18, 2023.

iOS 18 2024 mobile operating system

iOS 18 is the eighteenth and current major release of Apple's iOS operating system for the iPhone. It was announced on June 10, 2024, at the 2024 Worldwide Developers Conference (WWDC). It was made publicly available on September 16, 2024, as a free software update for supported iOS devices. It is the direct successor to iOS 17 and was announced alongside iPadOS 18, macOS Sequoia, watchOS 11, visionOS 2, and tvOS 18.

iPadOS 18 2024 tablet operating system by Apple Inc.

iPadOS 18 is the sixth and current major release of Apple's iPadOS operating system for the iPad. It was revealed at the 2024 Worldwide Developers Conference (WWDC). It is the direct successor to iPadOS 17 and was announced alongside iOS 18, macOS Sequoia, visionOS 2, watchOS 11, and tvOS 18.

macOS Sequoia 21st major version of the macOS operating system

macOS Sequoia is the twenty-first and current major release of Apple's macOS operating system, the successor to macOS Sonoma. It was announced at WWDC 2024 on June 10, 2024. In line with Apple's practice of naming macOS releases after landmarks in California, it is named after Sequoia National Park, located in the Sierra Nevada mountain range.

References

  1. ↑ Apple Intelligence Available Today (October 28, 2024)
  2. ↑ "Apple's AI plans, iOS 18, and more at WWDC 2024". The Verge . June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 10, 2024.
  3. ↑ "Apple Intelligence Preview". Apple. Archived from the original on June 13, 2024. Retrieved June 14, 2024.
  4. ↑ Davis, Wes (June 16, 2024). "Apple won't wait until next year for some Siri improvements". The Verge . Vox Media. Archived from the original on June 17, 2024. Retrieved June 17, 2024.
  5. ↑ "Apple Intelligence comes to iPhone, iPad, and Mac starting next month. iOS 18.1 was released today". Apple Newsroom (Hong Kong). Retrieved October 20, 2024.
  6. ↑ "Introducing Apple's On-Device and Server Foundation Models". Apple Machine Learning Research. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
  7. ↑ Lambert, Nathan (June 12, 2024). "AI for the rest of us". Interconnects. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
  8. ↑ "Private Cloud Compute: A new frontier for AI privacy in the cloud". Apple Security Research. June 10, 2024. Archived from the original on June 11, 2024. Retrieved June 11, 2024.
  9. ↑ Chedraoui, Katelyn (June 11, 2024). "Did Apple Intelligence's 'Rewrite' Tool Just Kill Grammarly?". CNET . Archived from the original on June 12, 2024. Retrieved June 12, 2024.
  10. ↑ Lovejoy, Ben (June 11, 2024). "Apple Intelligence: The features I can't wait to try". 9to5Mac. Archived from the original on June 12, 2024. Retrieved June 12, 2024.
  11. 1 2 3 4 "Introducing Apple Intelligence for iPhone, iPad, and Mac". Apple Newsroom. June 10, 2024. Archived from the original on June 15, 2024. Retrieved June 14, 2024.
  12. ↑ Zivkovic, Marko (June 17, 2024). "How Apple plans to label AI-generated images made through its new Image Playground app". AppleInsider. Retrieved August 25, 2024.
  13. ↑ Clover, Juli (August 23, 2024). "iOS 18 Notes App: All the New Features". MacRumors. Retrieved August 25, 2024.
  14. ↑ Rutherford, Sam (June 10, 2024). "In case there weren't enough emoji already, Apple's Genmoji uses AI to generate even more". Engadget. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
  15. ↑ Jones, D. Griffin (June 10, 2024). "Image Playground and Genmoji bring AI images to iMessage and more". Cult of Mac. Archived from the original on June 11, 2024. Retrieved June 24, 2024.
  16. ↑ Murphy, Darragh (June 10, 2024). "WWDC 2024: Genmoji lets you create your own emojis with 'Apple Intelligence'". Mashable. Archived from the original on June 12, 2024. Retrieved June 24, 2024.
  17. ↑ Joseph, Melwyn (June 11, 2024). "How to Use Genmoji - Steps Explained". Stealth Optional. Archived from the original on June 24, 2024. Retrieved June 24, 2024.
  18. ↑ Perez, Sarah (June 10, 2024). "Apple revamps its Photos app for iOS 18". TechCrunch. Retrieved June 12, 2024.
  19. ↑ "iOS 18.1 Beta Now Offers Notification Summaries for All Apps". MacRumors. August 28, 2024. Retrieved October 4, 2024.
  20. ↑ "How to use Reduce Interruptions on iOS 18 and what it does". AppleInsider. July 31, 2024. Retrieved October 4, 2024.
  21. ↑ Edu, Jide (June 14, 2024). "Apple insists its ChatGPT tie-up will protect users' privacy: here are the questions it must answer first". The Conversation. Archived from the original on June 26, 2024. Retrieved June 26, 2024.
  22. ↑ Perry, Alex (June 11, 2024). "Apple plans to work with Google's Gemini, other AI models". Mashable. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
  23. ↑ Olson, Parmy. "Steve Jobs Leaves A Legacy In A.I. With Siri". Forbes. Archived from the original on November 28, 2023. Retrieved July 6, 2024.
  24. ↑ Clark, Jack (October 29, 2015). "Apple's Deep Learning Curve". Bloomberg News. Archived from the original on May 26, 2023. Retrieved June 10, 2024.
  25. ↑ Love, Julia (September 7, 2015). "Exclusive: Apple ups hiring, but faces obstacles to making phones smarter". Reuters. Archived from the original on November 19, 2015. Retrieved July 6, 2024.
  26. ↑ "Apple Set to Join Amazon, Google, Facebook in AI Research Group". Bloomberg.com. January 26, 2017. Archived from the original on July 6, 2024. Retrieved July 6, 2024.
  27. ↑ "Apple Bought the Most AI Companies From 2016 to 2020". MacRumors. March 25, 2021. Archived from the original on May 20, 2024. Retrieved July 6, 2024.
  28. ↑ "The future is here: iPhone X". Apple Newsroom. Archived from the original on April 1, 2018. Retrieved July 6, 2024.
  29. ↑ Vincent, James (October 4, 2021). "Hey Siri, what happened?". The Verge. Archived from the original on June 12, 2024. Retrieved July 6, 2024.
  30. ↑ "Former Apple Employees Reflect on Siri's 'Squandered Lead' Over Amazon Alexa and Google Assistant". MacRumors. March 14, 2018. Archived from the original on February 23, 2024. Retrieved July 6, 2024.
  31. 1 2 "Apple Tests 'Apple GPT,' Develops Generative AI Tools to Catch OpenAI". Bloomberg.com. July 19, 2023. Archived from the original on July 6, 2024. Retrieved July 6, 2024.
  32. 1 2 "Apple Generative AI Features and Smarter Siri Could Launch Next Year". MacRumors. October 22, 2023. Archived from the original on June 14, 2024. Retrieved July 6, 2024.
  33. ↑ "Apple Spending a 'Tremendous Amount of Time and Effort' on AI, Details Coming 'Later This Year'". MacRumors. February 1, 2024. Archived from the original on July 6, 2024. Retrieved July 6, 2024.
  34. ↑ Nield, David (June 11, 2024). "Apple Intelligence: here's a full list of the iPhones, iPads and Macs that'll get Apple's new AI powers". TechRadar. Archived from the original on June 11, 2024. Retrieved June 15, 2024.
  35. ↑ Kuo, Ming-Chi (June 11, 2024). "How Apple defines on-device AI and future trends — from the perspective of analyzing supported models of Apple Intelligence". Medium. Archived from the original on June 15, 2024. Retrieved June 15, 2024.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.