Neural Engine

Last updated

Neural Engine is a series of AI accelerators designed for machine learning by Apple. The first SoC including Neural Engine is Apple A11 Bionic for iPhone 8, 8 Plus and iPhone X introduced in 2017. [1] Since then, all Apple A series SoCs have Neural Engine. In 2020, Apple introduced the Apple M1 for Mac [2] and all Apple M series SoCs have Neural Engine. [3] [4] [5] [6] [7]

Contents

Apple has stated the Neural Engine in the M4 can perform 38 trillion operations per second (TOPS), an improvement over the 18 TOPS in the M3. [8]

Applications

The Neural Engine is used for real-time AI-driven applications such as Face ID, Siri, and augmented reality (AR). It also handles computational photography features, including Smart HDR and Night Mode, by processing vast amounts of sensor data for real-time image enhancements. [9]

Energy efficiency and privacy

The Neural Engine also provides high energy efficiency, allowing real-time AI tasks to be performed with minimal battery consumption.[ citation needed ] Its on-device processing ensures that sensitive tasks such as facial recognition and voice commands are handled locally, enhancing privacy by keeping user data secure.

Developer tools

The Neural Engine is fully integrated with Apple’s Core ML framework, which allows developers to run machine learning models on-device. This integration supports applications like object recognition, natural language processing, and gesture detection, giving developers the tools to harness AI power efficiently.

Related Research Articles

<span class="mw-page-title-main">MacBook Pro</span> Line of notebook computer

The MacBook Pro is a line of Mac laptop computers developed and manufactured by Apple. Introduced in January 2006, it is the high-end sibling of the MacBook family, sitting above the ultra-portable MacBook Air and previously the low-end MacBook. It is currently sold with 14-inch and 16-inch screens, all using Apple M-series chips. Before Apple silicon, the MacBook Pro used Intel chips, and was the first laptop made by Apple to do so, replacing the earlier PowerBook. It was also the first Apple laptop to carry the MacBook moniker.

The transistor count is the number of transistors in an electronic device. It is the most common measure of integrated circuit complexity. The rate at which MOS transistor counts have increased generally follows Moore's law, which observes that transistor count doubles approximately every two years. However, being directly proportional to the area of a die, transistor count does not represent how advanced the corresponding manufacturing technology is. A better indication of this is transistor density which is the ratio of a semiconductor's transistor count to its die area.

<span class="mw-page-title-main">MacBook</span> Line of laptop computers by Apple

MacBook is a brand of Mac notebook computers developed and marketed by Apple that use Apple's macOS operating system since 2006. The MacBook brand replaced the PowerBook and iBook brands during the Mac transition to Intel processors, announced in 2005. The current lineup consists of the MacBook Air (2008–present) and the MacBook Pro (2006–present). Two different lines simply named "MacBook" existed from 2006 to 2012 and 2015 to 2019. The MacBook brand was the "world's top-selling line of premium laptops" as of 2015.

<span class="mw-page-title-main">Apple silicon</span> System-on-chip processors designed by Apple Inc.

Apple silicon refers to a series of system on a chip (SoC) and system in a package (SiP) processors designed by Apple Inc., mainly using the ARM architecture. They are the basis of Mac, iPhone, iPad, Apple TV, Apple Watch, AirPods, AirTag, HomePod, and Apple Vision Pro devices.

<span class="mw-page-title-main">Apple A12</span> System on a chip (SoC) designed by Apple Inc.

The Apple A12 Bionic is a 64-bit ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series, It first appeared in the iPhone XS and XS Max, iPhone XR, iPad Air, iPad Mini, 8th generation iPad and Apple TV 4K. Apple states that the two high-performance cores are 15% faster and 40% more energy-efficient than the Apple A11's, and the four high-efficiency cores use 50% less power than the A11's. It is the first mass-market system on a chip to be built using the 7 nm process.

<span class="mw-page-title-main">Apple A12X</span> System on a chip (SoC) designed by Apple Inc.

The Apple A12X Bionic is a 64-bit system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series, It first appeared in the iPad Pro, announced on October 30, 2018. The A12X is an 8-core variant of the A12 and Apple states that it has 35 percent faster single-core CPU performance and 90 percent faster overall CPU performance than its predecessor, the Apple A10X. The Apple A12Z Bionic is an updated version of the A12X, adding an additional GPU core, and was unveiled on March 18, 2020, as part of the iPad Pro.

<span class="mw-page-title-main">Apple A14</span> System on a chip (SoC) designed by Apple Inc.

The Apple A14 Bionic is a 64-bit ARMv8.4-A system on a chip (SoC)designed by Apple Inc., part of the Apple silicon series. It appears in the fourth generation iPad Air and tenth generation iPad, as well as iPhone 12 Mini, iPhone 12, iPhone 12 Pro, and iPhone 12 Pro Max. Apple states that the central processing unit (CPU) performs up to 40% faster than the A12, while the graphics processing unit (GPU) is up to 30% faster than the A12. It also includes a 16-core neural engine and new machine learning matrix accelerators that perform twice and ten times as fast, respectively.

<span class="mw-page-title-main">Apple M1</span> Series of systems-on-a-chip designed by Apple, launched 2020 to 2022

Apple M1 is a series of ARM-based system-on-a-chip (SoC) designed by Apple Inc., launched 2020 to 2022. It is part of the Apple silicon series, as a central processing unit (CPU) and graphics processing unit (GPU) for its Mac desktops and notebooks, and the iPad Pro and iPad Air tablets. The M1 chip initiated Apple's third change to the instruction set architecture used by Macintosh computers, switching from Intel to Apple silicon fourteen years after they were switched from PowerPC to Intel, and twenty-six years after the transition from the original Motorola 68000 series to PowerPC. At the time of its introduction in 2020, Apple said that the M1 had "the world's fastest CPU core in low power silicon" and the world's best CPU performance per watt. Its successor, Apple M2, was announced on June 6, 2022, at Worldwide Developers Conference (WWDC).

The MacBook Air is a line of Mac laptops made by Apple Inc. In 2020, Apple stopped using Intel processors in the Air and switched to using their own Apple silicon M-series chips. In the current product line, the MacBook Air is Apple's entry-level laptop, situated below the performance range MacBook Pro, and is currently sold with 13-inch and 15-inch screens.

<span class="mw-page-title-main">Apple A15</span> System on a chip (SoC) designed by Apple Inc.

The Apple A15 Bionic is a 64-bit ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series. It is used in the iPhone 13 and 13 Mini, iPhone 13 Pro and 13 Pro Max, iPad Mini, iPhone SE, iPhone 14 and 14 Plus and Apple TV 4K.

<span class="mw-page-title-main">MacBook Pro (Apple silicon)</span> Current line of high-end notebook computers by Apple

The MacBook Pro with Apple silicon is a line of Mac notebook computers first introduced in November 2020 by Apple. It is the higher-end model of the MacBook family, sitting above the consumer-focused MacBook Air, and is currently sold with 14-inch and 16-inch screens. All models use Apple-designed M series systems on a chip.

iPad Air (5th generation) Tablet computer developed by Apple (2022-2024)

The iPad Air , colloquially known as the iPad Air 5 or iPad Air M1, is a tablet computer developed and marketed by Apple Inc. It was announced by Apple on March 8, 2022. Pre-orders began on March 11, 2022, and shipping began on March 18, 2022. It succeeded the fourth-generation iPad Air and is available in five colors: Space Gray, Starlight, Pink, Purple, and Blue.

<span class="mw-page-title-main">Mac Studio</span> Desktop computer by Apple Inc.

The Mac Studio is a small-form-factor workstation developed and marketed by Apple Inc. It is one of four desktop computers in the Mac lineup, sitting above the consumer-range Mac Mini and iMac, and positioned below the Mac Pro. It is configurable with either the M2 Max or M2 Ultra system on a chip.

<span class="mw-page-title-main">Apple M2</span> Series of system-on-a-chip designed by Apple, launched 2022 to 2023

Apple M2 is a series of ARM-based system on a chip (SoC) designed by Apple Inc., launched 2022 to 2023. It is part of the Apple silicon series, as a central processing unit (CPU) and graphics processing unit (GPU) for its Mac desktops and notebooks, the iPad Pro and iPad Air tablets, and the Vision Pro mixed reality headset. It is the second generation of ARM architecture intended for Apple's Mac computers after switching from Intel Core to Apple silicon, succeeding the M1. Apple announced the M2 on June 6, 2022, at Worldwide Developers Conference (WWDC), along with models of the MacBook Air and the 13-inch MacBook Pro using the M2. The M2 is made with TSMC's "Enhanced 5-nanometer technology" N5P process and contains 20 billion transistors, a 25% increase from the M1. Apple claims CPU improvements up to 18% and GPU improvements up to 35% compared to the M1.

<span class="mw-page-title-main">Apple A16</span> System on a chip (SoC) designed by Apple Inc.

The Apple A16 Bionic is a 64-bit ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series, and manufactured by TSMC. It is used in iPhones 14 Pro and 14 Pro Max, and 15 and 15 Plus.

<span class="mw-page-title-main">Apple M3</span> System on a Chip (SoC) designed by Apple Inc.

Apple M3 is a series of ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series, as a central processing unit (CPU) and graphics processing unit (GPU) for its Mac desktops and notebooks. Released in late 2023, it is the third generation of ARM architecture intended for Apple's Mac computers after switching from Intel Core to Apple silicon, succeeding the Apple M2.

<span class="mw-page-title-main">Apple A17</span> System on a chip (SoC) designed by Apple Inc.

The Apple A17 Pro is a 64-bit ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series, and manufactured by TSMC. It is used in the iPhone 15 Pro, iPhone 15 Pro Max, and iPad Mini models and is the first widely available SoC to be built on a 3 nm process. This chip does not have a non-Pro variant, as Apple moved to the TSMC N3E manufacturing node technology and announced the A18 Series on September 9, 2024, with the A18 and the A18 Pro respectively replacing the A16 and the A17 Pro on the new iPhone 16 lineup.

Apple M4 is a series of ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series, including a central processing unit (CPU), a graphics processing unit (GPU), a neural processing unit (NPU), and a digital signal processor (DSP). The M4 chip was introduced in May 2024 for the iPad Pro, and is the fourth generation of the M series Apple silicon architecture, succeeding the Apple M3. It was followed by the professional-focused M4 Pro and M4 Max in October 2024.

The Apple A18 and Apple A18 Pro are a pair of 64-bit ARM-based system on a chip (SoC) designed by Apple Inc., part of the Apple silicon series. They are used in the iPhone 16 and iPhone 16 Pro lineups, and built on a second generation 3 nm process by TSMC. Announced on September 9, 2024, they are the successors to the Apple A16 Bionic and the Apple A17 Pro processors, respectively.

References

  1. Butts, Jeff (2023-02-16). "What Is the Apple Neural Engine and What Does It Do?". The Mac Observer. Retrieved 2023-12-26.
  2. "Apple unleashes M1". Apple Newsroom (Press release). Retrieved 2023-12-26.
  3. "Introducing M1 Pro and M1 Max: the most powerful chips Apple has ever built". Apple Newsroom (Press release). Retrieved 2023-12-26.
  4. "Apple unveils M2 with breakthrough performance and capabilities". Apple Newsroom (Press release). Retrieved 2023-12-26.
  5. "Apple unveils M2 Pro and M2 Max: next-generation chips for next-level workflows". Apple Newsroom (Press release). Retrieved 2023-12-26.
  6. "Apple unveils M3, M3 Pro, and M3 Max, the most advanced chips for a personal computer". Apple Newsroom (Press release). Retrieved 2023-12-26.
  7. "Apple introduces M4 chip". Apple Newsroom (Press release). Retrieved 7 May 2024.
  8. Andrew Cunningham (7 May 2024). "Apple announces M4 with more CPU cores and AI focus, just months after M3". ArsTechnica. Retrieved 8 May 2024. Apple says the M4 runs up to 38 trillion operations per second (TOPS) […] The M3's Neural Engine is only capable of 18 TOPS
  9. "Neural Engine AI Basics". AI Online Course. Retrieved 26 December 2023.