Tegra is a system on a chip (SoC) series developed by Nvidia for mobile devices such as smartphones, personal digital assistants, and mobile Internet devices. The Tegra integrates an ARM architecture central processing unit (CPU), graphics processing unit (GPU), northbridge, southbridge, and memory controller onto one package. Early Tegra SoCs are designed as efficient multimedia processors. The Tegra-line evolved to emphasize performance for gaming and machine learning applications without sacrificing power efficiency, before taking a drastic shift in direction towards platforms that provide vehicular automation with the applied " Nvidia Drive " brand name on reference boards and its semiconductors; and with the " Nvidia Jetson " brand name for boards adequate for AI applications within e.g. robots or drones, and for various smart high level automation purposes.
The Tegra APX 2500 was announced on February 12, 2008. The Tegra 6xx product line was revealed on June 2, 2008, [1] and the APX 2600 was announced in February 2009. The APX chips were designed for smartphones, while the Tegra 600 and 650 chips were intended for smartbooks and mobile Internet devices (MID). [2]
The first product to use the Tegra was Microsoft's Zune HD media player in September 2009, followed by the Samsung M1. [3] Microsoft's Kin was the first cellular phone to use the Tegra; [4] however, the phone did not have an app store, so the Tegra's power did not provide much advantage. In September 2008, Nvidia and Opera Software announced that they would produce a version of the Opera 9.5 browser optimized for the Tegra on Windows Mobile and Windows CE. [5] [6] At Mobile World Congress 2009, Nvidia introduced its port of Google's Android to the Tegra.
On January 7, 2010, Nvidia officially announced and demonstrated its next generation Tegra system-on-a-chip, the Nvidia Tegra 250, at Consumer Electronics Show 2010. [7] Nvidia primarily supports Android on Tegra 2, but booting other ARM-supporting operating systems is possible on devices where the bootloader is accessible. Tegra 2 support for the Ubuntu Linux distribution was also announced on the Nvidia developer forum. [8]
Nvidia announced the first quad-core SoC at the February 2011 Mobile World Congress event in Barcelona. Though the chip was codenamed Kal-El, it is now branded as Tegra 3. Early benchmark results show impressive gains over Tegra 2, [9] [10] and the chip was used in many of the tablets released in the second half of 2011.
In January 2012, Nvidia announced that Audi had selected the Tegra 3 processor for its In-Vehicle Infotainment systems and digital instruments display. [11] The processor will be integrated into Audi's entire line of vehicles worldwide, beginning in 2013. The process is ISO 26262-certified. [12]
In summer of 2012 Tesla Motors began shipping the Model S all electric, high performance sedan, which contains two NVIDIA Tegra 3D Visual Computing Modules (VCM). One VCM powers the 17-inch touchscreen infotainment system, and one drives the 12.3-inch all digital instrument cluster." [13]
In March 2015, Nvidia announced the Tegra X1, the first SoC to have a graphics performance of 1 teraflop. At the announcement event, Nvidia showed off Epic Games' Unreal Engine 4 "Elemental" demo, running on a Tegra X1.
On October 20, 2016, Nvidia announced that the Nintendo Switch hybrid video game console will be powered by Tegra hardware. [14] On March 15, 2017, TechInsights revealed the Nintendo Switch is powered by a custom Tegra X1 (model T210), with lower clockspeeds. [15]
The second generation Tegra SoC has a dual-core ARM Cortex-A9 CPU, an ultra low power (ULP) GeForce GPU, [17] a 32-bit memory controller with either LPDDR2-600 or DDR2-667 memory, a 32 KB/32 KB L1 cache per core and a shared 1 MB L2 cache. [18] Tegra 2's Cortex A9 implementation does not include ARM's SIMD extension, NEON. There is a version of the Tegra 2 SoC supporting 3D displays; this SoC uses a higher clocked CPU and GPU.
The Tegra 2 video decoder is largely unchanged from the original Tegra and has limited support for HD formats. [19] The lack of support for high-profile H.264 is particularly troublesome when using online video streaming services.
Common features:
Model number | CPU | GPU | Memory | Adoption | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Micro- architecture | Core configuration1 | Frequency | Type | Amount | Bus width | Band- width | Availability | |
AP20H (Ventana/Unknown) | Cortex-A9 | 2 | 1.0 GHz | VLIW-based VEC4 units [20] | 4:4:4:4 [21] | 300 MHz | LPDDR2 300 MHz DDR2 333 MHz | ? | 32 bit single-channel | 2.4 GB/s 2.7 GB/s | Q1 2010 |
T20 (Harmony/Ventana) | 333 MHz | ||||||||||
AP25 | 1.2 GHz | 400 MHz | Q1 2011 | ||||||||
T25 |
1 Pixel shaders : Vertex shaders : Texture mapping units : Render output units
Model | Devices |
---|---|
AP20H | Motorola Atrix 4G, Motorola Droid X2, Motorola Photon, LG Optimus 2X / LG Optimus Dual P990 / Optimus 2x SU660 (?), Samsung Galaxy R, Samsung Captivate Glide, T-Mobile G2X P999, Acer Iconia Tab A200 and A500, LG Optimus Pad, Motorola Xoom, [22] Sony Tablet S, Dell Streak Pro, [23] Toshiba Thrive [24] tablet, T-Mobile G-Slate |
AP25 | Fusion Garage Grid 10[ citation needed ] |
T20 | Avionic Design Tamonten Processor Board, [25] Notion Ink Adam tablet, Olivetti OliPad 100, ViewSonic G Tablet, ASUS Eee Pad Transformer, Samsung Galaxy Tab 10.1, Toshiba AC100, CompuLab Trim-Slice nettop, Velocity Micro Cruz Tablet L510, Acer Iconia Tab A100 |
Unknown | Tesla Motors Model S 2012~2017 and Model X 2015~2017 instrument cluster (IC) [26] [27] |
NVIDIA's Tegra 3 (codenamed "Kal-El") [28] is functionally a SoC with a quad-core ARM Cortex-A9 MPCore CPU, but includes a fifth "companion" core in what Nvidia refers to as a "variable SMP architecture". [29] While all cores are Cortex-A9s, the companion core is manufactured with a low-power silicon process. This core operates transparently to applications and is used to reduce power consumption when processing load is minimal. The main quad-core portion of the CPU powers off in these situations.
Tegra 3 is the first Tegra release to support ARM's SIMD extension, NEON.
The GPU in Tegra 3 is an evolution of the Tegra 2 GPU, with 4 additional pixel shader units and higher clock frequency. It can also output video up to 2560×1600 resolution and supports 1080p MPEG-4 AVC/h.264 40 Mbit/s High-Profile, VC1-AP, and simpler forms of MPEG-4 such as DivX and Xvid. [30]
The Tegra 3 was released on November 9, 2011. [31]
Common features:
Model number | CPU | GPU | Memory | Adoption | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency (multi- / single-core mode) | Micro- architecture | Core configuration1 | Frequency | Type | Amount | Bus width | Band- width | Availability | |
T30L | Cortex-A9 | 4+1 | 1.2 GHz / up to 1.3 GHz | VLIW-based VEC4 units [20] | 8:4:8:8 [32] | 416 MHz | DDR3-1333 | ? | 32 bit single-channel | 5.3 GB/s [33] | Q1 2012 |
T30 | 1.4 GHz / up to 1.5 GHz | 520 MHz | LPDDR2-1066 DDR3-L-1500 | ? | 4.3 GB/s 6.0 GB/s [34] | Q4 2011 | |||||
AP33 | |||||||||||
T33 | 1.6 GHz / up to 1.7 GHz [33] | DDR3-1600 | ? | 6.4 GB/s [33] | Q2 2012 |
1 Pixel shaders : Vertex shaders : Texture mapping units : Render output units
Model | Devices |
---|---|
AP33 | LG Optimus 4X HD, HTC One X, XOLO Play T1000, [35] Coolpad 8735 |
T30 | Asus Eee Pad Transformer Prime (TF201), [36] IdeaTab K2 / LePad K2, [37] Acer Iconia Tab A510, Fuhu Inc. nabi 2 Tablet, [38] Microsoft Surface RT, [39] Lenovo IdeaPad Yoga 11, [40] [41] |
T30I | Tesla Model S 2012~2017 and Model X 2015~2017 media control unit (MCU) [27] [42] |
T30L | Asus Transformer Pad TF300T, Microsoft Surface, Nexus 7 (2012), [43] Sony Xperia Tablet S, Acer Iconia Tab A210, Toshiba AT300 (Excite 10), [44] [ unreliable source? ] BLU Quattro 4.5, [45] Coolpad 9070 |
T33 | Asus Transformer Pad Infinity (TF700T), Fujitsu ARROWS X F-02E, Ouya, HTC One X+ |
The Tegra 4 (codenamed "Wayne") was announced on January 6, 2013, and is a SoC with a quad-core CPU, but includes a fifth low-power Cortex A15 companion core which is invisible to the OS and performs background tasks to save power. This power-saving configuration is referred to as "variable SMP architecture" and operates like the similar configuration in Tegra 3. [46]
The GeForce GPU in Tegra 4 is again an evolution of its predecessors. However, numerous feature additions and efficiency improvements were implemented. The number of processing resources was dramatically increased, and clock rate increased as well. In 3D tests, the Tegra 4 GPU is typically several times faster than that of Tegra 3. [47] Additionally, the Tegra 4 video processor has full support for hardware decoding and encoding of WebM video (up to 1080p 60 Mbit/s @ 60fps). [48]
Along with Tegra 4, Nvidia also introduced i500, an optional software modem based on Nvidia's acquisition of Icera, which can be reprogrammed to support new network standards. It supports category 3 (100 Mbit/s) LTE but will later be updated to Category 4 (150 Mbit/s).
Common features:
Model number | CPU | GPU | Memory | Adoption | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Microarchitecture | Core configuration1 | Frequency | Type | Amount | Bus width | Band- width | Availability | |
T114 [49] [ unreliable source? ] | Cortex-A15 | 4+1 | up to 1.9 GHz | VLIW-based VEC4 units [50] | 72 (48:24:4) [20] [50] | 672 MHz [51] | DDR3L or LPDDR3 | ? | 32 bit dual-channel | up to 14.9 GB/s (1866 MT/s data rate) [52] [53] | Q2 2013 [54] |
1 Pixel shaders : Vertex shaders : Pixel pipelines (pairs 1x TMU and 1x ROP)
Model | Devices |
---|---|
T114 | Nvidia Shield Portable, Tegra Note 7, Microsoft Surface 2, HP Slate 7 Extreme, [55] HP Slate 7 Beats Special Edition, [56] HP Slate 8 Pro, [57] HP SlateBook x2, [58] HP SlateBook 14, [59] HP Slate 21, [60] ZTE N988S, nabi Big Tab, Nuvola NP-1, Project Mojo, Asus Transformer Pad TF701T, Toshiba AT10-LE-A (Excite Pro), Vizio 10" tablet, Wexler.Terra 7, Wexler.Terra 10, Acer TA272HUL AIO, Xiaomi Mi 3 (TD-LTE version), [61] Coolpad 8970L (大观 4), [62] Audi Tablet, [63] Le Pan TC1020 10.1", [64] Matrimax iPLAY 7, [65] Kobo Arc 10HD [66] |
The Tegra 4i (codenamed "Grey") was announced on February 19, 2013. With hardware support for the same audio and video formats, [48] but using Cortex-A9 cores instead of Cortex-A15, the Tegra 4i is a low-power variant of the Tegra 4 and is designed for phones and tablets. Unlike its Tegra 4 counterpart, the Tegra 4i also integrates the Icera i500 LTE/HSPA+ baseband processor onto the same die.
Common features:
Model number | CPU | GPU | Memory | Adoption | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Microarchitecture | Core configuration1 | Frequency | Type | Amount | Bus width | Band- width | Availability | |
T148? [67] | Cortex-A9 "R4" | 4+1 | up to 2.0 GHz | VLIW-based VEC4 units [50] | 60 (48:12:2) [50] | 660 MHz [51] | LPDDR3 | 32 bit single-channel | 6.4–7.5 GB/s (800–933 MHz) [53] | Q1 2014 |
1 Pixel shaders : Vertex shaders : Pixel pipelines (pairs 1x TMU and 1x ROP)
Model | Devices |
---|---|
T148? | Blackphone, LG G2 mini LTE, Wiko Highway 4G, [68] Explay 4Game, [69] Wiko Wax [70] [71] QMobile Noir LT-250 [72] |
Nvidia's Tegra K1 (codenamed "Logan") features ARM Cortex-A15 cores in a 4+1 configuration similar to Tegra 4, or Nvidia's 64-bit Project Denver dual-core processor as well as a Kepler graphics processing unit with support for Direct3D 12, OpenGL ES 3.1, CUDA 6.5, OpenGL 4.4/OpenGL 4.5, and Vulkan. [73] [74] Nvidia claims that it outperforms both the Xbox 360 and the PS3, whilst consuming significantly less power. [75]
Support Adaptive Scalable Texture Compression. [76]
In late April 2014, Nvidia shipped the "Jetson TK1" development board containing a Tegra K1 SoC and running Ubuntu Linux. [77] [ unreliable source? ]
Model number | CPU | GPU | Memory | Adoption | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Micro- architecture | Core configuration1 | Frequency | GFLOPS (FP32) | Type | Amount | Bus width | Band- width | Availability | |
T124 [80] | Cortex-A15 R3 (32-bit) | 4+1 | up to 2.3 GHz [81] | GK20A (Kepler) | 192:8:4 [82] | 756–951 MHz | 290–365 [83] | DDR3L LPDDR3 [82] | max 8 GB with 40-bit address extension2 | 64 bit | 17 GB/s [82] | Q2 2014 |
T132 | Denver (64-bit) | 2 [82] | up to 2.5 GHz [81] | max 8 GB | ? | ? | Q3 2014 |
1 Unified Shaders : Texture mapping units : Render output units
2 ARM Large Physical Page Extension (LPAE) supports 1 TiB (240 bytes). The 8 GiB limitation is part-specific.
Model | Devices |
---|---|
T124 | Jetson TK1 development board, [84] Nvidia Shield Tablet, [85] Acer Chromebook 13, [86] HP Chromebook 14 G3, [87] Xiaomi MiPad, [88] Snail Games OBox, UTStarcom MC8718, Google Project Tango tablet, [89] Apalis TK1 System on Module, [90] Fuze Tomahawk F1, [91] JXD Singularity S192 [92] |
T132 | HTC Nexus 9 [93] [94] |
In December 2015, the web page of wccftech.com published an article stating that Tesla is going to use a Tegra K1 based design derived from the template of the Nvidia Visual Computing Module (VCM) for driving the infotainment systems and providing visual driving aid in the respective vehicle models of that time. [95] This news has, as of now, found no similar successor or other clear confirmation later on in any other place on such a combination of a multimedia with an auto pilot system for these vehicle models.
Released in 2015, Nvidia's Tegra X1 (codenamed "Erista") features two CPU clusters, one with four ARM Cortex-A57 cores and the other with four ARM Cortex-A53 cores, as well as a Maxwell-based graphics processing unit. [96] [97] It supports Adaptive Scalable Texture Compression. [76] Only one cluster of cores can be active at once, with the cluster switch being handled by software on the BPMP-L. Devices utilizing the Tegra X1 have only been seen to utilize the cluster with the more powerful ARM Cortex-A57 cores. The other cluster with four ARM Cortex-A53 cores cannot be accessed without first powering down the Cortex-A57 cores (both clusters must be in the CC6 off state). [98] Nvidia has removed the ARM Cortex-A53 cores from later versions of technical documentation, implying that they have been removed from the die. [99] [100] The Tegra X1 was found to be vulnerable to a Fault Injection (FI) voltage glitching attack, which allowed for arbitrary code execution and homebrew software on the devices it was implemented in. [101]
A revision (codenamed "Mariko") with greater power efficiency, known officially as Tegra X1+ was released in 2019, [102] fixing the Fusée Gelée exploit. It's also known as T214 and T210B01.
Model number | SOC Variant | Process | CPU | GPU | Memory | Adoption | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency1 | Micro- architecture | Core configuration2 | Frequency | GFLOPS (FP32) | GFLOPS (FP16) | Type | Amount3 | Bus width | Band- width4 | Availability | |||
T210 | ODNX02-A2 TM670D-A1 TM670M-A2 TM671D-A2 | TSMC 20 nm | Cortex-A57 + Cortex-A53 [106] : 753 | A57: 4 A53: 4 [106] | A57: 2.2 GHz [107] A53: 1.3 GHz | GM20B (Maxwell) [106] : 14 | 256: [106] 16:16 | 1000 MHz | 512 | 1024 | LPDDR3 / LPDDR4 | 8 GB [106] | 64 bit [106] | 25.6 GB/s | Q2 2015 |
TM660M-A2 | A57: 1.428 GHz A53: ? GHz | 128:16:16 | 921 MHz | 236 | 472 | LPDDR3? / LPDDR4 : 773 | 4 GB | March 2019 | |||||||
T214 / T210b01 | ODNX10-A1 TM675M-A1 | TSMC 16 nm | Cortex-A57 | A57: 4 | A57: 2.1 GHz [108] | GM21B (Maxwell) [109] | 256:16:16 | 1267 MHz [110] | 649 | 1298 | LPDDR4 /LPDDR4X | 8 GB | 34.1 GB/s | Q2 2019 |
1 CPU frequency may be clocked differently than the maximum validated by Nvidia at the OEM's discretion
2 Unified Shaders : Texture mapping units : Render output units
3 Maximum validated amount of memory, implementation is board specific
4 Maximum validated memory bandwidth, implementation is board specific
Model | SOC Variant | Devices |
---|---|---|
T210 | ODNX02-A2 | Nintendo Switch (2017, HAC-001) [111] [15] |
TM670D-A1 | Nvidia Shield Android TV (2015) | |
TM670M-A2 | Nvidia Shield Android TV (2017) | |
TM660M-A2 | Jetson Nano 4 GB, Jetson Nano 2 GB | |
TM671D-A2 | Google Pixel C | |
Unknown | Nvidia Jetson TX1 development board, [112] Nvidia Drive CX & PX | |
T210b01 | ODNX10-A1 | Nintendo Switch (2019, HAC-001(-01)), Nintendo Switch: OLED Model (HEG-001), Nintendo Switch Lite (HDH-001) |
TM675M-A1 | Nvidia Shield Android TV (2019) |
Nvidia's Tegra X2 [113] [114] (codenamed "Parker") features Nvidia's own custom general-purpose ARMv8-compatible core Denver 2 as well as code-named Pascal graphics processing core with GPGPU support. [115] The chips are made using FinFET process technology using TSMC's 16 nm FinFET+ manufacturing process. [116] [117] [118]
Model number | CPU | GPU | Memory | Adoption | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Micro- architecture | Core configuration1 | Frequency | GFLOPS (FP32) | GFLOPS (FP16) | Type | Amount | Bus width | Band- width | Availability | |
T186 | Denver2 + Cortex-A57 | 2 + 4 | Denver2: 1.4–2.0 GHz A57: 1.2–2.0 GHz | GP10B (Pascal) [122] [ unreliable source? ] | 256:16:16 (2) [123] | 854–1465 MHz | 437–750 | 874–1500 | LPDDR4 | 8 GB | 128 bit | 59.7 GB/s |
1 Unified Shaders : Texture mapping units : Render output units (SM count)
Model | Devices |
---|---|
T186 | Nvidia Drive PX2 (variants), ZF ProAI 1.1 [124] |
T186 | Nvidia Jetson TX2 [121] |
Unknown | Mercedes-Benz MBUX (infotainment system) [125] |
Unknown | 1 unit along with 1 GPU semiconductor is part of the ECU for "Tesla vision" functionality in all Tesla vehicles since October 2016 [126] [127] |
T186 | Magic Leap One [128] [129] (mixed environment glasses) |
Unknown | Skydio 2 (drone) [130] |
The Xavier Tegra SoC, named after the comic book character Professor X, was announced on 28 September 2016, and by March 2019, it had been released. [131] It contains 7 billion transistors and 8 custom ARMv8 cores, a Volta GPU with 512 CUDA cores, an open sourced TPU (Tensor Processing Unit) called DLA (Deep Learning Accelerator). [132] [133] It is able to encode and decode 8K Ultra HD (7680×4320). Users can configure operating modes at 10 W, 15 W, and 30 W TDP as needed and the die size is 350 mm2. [134] [135] [136] Nvidia confirmed the fabrication process to be 12 nm FinFET at CES 2018. [137]
Module (Model) | SoC Variant | CPU | GPU | Deep Learning | Memory | Adoption | TDP in watts | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency (GHz) | Micro- architecture | Core configuration1 | Frequency (MHz) | TFLOPS (FP32) | TFLOPS (FP16) | TOPS (INT8) | Type | Amount | Bus width | Band- width | Availability | |||
AGX Xavier 64 GB | Carmel 12 MB cache | 8 | up to 2.2 | Volta | 512:64 (8, 4, 1) | up to 1377 | 1.41 | 2.82 | up to 32 | LPDDR4X | 64 GB | 256-bit | 136.5 GB/s | 10-30 | ||
AGX Xavier 32 GB | Carmel 12 MB cache | 8 | up to 2.2 | Volta | 512:64 (8, 4, 1) | up to 1377 | 1.41 | 2.82 | up to 32 | LPDDR4X | 32 GB | 256-bit | 136.5 GB/s | 10-30 | ||
AGX Xavier Industrial | Carmel 12 MB cache | 8 | up to 2 | Volta | 512:64 (8, 4, 1) | up to 1221 | 1.24 | 2.48 | up to 30 | LPDDR4X | 32 GB | 256-bit | 136.5 GB/s | 20-40 | ||
Xavier NX 16 GB | Carmel 10 MB cache | 6 | up to 1.9 | Volta | 384:48 (6, 3, 1) | up to 1100 | 0.84 | 1.69 | up to 21 | LPDDR4X | 16 GB | 128-bit | 59.7 GB/s | 10-20 | ||
Xavier NX 8 GB | Carmel 10 MB cache | 6 | up to 1.9 | Volta | 384:48 (6, 3, 1) | up to 1100 | 0.84 | 1.69 | up to 21 | LPDDR4X | 8 GB | 128-bit | 59.7 GB/s | 10-20 |
1 CUDA cores : Tensor cores (SMs, TPCs, GPCs)
Model | SOC Variant | Devices |
---|---|---|
T194 | Unknown | Nvidia Drive Xavier (Drive PX-series) [144] (formerly named Xavier AI Car Supercomputer) |
Unknown | Nvidia Drive Pegasus (Drive PX-series) [144] | |
Unknown | Nvidia Drive AGX Xavier Developer Kit [145] | |
Unknown | Nvidia Jetson AGX Xavier Developer Kit [146] | |
Unknown | Nvidia Jetson Xavier [146] | |
TE860M-A2 | Nvidia Jetson Xavier NX [147] | |
Unknown | Nvidia Clara AGX [148] "Clara AGX is based on NVIDIA Xavier and NVIDIA Turing GPUs." [149] [ unreliable source? ] | |
Unknown | Bosch and Nvidia designed Self Driving System [150] | |
Unknown | ZF ProAI [151] [152] |
On the Linux Kernel Mailing List, a Tegra194 based development board with type ID "P2972-0000" got reported: The board consists of the P2888 compute module and the P2822 baseboard. [153]
Nvidia announced the next-gen SoC codename Orin on March 27, 2018, at GPU Technology Conference 2018. [154] It contains 17 billion transistors and 12 ARM Hercules cores and is capable of 200 INT8 TOPs @ 65W. [155]
The Drive AGX Orin board system family was announced on December 18, 2019, at GTC China 2019. Nvidia has sent papers to the press documenting that the known (from Xavier series) clock and voltage scaling on the semiconductors and by pairing multiple such chips a wider range of application can be realized with the thus resulting board concepts. [156] In early 2021, Nvidia announced the Chinese vehicle company NIO will be using an Orin-based chip in their cars. [157]
The so far published specifications for Orin are:
1 Orin uses the double-rate tensor cores in the A100, not the standard tensor cores in consumer Ampere GPUs.
Nvidia announced the latest member of the family, "Orin Nano" in September 2022 at the GPU Technology Conference 2022. [163] The Orin product line now features SoC and SoM(System-On-Module) based on the core Orin design and scaled for different uses from 60W all the way down to 5W. While less is known about the exact SoC's that are being manufactured, Nvidia has publicly shared detailed technical specifications about the entire Jetson Orin SoM product line. These module specifications illustrate how Orin scales providing insight into future devices that contain an Orin derived SoC.
Module (Model) | SoC Variant | CPU | GPU | Deep Learning | Memory | Adoption | TDP in watts | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency (GHz) | Micro- architecture | Core configuration1 | Frequency (MHz) | TFLOPS (FP32) | TFLOPS (FP16) | TOPS (INT8) | Type | Amount | Bus width | Band- width | Availability | |||
AGX Orin 64 GB [164] [165] | Cortex-A78AE 9 MB cache [161] | 12 | up to 2.2 [161] | Ampere | 2048:64:8 (16, 8, 2) [161] | up to 1300 [161] | 5.32 [161] | 10.649 | up to 275 [161] | LPDDR5 | 64 GB | 256-bit | 204.8 GB/s [161] | Sample 2021, Kit Q1 2022, Prod Dec 2022 [166] | 15-60 [161] | |
AGX Orin 32 GB [166] | Cortex-A78AE 6 MB cache [166] | 8 | up to 2.2 [166] | Ampere | 1792:56:7 (14, 7, 2) [166] | up to 930 [166] | 3.365 [161] | 6.73 | up to 200 [166] | LPDDR5 | 32 GB [166] | 256-bit [166] | 204.8 GB/s [166] | Oct 2022 [166] | 15-40 [166] | |
Orin NX 16 GB [167] | TE980-M [168] | Cortex-A78AE 6 MB cache [167] | 8 | up to 2 [167] | Ampere | 1024:32:4 (8, 4, 1) [167] | up to 918 [167] | 1.88 | 3.76 | up to 100 [167] | LPDDR5 | 16 GB [167] | 128-bit [167] | 102.4 GB/s [167] | Dec 2022 [167] | 10-25 [167] |
Orin NX 8 GB [166] | TE980-M [168] | Cortex-A78AE 5.5 MB cache [166] | 6 | up to 2 [166] | Ampere | 1024:32:4 (8, 4, 1) [166] | up to 765 [166] | 1.57 | 3.13 | up to 70 [166] | LPDDR5 | 8 GB [166] | 128-bit [166] | 102.4 GB/s [166] | Jan 2023 [166] | 10-20 [166] |
Orin Nano 8 GB [166] | Cortex-A78AE 5.5 MB cache [166] | 6 | up to 1.5 [166] | Ampere | 1024:32:4 (8, 4, 1) [166] | up to 625 [166] | 1.28 | 2.56 | up to 40 [166] | LPDDR5 | 8 GB [166] | 128-bit [166] | 68 GB/s [166] | Jan 2023 [166] | 7-15 [166] | |
Orin Nano 4 GB [166] | Cortex-A78AE 5.5 MB cache [166] | 6 | up to 1.5 [166] | Ampere | 512:16:2 (4, 2, 1) [166] | up to 625 [166] | 0.64 | 1.28 | up to 20 [166] | LPDDR5 | 4 GB [166] | 64-bit [166] | 34 GB/s [166] | Jan 2023 [166] | 5-10 [166] |
1 CUDA cores : Tensor cores : RT cores (SMs, TPCs, GPCs)
Model | Devices | Comments |
---|---|---|
T234 [169] | Nvidia Jetson AGX Orin [170] [161] | comes in 32 GB and 64 GB RAM configurations, available as standalone module or devkit; intended for industrial robotics and/or embedded HPC applications |
Unknown | Nvidia Jetson Orin NX [167] | mid-power SODIMM-form factor Orin-series module, available only as standalone module; pin-compatible with Xavier NX carrier |
Unknown | Nvidia Jetson Orin Nano [171] | low-power, cost-effective SODIMM-form factor Orin-series module, available as standalone module or devkit; intended for entry-level usage |
Unknown | Nio Adam [172] [173] | built from 4x Nvidia Drive Orin, totals to 48 CPU cores and 8,192 CUDA cores; for use in vehicles ET7 in March 2022 and ET5 in September 2022 |
The Grace CPU is an NVIDIA-developed ARM Neoverse CPU platform, targeted at large-scale AI and HPC applications, available within several NVIDIA products. The NVIDIA OVX platform combines the Grace Superchip (two Grace dies on one board) with desktop NVIDIA GPUs in a server form-factor, while the NVIDIA HGX platform is available with either the Grace Superchip or the Grace Hopper Superchip. [174] The latter is an HPC platform in of itself, combining a Grace CPU with a Hopper-based GPU, announced by NVIDIA on March 22, 2022. [175] Kernel patchsets indicate that a single Grace CPU is also known as T241, placing it under the Tegra SoC branding, despite the chip itself not including a GPU (a referenced T241 patchset cites impact to "NVIDIA server platforms that use more than two T241 chips...interconnected," pointing to the Grace Superchip design). [176]
Model number | CPU | Memory | Adoption | |||||||
---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Cache | TFLOPS (FP64) | Type | Amount | Bus width | Band- width | Availability | |
T241 [177] | Grace | 72 ARM Neoverse V2 Cores (ARMv9) [178] | ? | L1: 64 KB I-cache + 64 KB D-cache per core L2: 1 MB per core L3: 117 MB shared [178] | 3.551 [178] | LPDDR5X ECC [178] | Up to 480 GB1 [178] | ? | 500 GB/s [178] | H2 2023 [179] |
1Figures cut in half from full Grace Superchip specification
Nvidia announced the next-gen SoC codename Atlan on April 12, 2021, at GPU Technology Conference 2021. [180] [181]
Nvidia announced the cancellation of Atlan on September 20, 2022, and their next SoC will be Thor. [182]
Functional units known so far are:
Model number | CPU | GPU | Deep Learning | Memory | Adoption | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Micro- architecture | Core configuration1 | Frequency | GFLOPS (FP32) | GFLOPS (FP16) | TOPS (INT8) | Type | Amount | Bus width | Band- width | Availability | |
T254? | Grace-Next [183] | ? | ? | Ada Lovelace [185] | ? | ? | ? | ? | >1000 [186] | ? | ? | ? | ? | Cancelled [187] |
Nvidia announced the next-gen SoC codename Thor on September 20, 2022, at GPU Technology Conference 2022, replacing the cancelled Atlan. [182] A patchset adding support for Tegra264 to mainline Linux was submitted May 5, 2023, likely indicating initial support for Thor. [188]
Model number | CPU | GPU | Deep Learning | Memory | Adoption | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Processor | Cores | Frequency | Micro- architecture | Core configuration1 | Frequency | GFLOPS (FP32) | GFLOPS (FP16) | TOPS (FP8) | Type | Amount | Bus width | Band- width | Availability | |
T264? | Arm Neoverse V3AE [191] | ? | ? | Blackwell | ? | ? | ? | ? | 2000 [182] | ? | 128 GB | ? | ? | 2025 [182] |
Generation | Tegra 2 | Tegra 3 | Tegra 4 | Tegra 4i | Tegra K1 | Tegra X1 | Tegra X1+ | Tegra X2 | Xavier | Orin | Thor | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
CPU | Instruction set | ARMv7‑A (32‑bit) | ARMv8‑A (64‑bit) | ARMv8.2‑A (64‑bit) | ARMv9.2‑A (64‑bit) | ||||||||
Cores | 2 A9 | 4+1 A9 | 4+1 A15 | 4+1 A9 | 4+1 A15 | 2 Denver | 4 A53 (disabled) + 4 A57 | 2 Denver2 + 4 A57 | 8 Carmel | 12 A78AE | Neoverse V3AE | ||
L1 cache (I/D) | 32/32 KB | 128/64 KB | 32/32 KB + 64/32 KB | 128/64 KB + 48/32 KB | 128/64 KB | 64/64 KB | |||||||
L2 cache | 1 MB | 2 MB | 128 KB + 2 MB | 2 MB + 2 MB | 8 MB | 3 MB | ? | ||||||
L3 cache | N/A | 4 MB | 6 MB | ? | |||||||||
GPU | Architecture | Vec4 | Kepler | Maxwell | Pascal | Volta | Ampere | Blackwell | |||||
CUDA cores | 4+4* | 8+4* | 48+24* | 48+12* | 192 | 256 | 512 | 2048 | ? | ||||
Tensor cores | N/A | 64 | ? | ||||||||||
RT cores | N/A | 8 | ? | ||||||||||
RAM | Protocol | DDR2/LPDDR2 | DDR3/LPDDR2 | DDR3/LPDDR3 | LPDDR3/LPDDR4 | LPDDR4/LPDDR4X | LPDDR5 | ? | |||||
Max. size | 1 GB | 2 GB | 4 GB | 8 GB | 64 GB | 128 GB | |||||||
Bandwidth | 2.7 GB/s | 6.4 GB/s | 7.5 GB/s | 14.88 GB/s | 25.6 GB/s | 34.1 GB/s | 59.7 GB/s | 136.5 GB/s | 204.8 GB/s | ? | |||
Process | 40 nm | 28 nm | 20 nm | 16 nm | 12 nm | 8 nm | 4 nm |
* VLIW-based Vec4: Pixel shaders + Vertex shaders. Since Kepler, Unified shaders are used.
FreeBSD supports a number of different Tegra models and generations, ranging from Tegra K1, [192] to Tegra 210. [193]
Nvidia distributes proprietary device drivers for Tegra through OEMs and as part of its "Linux for Tegra" (formerly "L4T") development kit, also Nvidia provides JetPack SDK with "Linux for Tegra" and other tools with it. The newer and more powerful devices of the Tegra family are now supported by Nvidia's own Vibrante Linux distribution. Vibrante comes with a larger set of Linux tools plus several Nvidia provided libraries for acceleration in the area of data processing and especially image processing for driving safety and automated driving up to the level of deep learning and neuronal networks that make e.g. heavy use of the CUDA capable accelerator blocks, and via OpenCV can make use of the NEON vector extensions of the ARM cores.
As of April 2012 [update] , due to different "business needs" from that of their GeForce line of graphics cards, Nvidia and one of their Embedded Partners, Avionic Design GmbH from Germany, are also working on submitting open-source drivers for Tegra upstream to the mainline Linux kernel. [194] [195] Nvidia co-founder & CEO laid out the Tegra processor roadmap using Ubuntu Unity in GPU Technology Conference 2013. [196] [ unreliable source? ]
By end of 2018 it is evident that Nvidia employees have contributed substantial code parts to make the T186 and T194 models run for HDMI display and audio with the upcoming official Linux kernel 4.21 in about Q1 2019. The affected software modules are the open source Nouveau and the closed source Nvidia graphics drivers along with the Nvidia proprietary CUDA interface. [197] [ unreliable source? ]
As of May, 2022, NVIDIA has open-sourced their GPU kernel modules for both Jetson and desktop platforms, allowing all but proprietary userspace libraries to be open-source on Tegra platforms with official NVIDIA drivers starting with T234 (Orin). [198]
The Drive PX2 board was announced with QNX RTOS support at the April 2016 GPU Technology Conference. [199]
SoCs and platforms with comparable specifications (e.g. audio/video input, output and processing capability, connectivity, programmability, entertainment/embedded/automotive capabilities & certifications, power consumption) are:
OMAP is a family of image/video processors that was developed by Texas Instruments. They are proprietary system on chips (SoCs) for portable and mobile multimedia applications. OMAP devices generally include a general-purpose ARM architecture processor core plus one or more specialized co-processors. Earlier OMAP variants commonly featured a variant of the Texas Instruments TMS320 series digital signal processor.
A free and open-source graphics device driver is a software stack which controls computer-graphics hardware and supports graphics-rendering application programming interfaces (APIs) and is released under a free and open-source software license. Graphics device drivers are written for specific hardware to work within a specific operating system kernel and to support a range of APIs used by applications to access the graphics hardware. They may also control output to the display if the display driver is part of the graphics hardware. Most free and open-source graphics device drivers are developed by the Mesa project. The driver is made up of a compiler, a rendering API, and software which manages access to the graphics hardware.
Adreno is a series of graphics processing unit (GPU) semiconductor intellectual property cores developed by Qualcomm and used in many of their SoCs.
Arm Holdings plc is a British semiconductor and software design company based in Cambridge, England, whose primary business is the design of central processing unit (CPU) cores that implement the ARM architecture family of instruction sets. It also designs other chips, provides software development tools under the DS-5, RealView and Keil brands, and provides systems and platforms, system-on-a-chip (SoC) infrastructure and software. As a "holding" company, it also holds shares of other companies. Since 2016, it has been majority owned by Japanese conglomerate SoftBank Group.
Rockchip is a Chinese fabless semiconductor company based in Fuzhou, Fujian province. It has offices in Shanghai, Beijing, Shenzhen, Hangzhou and Hong Kong. It designs system on a chip (SoC) products, using the ARM architecture licensed from ARM Holdings for the majority of its projects.
The ARM Cortex-A15 MPCore is a 32-bit processor core licensed by ARM Holdings implementing the ARMv7-A architecture. It is a multicore processor with out-of-order superscalar pipeline running at up to 2.5 GHz.
Project Denver is the codename of a central processing unit designed by Nvidia that implements the ARMv8-A 64/32-bit instruction sets using a combination of simple hardware decoder and software-based binary translation where "Denver's binary translation layer runs in software, at a lower level than the operating system, and stores commonly accessed, already optimized code sequences in a 128 MB cache stored in main memory". Denver is a very wide in-order superscalar pipeline. Its design makes it suitable for integration with other SIPs cores into one die constituting a system on a chip (SoC).
Apple silicon is a series of system on a chip (SoC) and system in a package (SiP) processors designed by Apple Inc., mainly using the ARM architecture. They are the basis of Mac, iPhone, iPad, Apple TV, Apple Watch, AirPods, AirTag, HomePod, and Apple Vision Pro devices.
The Samsung Exynos, formerly Hummingbird (Korean: 엑시노스), is a series of ARM-based system-on-chips developed by Samsung Electronics' System LSI division and manufactured by Samsung Foundry. It is a continuation of Samsung's earlier S3C, S5L and S5P line of SoCs.
The Mali and Immortalis series of graphics processing units (GPUs) and multimedia processors are semiconductor intellectual property cores produced by Arm Holdings for licensing in various ASIC designs by Arm partners.
The ARM Cortex-A57 is a central processing unit implementing the ARMv8-A 64-bit instruction set designed by ARM Holdings. The Cortex-A57 is an out-of-order superscalar pipeline. It is available as SIP core to licensees, and its design makes it suitable for integration with other SIP cores into one die constituting a system on a chip (SoC).
NVLink is a wire-based serial multi-lane near-range communications link developed by Nvidia. Unlike PCI Express, a device can consist of multiple NVLinks, and devices use mesh networking to communicate instead of a central hub. The protocol was first announced in March 2014 and uses a proprietary high-speed signaling interconnect (NVHS).
This is a comparison of ARM instruction set architecture application processor cores designed by ARM Holdings and 3rd parties. It does not include ARM Cortex-R, ARM Cortex-M, or legacy ARM cores.
The Nvidia Shield TV is an Android TV-based digital media player produced by Nvidia as part of its Shield brand of Android devices. First released in May 2015, the Shield was initially marketed by Nvidia as a microconsole, emphasizing its ability to play downloaded games and stream games from a compatible PC on a local network, or via the GeForce Now subscription service. As with all other Android TV devices, it can also stream content from various sources using apps, and also supports 4K resolution video. It is produced in two models, with the second Shield TV Pro model distinguished primarily by increased internal storage.
Nvidia Drive is a computer platform by Nvidia, aimed at providing autonomous car and driver assistance functionality powered by deep learning. The platform was introduced at the Consumer Electronics Show (CES) in Las Vegas in January 2015. An enhanced version, the Drive PX 2 was introduced at CES a year later, in January 2016.
Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.
The ARM Cortex-A78 is a central processing unit implementing the ARMv8.2-A 64-bit instruction set designed by ARM Ltd.'s Austin centre.
The ARM Neoverse is a group of 64-bit ARM processor cores licensed by Arm Holdings. The cores are intended for datacenter, edge computing, and high-performance computing use. The group consists of ARM Neoverse V-Series, ARM Neoverse N-Series, and ARM Neoverse E-Series.
{{cite web}}
: CS1 maint: numeric names: authors list (link)