Nvidia Jetson

Last updated

Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor (or SoC) from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.

Contents

Hardware

Nvidia Jetson TK1 Nvidia Jetson TK1 - Full Board (14672953894).png
Nvidia Jetson TK1

The Jetson family includes the following boards:

An Nvidia Jetson Nano developer kit NVIDIA Jetson Nano Developer Kit (47616885631).jpg
An Nvidia Jetson Nano developer kit
An Nvidia Jetson Orin developer kit NVidia Jetson Orin AGX.png
An Nvidia Jetson Orin developer kit


Performance

There are various versions of the Jetson board available.

YearNamePerformanceGPUDLACPUMemoryPower
2014Jetson TK10.327 Dense FP32 Total TFLOPS [17] 192-core Nvidia Kepler architecture GPUQuad-core ARM Cortex-A15 processor2 GiB10 W
2015Jetson TX11.024 Dense FP16 TFLOPS [18] 256-core Nvidia Maxwell architecture GPUQuad-core ARM Cortex-A57 MPCore processor4 GiB10 W
2017Jetson TX2 [19] 1.333 Dense FP16 TFLOPS256-core Nvidia Pascal architecture GPUDual-core Nvidia Denver 2 64-bit CPU and quad-core ARM Cortex-A57 MPCore processor8 GiB7.5–15 W
2018Jetson AGX Xavier [20] 30-32 Dense INT8 Total TOPS512-core Nvidia Volta architecture GPU with 64 Tensor cores28-core NVIDIA Carmel ARMv8.2 64-bit CPU 8MB L2 + 4MB L332–64 GiB10-40 W
2019Jetson Nano0.472 Dense FP16 TFLOPS128-core Nvidia Maxwell architecture GPUQuad-core ARM Cortex-A57 MPCore processor4 GiB5–10 W
2020Jetson Xavier NX21 Dense INT8 Total TOPS384-core Nvidia Volta architecture GPU with 48 Tensor cores26-core Nvidia Carmel ARMv8.2 64-bit CPU 6MB L2 + 4MB L38 GiB10–20 W
2023Jetson Orin Nano [21] 34–67 Sparse INT8 TOPSup to 1024-core Nvidia Ampere architecture GPU with 32 Tensor cores6-core ARM Cortex-A78AE v8.2 64-bit CPU 1.5MB L2 + 4MB L34–8 GiB7–25 W
2023Jetson Orin NX117–157 Sparse INT8 Total TOPS1024-core Nvidia Ampere architecture GPU with 32 Tensor cores1-2up to 8-core ARM Cortex-A78AE v8.2 64-bit CPU 2MB L2 + 4MB L38–16 GiB10–40 W
2023Jetson AGX Orin200-275 Sparse INT8 Total TOPSup to 2048-core Nvidia Ampere architecture GPU with 64 Tensor cores2up to 12-core ARM Cortex-A78AE v8.2 64-bit CPU 3MB L2 + 6MB L332–64 GiB15–60 W

Maxwell architecture

The published operation modes of the Nvidia Jetson Nano are:

Mode01
GPU clock (MHz)921640
Cortex-A57 (MHz)4x 14282x 918
2x stopped
TDP (W)105

Pascal architecture

Jetson TX2 Series Comparison Table [22]
Product NameGPU Performance
Dense Tensor
FP16 TFLOPS
Memory
GB
Storage
GB
Power
W
Jetson TX2 NX1.334167.5, 15
Jetson TX2 4GB1.334167.5, 15
Jetson TX2i1.2683210, 20
Jetson TX21.338327.5, 15

The published performance modes of the Nvidia Jetson TX2 are as follows.

ModeMax Clocks
(Denver 2 + A57)
Max-P
(Denver 2 + A57)
Max-P
(only Denver 2)
Max-P
(only A57)
Max-Q
(only A57)
GPU clock (MHz)13021122854
Denver 2 clock (MHz)200014002000stoppedstopped
Cortex-A57 (MHz)2000+1400stopped20001200
TDP (W)might vary1515157.5

Jetson TX2 also has 5 power modes, numbered 0 through 4 as published by NVIDIA. [23] The default mode is mode 3 (MAX-P).

Jetson TX2 clock configuration with power modes
PropertyMAX-N
(Mode 0)
MAX-Q
(Mode 1)
MAX-P
(Mode 2)
MAX-P*
(Mode 3)
MAX-P
(Mode 4)
Power budgetN/A7.5W15W15W15W
Online A57 CPU44441
Online D15 CPU20201
A57 CPU max freq (MHz)2000120014002000345
D15 CPU max freq (MHz)2000N/A1400N/A2000
GPU max freq (MHz)1300850112211221122
Memory max freq (MHz)18661331160016001600

Volta architecture

Jetson Xavier Series Comparison Table [24]
Product NameGPU Performance
Dense Tensor
INT8 TOPS
DLA Performance
Dense Tensor
INT8 TOPS
Memory
GB
Storage
GB
Power
W
Jetson Xavier NX13881610, 15, 20
Jetson Xavier NX 16GB138161610, 15, 20
Jetson AGX Xavier2210323210, 15, 30
Jetson AGX Xavier Industrial2010323220, 40
Jetson AGX Xavier 64GB2210646410, 15, 30

Ampere architecture

Jetson Orin Series Comparison Table [25]
Product NameGPU Performance
Dense Tensor
INT8 TOPS
DLA Performance
Dense Tensor
INT8 TOPS
Memory
GB
Storage
GB
Power
W
Jetson Orin Nano 4GB1747, 10, 25
Jetson Orin Nano 8GB3387, 15, 25
Jetson Orin NX 8GB3820810, 15, 25, 40
Jetson Orin NX 16GB38401610, 15, 25, 40
Jetson AGX Orin 32GB5446326415, 40
Jetson AGX Orin Industrial7846646415, 75
Jetson AGX Orin 64GB8552.5646415, 60

Software

Various operating systems and software might be able to run on the Jetson board series.

Linux

JetPack is a software development kit (SDK) from Nvidia for their Jetson board series. It includes the Linux for Tegra (L4T) operating system and other tools. The official Nvidia download page bears an entry for JetPack 3.2 (uploaded there on 2018-03-08) that states:

JetPack 3.2 adds support for the Linux for Tegra r28.2 image for the Jetson OS. It is packaged with newer versions of Tegra System Profiler, TensorRT, and cuDNN from the last release. [26]

RedHawk Linux is a high-performance RTOS available for the Jetson platform, along with associated NightStar real-time development tools, CUDA/GPU enhancements, and a framework for hardware-in-the-loop and man-in-the-loop simulations. [27]

QNX

The QNX operating system also available for the Jetson platform, though it is not widely announced. There are success reports of installing and running specific QNX packages on certain Nvidia Jetson board variants. Namely the package qnx-V3Q-23.16.01 that is seemingly in parts based on Nvidia's Vibrante Linux distribution is reported to run on the Jetson TK1 Pro board. [28]

See also

References

  1. Michael Larabel (29 April 2014). "NVIDIA's Tegra TK1 Jetson Board Is Now Shipping". Phoronix.
  2. "Embedded Systems Development Solutions from NVIDIA Jetson". NVIDIA. 2015-03-18. Retrieved 2016-07-10.
  3. NVIDIA Rolls Out Tegra X2 GPU Support In Nouveau by Michael Larabel at phoronix.com on March 29, 2017
  4. Alarcon, Nefi. "Inception Spotlight: New Skydio 2 Drone Powered by NVIDIA Jetson". NVIDIA Technical Blog. NVIDIA Technical Blog. Retrieved 6 January 2025.
  5. NVIDIA Announces Jetson TX2: Parker Comes To NVIDIA’s Embedded System Kit, March 7, 2017
  6. "NVIDIA Jetson TX2i Module for Industrial Environments". NVIDIA Developer Forums. March 9, 2018.
  7. "Jetson AGX Xavier Developer Kit". NVIDIA Developer. July 9, 2018.
  8. "NVIDIA Jetson Nano For Edge AI Applications and Education". NVIDIA.
  9. "Nvidia Jetson Nano – $99 of CUDA X Awesomeness". March 18, 2019.
  10. "Hands-On: New Nvidia Jetson Nano Is More Power In A Smaller Form Factor". March 18, 2019.
  11. NVIDIA Introduces $99 Jetson Nano Developer Kit by Jean-Luc Aufranc on March 19, 2019 on CNXSoft
  12. Links to Jetson Nano Resources & Wiki
  13. Nvidia Jetson Developer Kit User Guide
  14. "Solving Entry-Level Edge AI Challenges with NVIDIA Jetson Orin Nano". NVIDIA Technical Blog. 2022-09-21. Retrieved 2022-10-27.
  15. Robinson, Cliff (2022-09-22). "NVIDIA Jetson Orin Nano Launched Cheaper Arm and Ampere". ServeTheHome. Retrieved 2022-10-27.
  16. "NVIDIA Unveils Its Most Affordable Generative AI Supercomputer". 2024-12-19. Retrieved 2024-12-19.
  17. "Low-Power Sensing and Autonomy With NVIDIA Jetson TK1 | Parallel Forall | NVIDIA Technical Blog". NVIDIA Technical Blog. Retrieved 23 February 2025.
  18. "NVIDIA Jetson TX1 Supercomputer-on-Module Drives Next Wave of Autonomous Machines | NVIDIA Technical Blog". NVIDIA Technical Blog. Retrieved 23 February 2025.
  19. NVIDIA (18 April 2023). "Jetson TX2 Module". Nvidia.
  20. NVIDIA (18 April 2023). "Jetson AGX Xavier Series". Nvidia.
  21. NVIDIA (27 March 2023). "Jetson Orin Modules and Developer Kits". Nvidia.
  22. "NVIDIA Jetson TX2: High Performance AI at the Edge". NVIDIA. Retrieved 24 February 2025.
  23. "Tegra Linux Driver (See under "NVPModel Clock Configuration for Jetson TX2 and TX2 4GB")". docs.nvidia.com. Retrieved 2021-07-25.
  24. "NVIDIA Jetson Xavier Series". NVIDIA. Retrieved 23 February 2025.
  25. "NVIDIA Jetson AGX Orin". NVIDIA. Retrieved 23 February 2025.
  26. "Jetson Download Center". NVIDIA Developer. November 3, 2015.
  27. "Concurrent products for the NVIDIA Jetson". Concurrent Real-Time Linux RTOS Solutions.
  28. "Running QNX onto Jetson TK1 Pro (1860)". NVIDIA Developer Forums. June 6, 2016.