Nvidia Jetson

Last updated

Nvidia Jetson is a series of embedded computing boards from Nvidia. The Jetson TK1, TX1 and TX2 models all carry a Tegra processor (or SoC) from Nvidia that integrates an ARM architecture central processing unit (CPU). Jetson is a low-power system and is designed for accelerating machine learning applications.

Contents

Hardware

Nvidia Jetson TK1 Nvidia Jetson TK1 - Full Board (14672953894).png
Nvidia Jetson TK1

The Jetson family includes the following boards:

An Nvidia Jetson Nano developer kit NVIDIA Jetson Nano Developer Kit (47616885631).jpg
An Nvidia Jetson Nano developer kit
An Nvidia Jetson Orin developer kit NVidia Jetson Orin AGX.png
An Nvidia Jetson Orin developer kit

Performance

The published performance modes of the Nvidia Jetson TX2 are as follows.

ModeMax Clocks (Denver 2 + A57)Max-P (Denver 2 + A57)Max-P (only Denver 2)Max-P (only A57)Max-Q (only A57)
GPU Clock (MHz)13021122854
Denver 2 Clock (MHz)200014002000stoppedstopped
Cortex-A57 (MHz)2000+1400stopped20001200
TDP / Wmight vary1515157.5

Jetson TX2 also has 5 power modes, numbered 0 through 4 as published by NVIDIA. [15] The default mode is mode 3 (MAX-P).

Jetson TX2 clock configuration with power modes
PropertyMAX-N

(Mode 0)

MAX-Q

(Mode 1)

MAX-P

(Mode 2)

MAX-P*

(Mode 3)

MAX-P

(Mode 4)

Power budgetN/A7.5W15W15W15W
Online A57 CPU44441
Online D15 CPU20201
A57 CPU max freq (MHz)2000120014002000345
D15 CPU max freq (MHz)2000N/A1400N/A2000
GPU max freq (MHz)1300850112211221122
Memory max freq (MHz)18661331160016001600

The published operation modes of the Nvidia Jetson Nano are:

Mode01
GPU Clock (MHz)921640
Cortex-A57 (MHz)4x 14282x 918
2x stopped
TDP / W105

Versions

There are various versions of the Jetson board available. Some of them are:

YearVersionPerformanceGPUCPUMemoryPower
2017Jetson TX2 [16] 1.33 TFLOPS256-core Nvidia Pascal architecture GPUDual-core Nvidia Denver 2 64-bit CPU and quad-core ARM Cortex-A57 MPCore processor8 GiB7.5–15 W
2020Jetson Xavier NX21 TOPS384-core Nvidia Volta architecture GPU with 48 Tensor cores6-core Nvidia Carmel ARMv8.2 64-bit CPU 6MB L2 + 4MB L38 GiB10–20W
2018Jetson Xavier AGX [17] 32 TOPS512-core Nvidia Volta architecture GPU with 64 Tensor cores8-core NVIDIA Carmel ARMv8.2 64-bit CPU 8MB L2 + 4MB L332-64 GiB10W - 30W
2019Jetson Nano472 GFLOPS128-core Nvidia Maxwell architecture GPUQuad-core ARM Cortex-A57 MPCore processor4 GiB5–10 W
2023Jetson Orin Nano [18] 20–40 TOPSfrom 512-core Nvidia Ampere architecture GPU with 16 Tensor cores6-core ARM Cortex-A78AE v8.2 64-bit CPU 1.5MB L2 + 4MB L34-8 GiB7–10 W
2023Jetson Orin NX70–100 TOPS1024-core Nvidia Ampere architecture GPU with 32 Tensor coresup to 8-core ARM Cortex-A78AE v8.2 64-bit CPU 2MB L2 + 4MB L38–16 GiB10–25 W
2023Jetson Orin AGX200-275 TOPSup to 2048-core Nvidia Ampere architecture GPU with 64 Tensor coresup to 12-core ARM Cortex-A78AE v8.2 64-bit CPU 3MB L2 + 6MB L332–64 GiB15–60 W

Software

Various operating systems and software might be able to run on the Jetson board series.

Linux

JetPack is a software development kit (SDK) from Nvidia for their Jetson board series. It includes the Linux for Tegra (L4T) operating system and other tools. The official Nvidia download page bears an entry for JetPack 3.2 (uploaded there on 2018-03-08) that states:

JetPack 3.2 adds support for the Linux for Tegra r28.2 image for the Jetson OS. It is packaged with newer versions of Tegra System Profiler, TensorRT, and cuDNN from the last release. [19]

RedHawk Linux is a high-performance RTOS available for the Jetson platform, along with associated NightStar real-time development tools, CUDA/GPU enhancements, and a framework for hardware-in-the-loop and man-in-the-loop simulations. [20]

QNX

The QNX operating system also available for the Jetson platform, though it is not widely announced. There are success reports of installing and running specific QNX packages on certain Nvidia Jetson board variants. Namely the package qnx-V3Q-23.16.01 that is seemingly in parts based on Nvidia's Vibrante Linux distribution is reported to run on the Jetson TK1 Pro board. [21]

See also

Related Research Articles

<span class="mw-page-title-main">Free and open-source graphics device driver</span> Software that controls computer-graphics hardware

A free and open-source graphics device driver is a software stack which controls computer-graphics hardware and supports graphics-rendering application programming interfaces (APIs) and is released under a free and open-source software license. Graphics device drivers are written for specific hardware to work within a specific operating system kernel and to support a range of APIs used by applications to access the graphics hardware. They may also control output to the display if the display driver is part of the graphics hardware. Most free and open-source graphics device drivers are developed by the Mesa project. The driver is made up of a compiler, a rendering API, and software which manages access to the graphics hardware.

<span class="mw-page-title-main">CUDA</span> Parallel computing platform and programming model

CUDA is a proprietary and closed-source parallel computing platform and application programming interface (API) that allows software to use certain types of graphics processing units (GPUs) for general-purpose processing, an approach called general-purpose computing on GPUs (GPGPU). CUDA is a software layer that gives direct access to the GPU's virtual instruction set and parallel computational elements for the execution of compute kernels.

nouveau (software) Open source software driver for Nvidia GPU

nouveau is a free and open-source graphics device driver for Nvidia video cards and the Tegra family of SoCs written by independent software engineers, with minor help from Nvidia employees.

<span class="mw-page-title-main">Tegra</span> System on a chip by Nvidia

Tegra is a system on a chip (SoC) series developed by Nvidia for mobile devices such as smartphones, personal digital assistants, and mobile Internet devices. The Tegra integrates an ARM architecture central processing unit (CPU), graphics processing unit (GPU), northbridge, southbridge, and memory controller onto one package. Early Tegra SoCs are designed as efficient multimedia processors. The Tegra-line evolved to emphasize performance for gaming and machine learning applications without sacrificing power efficiency, before taking a drastic shift in direction towards platforms that provide vehicular automation with the applied "Nvidia Drive" brand name on reference boards and its semiconductors; and with the "Nvidia Jetson" brand name for boards adequate for AI applications within e.g. robots or drones, and for various smart high level automation purposes.

Nvidia Ion was a product line of Nvidia Corporation intended for motherboards of low-cost portable computers. It used graphics processing units and chipsets intended for small products.

Orin is a masculine given name, sometimes spelled Orrin.

The Adam Tablet is a tablet computer designed by Bangalore-based firm Notion Ink Design Labs. The worldwide launch occurred on December 18, 2010 via a video released by Notion Ink detailing their Eden Interface. On December 9 a limited number of devices were released for pre-order globally, followed by a larger pre-order starting January 9, 2011 and an open subscription pre-order from 11 January 2011. The Adam runs a customized version of Android 2.2 Froyo, and has released beta versions of Android 3.0 Honeycomb and Android 4.0 Ice Cream Sandwich The beta versions released were largely done through the efforts of volunteer developers. The Adam is set to be the first Android device marketed to contain Pixel Qi's low-power, dual-mode display. The device is one of several tablet form-factor devices to include a dual-core Nvidia Tegra 2 processor that can support 1080p video output mirroring.

<span class="mw-page-title-main">ARM Cortex-A15</span> Family of microprocessor cores with ARM microarchitecture

The ARM Cortex-A15 MPCore is a 32-bit processor core licensed by ARM Holdings implementing the ARMv7-A architecture. It is a multicore processor with out-of-order superscalar pipeline running at up to 2.5 GHz.

<span class="mw-page-title-main">POWER8</span> 2014 family of multi-core microprocessors by IBM

POWER8 is a family of superscalar multi-core microprocessors based on the Power ISA, announced in August 2013 at the Hot Chips conference. The designs are available for licensing under the OpenPOWER Foundation, which is the first time for such availability of IBM's highest-end processors.

<span class="mw-page-title-main">Motorola Atrix 4G</span> Android smartphone developed by Motorola Mobility

The Motorola Atrix 4G is an Android-based smartphone developed by Motorola, introduced at CES 2011 along with the Motorola Xoom, Motorola Droid Bionic, and Motorola Cliq 2 on January 5, 2011. It was made available in the first quarter of 2011.

Project Denver is the codename of a central processing unit designed by Nvidia that implements the ARMv8-A 64/32-bit instruction sets using a combination of simple hardware decoder and software-based binary translation where "Denver's binary translation layer runs in software, at a lower level than the operating system, and stores commonly accessed, already optimized code sequences in a 128 MB cache stored in main memory". Denver is a very wide in-order superscalar pipeline. Its design makes it suitable for integration with other SIPs cores into one die constituting a system on a chip (SoC).

The Samsung Galaxy R (Royal) (GT-I9103) is an Android smartphone that was announced by Samsung on August 10, 2011 as a variant to the Samsung Galaxy S II.

<span class="mw-page-title-main">POWER9</span> 2017 family of multi-core microprocessors by IBM

POWER9 is a family of superscalar, multithreading, multi-core microprocessors produced by IBM, based on the Power ISA. It was announced in August 2016. The POWER9-based processors are being manufactured using a 14 nm FinFET process, in 12- and 24-core versions, for scale out and scale up applications, and possibly other variations, since the POWER9 architecture is open for licensing and modification by the OpenPOWER Foundation members.

<span class="mw-page-title-main">Nvidia Tesla</span> Nvidias line of general purpose GPUs

Nvidia Tesla was the name of Nvidia's line of products targeted at stream processing or general-purpose graphics processing units (GPGPU), named after pioneering electrical engineer Nikola Tesla. Its products began using GPUs from the G80 series, and have continued to accompany the release of new chips. They are programmable using the CUDA or OpenCL APIs.

<span class="mw-page-title-main">NVLink</span> High speed chip interconnect

NVLink is a wire-based serial multi-lane near-range communications link developed by Nvidia. Unlike PCI Express, a device can consist of multiple NVLinks, and devices use mesh networking to communicate instead of a central hub. The protocol was first announced in March 2014 and uses a proprietary high-speed signaling interconnect (NVHS).

Nvidia Drive is a computer platform by Nvidia, aimed at providing autonomous car and driver assistance functionality powered by deep learning. The platform was introduced at the Consumer Electronics Show (CES) in Las Vegas in January 2015. An enhanced version, the Drive PX 2 was introduced at CES a year later, in January 2016.

Vibrante is the name of a Linux distribution created by Nvidia and used for at least their Drive PX 2 platform series. The name is listed as a registered trademark of Nvidia. First appearances of the name were seen in about the year 2010 when it labeled some rather universal multimedia engine including audio, video and 3D building display that was in tight cooperation with Audi company. At NVidia TechDay in December 2015 the distribution was reported with version numbers 3.0 for Jetson TK1 Pro and Drive CX, and with version 4.0 for Drive CX and PX platforms. Jetson TK1 is mentioned as running with the Linux4Tegra package instead. Companies like Toradex have built and published e.g. sample application codes on top of it. Abbreviations of Vibrante Linux like V3L, V3Le or V4L with the number representing the version plus terms like L4T and assigned to certain devices can be found in some history and release docs, e.g. for Nvidia VisionWorks. On top of Vibrante it is possible to run Nvidias VisionWorks Toolkit. Vibrante is one of the targets that OpenCV4Tegra can run upon. Further there is the Nvidia PerfKit Package that copes with Vibrante.

<span class="mw-page-title-main">GameFace Labs</span> American software and hardware company

GameFace Labs is an American technology company that develops hardware and software for the consumer virtual reality market, and was founded in 2013 by Edward Mason. The company's headquarters are in San Francisco, with international offices in London, United Kingdom.

The NVIDIA Deep Learning Accelerator (NVDLA) is an open-source hardware neural network AI accelerator created by Nvidia. The accelerator is written in Verilog and is configurable and scalable to meet many different architecture needs. NVDLA is merely an accelerator and any process must be scheduled and arbitered by an outside entity such as a CPU.

Ampere is the codename for a graphics processing unit (GPU) microarchitecture developed by Nvidia as the successor to both the Volta and Turing architectures. It was officially announced on May 14, 2020 and is named after French mathematician and physicist André-Marie Ampère.

References

  1. Michael Larabel (29 April 2014). "NVIDIA's Tegra TK1 Jetson Board Is Now Shipping". Phoronix.
  2. "Embedded Systems Development Solutions from NVIDIA Jetson". NVIDIA. 2015-03-18. Retrieved 2016-07-10.
  3. NVIDIA Rolls Out Tegra X2 GPU Support In Nouveau by Michael Larabel at phoronix.com on March 29, 2017
  4. NVIDIA Announces Jetson TX2: Parker Comes To NVIDIA’s Embedded System Kit, March 7, 2017
  5. "NVIDIA Jetson TX2i Module for Industrial Environments". NVIDIA Developer Forums. March 9, 2018.
  6. "Jetson AGX Xavier Developer Kit". NVIDIA Developer. July 9, 2018.
  7. "NVIDIA Jetson Nano For Edge AI Applications and Education". NVIDIA.
  8. "Nvidia Jetson Nano – $99 of CUDA X Awesomeness". March 18, 2019.
  9. "Hands-On: New Nvidia Jetson Nano Is More Power In A Smaller Form Factor". March 18, 2019.
  10. NVIDIA Introduces $99 Jetson Nano Developer Kit by Jean-Luc Aufranc on March 19, 2019 on CNXSoft
  11. Links to Jetson Nano Resources & Wiki
  12. Nvidia Jetson Developer Kit User Guide
  13. "Solving Entry-Level Edge AI Challenges with NVIDIA Jetson Orin Nano". NVIDIA Technical Blog. 2022-09-21. Retrieved 2022-10-27.
  14. Robinson, Cliff (2022-09-22). "NVIDIA Jetson Orin Nano Launched Cheaper Arm and Ampere". ServeTheHome. Retrieved 2022-10-27.
  15. "Tegra Linux Driver (See under "NVPModel Clock Configuration for Jetson TX2 and TX2 4GB")". docs.nvidia.com. Retrieved 2021-07-25.
  16. NVIDIA (18 April 2023). "Jetson TX2 Module". Nvidia.
  17. NVIDIA (18 April 2023). "Jetson AGX Xavier Series". Nvidia.
  18. NVIDIA (27 March 2023). "Jetson Orin Modules and Developer Kits". Nvidia.
  19. "Jetson Download Center". NVIDIA Developer. November 3, 2015.
  20. "Concurrent products for the NVIDIA Jetson". Concurrent Real-Time Linux RTOS Solutions.
  21. "Running QNX onto Jetson TK1 Pro (1860)". NVIDIA Developer Forums. June 6, 2016.