VMware ESXi

Last updated

VMware ESXi
Developer(s) VMware (Broadcom)
Initial releaseMarch 23, 2001;23 years ago (2001-03-23)
Stable release
8.0 Update 2 (Build 22380479) [1] / September 21, 2023;6 months ago (2023-09-21) [2]
Platform IA-32 (x86-32) (discontinued in 4.0 onwards), [3] x86-64, ARM [4]
Type Native hypervisor (type 1)
License Proprietary
Website www.vmware.com/products/esxi-and-esx.html

VMware ESXi (formerly ESX) is an enterprise-class, type-1 hypervisor developed by VMware, a subsidiary of Broadcom, for deploying and serving virtual computers. As a type-1 hypervisor, ESXi is not a software application that is installed on an operating system (OS); instead, it includes and integrates vital OS components, such as a kernel. [5]

Contents

After version 4.1 (released in 2010), VMware renamed ESX to ESXi. ESXi replaces Service Console (a rudimentary operating system) with a more closely integrated OS. ESX/ESXi is the primary component in the VMware Infrastructure software suite. [6]

The name ESX originated as an abbreviation of Elastic Sky X. [7] [8] In September 2004, the replacement for ESX was internally called VMvisor, but later changed to ESXi (as the "i" in ESXi stood for "integrated"). [9] [10]

Architecture

ESX runs on bare metal (without running an operating system) [11] unlike other VMware products. [12] It includes its own kernel. In the historic VMware ESX, a Linux kernel was started first [13] and then used to load a variety of specialized virtualization components, including ESX, which is otherwise known as the vmkernel component. [14] The Linux kernel was the primary virtual machine; it was invoked by the service console. At normal run-time, the vmkernel was running on the bare computer, and the Linux-based service console ran as the first virtual machine. VMware dropped development of ESX at version 4.1, and now uses ESXi, which does not include a Linux kernel at all. [15]

The vmkernel is a microkernel [16] with three interfaces: hardware, guest systems, and the service console (Console OS).

Interface to hardware

The vmkernel handles CPU and memory directly, using scan-before-execution (SBE) to handle special or privileged CPU instructions [17] [18] and the SRAT (system resource allocation table) to track allocated memory. [19]

Access to other hardware (such as network or storage devices) takes place using modules. At least some of the modules derive from modules used in the Linux kernel. To access these modules, an additional module called vmklinux implements the Linux module interface. According to the README file, "This module contains the Linux emulation layer used by the vmkernel." [20]

The vmkernel uses the device drivers: [20]

  1. net/e100
  2. net/e1000
  3. net/e1000e
  4. net/bnx2
  5. net/tg3
  6. net/forcedeth
  7. net/pcnet32
  8. block/cciss
  9. scsi/adp94xx
  10. scsi/aic7xxx
  11. scsi/aic79xx
  12. scsi/ips
  13. scsi/lpfcdd-v732
  14. scsi/megaraid2
  15. scsi/mptscsi_2xx
  16. scsi/qla2200-v7.07
  17. scsi/megaraid_sas
  18. scsi/qla4010
  19. scsi/qla4022
  20. scsi/vmkiscsi
  21. scsi/aacraid_esx30
  22. scsi/lpfcdd-v7xx
  23. scsi/qla2200-v7xx

These drivers mostly equate to those described in VMware's hardware compatibility list. [21] All these modules fall under the GPL. Programmers have adapted them to run with the vmkernel: VMware Inc. has changed the module-loading and some other minor things. [20]

Service console

In ESX (and not ESXi), the Service Console is a vestigial general purpose operating system most significantly used as bootstrap for the VMware kernel, vmkernel, and secondarily used as a management interface. Both of these Console Operating System functions are being deprecated from version 5.0, as VMware migrates exclusively to the ESXi model. [22] The Service Console, for all intents and purposes, is the operating system used to interact with VMware ESX and the virtual machines that run on the server.

Purple Screen of Death

A purple diagnostic screen as seen in VMware ESX Server 3.0 VMware ESX PSOD.png
A purple diagnostic screen as seen in VMware ESX Server 3.0
A purple diagnostic screen from VMware ESXi 4.1 VMware ESXi 4.1 PSOD.jpg
A purple diagnostic screen from VMware ESXi 4.1

In the event of a hardware error, the vmkernel can catch a Machine Check Exception. [23] This results in an error message displayed on a purple diagnostic screen. This is colloquially known as a purple diagnostic screen, or purple screen of death (PSoD, c.f. blue screen of death (BSoD)).

Upon displaying a purple diagnostic screen, the vmkernel writes debug information to the core dump partition. This information, together with the error codes displayed on the purple diagnostic screen can be used by VMware support to determine the cause of the problem.

Versions

VMware ESX used to be available in two main types: ESX and ESXi, but as of version 5, the original ESX has been discontinued in favor of ESXi.

ESX and ESXi before version 5.0 do not support Windows 8/Windows 2012. These Microsoft operating systems can only run on ESXi 5.x or later. [24]

VMware ESXi, a smaller-footprint version of ESX, does not include the ESX Service Console. Before Broadcom acquired VMware, it was available - without the need to purchase a vCenter license - as a free download from VMware, with some features disabled. [25] [26] [27]

ESXi stands for "ESX integrated". [28]

VMware ESXi originated as a compact version of VMware ESX that allowed for a smaller 32 MB disk footprint on the host. With a simple configuration console for mostly network configuration and remote based VMware Infrastructure Client Interface, this allows for more resources to be dedicated to the guest environments.

Two variations of ESXi exist:

The same media can be used to install either of these variations depending on the size of the target media. [29] One can upgrade ESXi to VMware Infrastructure 3 [30] or to VMware vSphere 4.0 ESXi.

Originally named VMware ESX Server ESXi edition, through several revisions the ESXi product finally became VMware ESXi 3. New editions then followed: ESXi 3.5, ESXi 4, ESXi 5 and (as of 2015) ESXi 6.

GPL violation lawsuit

VMware has been sued by Christoph Hellwig, a Linux kernel developer. The lawsuit began on March 5, 2015. It was alleged that VMware had misappropriated portions of the Linux kernel, [31] [32] and, following a dismissal by the court in 2016, Hellwig announced he would file an appeal. [33]

The appeal was decided February 2019 and again dismissed by the German court, on the basis of not meeting "procedural requirements for the burden of proof of the plaintiff". [34]

In the last stage of the lawsuit in March 2019, the Hamburg Higher Regional Court also rejected the claim on procedural grounds. Following this, VMware officially announced that they would remove the code in question. [35] This followed with Hellwig withdrawing his case, and withholding further legal action. [36]

The following products operate in conjunction with ESX:

Cisco Nexus 1000v

Network-connectivity between ESX hosts and the VMs running on it relies on virtual NICs (inside the VM) and virtual switches. The latter exists in two versions: the 'standard' vSwitch allowing several VMs on a single ESX host to share a physical NIC and the 'distributed vSwitch' where the vSwitches on different ESX hosts together form one logical switch. Cisco offers in their Cisco Nexus product-line the Nexus 1000v, an advanced version of the standard distributed vSwitch. A Nexus 1000v consists of two parts: a supervisor module (VSM) and on each ESX host a virtual Ethernet module (VEM). The VSM runs as a virtual appliance within the ESX cluster or on dedicated hardware (Nexus 1010 series) and the VEM runs as a module on each host and replaces a standard dvS (distributed virtual switch) from VMware.

Configuration of the switch is done on the VSM using the standard NX-OS CLI. It offers capabilities to create standard port-profiles which can then be assigned to virtual machines using vCenter.

There are several differences between the standard dvS and the N1000v; one is that the Cisco switch generally has full support for network technologies such as LACP link aggregation or that the VMware switch supports new features such as routing based on physical NIC load. However, the main difference lies in the architecture: Nexus 1000v is working in the same way as a physical Ethernet switch does while dvS is relying on information from ESX. This has consequences for example in scalability where the Kappa limit for a N1000v is 2048 virtual ports against 60000 for a dvS.

The Nexus1000v is developed in co-operation between Cisco and VMware and uses the API of the dvS. [41]

Third-party management tools

Because VMware ESX is a leader in the server-virtualization market, [42] software and hardware vendors offer a range of tools to integrate their products or services with ESX. Examples are the products from Veeam Software with backup and management applications [43] and a plugin to monitor and manage ESX using HP OpenView, [44] Quest Software with a range of management and backup-applications and most major backup-solution providers have plugins or modules for ESX. Using Microsoft Operations Manager (SCOM) 2007/2012 with a Bridgeways ESX management pack gives the user a realtime ESX datacenter health view.

Hardware vendors such as Hewlett Packard Enterprise and Dell include tools to support the use of ESX(i) on their hardware platforms. An example is the ESX module for Dell's OpenManage management platform. [45]

VMware has added a Web Client [46] since v5 but it will work on vCenter only and does not contain all features. [47] vEMan [48] is a Linux application which is trying to fill that gap. These are just a few examples: there are numerous 3rd party products to manage, monitor or backup ESX infrastructures and the VMs running on them. [49]

Known limitations

As of September 2020, these are the known limitations of VMware ESXi 7.0 U1.

Infrastructure limitations

Some maximums in ESXi Server 7.0 may influence the design of data centers: [50] [51]

Performance limitations

In terms of performance, virtualization imposes a cost in the additional work the CPU has to perform to virtualize the underlying hardware. Instructions that perform this extra work, and other activities that require virtualization, tend to lie in operating system calls. In an unmodified operating system, OS calls introduce the greatest portion of virtualization "overhead".[ citation needed ]

Paravirtualization or other virtualization techniques may help with these issues. VMware developed the Virtual Machine Interface for this purpose, and selected operating systems currently support this. A comparison between full virtualization and paravirtualization for the ESX Server [52] shows that in some cases paravirtualization is much faster.

Network limitations

When using the advanced and extended network capabilities by using the Cisco Nexus 1000v distributed virtual switch the following network-related limitations apply: [41]

  • 64 ESX/ESXi hosts per VSM (Virtual Supervisor Module)
  • 2048 virtual Ethernet interfaces per VMware vDS (virtual distributed switch)
  • and a maximum of 216 virtual interfaces per ESX/ESXi host
  • 2048 active VLANs (one to be used for communication between VEMs and VSM)
  • 2048 port-profiles
  • 32 physical NICs per ESX/ESXi (physical) host
  • 256 port-channels per VMware vDS (virtual distributed switch)
  • and a maximum of 8 port-channels per ESX/ESXi host

Fibre Channel Fabric limitations

Regardless of the type of virtual SCSI adapter used, there are these limitations: [53]

See also

Related Research Articles

In computing, a virtual machine (VM) is the virtualization or emulation of a computer system. Virtual machines are based on computer architectures and provide the functionality of a physical computer. Their implementations may involve specialized hardware, software, or a combination of the two. Virtual machines differ and are organized by their function, shown here:

<span class="mw-page-title-main">VMware</span> Multi-cloud service provider for all apps

VMware LLC is an American cloud computing and virtualization technology company with headquarters in Palo Alto, California. VMware was the first commercially successful company to virtualize the x86 architecture.

<span class="mw-page-title-main">Xen</span> Type-1 hypervisor

Xen is a free and open-source type-1 hypervisor, providing services that allow multiple computer operating systems to execute on the same computer hardware concurrently. It was originally developed by the University of Cambridge Computer Laboratory and is now being developed by the Linux Foundation with support from Intel, Citrix, Arm Ltd, Huawei, AWS, Alibaba Cloud, AMD, Bitdefender and epam.

<span class="mw-page-title-main">UEFI</span> Operating system and firmware specification

Unified Extensible Firmware Interface is a specification that defines the architecture of the platform firmware used for booting the computer hardware and its interface for interaction with the operating system. Examples of firmware that implement the specification are AMI Aptio, Phoenix SecureCore, TianoCore EDK II, InsydeH2O. UEFI replaces the BIOS which was present in the boot ROM of all personal computers that are IBM PC compatible, although it can provide backwards compatibility with the BIOS using CSM booting. Intel developed the original Extensible Firmware Interface (EFI) specification. Some of the EFI's practices and data formats mirror those of Microsoft Windows. In 2005, UEFI deprecated EFI 1.10.

<span class="mw-page-title-main">QEMU</span> Free virtualization and emulation software

QEMU is a free and open-source emulator. It emulates a computer's processor through dynamic binary translation and provides a set of different hardware and device models for the machine, enabling it to run a variety of guest operating systems. It can interoperate with Kernel-based Virtual Machine (KVM) to run virtual machines at near-native speed. QEMU can also do emulation for user-level processes, allowing applications compiled for one architecture to run on another.

Platform virtualization software, specifically emulators and hypervisors, are software packages that emulate the whole physical computer machine, often providing multiple virtual machines on one physical platform. The table below compares basic information about platform virtualization hypervisors.

The following is a timeline of virtualization development. In computing, virtualization is the use of a computer to simulate another computer. Through virtualization, a host simulates a guest by exposing virtual hardware devices, which may be done through software or by allowing access to a physical device connected to the machine.

<span class="mw-page-title-main">Kernel-based Virtual Machine</span> Virtualization module in the Linux kernel

Kernel-based Virtual Machine (KVM) is a free and open-source virtualization module in the Linux kernel that allows the kernel to function as a hypervisor. It was merged into the mainline Linux kernel in version 2.6.20, which was released on February 5, 2007. KVM requires a processor with hardware virtualization extensions, such as Intel VT or AMD-V. KVM has also been ported to other operating systems such as FreeBSD and illumos in the form of loadable kernel modules.

VMware VMFS is VMware, Inc.'s clustered file system used by the company's flagship server virtualization suite, vSphere. It was developed to store virtual machine disk images, including snapshots. Multiple servers can read/write the same filesystem simultaneously while individual virtual machine files are locked. VMFS volumes can be logically "grown" by spanning multiple VMFS volumes together.

<span class="mw-page-title-main">Hyper-V</span> Native hypervisor by Microsoft

Microsoft Hyper-V, codenamed Viridian, and briefly known before its release as Windows Server Virtualization, is a native hypervisor; it can create virtual machines on x86-64 systems running Windows. Starting with Windows 8, Hyper-V superseded Windows Virtual PC as the hardware virtualization component of the client editions of Windows NT. A server computer running Hyper-V can be configured to expose individual virtual machines to one or more networks. Hyper-V was first released with Windows Server 2008, and has been available without additional charge since Windows Server 2012 and Windows 8. A standalone Windows Hyper-V Server is free, but has a command-line interface only. The last version of free Hyper-V Server is Hyper-V Server 2019, which is based on Windows Server 2019.

Infrastructure as a service (IaaS) is a cloud computing service model by means of which computing resources are supplied by a cloud services provider. The IaaS vendor provides the storage, network, servers, and virtualization. This service enables users to free themselves from maintaining an on-premises data center. The IaaS provider is hosting these resources in either the public cloud, the private cloud, or the hybrid cloud.

VMware Infrastructure is a collection of virtualization products from VMware. Virtualization is an abstraction layer that decouples hardware from operating systems. The VMware Infrastructure suite allows enterprises to optimize and manage their IT infrastructure through virtualization as an integrated offering. The core product families are vSphere, vSAN and NSX for on-premises virtualization. VMware Cloud Foundation (VCF) is an infrastructure platform for hybrid cloud management. The VMware Infrastructure suite is designed to span a large range of deployment types to provide maximum flexibility and scalability.

The Cisco Nexus series switches are modular and fixed port network switches designed for the data center. Cisco Systems introduced the Nexus Series of switches on January 28, 2008. The first chassis in the Nexus 7000 family is a 10-slot chassis with two supervisor engine slots and eight I/O module slots at the front, as well as five crossbar switch fabric modules at the rear. Beside the Nexus 7000 there are also other models in the Nexus range.

Oracle VM Server for x86 is the server virtualization offering from Oracle Corporation. Oracle VM Server for x86 incorporates the free and open-source Xen hypervisor technology, supports Windows, Linux, and Solaris guests and includes an integrated Web based management console. Oracle VM Server for x86 features fully tested and certified Oracle Applications stack in an enterprise virtualization environment.

<span class="mw-page-title-main">VMware vSphere</span> VMwares cloud computing virtualization platform

VMware vSphere is VMware's cloud computing virtualization platform.

libvirt Management tool

libvirt is an open-source API, daemon and management tool for managing platform virtualization. It can be used to manage KVM, Xen, VMware ESXi, QEMU and other virtualization technologies. These APIs are widely used in the orchestration layer of hypervisors in the development of a cloud-based solution.

Second Level Address Translation (SLAT), also known as nested paging, is a hardware-assisted virtualization technology which makes it possible to avoid the overhead associated with software-managed shadow page tables.

<span class="mw-page-title-main">StarWind Software</span> American computer storage company

StarWind Software, Inc. is a privately held Beverly, Massachusetts-based computer software and hardware appliance company specializing in storage virtualization and software-defined storage.

Dell PowerEdge VRTX is a computer hardware product line from Dell. It is a mini-blade chassis with built-in storage system. The VRTX comes in two models: a 19" rack version that is 5 rack units high or as a stand-alone tower system.

References

  1. ↑ "Build numbers and versions of VMware ESXi/ESX".
  2. ↑ "VMware ESXi 8.0 Update 2 Release Notes".
  3. ↑ "VMware ESX 4.0 only installs and runs on servers with 64bit x86 CPUs. 32bit systems are no longer supported". VMware, Inc.
  4. ↑ "Announcing the ESXi-ARM Fling". VMware, Inc.
  5. ↑ "ESX Server Architecture". VMware. Archived from the original on 7 November 2009. Retrieved 22 October 2009.
  6. ↑ VMware:vSphere ESX and ESXi Info Center
  7. ↑ "What does ESX stand for?". Archived from the original on 20 December 2014. Retrieved 3 October 2014.
  8. ↑ "Glossary" (PDF). Developer’s Guide to Building vApps and Virtual Appliances: VMware Studio 2.5. Palo Alto: VMware. 2011. p. 153. Retrieved 9 November 2011.
  9. ↑ "Did you know VMware Elastic Sky X (ESX) was once called 'Scaleable Server'?". UP2V. 12 May 2014. Archived from the original on 10 June 2019. Retrieved 9 May 2018.
  10. ↑ "VMware ESXi was created by a French guy !!! | ESX Virtualization". ESX Virtualization. 26 September 2009. Retrieved 9 May 2018.
  11. ↑ "ESX Server Datasheet"
  12. ↑ "ESX Server Architecture". Vmware.com. Archived from the original on 29 September 2007. Retrieved 1 July 2009.
  13. ↑ "ESX machine boots". Video.google.com.au. 12 June 2006. Archived from the original on 13 December 2021. Retrieved 1 July 2009.
  14. ↑ "VMKernel Scheduler". vmware.com. 27 May 2008. Retrieved 10 March 2016.
  15. ↑ Mike, Foley. "It's a Unix system, I know this!". VMware Blogs. VMware.
  16. ↑ "Support for 64-bit Computing". Vmware.com. 19 April 2004. Archived from the original on 2 July 2009. Retrieved 1 July 2009.
  17. ↑ Gerstel, Markus: "Virtualisierungsansätze mit Schwerpunkt Xen" Archived 10 October 2013 at the Wayback Machine
  18. ↑ VMware ESX
  19. ↑ "VMware ESX Server 2: NUMA Support" (PDF). Palo Alto, California: VMware Inc. 2005. p. 7. Retrieved 29 March 2011. SRAT (system resource allocation table) – table that keeps track of memory allocated to a virtual machine.
  20. 1 2 3 "ESX Server Open Source". Vmware.com. Retrieved 1 July 2009.
  21. ↑ "ESX Hardware Compatibility List". Vmware.com. 10 December 2008. Retrieved 1 July 2009.
  22. ↑ "ESXi vs. ESX: A comparison of features". Vmware, Inc. Retrieved 1 June 2009.
  23. ↑ "KB: Decoding Machine Check Exception (MCE) output after a purple diagnostic screen |publisher=VMware, Inc."
  24. ↑ VMware KBArticle Windows 8/Windows 2012 doesn't boot on ESX, visited 12 September 2012
  25. ↑ "Download VMware vSphere Hypervisor (ESXi)". www.vmware.com. Retrieved 22 July 2014.
  26. ↑ "Getting Started with ESXi Installable" (PDF). VMware . Retrieved 22 July 2014.
  27. ↑ "VMware ESX and ESXi 4.1 Comparison". Vmware.com. Retrieved 9 June 2011.
  28. ↑ "What do ESX and ESXi stand for?". VM.Blog. 31 August 2011. Retrieved 21 June 2016. Apparently, the 'i' in ESXi stands for Integrated, probably coming from the fact that this version of ESX can be embedded in a small bit of flash memory on the server hardware.
  29. ↑ Andreas Peetz. "ESXi embedded vs. ESXi installable FAQ" . Retrieved 11 August 2014.
  30. ↑ "Free VMware ESXi: Bare Metal Hypervisor with Live Migration". VMware. Retrieved 1 July 2009.
  31. ↑ "Conservancy Announces Funding for GPL Compliance Lawsuit". sfconservancy.org. 5 March 2015. Retrieved 27 August 2015.
  32. ↑ "Copyleft Compliance Projects - Software Freedom Conservancy". Sfconservancy.org. 25 May 2018. Retrieved 7 February 2020.
  33. ↑ "Hellwig To Appeal VMware Ruling After Evidentiary Set Back in Lower Court". 9 August 2016. Archived from the original on 14 January 2020.
  34. ↑ "Klage von Hellwig gegen VMware erneut abgewiesen". 1 March 2019.
  35. ↑ "VMware's Update to Mr. Hellwig's Legal Proceedings". Vmware.com. Retrieved 7 February 2020.
  36. ↑ "Press release" (PDF). bombadil.infradead.org. 2019. Retrieved 7 February 2020.
  37. ↑ VMware Blog by Kyle Gleed: vMotion: what's going on under the covers, 25 February 2011, visited: 2 February 2012
  38. ↑ VMware website vMotion brochure . Retrieved 3 February 2012
  39. ↑ "Archived copy" (PDF). www.vmware.com. Archived from the original (PDF) on 28 December 2009. Retrieved 17 January 2022.{{cite web}}: CS1 maint: archived copy as title (link)
  40. ↑ "Archived copy" (PDF). www.vmware.com. Archived from the original (PDF) on 21 November 2010. Retrieved 17 January 2022.{{cite web}}: CS1 maint: archived copy as title (link)
  41. 1 2 Overview of the Nexus 1000v virtual switch, visited 9 July 2012
  42. ↑ VMware continues virtualization market romp, 18 April 2012. Visited: 9 July 2012
  43. ↑ About Veeam, visited 9 July 2012
  44. ↑ Veeam OpenView plugin for VMware, visited 9 July 2012
  45. ↑ OpenManage (omsa) support for ESXi 5.0, visited 9 July 2012
  46. ↑ VMware info about Web Client – VMware ESXi/ESX 4.1 and ESXi 5.0 Comparison
  47. ↑ Availability of vSphere Client for Linux systems – What the web client can do and what not
  48. ↑ vEMan website vEMan – Linux vSphere client
  49. ↑ Petri website 3rd party ESX tools, 23 December 2008. Visited: 11 September 2001
  50. ↑ "What's New with VMware vSphere 7 Update 1". VMware vSphere Blog. 15 September 2020. Retrieved 9 June 2023.
  51. ↑ "VMware Configuration Maximum tool".
  52. ↑ "Performance of VMware VMI" (PDF). VMware, Inc. 13 February 2008. Retrieved 22 January 2009.
  53. ↑ "vSphere 6.7 Configuration Maximums". VMware Configuration Maximum Tool. VMware. Retrieved 12 July 2019.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.