Xen


Xen[ARM Cortex-A15 MPCore|] is a free and open-source type-1 hypervisor, providing services that allow multiple computer operating systems to execute on the same computer hardware concurrently. It was
originally developed by the University of Cambridge Computer Laboratory and is now being developed by the Linux Foundation with support from Intel, Citrix, Arm Ltd, Huawei, AWS, Alibaba Cloud, AMD, Bitdefender and EPAM Systems.
The Xen Project community develops and maintains Xen Project as free and open-source software, subject to the requirements of the GNU General Public License, version 2. Xen Project is currently available for the IA-32, x86-64 and ARM instruction sets.

Software architecture

Xen Project runs in a more privileged CPU state than any other software on the machine, except for firmware.
Responsibilities of the hypervisor include memory management and CPU scheduling of all virtual machines, and for launching the most privileged domain - the only virtual machine which by default has direct access to hardware. From the dom0 the hypervisor can be managed and unprivileged domains can be launched.
The dom0 domain is typically a version of Linux or BSD. User domains may either be traditional operating systems, such as Microsoft Windows under which privileged instructions are provided by hardware virtualization instructions, or paravirtualized operating systems whereby the operating system is aware that it is running inside a virtual machine, and so makes hypercalls directly, rather than issuing privileged instructions.
Xen Project boots from a bootloader such as GNU GRUB, and then usually loads a paravirtualized host operating system into the host domain.

History

Xen originated as a research project at the University of Cambridge led by Ian Pratt, a senior lecturer in the Computer Laboratory, and his PhD student Keir Fraser. According to Anil Madhavapeddy, an early contributor, Xen started as a bet on whether Fraser could make multiple Linux Kernels boot on the same hardware in a weekend. The first public release of Xen was made in 2003, with v1.0 following in 2004. Soon after, Pratt and Fraser along with other Cambridge alumni including Simon Crosby and founding CEO Nick Gault created XenSource Inc. to turn Xen into a competitive enterprise product.
To support embedded systems such as smartphone/ IoT with relatively scarce hardware computing resources, the Secure Xen ARM architecture on an ARM CPU was exhibited at Xen Summit on April 17, 2007, held in IBM TJ Watson. The first public release of Secure Xen ARM source code was made at Xen Summit on June 24, 2008 by Sang-bum Suh, a Cambridge alumnus, in Samsung Electronics.
On October 22, 2007, Citrix Systems completed its acquisition of XenSource, and the Xen Project moved to the xen.org domain. This move had started some time previously, and made public the existence of the Xen Project Advisory Board, which had members from Citrix, IBM, Intel, Hewlett-Packard, Novell, Red Hat, Sun Microsystems and Oracle. The Xen Advisory Board advises the Xen Project leader and is responsible for the Xen trademark, which Citrix has freely licensed to all vendors and projects that implement the Xen hypervisor. Citrix also used the Xen brand itself for some proprietary products unrelated to Xen, including XenApp and XenDesktop.
On April 15, 2013, it was announced that the Xen Project was moved under the auspices of the Linux Foundation as a Collaborative Project. The Linux Foundation launched a new trademark for "Xen Project" to differentiate the project from any commercial use of the older "Xen" trademark. A new community website was launched at xenproject.org as part of the transfer. Project members at the time of the announcement included: Amazon, AMD, Bromium, CA Technologies, Calxeda, Cisco, Citrix, Google, Intel, Oracle, Samsung, and Verizon. The Xen project itself is self-governing.
Since version 3.0 of the Linux kernel, Xen support for dom0 and domU exists in the mainline kernel.

Release history

VersionRelease dateNotes
1.0
2.0Live migration of PV guests.
3.0
The releases up to 3.0.4 also added:
3.1Live migration for HVM guests, XenAPI
3.2PCI passthrough and ACPI S3 standby mode for the host system.
3.3Improvements for the PCI passthrough and the power management. Xen ARM hypervisor source code released for ARM CPU support
3.4Contains a first version of the "Xen Client Initiative", shortly XCI.
4.0Makes it possible to use a dom0 Linux kernel, which has been implemented by using PVOps. A Linux kernel of version 2.6.31 has been modified for this purpose, because the official Linux kernel actually does not support the usage as dom0 kernel.
4.1Some of the improvements: Support for more than 255 processors, better stability. Linux kernel v2.6.37 and onward support usage as dom0 kernel.
4.2XL became the default toolstack. Support for up to 4095 host processors and up to 512 guest processors.
4.3Experimental ARM support. NUMA-aware scheduling. Support for Open vSwitch.
4.4Solid libvirt support for libxl, new scalable event channel interface, hypervisor ABI for ARM declared stable, Nested Virtualization on Intel hardware.
4.5With 43 major new features, 4.5 includes the most updates in the project's history.
4.6Focused on improving code quality, security hardening, enablement of security appliances, and release cycle predictability.
4.7Improved: security, live migrations, performances and workload. Hardware support.
4.8.1April 12, 2017-
4.9June 28, 2017
4.10December 12, 2017
4.11July 10, 2018
4.12April 2, 2019
4.13December 18, 2019
4.14July 24, 2020
4.15April 8, 2021
4.16December 2, 2021
4.17December 14, 2022
4.18November 23, 2023
4.19July 29, 2024
4.20March 5, 2025

Uses

Internet hosting service companies use hypervisors to provide virtual private servers. Amazon EC2, IBM SoftLayer, Liquid Web, Fujitsu Global Cloud Platform, Linode, OrionVM and Rackspace Cloud use Xen as the primary VM hypervisor for their product offerings.
Virtual machine monitors also often operate on mainframes and large servers running IBM, HP, and other systems.
Server virtualization can provide benefits such as:
  • Consolidation leading to increased utilization
  • Rapid provisioning
  • Dynamic fault tolerance against software failures
  • Hardware fault tolerance
  • Secure separations of virtual operating systems
  • Support for legacy software as well as new OS instances on the same computer
Xen's support for virtual machine live migration from one host to another allows load balancing and the avoidance of downtime.
Virtualization also has benefits when working on development : running the new system as a guest avoids the need to reboot the physical computer whenever a bug occurs. Sandboxed guest systems can also help in computer-security research, allowing study of the effects of some virus or worm without the possibility of compromising the host system.
Finally, hardware appliance vendors may decide to ship their appliance running several guest systems, so as to be able to execute various pieces of software that require different operating systems.

Types of virtualization

Xen offers five approaches to running the guest operating system:PV : Virtualization-aware Guest and devices.HVM : Fully hardware-assisted virtualization with emulated devices.HVM with PV drivers: Fully hardware-assisted virtualization with PV drivers for IO devices.PVHVM : PV supported hardware-assisted virtualization with PV drivers for IO devices.PVH : Fully paravirtualized Guest accelerated by hardware-assisted virtualization where available.
Xen provides a form of virtualization known as paravirtualization, in which guests run a modified operating system. The guests are modified to use a special hypercall ABI, instead of certain architectural features. Through paravirtualization, Xen can achieve high performance even on its host architecture which has a reputation for non-cooperation with traditional virtualization techniques. Xen can run paravirtualized guests even on CPUs without any explicit support for virtualization. Paravirtualization avoids the need to emulate a full set of hardware and firmware services, which makes a PV system simpler to manage and reduces the attack surface exposed to potentially malicious guests. On 32-bit x86, the Xen host kernel code runs in Ring 0, while the hosted domains run in Ring 1 and Ring 3.
CPUs that support virtualization make it possible to run unmodified guests, including proprietary operating systems. This is known as hardware-assisted virtualization, however, in Xen this is known as hardware virtual machine. HVM extensions provide additional execution modes, with an explicit distinction between the most-privileged modes used by the hypervisor with access to the real hardware and the less-privileged modes used by guest kernels and applications with "hardware" accesses under complete control of the hypervisor. Both Intel and AMD have contributed modifications to Xen to exploit their respective Intel VT-x and AMD-V architecture extensions. Use of ARM v7A and v8A virtualization extensions came with Xen 4.3. HVM extensions also often offer new instructions to allow direct calls by a paravirtualized guest/driver into the hypervisor, typically used for I/O or other operations needing high performance. These allow HVM guests with suitable minor modifications to gain many of the performance benefits of paravirtualized I/O. In current versions of Xen only fully virtualized HVM guests can make use of hardware facilities for multiple independent levels of memory protection and paging. As a result, for some workloads, HVM guests with PV drivers provide better performance than pure PV guests. Xen HVM has device emulation based on the QEMU project to provide I/O virtualization to the virtual machines. The system emulates hardware via a patched QEMU "device manager" daemon running as a backend in dom0. This means that the virtualized machines see an emulated version of a fairly basic PC. In a performance-critical environment, PV-on-HVM disk and network drivers are used during the normal guest operation, so that the emulated PC hardware is mostly used for booting.

Features

Administrators can "live migrate" Xen virtual machines between physical hosts across a LAN without loss of availability. During this procedure, the LAN iteratively copies the memory of the virtual machine to the destination without stopping its execution. The process requires a stoppage of around 60–300 ms to perform final synchronization before the virtual machine begins executing at its final destination, providing an illusion of seamless migration. Similar technology can serve to suspend running virtual machines to disk, "freezing" their running state for resumption at a later date.
Xen can scale to 4095 physical CPUs, 256 VCPUs per HVM guest, 512 VCPUs per PV guest, 16 TB of RAM per host, and up to 1 TB of RAM per HVM guest or 512 GB of RAM per PV guest.

Availability

The Xen hypervisor has been ported to a number of processor families:
  • Intel: IA-32, IA-64, x86-64
  • PowerPC: previously supported under the XenPPC project, no longer active after Xen 3.2
  • ARM: previously supported under the XenARM project for older versions of ARM without virtualization extensions, such as the Cortex-A9. Currently supported since Xen 4.3 for newer versions of the ARM with virtualization extensions, such as the
Cortex-A15.
  • MIPS: XLP832 experimental port

Hosts

Xen can be shipped in a dedicated virtualization platform, such as XCP-ng or XenServer.
Alternatively, Xen is distributed as an optional configuration of many standard operating systems. Xen is available for and distributed with:
  • Alpine Linux offers a minimal dom0 system that can be run from removable media, like USB sticks.
  • Arch Linux provides the necessary packages with detailed setup instructions on their Wiki.
  • Debian Linux and many of its derivatives;
  • FreeBSD 11 includes experimental host support.
  • Gentoo has the necessary packages available to support Xen, along with instructions on their Wiki.
  • Mageia ;
  • NetBSD can function as domU and dom0.
  • OpenSolaris-based distributions can function as dom0 and domU from Nevada build 75 onwards.
  • openSUSE 10.x to 12.x: only 64-bit hosts are supported since 12.1;
  • Qubes OS uses Xen to isolate applications for a more secure desktop.
  • SUSE Linux Enterprise Server ;
  • Solaris ;
  • Ubuntu

Guests

Guest systems can run fully virtualized, paravirtualized, or fully virtualized with paravirtualized drivers. Most operating systems which can run on PCs can run as a Xen HVM guest. The following systems can operate as paravirtualized Xen guests:
Xen version 3.0 introduced the capability to run Microsoft Windows as a guest operating system unmodified if the host machine's processor supports hardware virtualization provided by Intel VT-x or AMD-V. During the development of Xen 1.x, Microsoft Research, along with the University of Cambridge Operating System group, developed a port of Windows XP to Xen — made possible by Microsoft's Academic Licensing Program. The terms of this license do not allow the publication of this port, although documentation of the experience appears in the original Xen SOSP paper. James Harper and the Xen open-source community have started developing free software paravirtualization drivers for Windows. These provide front-end drivers for the Xen block and network devices and allow much higher disk and network performance for Windows systems running in HVM mode. Without these drivers all disk and network traffic has to be processed through QEMU-DM. Subsequently, Citrix has released under a BSD license PV drivers for Windows.

Management

Third-party developers have built a number of tools to facilitate the common tasks of administering a Xen host, such as configuring, starting, monitoring and stopping of Xen guests. Examples include:
  • The OpenNebula cloud management toolkit
  • On openSUSE YaST and virt-man offer graphical VM management
  • OpenStack natively supports Xen as a Hypervisor/Compute target
  • Apache CloudStack also supports Xen as a Hypervisor
  • Novell's PlateSpin Orchestrate also manages Xen virtual machines for Xen shipping in SUSE Linux Enterprise Server.
  • for both XCP-ng and Citrix Hypervisor platforms

Commercial versions

The Xen hypervisor is covered by the GNU General Public Licence, so all of these versions contain a core of free software with source code. However, many of them contain proprietary additions.