Proxmox Backup Server

Last updated
Proxmox Backup Server
Proxmox-Backup-Server-2.0-Dashboard.png
Proxmox Backup Server 2.0 - dashboard
Developer Proxmox Server Solutions GmbH
Written in Rust [1]
OS family Unix-like
Working stateCurrent
Source model Free and open source software
Initial release11 November 2020;3 years ago (2020-11-11)
Latest release 3.1 [2]   OOjs UI icon edit-ltr-progressive.svg / 30 November 2023
Repository
Update method APT
Package manager dpkg
Platforms AMD64
Userland GNU
Default
user interface
Web-based
License GNU Affero General Public License v3.0
Official website www.proxmox.com/en/proxmox-backup-server/

Proxmox Backup Server (short Proxmox BS) is an open-source backup software project supporting virtual machines, containers, and physical hosts. [3] The Bare-metal server is based on the Debian Linux distribution, with some extended features, such as out-of-the-box ZFS support and Linux kernel 5.4 LTS. [4] Proxmox Backup Server is licensed under the GNU Affero General Public License, version 3. [5]

Contents

Technology

Proxmox Backup Server is written mostly in Rust [6] and implements data deduplication to reduce the storage space needed. [7] Data is split into chunks. [8]

History

Development of Proxmox Backup originally began in October 2018 to provide more efficient backup for the virtualization platform Proxmox Virtual Environment than the integrated vzdump backup tool which only allows full backups. In July 2020, the first public beta was announced. Its first stable release was announced in November, 2020. [9]

Operation

Proxmox Backup uses a client-server model where the server stores the backup data. The client tool works on most modern Linux systems. The software is installed bare-metal with an ISO image, which includes management tools and a web-based GUI. Administrators can manage the system via a Web browser or a command-line interface (CLI). Proxmox Backup Server also provides a REST API for third party tools.

Proxmox Backup Server supports incremental backups, data deduplication, Zstandard compression and authenticated encryption (AE). [3] The first backup is a full backup, and subsequent backups are sent incrementally from the client to the Proxmox Backup Server, where data is deduplicated.

Backups can be stored on-premises or synchronized to remote locations with Remotes, [10] and multiple, unrelated hosts can use the same backup server. All client-server traffic is transferred over TLS-1.3 to protect against eavesdropping. To further protect backup data at rest, optional encryption of all backed-up-data is available using AES-256 in Galois/Counter Mode. [11] As the backup server can not access the backup data without the matching encryption keys, it can even be an untrusted host.

Data retention policy can be defined in Proxmox Backup Server. Removing expired data is done in two phases: first, prune removes indices of the backups which are no longer needed, and then garbage collector process is running to physically delete the orphaned data chunks. [12]

PBS supports using namespaces, which allows to store backups from multiple PVE servers with duplicate VM IDs. [13]

Client software

For the Proxmox VE platform, the Proxmox Backup client is tightly integrated; the backup storage is configurable as a storage backend on a Proxmox VE node and supports deduplicated backups of QEMU virtual machines and LXC containers. [14] The platform also leverages QEMU dirty-bitmaps, which allows for fast backups from the Proxmox VE client to the server, as the disk images do not need to be scanned for changes. [15]

PBS can be also used via separate text based application Proxmox Backup Client application. [16]

See also

Related Research Articles

In information technology, a backup, or data backup is a copy of computer data taken and stored elsewhere so that it may be used to restore the original after a data loss event. The verb form, referring to the process of doing so, is "back up", whereas the noun and adjective form is "backup". Backups can be used to recover data after its loss from data deletion or corruption, or to recover data from an earlier time. Backups provide a simple form of disaster recovery; however not all backup systems are able to reconstitute a computer system or other complex configuration such as a computer cluster, active directory server, or database server.

9P is a network protocol developed for the Plan 9 from Bell Labs distributed operating system as the means of connecting the components of a Plan 9 system. Files are key objects in Plan 9. They represent windows, network connections, processes, and almost anything else available in the operating system.

Filesystem in Userspace (FUSE) is a software interface for Unix and Unix-like computer operating systems that lets non-privileged users create their own file systems without editing kernel code. This is achieved by running file system code in user space while the FUSE module provides only a bridge to the actual kernel interfaces.

Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing. The name Lustre is a portmanteau word derived from Linux and cluster. Lustre file system software is available under the GNU General Public License and provides high performance file systems for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site systems. Since June 2005, Lustre has consistently been used by at least half of the top ten, and more than 60 of the top 100 fastest supercomputers in the world, including the world's No. 1 ranked TOP500 supercomputer in November 2022, Frontier, as well as previous top supercomputers such as Fugaku, Titan and Sequoia.

<span class="mw-page-title-main">Nexenta OS</span> Discontinued computer operating system

Nexenta OS, officially known as the Nexenta Core Platform, is a discontinued computer operating system based on OpenSolaris and Ubuntu that runs on IA-32- and x86-64-based systems. It emerged in fall 2005, after Sun Microsystems started the OpenSolaris project in June of that year. Nexenta Systems, Inc. initiated the project and sponsored its development. Nexenta OS version 1.0 was released in February 2008.

EMC NetWorker is an enterprise-level data protection software product from Dell EMC that unifies and automates backup to tape, disk-based, and flash-based storage media across physical and virtual environments for granular and disaster recovery.

Veritas Backup Exec is a data protection software product designed for customers with mixed physical and virtual environments, and who are moving to public cloud services. Supported platforms include VMware and Hyper-V virtualization, Windows and Linux operating systems, Amazon S3, Microsoft Azure and Google Cloud Storage, among others. All management and configuration operations are performed with a single user interface. Backup Exec also provides integrated deduplication, replication, and disaster recovery capabilities and helps to manage multiple backup servers or multi-drive tape loaders.

The following tables compare general and technical information for a number of file systems.

<span class="mw-page-title-main">IBM storage</span> Product portfolio of IBM

The IBM Storage product portfolio includes disk, flash, tape, NAS storage products, storage software and services. IBM's approach is to focus on data management.

Single-instance storage (SIS) is a system's ability to take multiple copies of content and replace them by a single shared copy. It is a means to eliminate data duplication and to increase efficiency. SIS is frequently implemented in file systems, e-mail server software, data backup, and other storage-related computer software. Single-instance storage is a simple variant of data deduplication. While data deduplication may work at a segment or sub-block level, single-instance storage works at the whole-file level and eliminates redundant copies of entire files or e-mail messages.

<span class="mw-page-title-main">Network block device</span> Network storage protocol

On Linux, network block device (NBD) is a network protocol that can be used to forward a block device from one machine to a second machine. As an example, a local machine can access a hard disk drive that is attached to another computer.

In computing, data deduplication is a technique for eliminating duplicate copies of repeating data. Successful implementation of the technique can improve storage utilization, which may in turn lower capital expenditure by reducing the overall amount of storage media required to meet storage capacity needs. It can also be applied to network data transfers to reduce the number of bytes that must be sent.

<span class="mw-page-title-main">TurnKey Linux Virtual Appliance Library</span> Open-Source virtual appliance library

The TurnKey Linux Virtual Appliance Library is a free open-source software project which develops a range of Debian-based pre-packaged server software appliances. Turnkey appliances can be deployed as a virtual machine, in cloud computing services such as Amazon Web Services or installed in physical computers.

In computing, SPICE is a remote-display system built for virtual environments which allows users to view a computing "desktop" environment – not only on its computer-server machine, but also from anywhere on the Internet – using a wide variety of machine architectures.

Resilient File System (ReFS), codenamed "Protogon", is a Microsoft proprietary file system introduced with Windows Server 2012 with the intent of becoming the "next generation" file system after NTFS.

<span class="mw-page-title-main">OpenMediaVault</span> NAS operating system

OpenMediaVault (OMV) is a free Linux distribution designed for network-attached storage (NAS). The project's lead developer is Volker Theile, who instituted it in 2009. OMV is based on the Debian operating system, and is licensed through the GNU General Public License v3.

<span class="mw-page-title-main">Proxmox Virtual Environment</span> Linux distribution for server virtualization

Proxmox Virtual Environment is a hyper-converged infrastructure open-source software. It is a hosted hypervisor that can run operating systems including Linux and Windows on x64 hardware. It is a Debian-based Linux distribution with a modified Ubuntu LTS kernel and allows deployment and management of virtual machines and containers. Two types of virtualization are supported: container-based with LXC, and full virtualization with KVM. It includes a web-based management interface. There is also a mobile application available for controlling PVE environments.

<span class="mw-page-title-main">Veeam Backup & Replication</span> Backup and disaster recovery software

Veeam Backup & Replication is a proprietary backup app developed by Veeam for virtual environments built on VMware vSphere, Nutanix AHV, and Microsoft Hyper-V hypervisors. The software provides backup, restore and replication functionality for virtual machines, physical servers and workstations as well as cloud-based workload.

ONTAP or Data ONTAP or Clustered Data ONTAP (cDOT) or Data ONTAP 7-Mode is NetApp's proprietary operating system used in storage disk arrays such as NetApp FAS and AFF, ONTAP Select, and Cloud Volumes ONTAP. With the release of version 9.0, NetApp decided to simplify the Data ONTAP name and removed the word "Data" from it, and remove the 7-Mode image, therefore, ONTAP 9 is the successor of Clustered Data ONTAP 8.

ZFS is a file system with volume management capabilities. It began as part of the Sun Microsystems Solaris operating system in 2001. Large parts of Solaris – including ZFS – were published under an open source license as OpenSolaris for around 5 years from 2005 before being placed under a closed source license when Oracle Corporation acquired Sun in 2009–2010. During 2005 to 2010, the open source version of ZFS was ported to Linux, Mac OS X and FreeBSD. In 2010, the illumos project forked a recent version of OpenSolaris, including ZFS, to continue its development as an open source project. In 2013, OpenZFS was founded to coordinate the development of open source ZFS. OpenZFS maintains and manages the core ZFS code, while organizations using ZFS maintain the specific code and validation processes required for ZFS to integrate within their systems. OpenZFS is widely used in Unix-like systems.

References

  1. "Proxmox Backup Server and Client Git Tree" . Retrieved 18 December 2020.
  2. "Proxmox Backup Server 3.1 released". 30 November 2023. Retrieved 30 November 2023.
  3. 1 2 Nestor, Marius. "Meet Proxmox Backup Server, a Debian-Based Open Source Enterprise Backup Solution". 9to5Linux. 9to5Linux. Retrieved 21 December 2020.
  4. Plura, Michael (13 November 2020). "Backup Server 1.0: Proxmox und ZFS absichern" [Backup Server 1.0: Securing Proxmox and ZFS]. Heise Online (in German). Heinz Heise . Retrieved 21 December 2020.
  5. "Proxmox Backup Server". Proxmox Server Solutions GmbH. 13 July 2011. Retrieved 16 December 2022.
  6. Thommes, Ferdinand (12 November 2020). "Proxmox erweitert Angebot mit Backup-Server" [Proxmox extends offer with backup server]. linuxnews.de (in German). Retrieved 21 December 2020.
  7. Legrand, David (12 November 2020). "Proxmox Backup Server est disponible en version 1.0" [Proxmox Backup Server available in version 1.0]. InpactHardware (in French). Retrieved 21 December 2020.
  8. "Backup Content". Proxmox Backup Documentation. Proxmox Server Solutions GmbH. 11 November 2020. Retrieved 21 December 2020.
  9. "Introduction - History". Proxmox Backup Documentation. Proxmox Server Solutions GmbH. 11 November 2020. Retrieved 21 December 2020.
  10. Cinar, Seda (14 November 2020). "Proxmox Backup Server 1.0 released" . Retrieved 21 December 2020.
  11. De Luz, Sergio (15 November 2020). "¿Necesitas hacer backups profesionales? Proxmox Backup Server es tu solución" [Do you need to make professional backups? Proxmox Backup Server is your solution]. RedesZone.net (in Spanish). Grupo ADSLZone. Retrieved 21 December 2020.
  12. Sterr, Jonas. "Proxmox Backup Server configuration". The Thomas-Krenn-Wiki. Thomas Krenn. Retrieved 10 August 2021.
  13. Pearce, David. "Using Namespaces with Proxmox Backup Server" . Retrieved 12 November 2023.
  14. "Roadmap Proxmox Backup". Project page of the Proxmox Backup. Proxmox Server Solutions. Retrieved 21 December 2020.
  15. Smith, Lyle (26 November 2020). "Proxmox VE 6.3 Now Available". StorageReview.com. Flying Pig Ventures, LLC. Retrieved 21 December 2020.
  16. "How To Use Proxmox Backup Client To Backup Files In Linux" . Retrieved 12 November 2023.