Comparison of cluster software

Last updated

The following tables compare general and technical information for notable computer cluster software. This software can be grossly separated in four categories: Job scheduler, nodes management, nodes installation and integrated stack (all the above).

Contents

General information


SoftwareMaintainerCategoryDevelopment statusLatest releaseArchitectureOCS High-Performance / High-Throughput Computing License Platforms supportedCostPaid support available
Amoeba No active development MIT
Base One Foundation Component Library Proprietary
DIET INRIA, SysFera, Open SourceAll in oneGridRPC, SPMD, Hierarchical and distributed architecture, CORBAHTC/HPC CeCILL Unix-like, Mac OS X, AIX Free
DxEnterprise DH2i Nodes managementActively developedv23.0Proprietary Windows 2012R2/2016/2019/2022 and 8+, RHEL 7/8/9, CentOS 7, Ubuntu 16.04/18.04/20.04/22.04, SLES 15.4CostYes
Enduro/X Mavimax, Ltd.Job/Data Scheduleractively developedSOA GridHTC/HPC/HAGPLv2 or CommercialLinux, FreeBSD, MacOS, Solaris, AIXFree / CostYes
Ganglia Monitoringactively developed3.7.6 [1] OOjs UI icon edit-ltr-progressive.svg 21 February 2024;12 months ago BSD Unix, Linux, Microsoft Windows NT/XP/2000/2003/2008, FreeBSD, NetBSD, OpenBSD, DragonflyBSD, Mac OS X, Solaris, AIX, IRIX, Tru64, HPUX.Free
Grid MP Univa (formerly United Devices)Job Schedulerno active developmentDistributed master/workerHTC/HPC Proprietary Windows, Linux, Mac OS X, SolarisCost
Apache Mesos Apacheactively developed Apache license v2.0LinuxFreeYes
Moab Cluster Suite Adaptive ComputingJob Scheduleractively developedHPC Proprietary Linux, Mac OS X, Windows, AIX, OSF/Tru-64, Solaris, HP-UX, IRIX, FreeBSD & other UNIX platformsCostYes
NetworkComputer Runtime Design Automationactively developedHTC/HPC Proprietary Unix-like, Windows Cost
OpenHPC OpenHPC projectall in oneactively developedv2.61 February 2, 2023;2 years agoHPCLinux (CentOS / OpenSUSE Leap)FreeNo
OpenLava None. Formerly TeraprocJob SchedulerHalted by injunctionMaster/Worker, multiple admin/submit nodesHTC/HPCIllegal due to being a pirated version of IBM Spectrum LSF LinuxNot legally availableNo
PBS Pro AltairJob Scheduleractively developedMaster/worker distributed with fail-overHPC/HTCAGPL or ProprietaryLinux, WindowsFree or CostYes
Proxmox Virtual Environment Proxmox Server SolutionsCompleteactively developedOpen-source AGPLv3Linux, Windows, other operating systems are known to work and are community supportedFreeYes
Rocks Cluster Distribution Open Source/NSF grantAll in oneactively developed7.0 [2]   OOjs UI icon edit-ltr-progressive.svg (Manzanita) 1 December 2017;7 years agoHTC/HPCOpenSource CentOS Free
Popular Power
ProActive INRIA, ActiveEon, Open SourceAll in oneactively developedMaster/Worker, SPMD, Distributed Component Model, SkeletonsHTC/HPC GPL Unix-like, Windows, Mac OS X Free
RPyC Tomer Filibaactively developed MIT License *nix/WindowsFree
SLURM SchedMD Job Scheduleractively developedv23.11.3 January 24, 2024;13 months agoHPC/HTCGPLLinux/*nixFreeYes
Spectrum LSF IBM Job Scheduleractively developedMaster node with failover/exec clients, multiple admin/submit nodes, Suite addOnsHPC/HTC Proprietary Unix, Linux, Windows Cost and Academic - model - Academic, Express, Standard, Advanced and SuitesYes
Oracle Grid Engine (Sun Grid Engine, SGE) AltairJob Scheduleractive Development moved to Altair Grid EngineMaster node/exec clients, multiple admin/submit nodesHPC/HTC Proprietary *nix/WindowsCost
Some Grid Engine / Son of Grid Engine / Sun Grid EnginedaimhJob Scheduleractively developed (stable/maintenance)Master node/exec clients, multiple admin/submit nodesHPC/HTCOpen-source SISSL*nixFreeNo
SynfiniWay Fujitsu actively developedHPC/HTC ? Unix, Linux, Windows Cost
Techila Distributed Computing Engine Techila Technologies Ltd. All in oneactively developedMaster/worker distributedHTC Proprietary Linux, Windows CostYes
TORQUE Resource Manager Adaptive ComputingJob Scheduleractively developedProprietaryLinux, *nixCostYes
TrinityX ClusterVision All in oneactively developedv15 February 27, 2025;6 days agoHPC/HTCGPLv3Linux/*nixFreeYes
UniCluster Univa All in OneFunctionality and development moved to UniCloud (see above)FreeYes
UNICORE
Xgrid Apple Computer
Warewulf Provision and clusters managementactively developedv4.4.1 July 6, 2023;19 months agoHPCOpen SourceLinuxFree
xCATProvision and clusters managementactively developedv2.16.5 March 7, 2023;23 months agoHPCEclipse Public LicenseLinuxFree
SoftwareMaintainerCategoryDevelopment statusLatest releaseArchitecture High-Performance/ High-Throughput Computing License Platforms supportedCostPaid support available

Table explanation

Technical information

SoftwareImplementation LanguageAuthenticationEncryptionIntegrityGlobal File SystemGlobal File System + KerberosHeterogeneous/ Homogeneous exec nodeJobs priorityGroup priorityQueue typeSMP awareMax exec nodeMax job submitted CPU scavenging Parallel job Job checkpointing Python interface
Enduro/X C/C++ OS AuthenticationGPG, AES-128, SHA1NoneAny cluster Posix FS (gfs, gpfs, ocfs, etc.)Any cluster Posix FS (gfs, gpfs, ocfs, etc.)HeterogeneousOS Nice levelOS Nice levelSOA Queues, FIFOYesOS LimitsOS LimitsYesYesNoNo
HTCondor C++ GSI, SSL, Kerberos, Password, File System, Remote File System, Windows, Claim To Be, AnonymousNone, Triple DES, BLOWFISHNone, MD5None, NFS, AFSNot official, hack with ACL and NFS4HeterogeneousYesYesFair-share with some programmabilitybasic (hard separation into different node)tested ~10000?tested ~100000?YesMPI, OpenMP, PVMYes Yes, and native Python Binding
PBS Pro C/Python OS Authentication, MungeAny, e.g., NFS, Lustre, GPFS, AFSLimited availabilityHeterogeneousYesYesFully configurableYestested ~50,000MillionsYesMPI, OpenMPYes Yes
OpenLava C/C++OS authenticationNoneNFSHeterogeneous LinuxYesYesConfigurableYesYes, supports preemption based on priorityYesYesNo
Slurm C Munge, None, KerberosHeterogeneousYesYesMultifactor Fair-shareyestested 120ktested 100kNoYesYes PySlurm
Spectrum LSF C/C++Multiple - OS Authentication/KerberosOptionalOptionalAny - GPFS/Spectrum Scale, NFS, SMBAny - GPFS/Spectrum Scale, NFS, SMBHeterogeneous - HW and OS agnostic (AIX, Linux or Windows)Policy based - no queue to computenode bindingPolicy based - no queue to computegroup bindingBatch, interactive, checkpointing, parallel and combinationsyes and GPU aware (GPU License free)> 9.000 compute hots> 4 mio jobs a dayYes, supports preemption based on priority, supports checkpointing/resumeYes, fx parallel submissions for job collaboration over fx MPIYes, with support for user, kernel or library level checkpointing environments Yes
Torque CSSH, mungeNone, anyHeterogeneousYesYesProgrammableYestestedtestedYesYesYes Yes
SoftwareImplementation LanguageAuthenticationEncryptionIntegrityGlobal File SystemGlobal File System + KerberosHeterogeneous/ Homogeneous exec nodeJobs priorityGroup priorityQueue typeSMP awareMax exec nodeMax job submitted CPU scavenging Parallel job Job checkpointing

Table Explanation

See also

References

  1. "Release 3.7.6".
  2. "Rocks 7.0 is Released". 1 December 2017. Retrieved 17 November 2022.