Comparison of cluster software
The following tables compare general and technical information for notable computer cluster software. This software can be grossly separated in four categories: Job scheduler, nodes management, nodes installation and integrated stack.
General information
| Software | Maintainer | Category | Development status | Latest release | ArchitectureOCS | High-Performance / High-Throughput Computing | License | Platforms supported | Cost | |
| Amoeba | active development | |||||||||
| Base One Foundation Component Library | ||||||||||
| DIET | INRIA, SysFera, Open Source | All in one | GridRPC, SPMD, Hierarchical and distributed architecture, CORBA | HTC/HPC | Unix-like, Mac OS X, AIX | |||||
| Nodes management | developed | v23.0 | Windows 2012R2/2016/2019/2022 and 8+, RHEL 7/8/9, CentOS 7, Ubuntu 16.04/18.04/20.04/22.04, SUSE [Linux Enterprise Server|SLES] 15.4 | Cost | ||||||
| Enduro/X | Mavimax, Ltd. | Job/Data Scheduler | developed | SOA Grid | HTC/HPC/HA | GPLv2 or Commercial | Linux, FreeBSD, MacOS, Solaris, AIX | Free / Cost | ||
| Ganglia | Monitoring | developed | Unix, Linux, Microsoft Windows NT/XP/2000/2003/2008, FreeBSD, NetBSD, OpenBSD, DragonflyBSD, Mac OS X, Solaris, AIX, IRIX, Tru64, HPUX. | |||||||
| Grid MP | Univa | Job Scheduler | active development | Distributed master/worker | HTC/HPC | Windows, Linux, Mac OS X, Solaris | ||||
| Apache Mesos | Apache | developed | Linux | |||||||
| Moab Cluster Suite | Adaptive Computing | Job Scheduler | developed | HPC | Linux, Mac OS X, Windows, AIX, OSF/Tru-64, Solaris, HP-UX, IRIX, FreeBSD & other UNIX platforms | |||||
| NetworkComputer | Runtime Design Automation | developed | HTC/HPC | Unix-like, Windows | ||||||
| OpenClusterScheduler | Open Cluster Scheduler | all in one | developed | 9.0.8 | HTC/HPC | SISSL / Apache License | Linux, FreeBSD, Solaris | |||
| OpenHPC | OpenHPC project | all in one | developed | v2.61 | HPC | Linux | ||||
| OpenLava | Formerly Teraproc | Job Scheduler | Halted by injunction | Master/Worker, multiple admin/submit nodes | HTC/HPC | Illegal due to being a pirated version of IBM Spectrum LSF | Linux | |||
| PBS Pro | Altair | Job Scheduler | developed | Master/worker distributed with fail-over | HPC/HTC | AGPL or Proprietary | Linux, Windows | or Cost | ||
| Proxmox Virtual Environment | Proxmox Server Solutions | Complete | developed | Linux, Windows, other operating systems are known to work and are community supported | ||||||
| Rocks Cluster Distribution | Open Source/NSF grant | All in one | developed | HTC/HPC | CentOS | |||||
| Popular Power | ||||||||||
| ProActive | INRIA, ActiveEon, Open Source | All in one | developed | Master/Worker, SPMD, Distributed Component Model, Skeletons | HTC/HPC | Unix-like, Windows, Mac OS X | ||||
| RPyC | Tomer Filiba | developed | *nix/Windows | |||||||
| SLURM | SchedMD | Job Scheduler | developed | v23.11.3 | HPC/HTC | Linux/*nix | ||||
| Spectrum LSF | IBM | Job Scheduler | developed | Master node with failover/exec clients, multiple admin/submit nodes, Suite addOns | HPC/HTC | Unix, Linux, Windows | and Academic - model - Academic, Express, Standard, Advanced and Suites | |||
| Oracle Grid Engine (Sun Grid Engine, SGE) | Altair | Job Scheduler | active Development moved to Altair Grid Engine | Master node/exec clients, multiple admin/submit nodes | HPC/HTC | *nix/Windows | ||||
| Some Grid Engine / Son of Grid Engine / Sun Grid Engine | daimh | Job Scheduler | developed | Master node/exec clients, multiple admin/submit nodes | HPC/HTC | *nix | ||||
| SynfiniWay | Fujitsu | developed | HPC/HTC | Unix, Linux, Windows | ||||||
| Techila Distributed Computing Engine | All in one | developed | Master/worker distributed | HTC | Linux, Windows | |||||
| TORQUE Resource Manager | Adaptive Computing | Job Scheduler | developed | Linux, *nix | ||||||
| TrinityX | All in one | developed | v15 | HPC/HTC | v3 | Linux/*nix | ||||
| UniCluster | Univa | All in One | Functionality and development moved to UniCloud | |||||||
| UNICORE | ||||||||||
| Xgrid | Apple Computer | |||||||||
| Warewulf | Provision and clusters management | developed | v4.6.4 | HPC | Linux | |||||
| xCAT | Provision and clusters management | developed | v2.17.0 | HPC | Eclipse Public License | Linux | ||||
| Software | Maintainer | Category | Development status | Latest release | Architecture | High-Performance/ High-Throughput Computing | License | Platforms supported | Cost |
Table explanationSoftware: The name of the application that is described
Technical information
| Software | Implementation Language | Authentication | Encryption | Integrity | Global File System | Global File System + Kerberos | Heterogeneous/ Homogeneous exec node | Jobs priority | Group priority | Queue type | SMP aware | Max exec node | Max job submitted | CPU scavenging | Parallel job | Job checkpointing | |
| Enduro/X | C/C++ | OS Authentication | GPG, AES-128, SHA1 | cluster Posix FS | cluster Posix FS | Heterogeneous | OS Nice level | OS Nice level | SOA Queues, FIFO | OS Limits | OS Limits | ||||||
| HTCondor | C++ | GSI, SSL, Kerberos, Password, File System, Remote File System, Windows, Claim To Be, Anonymous | None, Triple DES, BLOWFISH | None, MD5 | None, NFS, AFS | Heterogeneous | Fair-share with some programmability | basic | tested ~10000? | tested ~100000? | MPI, OpenMP, PVM | ||||||
| PBS Pro | C/Python | OS Authentication, Munge | , e.g., NFS, Lustre, GPFS, AFS | Limited availability | Heterogeneous | Fully configurable | tested ~50,000 | Millions | MPI, OpenMP | ||||||||
| OpenLava | C/C++ | OS authentication | NFS | Heterogeneous Linux | Configurable | , supports preemption based on priority | |||||||||||
| Slurm | C | Munge, None, Kerberos | Heterogeneous | Multifactor Fair-share | tested 120k | tested 100k | |||||||||||
| Spectrum LSF | C/C++ | Multiple - OS Authentication/Kerberos | - GPFS/Spectrum Scale, NFS, SMB | - GPFS/Spectrum Scale, NFS, SMB | Heterogeneous - HW and OS agnostic | Policy based - no queue to computenode binding | Policy based - no queue to computegroup binding | Batch, interactive, checkpointing, parallel and combinations | and GPU aware | > 9.000 compute hots | > 4 mio jobs a day | , supports preemption based on priority, supports checkpointing/resume | , fx parallel submissions for job collaboration over fx MPI | , with support for user, kernel or library level checkpointing environments | |||
| Torque | C | SSH, munge | None, any | Heterogeneous | Programmable | tested | tested | ||||||||||
| Software | Implementation Language | Authentication | Encryption | Integrity | Global File System | Global File System + Kerberos | Heterogeneous/ Homogeneous exec node | Jobs priority | Group priority | Queue type | SMP aware | Max exec node | Max job submitted | CPU scavenging | Parallel job | Job checkpointing |
Table ExplanationSoftware: The name of the application that is describedSMP aware:
- * basic: hard split into multiple virtual host
- * basic+: hard split into multiple virtual host with some minimal/incomplete communication between virtual host on the same computer
- * dynamic: split the resource of the computer on demand