1. Hardware Overview

[For a detailed hardware list go here!]

The tux cluster consists of 2 login nodes, 30 compute nodes and a few service nodes. It runs Debian 12 Linux OS , uses SLURM as workload manager, and (hierarchical) Lmod environment module system for loading the installed software. Furthermore, three of the nodes have each installed two GPUs (NVIDIA GeForce GTX TITAN X and/or NVIDIA Tesla P100) for the purpose of calculations.

Every node consists of dual-socket servers equipped with different generations of Intel Xeon CPUs (currently, cascadelake, skylake, broadwell, haswell, and sandybridge); for this reason, the cluster is a heterogeneous system. All nodes are manufactured by Hewlett Packard Enterprise, DELL or Supermicro and they are equipped with Infiniband (IB) ConnectX-3 interconnects (FDR or QDR).

In total the cluster has 780 physical compute cores and in total memory is 4.7TB.

1.1. Main components

• 4 Intel Xeon Gold 6148 @ 2.40GHz CPU nodes with 40 cores and 128 GB memory each

• 6 Intel Xeon Gold 6142 @ 2.60GHz CPU nodes with 32 cores and 192 GB memory each

• 2 Intel Xeon Gold 6142 @ 2.60GHz CPU nodes with 32 cores and 384 GB memory each

• 2 Intel Xeon Gold 5218R @ 2.10GHz CPU nodes 40 cores and 128GB memory each

• 1 Intel Xeon E5-2630 v4 @ 2.20GHz CPU nodes with 20 cores and 64 GB memory each

• 2 Intel Xeon E5-2690 v3 @ 2.60GHz CPU nodes with 24 cores and 128 GB memory each

• 3 Intel Xeon E5-2660 v3 @ 2.60GHz CPU nodes with 20 cores and 128 GB memory each

• 11 Intel Xeon E5-2670 @ 2.60GHz CPU nodes with 16 cores and 96GB memory each

• 1 Intel Xeon E5-2650 @ 2.00GHz CPU node with 16 cores and 192GB memory each

• 3 GPU nodes with 2 NVIDIA GeForce GTX TITAN X cards with 12 GB ram each

• 4 login and service nodes with 64 cores and 416 GB memory in total

• Infiniband interconnects (FDR or QDR)

Feature	Tux
Number of nodes	30
Number of Cores	780
Number of GPUs	6
CPU types	Intel Xeon Gold 6148 @ 2.40GHz Intel Xeon Gold 6142 @ 2.60GHz Intel Xeon Gold 5218R @ 2.10GHz Intel Xeon E5-2630 v4 @ 2.20GHz Intel Xeon E5-2690 v3 @ 2.60GHz Intel Xeon E5-2660 v3 @ 2.60GHz Intel Xeon E5-2670 @ 2.60GHz Intel Xeon E5-2650 @ 2.00GHz
GPU type	NVIDIA TITAN X, 12GB RAM NVIDIA Tesla P100, 16GB RAM
Interconnects	Infiniband ConnectX-3 FDR or QDR
Total memory	4.7 TB
Total local disc	13 TB
Total shared filesystem capacity	23 TB

Notes:

• All tux nodes use Intel CPU architectures.

• Tux's operating system is Linux and the default shell is Bash