Hardware
Lichtenberg II Cluster Stage 2

Login (8 nodes)

  • 2x “Intel® Xeon® Platinum 8470Q Processor” (Sapphire Rapids)
  • 104 CPU cores and 2x Intel® AVX-512 units per core
  • 1024 GByte Main memory (DDR5-4800)
  • Hostnames: logd0001 .. logd0008
  • Accessible from outside as: lcluster1 .. lcluster8.hrz.tu-darmstadt.de
  • 52 cores per processor – Hyperthreading is off
    • CPU clock 2.1 GHz, Turbo 3.8 GHz
    • AVX-512 (Advanced Vector eXtensions, 512 bits)
    • AMX (Advanced Matrix eXtensions)
    • VNNI (Vector Neural Network Instructions)
    • TSX-NI (Transactional Synchronization eXtensions)

(See Intel's web site for the Xeon Platinum 8470Q for more details.)

MPI – Section (576 nodes)

In testing since 5th Dec 2023!

  • 2x “Intel® Xeon® Platinum 8470Q Processor” (Sapphire Rapids)
  • 104 cores and 2x Intel® AVX-512 units per core
  • 512 GByte Main memory (DDR5-4800)
  • HPC interconnect: InfiniBand HDR100 (100 GBit/s)
  • Hostnames: mpsd0001 .. mpsd0576
  • 52 cores per processor – Hyperthreading is off
    • CPU clock 2.1 GHz, Turbo 3.8 GHz
    • AVX-512 (Advanced Vector eXtensions, 512 bits)
    • AMX (Advanced Matrix eXtensions)
    • VNNI (Vector Neural Network Instructions)
    • TSX-NI (Transactional Synchronization eXtensions)

(See Intel's web site for the Xeon Platinum 8470Q for more details.)

MEM – Section (3 nodes)

2x nodes

  • 2x “Intel® Xeon® Platinum 8470Q Processor” (Sapphire Rapids)
  • 104 CPU cores and 2x Intel® AVX-512 units per CPU core
  • 2048 GByte Main memory (DDR5-4800)
  • HPC interconnect: InfiniBand HDR200 (200 GBit/s)
  • Hostnames: mpqd0001, mpqd0002

1x node

  • 4x “Intel® Xeon® Platinum 8468H Processor” (Sapphire Rapids)
  • 192 CPU cores and 2x Intel® AVX-512 units per CPU core
  • 6144 GByte Main memory (DDR5-4800)
  • HPC interconnect: InfiniBand HDR200 (200 GBit/s)
  • Hostname: mpzd0001
  • 52 cores per processor – Hyperthreading is off
    • CPU clock 2.1 GHz, Turbo 3.8 GHz
    • AVX-512 (Advanced Vector eXtensions, 512 bits)
    • AMX (Advanced Matrix eXtensions)
    • VNNI (Vector Neural Network Instructions)
    • TSX-NI (Transactional Synchronization eXtensions)

(See Intel's web site for the Xeon Platinum 8470Q for more details.)

  • 48 cores per processor – Hyperthreading is off
    • CPU clock 2.1 GHz, Turbo 3.8 GHz
    • AVX-512 (Advanced Vector eXtensions, 512 bits)
    • AMX (Advanced Matrix eXtensions)
    • VNNI (Vector Neural Network Instructions)
    • TSX-NI (Transactional Synchronization eXtensions)

(See Intel's web site for the Xeon Platinum 8468H for more details.)

ACC – Section GPUs (8 nodes)

Intel-GPUs (Ponte Vecchio / PVC)

2x nodes

  • 2x “Intel® Xeon® Platinum 8470Q Processor” (Sapphire Rapids)
  • 104 CPU cores and 2x Intel® AVX-512 units per core
  • 1024 GByte Main memory (DDR5-4800)
  • HPC interconnect: InfiniBand HDR100 (100 GBit/s)
  • 4x “Intel Xe® Ponte Vecchio®” (“DataCenter GPU Max 1550”) – there is a special usage info (opens in new tab) available
  • Hostnames: gpqd0004..gpqd0005

3x nodes as above, in addition (per processor):

  • 64 GByte HBM (High Bandwidth Memory)
  • Hostnames: gpqd0001..gpqd0003

Accelerator cards “Intel Xe® Ponte Vecchio®” (“DataCenter GPU Max 1550”):

  • 900 – 1600 MHz GPU clock
  • 128 Xe-Cores
  • 1024 Xe Vector Engines
  • 128 Ray Tracing Units
  • 1024 Intel® Xe Matrix Extensions (Intel® XMX) Engines
  • 128 GByte HBM2e (High Bandwidth Memory): 3276.8 GB/s

Details

Nvidia-GPUs

2x nodes

  • 2x AMD EPYC 9554 Processor (Zen 4)
  • 128 CPU cores and 1x AVX-512 unit per core
  • 1536 GByte Main memory (DDR5-4800)
  • HPC interconnect: Infiniband HDR200 (200 GBit/s)
  • 4x NVIDIA Hopper SXM5 (H100 Chip) HBM3 GPUs
  • Hostnames: ghqd0001..ghqd0002

Accelerator cards NVIDIA® Hopper 100:

  • 1096 – 1755 MHz GPU clock
  • 528 Tensor cores
  • 16896 CUDA cores
  • 9.7 TFlop/s | 51 TFlop/s Performance (Double Precision, FP64 | Tensor FP64)
  • 51 TFlop/s | 756 TFlop/s Performance (Single Precision, FP32 | Tensor FP32)
  • 80 GB HBM3 ECC RAM

Details

AMD-GPUs

1x nodes

  • 2x AMD EPYC 9534 Processor (Zen 4)
  • 128 CPU cores and 1x AVX-512 unit per core
  • 2304 GByte Main memory (DDR5-4800)
  • HPC interconnect: Infiniband HDR100 (100 GBit/s)
  • 8x AMD MI300X192GB (MI300X) GPUs
  • Hostnames: gaod0001

Accelerator cards AMD Instinct® MI300X:

  • 2100 MHz GPU clock
  • 1216 Matrix cores
  • 19456 Stream processors
  • 81.7 TFlop/s | 163.4 TFlop/s Peak Performance (Double Precision, FP64 | MatrixFP64)
  • 163.4 TFlop/s | 653.7 TFlop/s Peak Performance (Single Precision, FP32 | Matrix FP32)
  • 192 GB HBM3 RAM

Details