Within the DEEP and DEEP-ER research projects various prototypes have been or are being built.

Here is an overview on all systems.

DEEP-ER SDV

DEEP-ER Cluster

  • 16 dual-socket Intel® Xeon® E5-2680v3 nodes
  • Each node: 128 GByte DRAM, 400 GByte NVM

 

DEEP-ER Booster

  • 8 Adams Pass Intel Xeon Phi 7210 CPU
  • 72 Aurora Blade nodes with Intel® Xeon Phi™ 7210 CPU (direct liquid cooled)
  • Each node: 16 GByte on-package memory, 96 GByte DRAM, 200 GByte NVM

 

System

  • EXTOLL fabric using TOURMALET NICs with six links of 100Gbit/s each
  • Aggregate performance approx. 200 TFlop/s

 

Storage

  • 2 storage servers (spinning disks, 57 TB)
  • 1 metadata server (SSDs)
  • BeeGFS file system

DEEP-ER NAM

2 NAM devices are integrated into the DEEP-ER prototype.

  • FPGA + HMC
  • 2 Extoll links per NAM
  • access via the libNAM library
  • Sequential read/write performance for both links peaks at 11.1 GByte/s and 10.2 GByte/s

 

  • 1 Rack with 8 backplanes x 16 nodes (total 128)                                                         DEEP Cluster
  • Nodes: 2 x Intel(R) Xeon(R) CPU E5-2680, 32 GB RAM
  • Processors: 256 x Intel(R) Xeon(R) CPU E5-2680 (2048 cores)
  • Overall peak performance: 45 Teraflops
  • Main memory: 4 TB (aggregate)
  • Network:
    • 1 Gigabit-Ethernet
    • Infiniband (QDR)
    • 3D torus (FPGA based)
  • Power consumption: 50 kW (aggregate)
  • Operating system: CentOS 6.3
  • Vendor: Eurotech
  • 1 rack with 24 (half) backplanes in 12 chassis                                          DEEP Aurora Booster
  • 24 x Booster Interface Cards (BIC)
  • 16 x 2 booster nodes (BNs) per chassis (384 total)
  • Processor: Intel Xeon Phi 7120X
  • Main memory: 6.1 TB (aggregate)
  • Overall peak performance: 500 Teraflops
  • Network:
    • Gigabit-Ethernet
    • 3D EXTOLL torus
  • Power consumption: max. 150 kW
  • Operating system: Linux
  • Vendor: Eurotech
  • 1 cube with 32 Booster Nodes (BNs)                                          GreenICE Booster
  • Processor: Intel Xeon Phi 7120D
  • Main Memory: 512 GB (aggregate)
  • Overall peak perpfrormance: 38.4 Teraflops
  • Network: 3D EXTOLL torus
  • Power consumption: 10 kW
  • Operating system: Linux
  • Vendor: UniHD/Megware