Using local non-volatile memory for optimising Astron's radio astronomy code.
NVMe in the DEEP-ER architecture
An important DEEP-ER architecture innovation is the local non-volatile memory (NVMe) available on each Cluster and Booster node. Based on SSD technology and offering 400 GByte, the NVMes are directly connected with PCIe. This allows a higher bandwidth and makes the reading and writing time much faster than with a normal HDD.
The beauty of this technology: only the paths to input and output files have to be changed to where the NVMes are mounted.
Harnessing NVMes for radio astronomy
The I/O within the data processing pipeline from ASTRON's radio astronomy code is local, and hence benefits greatly from the use of the NVMes. Exploiting the NVMes, the achieved bandwidth for writing the correlator output to disk is increased from 490 GByte/s (global BeeGFS) to 658 GByte/s (local NVMe). Performance improvements like this will greatly optimise the overall performance of the data processing pipeline.