EXTOLL’s 65nm ASIC TOURMALET mounted on a PCI-express gen3 x16 plug-in card is the network interface controller (NIC). It enables high bandwidth, extremely low latency and ultra-high message rate. Furthermore, an efficient interface to the Network Attached Memory (NAM) devices developed in DEEP-ER is implemented.
Benefits of the EXTOLL network technology for the DEEP-ER architecture
The EXTOLL network is a direct network, i.e. no central switches are required. This reduces the total cost of ownership (TOC) and avoids performance degradation by such central components. Finally, EXTOLL networks scale linearly in terms of costs and allow scaling the network size by an increment of 1.
Each NIC provides 7 links with 100Gb/s per link and direction. In the DEEP-ER setup up to 6 links are used for spanning, e.g., a 3D-torus network topology, whereas the 7th link can be used to connect the NAM or other I/O resources to the network. In order to saturate the bandwidth of the particular NAM hardware used in DEEP-ER, up to 2 EXTOLL links can be used resulting in a total usable bidirectional memory bandwidth in excess of 32 GB/s.
The network supports point-to-point as well as multi-cast routing, which may be deterministic or adaptive. The network topology with a radix of 6 or less is arbitrary, since the routing is distributed and table based.
More information about the EXTOLL network technology is available on the EXTOLL website: www.extoll.de