The Ohio State University (OSU) Micro Benchmarks (OMB) are a widely used suite of benchmarks for measuring and evaluating the performance of MPI operations for point-to-point, multi-pair, and collective communications. These benchmarks are often used for comparing different Message Passing Inerface (MPI) implementations and the underlying network interconnect. Here we use the OSU micro-benchmark (version 7.2) to assess the performance in terms of bandwidth achieved with an Apptainer container between 2 processors on different nodes with OpenMPI (version 4.1.6) on the Norwegian academic High Performance Computers (HPC) located in Tromsø (Fram) and Trondheim (Betzy).
OSU MPI Get Bandwidth Test v7.2 with OpenMPI 4.1.6 on Fram & Betzy
Iaquinta, Jean. "OSU MPI Get Bandwidth Test v7.2 with OpenMPI 4.1.6 on Fram & Betzy." ROHub. Jan 05 ,2024. https://w3id.org/ro-id/3125b7be-03f9-447e-806f-20beb66f7949.
Output of the OSU MPI Get Bandwidth Test with openMPI 4.1.6 on Fram and Betzy
Plot showing the bandwidth as a function of the message size on Fram and Betzy
Sport/Competition discipline/Horse racing/Steeple chase
Education/School/Higher education/University
These benchmarks are often used for comparing different Message Passing Inerface (MPI) implementations and the underlying network interconnect.
Here we use the OSU micro-benchmark (version 7.2) to assess the performance in terms of bandwidth achieved with an Apptainer container between 2 processors on different nodes with OpenMPI (version 4.1.6) on the Norwegian academic High Performance Computers (HPC) located in Tromsø (Fram) and Trondheim (Betzy)
The Ohio State University (OSU) Micro Benchmarks (OMB) are a widely used suite of benchmarks for measuring and evaluating the performance of MPI operations for point-to-point, multi-pair, and collective communications.
Abstract The Slingshot interconnect designed by HPE/Cray is becoming more relevant in high-performance computing with its deployment on the upcoming exascale systems. In particular, it is the interconnect empowering the first exascale and highest-ranked supercomputer in the world, Frontier. It offers various features such as adaptive routing, congestion control, and isolated workloads. The deployment of newer interconnects sparks interest related to performance, scalability, and any potential bottlenecks as they are critical elements contributing to the scalability across nodes on these systems. In this paper, we delve into the challenges the Slingshot interconnect poses with current state-of-the-art MPI (message passing interface) libraries. In particular, we look at the scalability performance when using Slingshot across nodes. We present a comprehensive evaluation using various MPI and communication libraries including Cray MPICH, OpenMPI + UCX, RCCL, and MVAPICH2 on CPUs and GPUs on the Spock system, an early access cluster deployed with Slingshot-10, AMD MI100 GPUs and AMD Epyc Rome CPUs to emulate the Frontier system. We also evaluate preliminary CPU-b:ed support of MPI libraries on the Slingshot-11 interconnect.
High Performance MPI over the Slingshot Interconnect