Scalability of NUMA

 

The results below show the scalability of NUMA for up to 1.5 Million MPI ranks (red curve in the plot).  The simulation was performed for the Baroclinic Instability problem on the sphere (full planet). The time-stepping uses Implicit-Explicit in the vertical direction (what we call 1D-IMEX and what atmospheric modelers call HEVI).


























25KM Resolution:

For 25 km global resolution this is achieved using 38,400 elements in the horizontal and 6 elements in the vertical all of order 5. This yields 29 Million grid points. The maximum number of cores is equal to the number of elements in the horizontal (38,400).


12.5KM Resolution:

For 12.5 km global resolution this is achieved using 153,600 elements in the horizontal and 6 elements in the vertical all of order 5. This yields 119 Million grid points. The maximum number of cores is equal to the number of elements in the horizontal (153,600).


2.77KM Resolution:

For 2.77 km global resolution this is achieved using 3,110,400 elements in the horizontal and 6 elements in the vertical all of order 5. This yields 2.4 Billion grid points. The maximum number of cores is equal to the number of elements in the horizontal (3,110,400).