In order to leverage the GPUs on a system, I'd like to be able to draw a block diagram and understand the connections represented by "nvidia-smi topo -m" output.
Can someone provide a system level block diagram of this? Descriptions of the connections would be great too. I'm sure this would help many people exploit their multi gpu systems.
lstopo
command from thehwloc
package ?hwloc
project is hosted by the Open MPI project, this is a standalone package that is independent from the MPI library. note you might have to buildhwloc
by yourself and configure it with--with-cuda