See
https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/usage/communicators.html
Howard
-------
Howard Pritchard
Research Scientist
HPC-ENV
Los Alamos National Laboratory
howardp@lanl.gov