We have been discussing this topic in the working group, and would be glad to have your input. If you're looking for something you can use today, NCCL is a good option. There's also a library called libmp that uses GPUDirect Async for stream-based communication [1]. ~Jim. [1] https://github.com/gpudirect/libmp On Tue, Feb 9, 2021 at 3:09 PM Choi, Jaemin <[email protected]> wrote:
Hi Jim,
Do you happen to know if there has been progress on supporting CUDA streams in the MPI standard?
I’d be interested to hear about this or other frameworks (e.g. NCCL) that support asynchronous communication via streams.
Best,
Jaemin Choi
PhD Candidate in Computer Science
Research Assistant at the Parallel Programming Laboratory
University of Illinois Urbana-Champaign
*From:* mpiwg-hybridpm <[email protected]> *On Behalf Of *Jim Dinan via mpiwg-hybridpm *Sent:* Tuesday, February 9, 2021 1:10 PM *To:* Hybrid working group mailing list < [email protected]> *Cc:* Jim Dinan <[email protected]> *Subject:* [mpiwg-hybridpm] Call for Topics
Hi All,
The Hybrid & Accelerator WG will meet tomorrow. The agenda so far is empty. Please let me know if you have any topics that you would like to discuss.
Cheers,
~Jim.