On 10/30/2012 10:17 AM, Torsten Hoefler wrote:

...

for network operations, this is harder unless the network guarantees that the data is placed in the remote memory. This, for example, is guaranteed by Mellanox adapters, but not by InfiniBand itself. Yes, I always assumed IB guarantees that but I couldn't cite the page of the standard. Isn't it that for an RDMA, the CQ entry will only appear at the source if the message is committed to remote memory?

No, it just means that it has been reliably delivered to the remote network adapter. The Mellanox adapters, however, send the network hardware ACK only after they get the PCIe ACK for the memory commit. -- Pavan -- Pavan Balaji http://www.mcs.anl.gov/~balaji