Thank you Shigang. Your links are very helpful. Sorry Muhammad I didn't answer your question at the first time. I have just read about HMPI briefly several days ago. Huiwei Lu http://www.mcs.anl.gov/~huiweilu/ On Thu, Aug 29, 2013 at 1:53 PM, Shigang Li <[email protected]> wrote:

Hi Muhammad, Huiwei,

There is a Hybrid MPI(HMPI) library which aims at implementing MPI efficiently on both inter-node network and shared memory architecture. Here are some papers talking about this, which may give you some info.

Ownership Passing: Efficient Distributed Memory Programming on Multi-core Systems<http://htor.inf.ethz.ch/publications//img/friedley-ownership-passing.pdf> NUMA-Aware Shared Memory Collective Communication for MPI<http://dl.acm.org/citation.cfm?id=2462903> Hybrid MPI: Efficient Message Passing for Multi-core Systems<http://htor.inf.ethz.ch/publications//img/friedley-hmpi-sc13.pdf>

Best Regards, Shigang

On Thu, Aug 29, 2013 at 12:31 PM, Muhammad Ansar Javed < [email protected]> wrote:

...

Hi Huiwei, Thank you so much for suggesting reading material. These are really useful papers but I am looking for models that provide seamless integration of two devices (Network device and Shared Memory device) into one hybrid device. Message passing mechanism should be exactly same for end user at MPI layer. Idea is to use to use Network Device for establishing network communication between nodes and Shared memory device should be responsible for Intra-node communication on each multi-core machine. Shared Memory device is implemented using Multi-threading approach. Both Network and Shared Memory device are in working state independently.

I hope it explains what I am really looking for. Please suggest papers that can provide guidelines for achieving this goal.

On Wed, Aug 28, 2013 at 7:40 PM, Huiwei Lu <[email protected]> wrote:

...

Hi, Muhammad,

As I am also starting to exploit this area, I would like to share with you some of my readings.

Following are a few papers to help you start: 1. Early Experiments with the OpenMP/MPI Hybrid Programming Model, http://www.mcs.anl.gov/~lusk/hybridpaper.pdf 2. Test Suite for Evaluating Performance of MPI Implementations That Support MPI THREAD MULTIPLE, http://www.mcs.anl.gov/~thakur/papers/thread-tests.pdf

In the second paper, you can also find some code examples for using hybrid programming model.

Best,

Huiwei Lu http://www.mcs.anl.gov/~huiweilu/

On Wed, Aug 28, 2013 at 12:54 AM, Muhammad Ansar Javed < [email protected]> wrote:

...

Hi, I am looking for message passing models for Hybrid Parallelism that are being used in MPICH implementations for the Cluster of Multi-core machines. Can you please suggest me some papers or study material that can explain communication models that incorporate network communication as well as shared memory communication.

Thanks, Ansar

--

Regards: * *Muhammad Ansar Javed NUST SEECS Contact: +92 334 438 9394 Email: [email protected]