March 2009 - mpiwg-tools - mailman3.cels.anl.gov

[Mpi3-tools] Group query proposal.
by Ashley Pittman 30 Mar '09

30 Mar '09

All, Firstly an apology, it seems I'm a little late arriving at this list, I thought I'd subscribed to the relevant ones last summer until Jeff gave me a heads up about this one a couple of weeks ago. I have been working on MPI debugging tools on and off for a few years now and at one point had a proposal ready to take to Euro-MPI, unfortunately at the time this didn't get to see the light of day however this working group is the ideal place to present this work. My proposal resolves around extending the existing message queue interface to cover collective operations, at it's heart is a simple per communicator rank-local counter and "active bit" which can be queried by the debbugger. This allows the debugger to see which ranks are performing collective operations at a given time and hence detect deadlock conditions and automatically locate ranks of interest in hung jobs. This code has been a feature of the Quadrics MPI stack for a number of years and has proved itself worthwhile time and time again, I hope to now bring this functionality to a wider audience, at this time I have working patches for OpenMPI and a open-source tool for making use of the new information. The Quadrics work is based on MPICH and MPICH2 and could be brought up to date with little work. Unfortunate timing means I can't make the April 7th meeting although I should be able to partake in the April 20th Conference call, it's the day after I return from holiday however so at that stage I'll be able to answer questions with a formal proposal following shortly after. Yours, Ashley Pittman.

1 0

[Mpi3-tools] Dial-in Access for MPI Tools WG Meeting in Chicago
by Martin Schulz 27 Mar '09

27 Mar '09

Hi all, As discussed during our last TelCon, we will use the next MPI forum face-to-face meeting to continue our discussion on the various debugging interfaces. In particular we will go over the feedback from the MPI forum and try to get the documents to a point where they can be written up. To allow people, who can't make it to Chicago, to participate, I was told that we will have access to a speakerphone. The meeting will be on Tuesday April 7th between 2pm and 5pm CDT (sorry for the later time). We will use the usual number: - Toll Free Dial In Number for Offsite Participants: 866-914-3976 - International Access/Caller Paid Dial In Number: 925-424-8105 - Dial In Number for LLNL Onsite Participants: 4-8105 - Access Security Code: 860609 # Martin _______________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulz6 CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0

[Mpi3-tools] Notes from 3/16 available
by Martin Schulz 20 Mar '09

20 Mar '09

Hi all, FYI - the notes from Monday's TelCon are now available on the Wiki. As usual, please feel free to add or correct. Martin _______________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulz6 CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0

Re: [Mpi3-tools] proccess ID type?
by William Gropp 16 Mar '09

16 Mar '09

They should be the same type, but they shouldn't be a type that is specific to one particular choice of operating system. pid_t isn't a universal type. int64_t might be sufficient to contain any simple enumeration of processes; otherwise, we'll need to define a type and the accessors for it. Bill On Mar 16, 2009, at 3:03 PM, Geoffrey R. Paulsen wrote: > Hello, I noticed a difference in the type used to declare pids in > two different areas, and I'm curious: > > 1) Why aren't they the same type? > 2) Why aren't we using a standardzed type like pid_t ? > > Location 1) http://www.mcs.anl.gov/research/projects/mpi/mpi-debug/ > > Taken from: mpich/mpid/ch2/attach.h > > typedef struct { > char * host_name; /* Something we can pass to > inet_addr */ > char * executable_name; /* The name of the image */ > int pid; /* The pid of the process */ > } MPIR_PROCDESC; > > > Location 2) http://www.mcs.anl.gov/research/projects/mpi/mpi-debug/mpi_interface.h.html > > Taken from: mpich/src/infoexport/mpi_interface.h > > #if (FOR_MPI2) > /* For handling attachment to new processes in MPI-2 we need > to know > * where they are. > */ > typedef struct mqs_process_location { > long pid; > char image_name [FILENAME_MAX]; > char host_name [64]; > } mqs_process_location; > #endif > > > These two structures look to have similar purposes. Is one a > "newer" version of the other? Are they from different MPI > implementations of the MSQ? > > > Thanks, > Geoff Paulsen > > _______________________________________________ > Mpi3-tools mailing list > Mpi3-tools(a)lists.mpi-forum.org > http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools William Gropp Deputy Director for Research Institute for Advanced Computing Applications and Technologies Paul and Cynthia Saylor Professor of Computer Science University of Illinois Urbana-Champaign

1 0

Re: [Mpi3-tools] Hello from HP-MPI
by Martin Schulz 16 Mar '09

16 Mar '09

Hi Geoff, Welcome to the group. Martin At 12:28 PM 3/16/2009, Geoffrey R. Paulsen wrote: >Hello All, > > I just wanted to take a moment and introduce myself to the team. > > I work in software development for HP-MPI in the Dallas, TX > area. I look forward to working with everyone on the tools > interface standardization effort for MPI3. > > Geoff (pronouced Jeff) > >_______________________________________________ >Mpi3-tools mailing list >Mpi3-tools(a)lists.mpi-forum.org >http:// lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools _______________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulz6 CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0

[Mpi3-tools] proccess ID type?
by Geoffrey R. Paulsen 16 Mar '09

16 Mar '09

Hello, I noticed a difference in the type used to declare pids in two different areas, and I'm curious: 1) Why aren't they the same type? 2) Why aren't we using a standardzed type like pid_t ? Location 1) http://www.mcs.anl.gov/research/projects/mpi/mpi-debug/ Taken from: mpich/mpid/ch2/attach.h typedef struct { char * host_name; /* Something we can pass to inet_addr */ char * executable_name; /* The name of the image */ int pid; /* The pid of the process */ } MPIR_PROCDESC; Location 2) http://www.mcs.anl.gov/research/projects/mpi/mpi-debug/mpi_interface.h.html Taken from: mpich/src/infoexport/mpi_interface.h #if (FOR_MPI2) /* For handling attachment to new processes in MPI-2 we need to know * where they are. */ typedef struct mqs_process_location { long pid; char image_name [FILENAME_MAX]; char host_name [64]; } mqs_process_location; #endif These two structures look to have similar purposes. Is one a "newer" version of the other? Are they from different MPI implementations of the MSQ? Thanks, Geoff Paulsen

1 0

[Mpi3-tools] Hello from HP-MPI
by Geoffrey R. Paulsen 16 Mar '09

16 Mar '09

Hello All, I just wanted to take a moment and introduce myself to the team. I work in software development for HP-MPI in the Dallas, TX area. I look forward to working with everyone on the tools interface standardization effort for MPI3. Geoff (pronouced Jeff)

1 0

Re: [Mpi3-tools] Reminder: MPI Tools WG TelCon Monday 3/16
by Bronis R. de Supinski 16 Mar '09

16 Mar '09

Yes. On Mon, 16 Mar 2009, Brian Smith wrote: > Is the call in number the same as before? > > Toll Free Dial In Number for Offsite Participants: 866-914-3976 > International Access/Caller Paid Dial In Number: 925-424-8105 > Dial In Number for LLNL Onsite Participants: 4-8105 > Access Security Code: 860609 # > > Thanks. > > > Brian Smith > BlueGene MPI Development > IBM Rochester > Phone: 507 253 4717 > smithbr(a)us.ibm.com > > > > > Martin Schulz <schulzm(a)llnl.gov> > Sent by: mpi3-tools-bounces(a)lists.mpi-forum.org > 03/16/2009 01:08 AM > Please respond to > mpi3-tools(a)lists.mpi-forum.org > > > To > mpi3-tools(a)lists.mpi-forum.org > cc > > Subject > [Mpi3-tools] Reminder: MPI Tools WG TelCon Monday 3/16 > > > > > > > Hi all, > > Sorry for the late email, but I still wanted to send a reminder > about tomorrow's/today's MPI tools WG TelCon: > > Date/Time: 3/16, 8am PT, 11am ET, 4pm(!) MSZ > > We'll continue our handle API discussion from last time. Please make > sure you have read the document at: > https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/MPI3Tools/handleapi > > If time permits, we'll also talk about the message queue interface, > since these two APIs are closely related. The current document for > this API is at: > www.cs.uiuc.edu/homes/wgropp/bib/papers/1999/pvmmpi99/eurompi-paper.pdf > > Also, we will decide on whether to shift the schedule for this > TelCon or keep it as is. The options are: > > - Keep the current bi-weekly schedule, next TelCon on 3/30 > - Shift schedule, next TelCon on 3/23 > - Shift schedule, but no TelCon until MPI forum meeting on 4/7 > > If you have a strong preference or constraint and can't make the > TelCon, please send me email before the TelCon time. > > Thanks! > > Martin > > > > _______________________________________________________________________ > Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulz6 > CASC @ Lawrence Livermore National Laboratory, Livermore, USA > > _______________________________________________ > Mpi3-tools mailing list > Mpi3-tools(a)lists.mpi-forum.org > http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools > >

1 0

Re: [Mpi3-tools] Reminder: MPI Tools WG TelCon Monday 3/16
by Brian Smith 16 Mar '09

16 Mar '09

Is the call in number the same as before? Toll Free Dial In Number for Offsite Participants: 866-914-3976 International Access/Caller Paid Dial In Number: 925-424-8105 Dial In Number for LLNL Onsite Participants: 4-8105 Access Security Code: 860609 # Thanks. Brian Smith BlueGene MPI Development IBM Rochester Phone: 507 253 4717 smithbr(a)us.ibm.com Martin Schulz <schulzm(a)llnl.gov> Sent by: mpi3-tools-bounces(a)lists.mpi-forum.org 03/16/2009 01:08 AM Please respond to mpi3-tools(a)lists.mpi-forum.org To mpi3-tools(a)lists.mpi-forum.org cc Subject [Mpi3-tools] Reminder: MPI Tools WG TelCon Monday 3/16 Hi all, Sorry for the late email, but I still wanted to send a reminder about tomorrow's/today's MPI tools WG TelCon: Date/Time: 3/16, 8am PT, 11am ET, 4pm(!) MSZ We'll continue our handle API discussion from last time. Please make sure you have read the document at: https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/MPI3Tools/handleapi If time permits, we'll also talk about the message queue interface, since these two APIs are closely related. The current document for this API is at: www.cs.uiuc.edu/homes/wgropp/bib/papers/1999/pvmmpi99/eurompi-paper.pdf Also, we will decide on whether to shift the schedule for this TelCon or keep it as is. The options are: - Keep the current bi-weekly schedule, next TelCon on 3/30 - Shift schedule, next TelCon on 3/23 - Shift schedule, but no TelCon until MPI forum meeting on 4/7 If you have a strong preference or constraint and can't make the TelCon, please send me email before the TelCon time. Thanks! Martin _______________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulz6 CASC @ Lawrence Livermore National Laboratory, Livermore, USA _______________________________________________ Mpi3-tools mailing list Mpi3-tools(a)lists.mpi-forum.org http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools

1 0

[Mpi3-tools] Reminder: MPI Tools WG TelCon Monday 3/16
by Martin Schulz 16 Mar '09

16 Mar '09

Hi all, Sorry for the late email, but I still wanted to send a reminder about tomorrow's/today's MPI tools WG TelCon: Date/Time: 3/16, 8am PT, 11am ET, 4pm(!) MSZ We'll continue our handle API discussion from last time. Please make sure you have read the document at: https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/MPI3Tools/handleapi If time permits, we'll also talk about the message queue interface, since these two APIs are closely related. The current document for this API is at: www.cs.uiuc.edu/homes/wgropp/bib/papers/1999/pvmmpi99/eurompi-paper.pdf Also, we will decide on whether to shift the schedule for this TelCon or keep it as is. The options are: - Keep the current bi-weekly schedule, next TelCon on 3/30 - Shift schedule, next TelCon on 3/23 - Shift schedule, but no TelCon until MPI forum meeting on 4/7 If you have a strong preference or constraint and can't make the TelCon, please send me email before the TelCon time. Thanks! Martin _______________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulz6 CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0