- mpiwg-tools - mailman3.cels.anl.gov

[Mpi3-tools] Next WG Meeting 5/17: MPIR Discussion
by Martin Schulz 14 May '10

14 May '10

Hi all, Just as a reminder - the next MPI3 tools WG meeting will be on Monday 5/17 at 8am PDT, 11am EDT, 5pm MSZ. The main agenda point will be the discussion of the MPIR document that John sent around yesterday. The meeting link is: https://cisco.webex.com/cisco/j.php?ED=139132487&UID=0&PW=NNTM1ODViNjFk&RT=… Password: tools Talk to you on Monday, Martin ________________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulzm CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0

Re: [Mpi3-tools] DRAFT of the MPIR Process Acquisition Interface document
by John DelSignore 14 May '10

14 May '10

David Lecomber wrote: > Hi John, > > Thanks for circulating. > > I have one query - for the Tool Daemon Launch Extension as described, we > get a binary executed out on the nodes with arguments.. Could we/should > we push for more? Remember, this paper attempts to describe where we are, not where we want to be. It describes current practice. "Know from whence you came. If you know whence you came, there are absolutely no limitations to where you can go." -- James Baldwin > My preference - and I think other other tools would benefit - would be > for having arbitrary files shipped out to compute nodes, as well as > optionally executing these files. Sure, that sounds useful, but the MPIR interface as it stands now has no provision for that, and I'm not aware of any vendor extension to MPIR that provides that functionality. So... if that's what is wanted, someone will need to write a separate proposal, implement it, and get it through the standardization proecss. > This would allow rapid sending of shared libraries, topology files, etc. > - which could really help scalability in the case where a system vendor > has specific capability for this in their existing tree network. You must be thinking of the capability on Cray XT systems. > In the case of a large but ordinary cluster, for example, it would be > preferable not to take shared libs and other daemons or config files > from a shared filesystem, but for the remote nodes to be able to read > them from their own /tmp or equivalent local storage having had them > delivered by the MPI's own daemons. Again, sounds like what Cray XT does. I'm not sure if other system support a similar arrangement. But one thing to be wary of, at least on Cray, is that "/tmp" on the compute node is a memory disk which transparently steals memory from the user's application. So, the bigger the files in /tmp the less memory available for the application, and users don't like to "share" memory (no pun intended). So, there are limits to how much stuff can be copied to the compute nodes. > Of course, you could do all this already by appending to your binary > that file you want to send out with it, but that does feel a bit dirty! Or you can use a tool like makeself.sh to create a self extracting .run file. Cheers, John D. > I'll be on the call next week I hope - but thought I'd just raise the > question now, and let folks ponder it first. > > Best wishes > David >

1 0

Re: [Mpi3-tools] DRAFT of the MPIR Process Acquisition Interface document
by David Lecomber 14 May '10

14 May '10

Hi John, Thanks for circulating. I have one query - for the Tool Daemon Launch Extension as described, we get a binary executed out on the nodes with arguments.. Could we/should we push for more? My preference - and I think other other tools would benefit - would be for having arbitrary files shipped out to compute nodes, as well as optionally executing these files. This would allow rapid sending of shared libraries, topology files, etc. - which could really help scalability in the case where a system vendor has specific capability for this in their existing tree network. In the case of a large but ordinary cluster, for example, it would be preferable not to take shared libs and other daemons or config files from a shared filesystem, but for the remote nodes to be able to read them from their own /tmp or equivalent local storage having had them delivered by the MPI's own daemons. Of course, you could do all this already by appending to your binary that file you want to send out with it, but that does feel a bit dirty! I'll be on the call next week I hope - but thought I'd just raise the question now, and let folks ponder it first. Best wishes David -- David Lecomber, CTO, Allinea Software +44 7980 863033 Allinea Software Limited: Registered in England and Wales No: 6871298 The Innovation Centre, Warwick Technology Park, Warwick, CV34 6UW, UK

1 0

[Mpi3-tools] DRAFT of the MPIR Process Acquisition Interface document
by John DelSignore 13 May '10

13 May '10

Hi all, Attached is the second DRAFT of the MPIR Process Acquisition Interface document for discussion during the 5/17/10 concall. I also included a copy with change tracking turned on so that you can see the changes. I incorporated most of the comments I received from Bill Gropp and Jeff Squyres on the first draft. TO DO items: * Review this draft to see if people like it any better than the first draft. * The document master is still in Word, and should to get converted to LaTex. I'd rather someone else do that, not me. * This document describes the MPIR Process Acquisition Interface, but has a placeholder for the MPIR Message Queue Display Interface. I think all of the MQD stuff should be contained in a separate document, and this document should be restructured accordingly. * The MQD stuff needs to get written up. Cheers, John D.

1 0

Re: [Mpi3-tools] Next MPI-WG Tools 4/26, 8am PDT
by Dave Goodell 26 Apr '10

26 Apr '10

Attached is a slightly updated version of the proposal. It just has a minor change to incorporate the "immediate contents" language and mention "Configuration" variables in the section title. See the diff below if you are interested. -Dave diff --git a/taxon.txt b/taxon.txt index 7732d71..624c9e3 100644 --- a/taxon.txt +++ b/taxon.txt @@ -9,7 +9,7 @@ Date: 2010-04-21 ------8<------ %% Comes after the current "Performance Variables" section. %% Subsubsection 1.3.5 should be deleted. -\section{Performance Variable Taxonomic Information} +\section{Performance and Configuration Variable Taxonomic Information} MPI implementations can optionally provide information that describes the relationship of performance and configuration variables to each @@ -90,7 +90,9 @@ OUT type int MPIT_Taxon_query_set_variables(MPIT_Taxonquery_iterator *iterator, char *setname, char *name, int *namelen, int *type); -Iterate over all variables contained in the set identified by "setname". +Iterate over all variables directly contained in the set identified by +"setname". That is, variables contained indirectly by a contained set +will not be returned by this call. A unique identifying name for the variable is returned in "name" and "namelen" is set to the number of characters written. The value of "namelen" cannot be larger than MPIT_MAX_SET_NAME-1. The "type" parameter is set On Apr 24, 2010, at 12:17 AM, Martin Schulz wrote: > Hi all, > > Just as a reminder: the next MPI-3 tools WG meeting will be on 4/26 > at 8am PDT, > 11am EDT, 5pm MSZ. The link for the Webex meeting (which is also on > the wiki) is: > https://cisco.webex.com/ciscosales/j.php?ED=136031477&UID=0&PW=NMThmODUxN2M… > Password: tools > > The main point of the agenda is the discussions of Dave's proposal > for the MPIT > group and hierarchy information. The proposal is attached below. > > Martin > > > > > Begin forwarded message: > >> From: Dave Goodell <goodell(a)mcs.anl.gov> >> Date: April 21, 2010 6:38:57 PM EDT >> To: mpi3-tools(a)lists.mpi-forum.org >> Subject: Re: [Mpi3-tools] 4/19 meeting canceled / extra meeting 4/26 >> Reply-To: mpi3-tools(a)lists.mpi-forum.org >> >> Here is the current proposal. I fleshed it out in general and >> incorporated all of the notes that I have. If I'm missing >> something that someone suggested/requested at the last telecon, >> please let me know and I'll add it in. >> >> -Dave >> > <taxon.txt>

1 0

[Mpi3-tools] Next MPI-WG Tools 4/26, 8am PDT
by Martin Schulz 24 Apr '10

24 Apr '10

Hi all, Just as a reminder: the next MPI-3 tools WG meeting will be on 4/26 at 8am PDT, 11am EDT, 5pm MSZ. The link for the Webex meeting (which is also on the wiki) is: https://cisco.webex.com/ciscosales/j.php?ED=136031477&UID=0&PW=NMThmODUxN2M… Password: tools The main point of the agenda is the discussions of Dave's proposal for the MPIT group and hierarchy information. The proposal is attached below. Martin Begin forwarded message: > From: Dave Goodell <goodell(a)mcs.anl.gov> > Date: April 21, 2010 6:38:57 PM EDT > To: mpi3-tools(a)lists.mpi-forum.org > Subject: Re: [Mpi3-tools] 4/19 meeting canceled / extra meeting 4/26 > Reply-To: mpi3-tools(a)lists.mpi-forum.org > > Here is the current proposal. I fleshed it out in general and > incorporated all of the notes that I have. If I'm missing something > that someone suggested/requested at the last telecon, please let me > know and I'll add it in. > > -Dave > > > > On Apr 18, 2010, at 12:45 AM, Martin Schulz wrote: > >> Hi all, >> >> John asked me to postpone the MPIR discussion, which was scheduled >> for 4/19. >> I am therefore canceling the call. However, to make up for this >> (and since we won't >> have a face-to-face meeting at the next MPI forum), I would like to >> schedule an >> additional meeting at 4/26 (same time) - Dave has agreed to lead >> the discussion >> on the MPIT groups and hierarchies. >> >> Please let me know of this additional meeting time causes a huge >> problem. >> Thanks, >> >> Martin >> >> Jeff: Could you please change the webex sessions accordingly? Thanks! >> ________________________________________________________________________ >> Martin Schulz, schulzm(a)llnl.gov, http://*people.llnl.gov/schulzm >> CASC @ Lawrence Livermore National Laboratory, Livermore, USA >> >> >> >> _______________________________________________ >> Mpi3-tools mailing list >> Mpi3-tools(a)lists.mpi-forum.org >> http://*lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools > > _______________________________________________ > Mpi3-tools mailing list > Mpi3-tools(a)lists.mpi-forum.org > http://*lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools ________________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulzm CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0

Re: [Mpi3-tools] 4/19 meeting canceled / extra meeting 4/26
by Dave Goodell 21 Apr '10

21 Apr '10

Here is the current proposal. I fleshed it out in general and incorporated all of the notes that I have. If I'm missing something that someone suggested/requested at the last telecon, please let me know and I'll add it in. -Dave On Apr 18, 2010, at 12:45 AM, Martin Schulz wrote: > Hi all, > > John asked me to postpone the MPIR discussion, which was scheduled > for 4/19. > I am therefore canceling the call. However, to make up for this (and > since we won't > have a face-to-face meeting at the next MPI forum), I would like to > schedule an > additional meeting at 4/26 (same time) - Dave has agreed to lead the > discussion > on the MPIT groups and hierarchies. > > Please let me know of this additional meeting time causes a huge > problem. > Thanks, > > Martin > > Jeff: Could you please change the webex sessions accordingly? Thanks! > ________________________________________________________________________ > Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulzm > CASC @ Lawrence Livermore National Laboratory, Livermore, USA > > > > _______________________________________________ > Mpi3-tools mailing list > Mpi3-tools(a)lists.mpi-forum.org > http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools

1 0

Re: [Mpi3-tools] 4/19 meeting canceled / extra meeting 4/26
by Martin Schulz 19 Apr '10

19 Apr '10

Thanks! Martin On Apr 19, 2010, at 10:56 AM, Jeff Squyres wrote: > Done. Webex link remains the same for the 26th. > > On Apr 18, 2010, at 1:45 AM, Martin Schulz wrote: > >> Hi all, >> >> John asked me to postpone the MPIR discussion, which was scheduled >> for >> 4/19. >> I am therefore canceling the call. However, to make up for this (and >> since we won't >> have a face-to-face meeting at the next MPI forum), I would like to >> schedule an >> additional meeting at 4/26 (same time) - Dave has agreed to lead the >> discussion >> on the MPIT groups and hierarchies. >> >> Please let me know of this additional meeting time causes a huge >> problem. >> Thanks, >> >> Martin >> >> Jeff: Could you please change the webex sessions accordingly? Thanks! >> ________________________________________________________________________ >> Martin Schulz, schulzm(a)llnl.gov, http://*people.llnl.gov/schulzm >> CASC @ Lawrence Livermore National Laboratory, Livermore, USA >> >> >> >> _______________________________________________ >> Mpi3-tools mailing list >> Mpi3-tools(a)lists.mpi-forum.org >> http://*lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools >> > > > -- > Jeff Squyres > jsquyres(a)cisco.com > For corporate legal information go to: > http://*www.*cisco.com/web/about/doing_business/legal/cri/ > > _______________________________________________ > Mpi3-tools mailing list > Mpi3-tools(a)lists.mpi-forum.org > http://*lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools > ________________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulzm CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0

Re: [Mpi3-tools] 4/19 meeting canceled / extra meeting 4/26
by Jeff Squyres 19 Apr '10

19 Apr '10

Done. Webex link remains the same for the 26th. On Apr 18, 2010, at 1:45 AM, Martin Schulz wrote: > Hi all, > > John asked me to postpone the MPIR discussion, which was scheduled for > 4/19. > I am therefore canceling the call. However, to make up for this (and > since we won't > have a face-to-face meeting at the next MPI forum), I would like to > schedule an > additional meeting at 4/26 (same time) - Dave has agreed to lead the > discussion > on the MPIT groups and hierarchies. > > Please let me know of this additional meeting time causes a huge > problem. > Thanks, > > Martin > > Jeff: Could you please change the webex sessions accordingly? Thanks! > ________________________________________________________________________ > Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulzm > CASC @ Lawrence Livermore National Laboratory, Livermore, USA > > > > _______________________________________________ > Mpi3-tools mailing list > Mpi3-tools(a)lists.mpi-forum.org > http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools > -- Jeff Squyres jsquyres(a)cisco.com For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/

1 0

[Mpi3-tools] 4/19 meeting canceled / extra meeting 4/26
by Martin Schulz 18 Apr '10

18 Apr '10

Hi all, John asked me to postpone the MPIR discussion, which was scheduled for 4/19. I am therefore canceling the call. However, to make up for this (and since we won't have a face-to-face meeting at the next MPI forum), I would like to schedule an additional meeting at 4/26 (same time) - Dave has agreed to lead the discussion on the MPIT groups and hierarchies. Please let me know of this additional meeting time causes a huge problem. Thanks, Martin Jeff: Could you please change the webex sessions accordingly? Thanks! ________________________________________________________________________ Martin Schulz, schulzm(a)llnl.gov, http://people.llnl.gov/schulzm CASC @ Lawrence Livermore National Laboratory, Livermore, USA

1 0