December 2018 - mpiwg-sessions - mailman3.cels.anl.gov

Standards review request
by Ralph H Castain 28 Dec '18

28 Dec '18

Hello all I have tried to capture the PMIx Groups support for MPI Sessions in a draft chapter for the PMIx Standards doc. I would appreciate it if those who are interested would take a look at it and provide any comments/questions. You can find the RFC (plus a pdf version of the chapter) here: https://github.com/pmix/pmix-standard/pull/139 I hope everyone is having a happy holiday season! Ralph

1 0

we should discuss this issue before the 1/9 virtual meeting
by Pritchard Jr., Howard 18 Dec '18

18 Dec '18

https://github.com/mpiwg-sessions/sessions-issues/issues/4 -- Howard Pritchard B Schedule HPC-ENV Office 9, 2nd floor Research Park TA-03, Building 4200, Room 203 Los Alamos National Laboratory

1 0

propose skipping today and next two webexes as well
by Pritchard Jr., Howard 17 Dec '18

17 Dec '18

HI Folks, I propose skipping today. I’m very busy with actually using Nathan’s proto-type in an app, and debugging Open MPI and PMIx/Prrte along the way, so would find my time best spent on that activity. We’ll skip the next two Mondays for the holidays and resume on 1/7/19. See you next year! Howard -- Howard Pritchard B Schedule HPC-ENV Office 9, 2nd floor Research Park TA-03, Building 4200, Room 203 Los Alamos National Laboratory

1 0

Re: [mpiwg-sessions] notes from sessions (Enclaves) reading at 12/5/18 forum
by Pritchard Jr., Howard 05 Dec '18

05 Dec '18

HI Dan, I think we should go through non-chap 10 changes if we get the chance tomorrow. Howard -- Howard Pritchard B Schedule HPC-ENV Office 9, 2nd floor Research Park TA-03, Building 4200, Room 203 Los Alamos National Laboratory From: HOLMES Daniel <d.holmes(a)epcc.ed.ac.uk<mailto:[email protected]>> Date: Wednesday, December 5, 2018 at 10:05 PM To: Howard Pritchard <howardp(a)lanl.gov<mailto:[email protected]>> Cc: MPI Sessions working group <mpiwg-sessions(a)lists.mpi-forum.org<mailto:[email protected]>> Subject: Re: [mpiwg-sessions] notes from sessions (Enclaves) reading at 12/5/18 forum Thanks Howard, that captures most things I can remember. If we get more time tomorrow, should we go through non-chap10 changes (my preference - none of that has been presented yet) or work on fixing some of the feedback from today (get a head-start on prep for the next virtual meeting)? Cheers, Dan. — Dr Daniel Holmes PhD Applications Consultant in HPC Research d.holmes(a)epcc.ed.ac.uk<mailto:[email protected]> Phone: +44 (0) 131 651 3465 Mobile: +44 (0) 7940 524 088 Address: Room 2.09, Bayes Centre, 47 Potterrow, Central Area, Edinburgh, EH8 9BT — The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. — On 5 Dec 2018, at 18:03, Pritchard Jr.,Howard via mpiwg-sessions <mpiwg-sessions(a)lists.mpi-forum.org<mailto:[email protected]>> wrote: Hi Folks, Notes from the Sessions reading at 12/5/18 forum: Dan gives some background about PR #55 as is. He says we’ve got enough changes that aren’t ticket 0 that this really shouldn’t be called a reading. We’ve added 7271 lines and subtracted 1004. A lot of this is moving around. Move all the getting processes started into chapter 10. Wesley asks about dynamic being incompatible with peer to peer – Dan says no, can be mixed. Tony is getting us confused. How to do Sessions outside of MPI? Looking for using sessions concepts for more general job startup. Aurelian asks about how we get groups from nothing – Dan says we aren’t getting groups from nothing – hence the runtime process set notion. Martin says we should be more careful about Process vs MPI Process – but this is in places we’ve not changed for sessions in most cases. Some discussion of the use of the term Session and “Peer to Peer” - should we use some others? List of things brought up during the reading/plenary * Martin wants to drop “unless the application explicitly calls MPI_INIT” in page 416, lines 46-47. Add valid as an adjective to MPI COMM WORLD in this section. * We need to fix the second paragraph of 10.1 to better integrate the dynamic process model back into the 3 models for process creation * fix 10.1 subtitle! * page 417 line 22 add Window or File * water down line 45 on page 416 or remove * question about MPC-MPI MPI process is a thread model from Aurelian and Martin. We need to think about this – maybe add a blurb in the pset definition * Maybe move last paragraph in 10.4 up to intro part of chapter and reword a bit. remove backward compatible? * swap 10.4.1 with 10.4.2. * page 418 line 1 remove use of “runtime” in that first, todo: decide if we want to mandate or highly recommend mpi://UNIVERSE and mpi://comm type shared.no<http://shared.no> examples. * make clearer what’s going on with lines 4-5, what exactly is a pset. define semantically? * some discussion of groups and getting groups from psets * key is mandatory for all process sets - Jeff Squyres thinks this needs more verbiage. * add some more discussion about the flags bit mask to MPI Session init. * fix f08 binding for MPI_Session_init flags should be TYPE(MPI_Flags), check other f08 bindings too where INTEGER should be replaced with a TYPE * could we use info arg to MPI_Session_init rather than flags * use tools cvar/pvar approach for psets and their lengths * replace MPI_Errhandler with MPI_Session_errhandler in multiple places * add text for thread level support * Aurelian asks about thread safety for things like data type manipulation, etc. This needs to go with the info ops before MPI Init discussion. * an advice to users about sessions and how implementations may use them – Dan talks about isolation and multiplexing, grouping of communicators. * should we call Sessions Enclaves? * pre-defined info keys * options naming for sessions? Nathan asked about this. * communicator inherits uri as its name idea * need to add local to the description of MPI_Session_init * be consistent with capitalization of session/enclave Martin says put MPI in front of Enclave or Session * function name for MPI_Session_init line 46 on page 418 * make session handle in out to MPI_Session_finalize * need a lot more text – use analogous not equivalent, should we add a drop-all-resources type of call that frees all resources associated with a session. Collective. Files, windows, communicators, groups get leaned up * MPI Session get num sets replace pset_name with npsets or something like this, * same issue with get_psetlen * could we replace all this with an in/out info object * definitely need to keep the figure * rework chapter describing MPI_SESSION_GET_NTH_PSET about room for NULL terminator etc. Check MPI T and info * in the code example title add a reference to chapter six functions. * question about where the example would block * verbiage about session finalize associated with the example * uniqueness of uri (Jeff says don’t use this!!!) across sets of processes, suggestion and advice to users for MPI_Create_comm_from_group gov://llnl thingy * Tony is talking about doing state transitions. * should we rename MPI_GROUP_FROM_SESSION_PSET . maybe return MPI GROUP EMPTY if not valid pset name? Howard -- Howard Pritchard B Schedule HPC-ENV Office 9, 2nd floor Research Park TA-03, Building 4200, Room 203 Los Alamos National Laboratory _______________________________________________ mpiwg-sessions mailing list mpiwg-sessions(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpiwg-sessions

1 0

Re: [mpiwg-sessions] notes from sessions (Enclaves) reading at 12/5/18 forum
by HOLMES Daniel 05 Dec '18

05 Dec '18

Thanks Howard, that captures most things I can remember. If we get more time tomorrow, should we go through non-chap10 changes (my preference - none of that has been presented yet) or work on fixing some of the feedback from today (get a head-start on prep for the next virtual meeting)? Cheers, Dan. — Dr Daniel Holmes PhD Applications Consultant in HPC Research d.holmes(a)epcc.ed.ac.uk<mailto:[email protected]> Phone: +44 (0) 131 651 3465 Mobile: +44 (0) 7940 524 088 Address: Room 2.09, Bayes Centre, 47 Potterrow, Central Area, Edinburgh, EH8 9BT — The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336. — On 5 Dec 2018, at 18:03, Pritchard Jr., Howard via mpiwg-sessions <mpiwg-sessions(a)lists.mpi-forum.org<mailto:[email protected]>> wrote: Hi Folks, Notes from the Sessions reading at 12/5/18 forum: Dan gives some background about PR #55 as is. He says we’ve got enough changes that aren’t ticket 0 that this really shouldn’t be called a reading. We’ve added 7271 lines and subtracted 1004. A lot of this is moving around. Move all the getting processes started into chapter 10. Wesley asks about dynamic being incompatible with peer to peer – Dan says no, can be mixed. Tony is getting us confused. How to do Sessions outside of MPI? Looking for using sessions concepts for more general job startup. Aurelian asks about how we get groups from nothing – Dan says we aren’t getting groups from nothing – hence the runtime process set notion. Martin says we should be more careful about Process vs MPI Process – but this is in places we’ve not changed for sessions in most cases. Some discussion of the use of the term Session and “Peer to Peer” - should we use some others? List of things brought up during the reading/plenary * Martin wants to drop “unless the application explicitly calls MPI_INIT” in page 416, lines 46-47. Add valid as an adjective to MPI COMM WORLD in this section. * We need to fix the second paragraph of 10.1 to better integrate the dynamic process model back into the 3 models for process creation * fix 10.1 subtitle! * page 417 line 22 add Window or File * water down line 45 on page 416 or remove * question about MPC-MPI MPI process is a thread model from Aurelian and Martin. We need to think about this – maybe add a blurb in the pset definition * Maybe move last paragraph in 10.4 up to intro part of chapter and reword a bit. remove backward compatible? * swap 10.4.1 with 10.4.2. * page 418 line 1 remove use of “runtime” in that first, todo: decide if we want to mandate or highly recommend mpi://UNIVERSE and mpi://comm type shared.no<http://shared.no> examples. * make clearer what’s going on with lines 4-5, what exactly is a pset. define semantically? * some discussion of groups and getting groups from psets * key is mandatory for all process sets - Jeff Squyres thinks this needs more verbiage. * add some more discussion about the flags bit mask to MPI Session init. * fix f08 binding for MPI_Session_init flags should be TYPE(MPI_Flags), check other f08 bindings too where INTEGER should be replaced with a TYPE * could we use info arg to MPI_Session_init rather than flags * use tools cvar/pvar approach for psets and their lengths * replace MPI_Errhandler with MPI_Session_errhandler in multiple places * add text for thread level support * Aurelian asks about thread safety for things like data type manipulation, etc. This needs to go with the info ops before MPI Init discussion. * an advice to users about sessions and how implementations may use them – Dan talks about isolation and multiplexing, grouping of communicators. * should we call Sessions Enclaves? * pre-defined info keys * options naming for sessions? Nathan asked about this. * communicator inherits uri as its name idea * need to add local to the description of MPI_Session_init * be consistent with capitalization of session/enclave Martin says put MPI in front of Enclave or Session * function name for MPI_Session_init line 46 on page 418 * make session handle in out to MPI_Session_finalize * need a lot more text – use analogous not equivalent, should we add a drop-all-resources type of call that frees all resources associated with a session. Collective. Files, windows, communicators, groups get leaned up * MPI Session get num sets replace pset_name with npsets or something like this, * same issue with get_psetlen * could we replace all this with an in/out info object * definitely need to keep the figure * rework chapter describing MPI_SESSION_GET_NTH_PSET about room for NULL terminator etc. Check MPI T and info * in the code example title add a reference to chapter six functions. * question about where the example would block * verbiage about session finalize associated with the example * uniqueness of uri (Jeff says don’t use this!!!) across sets of processes, suggestion and advice to users for MPI_Create_comm_from_group gov://llnl thingy * Tony is talking about doing state transitions. * should we rename MPI_GROUP_FROM_SESSION_PSET . maybe return MPI GROUP EMPTY if not valid pset name? Howard -- Howard Pritchard B Schedule HPC-ENV Office 9, 2nd floor Research Park TA-03, Building 4200, Room 203 Los Alamos National Laboratory _______________________________________________ mpiwg-sessions mailing list mpiwg-sessions(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpiwg-sessions The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.

1 0

notes from sessions (Enclaves) reading at 12/5/18 forum
by Pritchard Jr., Howard 05 Dec '18

05 Dec '18

Hi Folks, Notes from the Sessions reading at 12/5/18 forum: Dan gives some background about PR #55 as is. He says we’ve got enough changes that aren’t ticket 0 that this really shouldn’t be called a reading. We’ve added 7271 lines and subtracted 1004. A lot of this is moving around. Move all the getting processes started into chapter 10. Wesley asks about dynamic being incompatible with peer to peer – Dan says no, can be mixed. Tony is getting us confused. How to do Sessions outside of MPI? Looking for using sessions concepts for more general job startup. Aurelian asks about how we get groups from nothing – Dan says we aren’t getting groups from nothing – hence the runtime process set notion. Martin says we should be more careful about Process vs MPI Process – but this is in places we’ve not changed for sessions in most cases. Some discussion of the use of the term Session and “Peer to Peer” - should we use some others? List of things brought up during the reading/plenary * Martin wants to drop “unless the application explicitly calls MPI_INIT” in page 416, lines 46-47. Add valid as an adjective to MPI COMM WORLD in this section. * We need to fix the second paragraph of 10.1 to better integrate the dynamic process model back into the 3 models for process creation * fix 10.1 subtitle! * page 417 line 22 add Window or File * water down line 45 on page 416 or remove * question about MPC-MPI MPI process is a thread model from Aurelian and Martin. We need to think about this – maybe add a blurb in the pset definition * Maybe move last paragraph in 10.4 up to intro part of chapter and reword a bit. remove backward compatible? * swap 10.4.1 with 10.4.2. * page 418 line 1 remove use of “runtime” in that first, todo: decide if we want to mandate or highly recommend mpi://UNIVERSE and mpi://comm type shared.no examples. * make clearer what’s going on with lines 4-5, what exactly is a pset. define semantically? * some discussion of groups and getting groups from psets * key is mandatory for all process sets - Jeff Squyres thinks this needs more verbiage. * add some more discussion about the flags bit mask to MPI Session init. * fix f08 binding for MPI_Session_init flags should be TYPE(MPI_Flags), check other f08 bindings too where INTEGER should be replaced with a TYPE * could we use info arg to MPI_Session_init rather than flags * use tools cvar/pvar approach for psets and their lengths * replace MPI_Errhandler with MPI_Session_errhandler in multiple places * add text for thread level support * Aurelian asks about thread safety for things like data type manipulation, etc. This needs to go with the info ops before MPI Init discussion. * an advice to users about sessions and how implementations may use them – Dan talks about isolation and multiplexing, grouping of communicators. * should we call Sessions Enclaves? * pre-defined info keys * options naming for sessions? Nathan asked about this. * communicator inherits uri as its name idea * need to add local to the description of MPI_Session_init * be consistent with capitalization of session/enclave Martin says put MPI in front of Enclave or Session * function name for MPI_Session_init line 46 on page 418 * make session handle in out to MPI_Session_finalize * need a lot more text – use analogous not equivalent, should we add a drop-all-resources type of call that frees all resources associated with a session. Collective. Files, windows, communicators, groups get leaned up * MPI Session get num sets replace pset_name with npsets or something like this, * same issue with get_psetlen * could we replace all this with an in/out info object * definitely need to keep the figure * rework chapter describing MPI_SESSION_GET_NTH_PSET about room for NULL terminator etc. Check MPI T and info * in the code example title add a reference to chapter six functions. * question about where the example would block * verbiage about session finalize associated with the example * uniqueness of uri (Jeff says don’t use this!!!) across sets of processes, suggestion and advice to users for MPI_Create_comm_from_group gov://llnl thingy * Tony is talking about doing state transitions. * should we rename MPI_GROUP_FROM_SESSION_PSET . maybe return MPI GROUP EMPTY if not valid pset name? Howard -- Howard Pritchard B Schedule HPC-ENV Office 9, 2nd floor Research Park TA-03, Building 4200, Room 203 Los Alamos National Laboratory

1 0