September 2017 - mpiwg-ft - mailman3.cels.anl.gov

2017 09 27 Meeting Notes
by Bland, Wesley 27 Sep '17

27 Sep '17

Here's the notes from today's WG con call. https://github.com/mpiwg-ft/ft-issues/wiki/2017-09-27 mpiwg-ft/ft-issues Attendees * Intel - Wesley * Argonne - Ken, Yanfei * UTK - Aurelien * ORNL - Geoffroy Error Handlers * Wesley made edits based on the feedback from the face-to-face. * There are still a couple of very minor edits that need to be made Process Fault Tolerance * Is it possible to use ULFM and Reinit at the same time? * Not sure how they can be composed (even if the smaller communicator used ULFM) because the error handler for the larger communicator is still likely to be triggered after a process failure, which would trigger reinit. * We don't think it's a problem to use error handlers, but if using MPI_ERRORS_REINIT, it would need to be consistent across all communicators. * We still like using error handlers better than an API call * It doesn't create a new API interface * Changing the error handler is already required for process fault tolerance anyway. TODO Items * Aurelien - Write first draft of ULFM composability/recovery advice to have libraries repair MPI in one place. * Aurelien - Merge MPI_COMM_ISHRINK branch * Aurelien - Go back over other ULFM branches so we can discuss them next time * Wesley - Go back through ULFM RMA discussions to see what we need to do (if anything to move forward). * Wesley - Improve slides for catastrophic errors to include example use cases

1 0

Re: [mpiwg-ft] FTWG Con Call TOMORROW
by Bland, Wesley 26 Sep '17

26 Sep '17

Oh ok. No problem then. On Sep 26, 2017, at 3:39 PM, Anthony Skjellum <skjellum(a)gmail.com<mailto:[email protected]>> wrote: We'd like a couple of weeks... I was just trying to attend as a listener tomorrow. Tony On Tue, Sep 26, 2017 at 4:36 PM, Bland, Wesley <wesley.bland(a)intel.com<mailto:[email protected]>> wrote: Ok. Do you think you'll be ready to present something about FA-MPI? I assumed you'd need another couple of weeks to get that ready. Can I propose that we work on the items from last week's meeting first so we can wrap them up before getting to the big things (ULFM/Reinit/FA-MPI)? > On Sep 26, 2017, at 3:33 PM, Anthony Skjellum <skjellum(a)auburn.edu<mailto:[email protected]>> wrote: > > Hi, we are at the EuroMPI meeting; I am going to check the schedule to see if we can slip out... > > > Anthony Skjellum, PhD > Affiliate Faculty, Computer Science and Software Engineering at Auburn University > 205-807-4968<tel:205-807-4968> (cell) > > Preferred e-mails for me are skjellum(a)gmail.com<mailto:[email protected]> or tony-skjellum(a)utc.edu<mailto:[email protected]> > > > ________________________________________ > From: mpiwg-ft <mpiwg-ft-bounces(a)lists.mpi-forum.org<mailto:[email protected]>> on behalf of Bland, Wesley <wesley.bland(a)intel.com<mailto:[email protected]>> > Sent: Tuesday, September 26, 2017 3:30 PM > To: FTWG > Subject: [mpiwg-ft] FTWG Con Call TOMORROW > > The Fault Tolerance Working Group’s biweekly con call is tomorrow at 3:00 PM Eastern. The agenda: > > * Post mortem of face to face topics > * Go over proposed edits to error handler pull request > * Improve presentation for catastrophic errors to include more motivating examples > * Discuss possibility of using error handlers to determine process failure recovery model > > Future topics (probably won't have time for tomorrow): > > * FA-MPI (I believe Tony won't be able to attend as he's at EuroMPI) > * Reinit (Same for Ignacio) > > If there's something else that people would like to discuss, please just send an email to the WG so we can get it on the agenda. > > Thanks, > Wesley > > ......................................................................................................................................... > Join from PC, Mac, Linux, iOS or Android: https://tennessee.zoom.us/j/632356722?pwd=lI4%2F169CGcewIumekTziMw%3D%3D > Password: mpiforum > > Or iPhone one-tap (US Toll): +14086380968<tel:%2B14086380968>,632356722# or +16465588656<tel:%2B16465588656>,632356722# > > Or Telephone: > Dial: +1 408 638 0968<tel:%2B1%20408%20638%200968> (US Toll) or +1 646 558 8656<tel:%2B1%20646%20558%208656> (US Toll) > Meeting ID: 632 356 722 > International numbers available: https://tennessee.zoom.us/zoomconference?m=GscM59o_Qoig8v4aJl1OrsnXL-7Blrke > > Or an H.323/SIP room system: > H.323: 162.255.37.11 (US West) or 162.255.36.11 (US East) > Meeting ID: 632 356 722 > Password: 366244 > > SIP: 632356722(a)zoomcrc.com<mailto:[email protected]> > Password: 366244 > ......................................................................................................................................... > > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org<mailto:[email protected]> > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org<mailto:[email protected]> > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft _______________________________________________ mpiwg-ft mailing list mpiwg-ft(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft -- Anthony Skjellum, PhD skjellum(a)gmail.com<mailto:[email protected]> Cell: +1-205-807-4968 _______________________________________________ mpiwg-ft mailing list mpiwg-ft(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft

1 0

Re: [mpiwg-ft] FTWG Con Call TOMORROW
by Anthony Skjellum 26 Sep '17

26 Sep '17

We'd like a couple of weeks... I was just trying to attend as a listener tomorrow. Tony On Tue, Sep 26, 2017 at 4:36 PM, Bland, Wesley <wesley.bland(a)intel.com> wrote: > Ok. Do you think you'll be ready to present something about FA-MPI? I > assumed you'd need another couple of weeks to get that ready. Can I propose > that we work on the items from last week's meeting first so we can wrap > them up before getting to the big things (ULFM/Reinit/FA-MPI)? > > > On Sep 26, 2017, at 3:33 PM, Anthony Skjellum <skjellum(a)auburn.edu> > wrote: > > > > Hi, we are at the EuroMPI meeting; I am going to check the schedule to > see if we can slip out... > > > > > > Anthony Skjellum, PhD > > Affiliate Faculty, Computer Science and Software Engineering at Auburn > University > > 205-807-4968 (cell) > > > > Preferred e-mails for me are skjellum(a)gmail.com or > tony-skjellum(a)utc.edu > > > > > > ________________________________________ > > From: mpiwg-ft <mpiwg-ft-bounces(a)lists.mpi-forum.org> on behalf of > Bland, Wesley <wesley.bland(a)intel.com> > > Sent: Tuesday, September 26, 2017 3:30 PM > > To: FTWG > > Subject: [mpiwg-ft] FTWG Con Call TOMORROW > > > > The Fault Tolerance Working Group’s biweekly con call is tomorrow at > 3:00 PM Eastern. The agenda: > > > > * Post mortem of face to face topics > > * Go over proposed edits to error handler pull request > > * Improve presentation for catastrophic errors to include more > motivating examples > > * Discuss possibility of using error handlers to determine process > failure recovery model > > > > Future topics (probably won't have time for tomorrow): > > > > * FA-MPI (I believe Tony won't be able to attend as he's at EuroMPI) > > * Reinit (Same for Ignacio) > > > > If there's something else that people would like to discuss, please just > send an email to the WG so we can get it on the agenda. > > > > Thanks, > > Wesley > > > > ............................................................ > ............................................................ > ................. > > Join from PC, Mac, Linux, iOS or Android: https://tennessee.zoom.us/j/ > 632356722?pwd=lI4%2F169CGcewIumekTziMw%3D%3D > > Password: mpiforum > > > > Or iPhone one-tap (US Toll): +14086380968,632356722# or +16465588656 > ,632356722# > > > > Or Telephone: > > Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll) > > Meeting ID: 632 356 722 > > International numbers available: https://tennessee.zoom.us/ > zoomconference?m=GscM59o_Qoig8v4aJl1OrsnXL-7Blrke > > > > Or an H.323/SIP room system: > > H.323: 162.255.37.11 (US West) or 162.255.36.11 (US East) > > Meeting ID: 632 356 722 > > Password: 366244 > > > > SIP: 632356722(a)zoomcrc.com > > Password: 366244 > > ............................................................ > ............................................................ > ................. > > > > _______________________________________________ > > mpiwg-ft mailing list > > mpiwg-ft(a)lists.mpi-forum.org > > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft > > _______________________________________________ > > mpiwg-ft mailing list > > mpiwg-ft(a)lists.mpi-forum.org > > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft > > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft > -- Anthony Skjellum, PhD skjellum(a)gmail.com Cell: +1-205-807-4968

1 0

Re: [mpiwg-ft] FTWG Con Call TOMORROW
by Bland, Wesley 26 Sep '17

26 Sep '17

Ok. Do you think you'll be ready to present something about FA-MPI? I assumed you'd need another couple of weeks to get that ready. Can I propose that we work on the items from last week's meeting first so we can wrap them up before getting to the big things (ULFM/Reinit/FA-MPI)? > On Sep 26, 2017, at 3:33 PM, Anthony Skjellum <skjellum(a)auburn.edu> wrote: > > Hi, we are at the EuroMPI meeting; I am going to check the schedule to see if we can slip out... > > > Anthony Skjellum, PhD > Affiliate Faculty, Computer Science and Software Engineering at Auburn University > 205-807-4968 (cell) > > Preferred e-mails for me are skjellum(a)gmail.com or tony-skjellum(a)utc.edu > > > ________________________________________ > From: mpiwg-ft <mpiwg-ft-bounces(a)lists.mpi-forum.org> on behalf of Bland, Wesley <wesley.bland(a)intel.com> > Sent: Tuesday, September 26, 2017 3:30 PM > To: FTWG > Subject: [mpiwg-ft] FTWG Con Call TOMORROW > > The Fault Tolerance Working Group’s biweekly con call is tomorrow at 3:00 PM Eastern. The agenda: > > * Post mortem of face to face topics > * Go over proposed edits to error handler pull request > * Improve presentation for catastrophic errors to include more motivating examples > * Discuss possibility of using error handlers to determine process failure recovery model > > Future topics (probably won't have time for tomorrow): > > * FA-MPI (I believe Tony won't be able to attend as he's at EuroMPI) > * Reinit (Same for Ignacio) > > If there's something else that people would like to discuss, please just send an email to the WG so we can get it on the agenda. > > Thanks, > Wesley > > ......................................................................................................................................... > Join from PC, Mac, Linux, iOS or Android: https://tennessee.zoom.us/j/632356722?pwd=lI4%2F169CGcewIumekTziMw%3D%3D > Password: mpiforum > > Or iPhone one-tap (US Toll): +14086380968,632356722# or +16465588656,632356722# > > Or Telephone: > Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll) > Meeting ID: 632 356 722 > International numbers available: https://tennessee.zoom.us/zoomconference?m=GscM59o_Qoig8v4aJl1OrsnXL-7Blrke > > Or an H.323/SIP room system: > H.323: 162.255.37.11 (US West) or 162.255.36.11 (US East) > Meeting ID: 632 356 722 > Password: 366244 > > SIP: 632356722(a)zoomcrc.com > Password: 366244 > ......................................................................................................................................... > > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft

1 0

Re: [mpiwg-ft] FTWG Con Call TOMORROW
by Anthony Skjellum 26 Sep '17

26 Sep '17

Hi, we are at the EuroMPI meeting; I am going to check the schedule to see if we can slip out... Anthony Skjellum, PhD Affiliate Faculty, Computer Science and Software Engineering at Auburn University 205-807-4968 (cell) Preferred e-mails for me are skjellum(a)gmail.com or tony-skjellum(a)utc.edu ________________________________________ From: mpiwg-ft <mpiwg-ft-bounces(a)lists.mpi-forum.org> on behalf of Bland, Wesley <wesley.bland(a)intel.com> Sent: Tuesday, September 26, 2017 3:30 PM To: FTWG Subject: [mpiwg-ft] FTWG Con Call TOMORROW The Fault Tolerance Working Group’s biweekly con call is tomorrow at 3:00 PM Eastern. The agenda: * Post mortem of face to face topics * Go over proposed edits to error handler pull request * Improve presentation for catastrophic errors to include more motivating examples * Discuss possibility of using error handlers to determine process failure recovery model Future topics (probably won't have time for tomorrow): * FA-MPI (I believe Tony won't be able to attend as he's at EuroMPI) * Reinit (Same for Ignacio) If there's something else that people would like to discuss, please just send an email to the WG so we can get it on the agenda. Thanks, Wesley ......................................................................................................................................... Join from PC, Mac, Linux, iOS or Android: https://tennessee.zoom.us/j/632356722?pwd=lI4%2F169CGcewIumekTziMw%3D%3D Password: mpiforum Or iPhone one-tap (US Toll): +14086380968,632356722# or +16465588656,632356722# Or Telephone: Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll) Meeting ID: 632 356 722 International numbers available: https://tennessee.zoom.us/zoomconference?m=GscM59o_Qoig8v4aJl1OrsnXL-7Blrke Or an H.323/SIP room system: H.323: 162.255.37.11 (US West) or 162.255.36.11 (US East) Meeting ID: 632 356 722 Password: 366244 SIP: 632356722(a)zoomcrc.com Password: 366244 ......................................................................................................................................... _______________________________________________ mpiwg-ft mailing list mpiwg-ft(a)lists.mpi-forum.org https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft

1 0

FTWG Con Call TOMORROW
by Bland, Wesley 26 Sep '17

26 Sep '17

The Fault Tolerance Working Group’s biweekly con call is tomorrow at 3:00 PM Eastern. The agenda: * Post mortem of face to face topics * Go over proposed edits to error handler pull request * Improve presentation for catastrophic errors to include more motivating examples * Discuss possibility of using error handlers to determine process failure recovery model Future topics (probably won't have time for tomorrow): * FA-MPI (I believe Tony won't be able to attend as he's at EuroMPI) * Reinit (Same for Ignacio) If there's something else that people would like to discuss, please just send an email to the WG so we can get it on the agenda. Thanks, Wesley ......................................................................................................................................... Join from PC, Mac, Linux, iOS or Android: https://tennessee.zoom.us/j/632356722?pwd=lI4%2F169CGcewIumekTziMw%3D%3D Password: mpiforum Or iPhone one-tap (US Toll): +14086380968,632356722# or +16465588656,632356722# Or Telephone: Dial: +1 408 638 0968 (US Toll) or +1 646 558 8656 (US Toll) Meeting ID: 632 356 722 International numbers available: https://tennessee.zoom.us/zoomconference?m=GscM59o_Qoig8v4aJl1OrsnXL-7Blrke Or an H.323/SIP room system: H.323: 162.255.37.11 (US West) or 162.255.36.11 (US East) Meeting ID: 632 356 722 Password: 366244 SIP: 632356722(a)zoomcrc.com Password: 366244 .........................................................................................................................................

1 0

Boost Meeting Frequency
by Bland, Wesley 26 Sep '17

26 Sep '17

Hi FTWG, There were a couple of things discussed at the face to face last week in a plenary with the intention to speed up progress in the forum, particularly with large topics (fault tolerance, sessions, endpoints, etc.). If you weren't present, I'd highly recommend flipping through the presentation: https://github.com/mpi-forum/mpi-forum.github.io/blob/master/slides/2017/09… And notes: http://mpi-forum.org/meetings/2017/09/notes The items most relevant to us are: meeting frequency and video calls. First, it was suggested that WGs should increase their meeting frequency to weekly meetings in order to not lose all of our progress between meetings. Personally, I can definitely empathize with forgetting everything that happened between meetings, particularly if I have to miss one. So I propose that we meet every week at the same time now (Wednesday at 3:00 PM EST), rather than every other week. We were already meeting this week. I know some will probably have to miss because of EuroMPI, but I think most of us aren't there). Second, and this one is going to be a bit weird for some folks, is that we start using the video feature of these con calls. This is something that Jeff Squyres in particular was in favor of after seeing how much impact it had when Cisco started using video for its own internal calls. I've done a few calls with forum folks since, and I agree that it does improve the productivity of the meeting. I assume that the Xoom software we're using right now will support video so I'd like to start this tomorrow as well. We can have a discussion about these during the call tomorrow, especially for those that weren't present. There are more ideas that we worked on last week that will be considered for future adoption for the full forum (might involve rule changes), but these are a starting point. I think we all want to keep MPI going for as long as it can remain relevant and hopefully these small steps help us pick up the pace to do that. Thanks, Wesley

1 0

Re: [mpiwg-ft] Notes from September 2017 Meeting
by Bland, Wesley 22 Sep '17

22 Sep '17

Oh, I guess there should be a link... https://github.com/mpiwg-ft/ft-issues/wiki/2017-09-20 > On Sep 22, 2017, at 2:55 PM, Bland, Wesley <wesley.bland(a)intel.com> wrote: > > Hi WG, > > Here's my notes from this week's meeting. Take a look to see how things went. > > Thanks, > Wesley > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft

1 0

Re: [mpiwg-ft] Notes from September 2017 Meeting
by Aurelien Bouteiller 22 Sep '17

22 Sep '17

You forgot the actual notes :) On Sep 22, 2017, 15:55 -0400, Bland, Wesley <wesley.bland(a)intel.com>, wrote: > Hi WG, > > Here's my notes from this week's meeting. Take a look to see how things went. > > Thanks, > Wesley > _______________________________________________ > mpiwg-ft mailing list > mpiwg-ft(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpiwg-ft

1 0

Notes from September 2017 Meeting
by Bland, Wesley 22 Sep '17

22 Sep '17

Hi WG, Here's my notes from this week's meeting. Take a look to see how things went. Thanks, Wesley

1 0