November 2019 - mpi-forum - mailman3.cels.anl.gov

Re: [Mpi-forum] MPI_T Events für Request Completion Callbacks
by Joseph Schuchart 25 Nov '19

25 Nov '19

Sorry y'all, this wasn't meant for everyone :( I really need to fix my thunderbird's address book... On 11/25/19 3:43 PM, Joseph Schuchart via mpi-forum wrote: > Hallo Marc-André, > > Jannis und ich hatten uns auf der SC kurz über MPI und Task-basierte > Programmiermodelle ausgetauscht. Wir sind uns mehr oder wenig einig, > dass MPI ein Interface braucht, das es dem Nutzer erlaubt asynchron über > den Abschluss von Operationen hinter einem Requests benachrichtigt zu > werden (sprich, ohne bzw bevor das Test/Wait auf dem Request aufgerufen > wird). Jannis (und ich glaube auch Martin) hatte in dem Kontext das > MPI_T Event Interface erwähnt um über die Events eine Benachrichtigung > zu bekommen. Da du leider nicht da warst wollten wir dich mal in die > Diskussion aufnehmen und fragen was mit den Events möglich ist: > > 1) Aynchrone Benachrichtigung über einen Callback sobald der Request als > completed erkannt wird? > 2) Irgendeine Art von Nutzdaten die man an MPI übergeben kann und die > dann an den Callback übergeben werden? > 3) Eine Garantie wann der Callback ausgeführt wird? (nicht zwingend > nötig, "immediately" wäre aber schön ^^) > > Punkt 2 ist wichtig um zu vermeiden, dass die Anwendung zB ein Mapping > von Request auf das Objekt halten muss das von dem Request abhängt, zB > ein Task. Das würde mMn viel von den Vorteilen zunichte machen weil die > Anwendung dann wieder Speicher allokieren und sich um Locking etc > kümmern muss. > > Aktuell schwebt mir sowas hier vor: > > ``` > void completion_cb(void *data) > { > omp_event_handle_t *event = (omp_event_handle_t*)data; > omp_fulfill_event(*event); > } > > [...] > > omp_event_handle_t event; > > #pragma omp task detach(event) > { > MPI_Request req; > MPI_Isend(..., &req); > MPI_Request_on_completion(request, &completion_cb, &event); > } > ``` > > Ich arbeite gerade an einem Prototypen in Open MPI. Wenn sich das so > oder so ähnlich aber mit den MPI_T Events lösen lässt wäre es natürlich > umso besser. Ich glaube aber, dass Punkt 2 der Knackpunkt ist, oder? > > > Best Grüße > Joseph

1 0

MPI_T Events für Request Completion Callbacks
by Joseph Schuchart 25 Nov '19

25 Nov '19

Hallo Marc-André, Jannis und ich hatten uns auf der SC kurz über MPI und Task-basierte Programmiermodelle ausgetauscht. Wir sind uns mehr oder wenig einig, dass MPI ein Interface braucht, das es dem Nutzer erlaubt asynchron über den Abschluss von Operationen hinter einem Requests benachrichtigt zu werden (sprich, ohne bzw bevor das Test/Wait auf dem Request aufgerufen wird). Jannis (und ich glaube auch Martin) hatte in dem Kontext das MPI_T Event Interface erwähnt um über die Events eine Benachrichtigung zu bekommen. Da du leider nicht da warst wollten wir dich mal in die Diskussion aufnehmen und fragen was mit den Events möglich ist: 1) Aynchrone Benachrichtigung über einen Callback sobald der Request als completed erkannt wird? 2) Irgendeine Art von Nutzdaten die man an MPI übergeben kann und die dann an den Callback übergeben werden? 3) Eine Garantie wann der Callback ausgeführt wird? (nicht zwingend nötig, "immediately" wäre aber schön ^^) Punkt 2 ist wichtig um zu vermeiden, dass die Anwendung zB ein Mapping von Request auf das Objekt halten muss das von dem Request abhängt, zB ein Task. Das würde mMn viel von den Vorteilen zunichte machen weil die Anwendung dann wieder Speicher allokieren und sich um Locking etc kümmern muss. Aktuell schwebt mir sowas hier vor: ``` void completion_cb(void *data) { omp_event_handle_t *event = (omp_event_handle_t*)data; omp_fulfill_event(*event); } [...] omp_event_handle_t event; #pragma omp task detach(event) { MPI_Request req; MPI_Isend(..., &req); MPI_Request_on_completion(request, &completion_cb, &event); } ``` Ich arbeite gerade an einem Prototypen in Open MPI. Wenn sich das so oder so ähnlich aber mit den MPI_T Events lösen lässt wäre es natürlich umso besser. Ich glaube aber, dass Punkt 2 der Knackpunkt ist, oder? Best Grüße Joseph -- Dipl.-Inf. Joseph Schuchart High Performance Computing Center Stuttgart (HLRS) Nobelstr. 19 D-70569 Stuttgart Tel.: +49(0)711-68565890 Fax: +49(0)711-6856832 E-Mail: schuchart(a)hlrs.de

1 0

Ticket 121: Request for 1st vote in Albuquerque
by Joseph Schuchart 25 Nov '19

25 Nov '19

I would like to request the first vote for ticket 121 (memory alignment): Ticket: https://github.com/mpi-forum/mpi-issues/issues/121 PR: https://github.com/mpi-forum/mpi-standard/pull/96 PDF: https://github.com/mpi-forum/mpi-issues/files/3886563/mpi-report-issue-121_… (changes marked with ticket121) There are ticket-0 changes that were requested in Zurich, which are highlighted in https://github.com/mpi-forum/mpi-issues/files/3886569/mpi-report-ticket0-de… Unfortunately I won't be able to attend this time but Rolf agreed to take over this ticket. Thanks, Joseph -- Dipl.-Inf. Joseph Schuchart High Performance Computing Center Stuttgart (HLRS) Nobelstr. 19 D-70569 Stuttgart Tel.: +49(0)711-68565890 Fax: +49(0)711-6856832 E-Mail: schuchart(a)hlrs.de

1 0

Re: [Mpi-forum] Items for MPI Forum in Albuquerque / DEADLINE IS MONDAY
by Marc-André Hermanns 25 Nov '19

25 Nov '19

Dear all, After passing the reading in Zürich, the tools WG plans a 1st vote for MPI_T Events: Issue #79: https://github.com/mpi-forum/mpi-issues/issues/79 PR #33: https://github.com/mpi-forum/mpi-standard/pull/33 Cheers, Marc-Andre On 23.11.19 22:56, Martin Schulz via mpi-forum wrote: > Hi all, > > The next forum meeting is almost upon us (December 9-12) - as > discussed last time, the plan is to only have plenary items with > preference to the big topics that we want to see in MPI 4.0. The > deadline for all announcements is this Monday, November 25th. Please > send all reading or vote announcements to the list by that date. > > Thanks and see you in Albuquerque, > > Martin > > PS: Please register soon to help with logistics! > > > — > Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel > Systems > Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching > Member of the Board of Directors at the Leibniz Supercomputing Centre > (LRZ) > Email: schulzm(a)in.tum.de <mailto:[email protected]> > > > > _______________________________________________ > mpi-forum mailing list > mpi-forum(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpi-forum > -- Dr. rer. nat. Marc-André Hermanns IT Center Group: High Performance Computing Division: Computational Science and Engineering RWTH Aachen University Seffenter Weg 23 52074 Aachen Phone: +49 241 80-24381 hermanns(a)itc.rwth-aachen.de www.itc.rwth-aachen.de

1 0

FTWG Readings for December 2019
by Wesley Bland 25 Nov '19

25 Nov '19

Hi all, The Fault Tolerance Working Group would like to announce the following items for the Albuquerque meeting: Readings Issue 143 - Create MPI_INFO_ENV before MPI_INIT Issue: https://github.com/mpi-forum/mpi-issues/issues/143 <https://github.com/mpi-forum/mpi-issues/issues/143> Pull Request: https://github.com/mpi-forum/mpi-standard/pull/126 <https://github.com/mpi-forum/mpi-standard/pull/126> Description: This proposes a new function called MPI_INFO_ENV_CREATE_ARGV which would allow the user to pass in the argc and argv parameters and receive an MPI_INFO_ENV-like object back, which could be used for all of the same functionality as MPI_INFO_ENV. Second Vote Issue 134 - Add MPI_ERR_PROC_ABORTED Issue: https://github.com/mpi-forum/mpi-issues/issues/134 <https://github.com/mpi-forum/mpi-issues/issues/134> Pull Request: https://github.com/mpi-forum/mpi-standard/pull/112 <https://github.com/mpi-forum/mpi-standard/pull/112> Description: The proposal adds the MPI_ERR_PROC_ABORTED error class, that can be returned by operations that fail due to an aborted process. Errata Issue 152 - Make error code functions thread-safe Issue: https://github.com/mpi-forum/mpi-issues/issues/152 <https://github.com/mpi-forum/mpi-issues/issues/152> Pull Request: https://github.com/mpi-forum/mpi-standard/pull/141 <https://github.com/mpi-forum/mpi-standard/pull/141> Description: Add MPI_ERROR_CLASS and MPI_ERROR_STRING to the list of always thread-safe functions. Thanks, Wesley

1 0

Re: [Mpi-forum] Items for MPI Forum in Albuquerque / DEADLINE IS MONDAY
by Wesley Bland 25 Nov '19

25 Nov '19

At the Zurich meeting we did say that we wanted to see the changed interfaces to be able to “vote” on them. However, since we’re not planning a two vote cycle for this, we have some more time. I think you should show what you have and start distributing work to the chapter authors/committees so people have lots of time before the Portland meeting to go through their chapters. > On Nov 24, 2019, at 11:16 AM, Jeff Squyres (jsquyres) via mpi-forum <mpi-forum(a)lists.mpi-forum.org> wrote: > > Martin -- > > We probably need some plenary time for the Pythonization effort. > > Technically, it's a "ticket 0" change (and we won't have all of it done/ready by the T-2 week deadline tomorrow). But it does touch a giant portion of the spec. How do you want to handle it? > > >> On Nov 23, 2019, at 4:56 PM, Martin Schulz via mpi-forum <mpi-forum(a)lists.mpi-forum.org <mailto:[email protected]>> wrote: >> >> Hi all, >> >> The next forum meeting is almost upon us (December 9-12) - as discussed last time, the plan is to only have plenary items with preference to the big topics that we want to see in MPI 4.0. The deadline for all announcements is this Monday, November 25th. Please send all reading or vote announcements to the list by that date. >> >> Thanks and see you in Albuquerque, >> >> Martin >> >> PS: Please register soon to help with logistics! >> >> >> — >> Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems >> Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching >> Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) >> Email: schulzm(a)in.tum.de <mailto:[email protected]> >> >> >> _______________________________________________ >> mpi-forum mailing list >> mpi-forum(a)lists.mpi-forum.org <mailto:[email protected]> >> https://lists.mpi-forum.org/mailman/listinfo/mpi-forum > > > -- > Jeff Squyres > jsquyres(a)cisco.com <mailto:[email protected]> > _______________________________________________ > mpi-forum mailing list > mpi-forum(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpi-forum

1 0

Readings Announcement: issues #132, #154 and #156
by Guillaume Mercier 24 Nov '19

24 Nov '19

Dear all, The following items will be read at the next physical meeting in Albuquerque : Hardware communicators, guided mode: Issue #132: https://github.com/mpi-forum/mpi-issues/issues/132 PR#142: https://github.com/mpi-forum/mpi-standard/pull/142 Query routines for hardware resource types: Issue #154: https://github.com/mpi-forum/mpi-issues/issues/154 PR #143h: ttps://github.com/mpi-forum/mpi-standard/pull/143 Hardware communicators, unguided Mode: Issue #156: https://github.com/mpi-forum/mpi-issues/issues/156 PR #148: https://github.com/mpi-forum/mpi-standard/pull/148 The text (as a pdf file) for each issue is available on its dedicated page: look for the last comment, which is updated with the latest version of the text (the date + version is included in the file name). Thanks, Guillaume

1 0

Re: [Mpi-forum] Items for MPI Forum in Albuquerque / DEADLINE IS MONDAY
by Jeff Squyres (jsquyres) 24 Nov '19

24 Nov '19

Martin -- We probably need some plenary time for the Pythonization effort. Technically, it's a "ticket 0" change (and we won't have all of it done/ready by the T-2 week deadline tomorrow). But it does touch a giant portion of the spec. How do you want to handle it? On Nov 23, 2019, at 4:56 PM, Martin Schulz via mpi-forum <mpi-forum(a)lists.mpi-forum.org<mailto:[email protected]>> wrote: Hi all, The next forum meeting is almost upon us (December 9-12) - as discussed last time, the plan is to only have plenary items with preference to the big topics that we want to see in MPI 4.0. The deadline for all announcements is this Monday, November 25th. Please send all reading or vote announcements to the list by that date. Thanks and see you in Albuquerque, Martin PS: Please register soon to help with logistics! — Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) Email: schulzm(a)in.tum.de<mailto:[email protected]> _______________________________________________ mpi-forum mailing list mpi-forum(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpi-forum -- Jeff Squyres jsquyres(a)cisco.com<mailto:[email protected]>

1 0

Issue 122 / Re: Items for MPI Forum in Albuquerque / DEADLINE IS MONDAY
by Rolf Rabenseifner 24 Nov '19

24 Nov '19

Dear Martin and all, I prepared https://github.com/mpi-forum/mpi-issues/issues/122 Intro nonblocking: no serialization & no deadlocks for reading in Albuquerque. Best regards Rolf ----- Original Message ----- > From: "Main MPI Forum mailing list" <mpi-forum(a)lists.mpi-forum.org> > To: "Main MPI Forum mailing list" <mpi-forum(a)lists.mpi-forum.org> > Cc: "Martin Schulz" <schulzm(a)in.tum.de> > Sent: Saturday, November 23, 2019 10:56:03 PM > Subject: [Mpi-forum] Items for MPI Forum in Albuquerque / DEADLINE IS MONDAY > Hi all, > > The next forum meeting is almost upon us (December 9-12) - as discussed last > time, the plan is to only have plenary items with preference to the big topics > that we want to see in MPI 4.0. The deadline for all announcements is this > Monday, November 25th. Please send all reading or vote announcements to the > list by that date. > > Thanks and see you in Albuquerque, > > Martin > > PS: Please register soon to help with logistics! > > > — > Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems > Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching > Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) > [ mailto:[email protected] | Email: schulzm(a)in.tum.de ] > > > > _______________________________________________ > mpi-forum mailing list > mpi-forum(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpi-forum -- Dr. Rolf Rabenseifner . . . . . . . . . .. email rabenseifner(a)hlrs.de . High Performance Computing Center (HLRS) . phone ++49(0)711/685-65530 . University of Stuttgart . . . . . . . . .. fax ++49(0)711 / 685-65832 . Head of Dpmt Parallel Computing . . . www.hlrs.de/people/rabenseifner . Nobelstr. 19, D-70550 Stuttgart, Germany . . . . (Office: Room 1.307) .

1 0

Items for MPI Forum in Albuquerque / DEADLINE IS MONDAY
by schulzm＠in.tum.de 23 Nov '19

23 Nov '19

Hi all, The next forum meeting is almost upon us (December 9-12) - as discussed last time, the plan is to only have plenary items with preference to the big topics that we want to see in MPI 4.0. The deadline for all announcements is this Monday, November 25th. Please send all reading or vote announcements to the list by that date. Thanks and see you in Albuquerque, Martin PS: Please register soon to help with logistics! — Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) Email: schulzm(a)in.tum.de

1 0