April 2021 - mpi-forum - mailman3.cels.anl.gov

No Virtual Meeting today
by Martin Schulz 28 Apr '21

28 Apr '21

Hi all, Just as a reminder - since we worked through all MPI 4.0 issues last week, we'll take a break this week with our virtual meetings. We'll resume next week with a more strategically oriented discussion on how to organize the work in the forum for MPI 4.1 as well as MPI 5.0. Thanks, Martin -- Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) Email: schulzm(a)in.tum.de

1 0

Re: [Mpi-forum] MPI supported languages
by Skjellum, Anthony 25 Apr '21

25 Apr '21

Benson and Dan, thanks. Martin Ruefenacht, Derek Schafer, and I plan to submit a proposal for a new language interface (not language binding) for C++17/20 when MPI-5 convenes. The aim is to generate more performance and productivity. My group is also working on two separate themes with colleagues at PNNL and LLNL on exploratory C++ interfaces for MPI for specific learning/prototyping. I am sure we will publish some joint papers before MPI-5 starts with these colleagues. We are likely to extend that thinking to Python also. Martin and I are hoping to form a WG around these OO languages. We also, want to do a type theory for the entire standard; there are many explicit and implicit types in MPI (not just containment by integers or such). This has become clear as Martin and Jeff Squyres developed the Python technology for the MPI-4 document itself. Note that (much) more can be done with Fortran-2018 too that goes beyond the imperative language binding that is pretty much identical to the LIS. One hope is that we can separate out the language interfaces from the main standard, and let them have space to develop properly and be extended to more languages than C and Fortran. Among other learning, some whole classes of helper objects may fall by the wayside in a modern C++ language interface, such as MPI_Info. Tony Anthony Skjellum, PhD Professor of Computer Science and Chair of Excellence Director, SimCenter University of Tennessee at Chattanooga (UTC) tony-skjellum(a)utc.edu [or skjellum(a)gmail.com] cell: 205-807-4968 ________________________________ From: mpi-forum <mpi-forum-bounces(a)lists.mpi-forum.org> on behalf of Dan Holmes via mpi-forum <mpi-forum(a)lists.mpi-forum.org> Sent: Sunday, April 25, 2021 10:10 AM To: Benson Muite <benson_muite(a)emailplus.org> Cc: Dan Holmes <danholmes(a)chi.scot>; MPI Forum <mpi-forum(a)lists.mpi-forum.org> Subject: Re: [Mpi-forum] MPI supported languages Hi Benson Muite, Thanks for this good list of unofficial bindings and projects using MPI or MPI-like interfaces. The short answer to your question is: yes, there is an effort underway to provide better support for other programming languages. Some work was done for the MPI-4.0 release of MPI (due this year) to firm up some of the key semantic terms, which will aid us when attempting to express those semantics in new languages. That work is continuing and more results from that are targeted at the upcoming MPI-4.1 and future versions of MPI. Figuring out the dividing line between what is currently being expressed (semantics) and what is dictated by the current mechanism of expression (C or Fortran) is a first step towards new forms of expression. Beyond that work, additional language expertise will be needed from some folks who are regular users of these other programming languages so that appropriate expressions of the essential MPI semantics are chosen — language mechanisms that “fit” with the normal/natural ways that a typical programmer would recognise. One possible strategy that has been discussed is to split the MPI Standard into a single MPI Core Standard and multiple MPI Bindings for <language> Standards. This might happen as early as MPI-5.0 (perhaps 5-10 years away) depending on how controversial it turns out to be and the rate of progress, which will depend heavily on the amount of interest and sustained contribution from a community of users. Cheers, Dan. — Dr Daniel Holmes PhD Executive Director Chief Technology Officer CHI Ltd danholmes(a)chi.scot<mailto:[email protected]> On 25 Apr 2021, at 09:36, Benson Muite via mpi-forum <mpi-forum(a)lists.mpi-forum.org<mailto:[email protected]>> wrote: MPI has official bindings for C and Fortran. There are unoffical bindings in C# - https://github.com/rogancarr/MpiDotNet D - https://github.com/DlangScience/OpenMPI) Go - https://pkg.go.dev/github.com/cpmech/gosl/mpi and https://github.com/marcusthierfelder/mpi Java - https://www.open-mpi.org/ Julia - https://github.com/JuliaParallel/MPI.jl Lua - https://github.com/jzrake/lua-mpi and https://peter.colberg.org/lua-mpi Ocaml - https://github.com/xavierleroy/ocamlmpi Perl - https://metacpan.org/pod/Parallel::MPI Python - https://bitbucket.org/mpi4py/mpi4py R - https://github.com/RBigData/pbdMPI and https://cran.r-project.org/package=Rmpi Ruby - https://github.com/gfd-dennou-club/ruby-mpi Rust - https://lib.rs/crates/mpi Scala - https://github.com/mpokorny/scampi It is also used as a possible backend for among other PGAS languages XcalableMP - https://xcalablemp.org/ Some people did not expect MPI to be used by many developers directly. Are there any thoughts on how better support for other programming languages and MPI as a backend might be improved in future? _______________________________________________ mpi-forum mailing list mpi-forum(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpi-forum

1 0

Re: [Mpi-forum] MPI supported languages
by Skjellum, Anthony 25 Apr '21

25 Apr '21

Agreed Anthony Skjellum, PhD 205-807-4968 On Apr 25, 2021, at 10:10 AM, Dan Holmes via mpi-forum <mpi-forum(a)lists.mpi-forum.org> wrote: Hi Benson Muite, Thanks for this good list of unofficial bindings and projects using MPI or MPI-like interfaces. The short answer to your question is: yes, there is an effort underway to provide better support for other programming languages. Some work was done for the MPI-4.0 release of MPI (due this year) to firm up some of the key semantic terms, which will aid us when attempting to express those semantics in new languages. That work is continuing and more results from that are targeted at the upcoming MPI-4.1 and future versions of MPI. Figuring out the dividing line between what is currently being expressed (semantics) and what is dictated by the current mechanism of expression (C or Fortran) is a first step towards new forms of expression. Beyond that work, additional language expertise will be needed from some folks who are regular users of these other programming languages so that appropriate expressions of the essential MPI semantics are chosen — language mechanisms that “fit” with the normal/natural ways that a typical programmer would recognise. One possible strategy that has been discussed is to split the MPI Standard into a single MPI Core Standard and multiple MPI Bindings for <language> Standards. This might happen as early as MPI-5.0 (perhaps 5-10 years away) depending on how controversial it turns out to be and the rate of progress, which will depend heavily on the amount of interest and sustained contribution from a community of users. Cheers, Dan. — Dr Daniel Holmes PhD Executive Director Chief Technology Officer CHI Ltd danholmes(a)chi.scot<mailto:[email protected]> On 25 Apr 2021, at 09:36, Benson Muite via mpi-forum <mpi-forum(a)lists.mpi-forum.org<mailto:[email protected]>> wrote: MPI has official bindings for C and Fortran. There are unoffical bindings in C# - https://github.com/rogancarr/MpiDotNet D - https://github.com/DlangScience/OpenMPI) Go - https://pkg.go.dev/github.com/cpmech/gosl/mpi and https://github.com/marcusthierfelder/mpi Java - https://www.open-mpi.org/ Julia - https://github.com/JuliaParallel/MPI.jl Lua - https://github.com/jzrake/lua-mpi and https://peter.colberg.org/lua-mpi Ocaml - https://github.com/xavierleroy/ocamlmpi Perl - https://metacpan.org/pod/Parallel::MPI Python - https://bitbucket.org/mpi4py/mpi4py R - https://github.com/RBigData/pbdMPI and https://cran.r-project.org/package=Rmpi Ruby - https://github.com/gfd-dennou-club/ruby-mpi Rust - https://lib.rs/crates/mpi Scala - https://github.com/mpokorny/scampi It is also used as a possible backend for among other PGAS languages XcalableMP - https://xcalablemp.org/ Some people did not expect MPI to be used by many developers directly. Are there any thoughts on how better support for other programming languages and MPI as a backend might be improved in future? _______________________________________________ mpi-forum mailing list mpi-forum(a)lists.mpi-forum.org<mailto:[email protected]> https://lists.mpi-forum.org/mailman/listinfo/mpi-forum _______________________________________________ mpi-forum mailing list mpi-forum(a)lists.mpi-forum.org https://lists.mpi-forum.org/mailman/listinfo/mpi-forum

1 0

Re: [Mpi-forum] MPI supported languages
by Dan Holmes 25 Apr '21

25 Apr '21

Hi Benson Muite, Thanks for this good list of unofficial bindings and projects using MPI or MPI-like interfaces. The short answer to your question is: yes, there is an effort underway to provide better support for other programming languages. Some work was done for the MPI-4.0 release of MPI (due this year) to firm up some of the key semantic terms, which will aid us when attempting to express those semantics in new languages. That work is continuing and more results from that are targeted at the upcoming MPI-4.1 and future versions of MPI. Figuring out the dividing line between what is currently being expressed (semantics) and what is dictated by the current mechanism of expression (C or Fortran) is a first step towards new forms of expression. Beyond that work, additional language expertise will be needed from some folks who are regular users of these other programming languages so that appropriate expressions of the essential MPI semantics are chosen — language mechanisms that “fit” with the normal/natural ways that a typical programmer would recognise. One possible strategy that has been discussed is to split the MPI Standard into a single MPI Core Standard and multiple MPI Bindings for <language> Standards. This might happen as early as MPI-5.0 (perhaps 5-10 years away) depending on how controversial it turns out to be and the rate of progress, which will depend heavily on the amount of interest and sustained contribution from a community of users. Cheers, Dan. — Dr Daniel Holmes PhD Executive Director Chief Technology Officer CHI Ltd danholmes(a)chi.scot > On 25 Apr 2021, at 09:36, Benson Muite via mpi-forum <mpi-forum(a)lists.mpi-forum.org> wrote: > > MPI has official bindings for C and Fortran. There are unoffical bindings in > > C# - https://github.com/rogancarr/MpiDotNet > D - https://github.com/DlangScience/OpenMPI) > Go - https://pkg.go.dev/github.com/cpmech/gosl/mpi and https://github.com/marcusthierfelder/mpi > Java - https://www.open-mpi.org/ > Julia - https://github.com/JuliaParallel/MPI.jl > Lua - https://github.com/jzrake/lua-mpi and https://peter.colberg.org/lua-mpi > Ocaml - https://github.com/xavierleroy/ocamlmpi > Perl - https://metacpan.org/pod/Parallel::MPI > Python - https://bitbucket.org/mpi4py/mpi4py > R - https://github.com/RBigData/pbdMPI and https://cran.r-project.org/package=Rmpi > Ruby - https://github.com/gfd-dennou-club/ruby-mpi > Rust - https://lib.rs/crates/mpi > Scala - https://github.com/mpokorny/scampi > > > It is also used as a possible backend for among other PGAS languages XcalableMP - https://xcalablemp.org/ > > Some people did not expect MPI to be used by many developers directly. Are there any thoughts on how better support for other programming languages and MPI as a backend might be improved in future? > _______________________________________________ > mpi-forum mailing list > mpi-forum(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpi-forum

1 0

MPI supported languages
by Benson Muite 25 Apr '21

25 Apr '21

1 0

Terms & One-sided - Re: Reminder: virtual MPI Forum Meeting today (Wednesday) 4/21 10am US CT
by Rolf Rabenseifner 21 Apr '21

21 Apr '21

Dear all, as we discussed at the end of the meeting today, here the pointer about the latest discussion status on moving the new MPI-4.0 terms --> into the one-sided chapter. See https://github.com/mpi-forum/mpi-issues/issues/96 and there the pdf https://github.com/mpi-forum/mpi-issues/files/4842764/SemanticTerms-4.1-Dis… especially slides 5 - end. Best regards Rolf ----- Original Message ----- > From: "Main MPI Forum mailing list" <mpi-forum(a)lists.mpi-forum.org> > To: "Main MPI Forum mailing list" <mpi-forum(a)lists.mpi-forum.org> > Cc: "Martin Schulz" <schulzm(a)in.tum.de> > Sent: Wednesday, April 21, 2021 6:32:44 AM > Subject: [Mpi-forum] Reminder: virtual MPI Forum Meeting today (Wednesday) 4/21 10am US CT > Hi all, > > We will have our usual MPI Forum virtual meeting today (Wednesday) 4/21 at 10am > US Central Time. > > The agenda is, as usual, to cover the outstanding tickets that are needed for > MPI 4.0 and ensure that we have consensus for them. If there are any particular > or any other items to discuss, please let me know. > > Additionally, we wanted to use today's meeting to do presentations by candidates > for MPI officers (chair, secretary, editor, treasurer) to have a discussion and > be available for question from the forum. > > Once we are done with these elements, we can also focus on any of the new MPI > 4.1 issues. Please let Wesley and me know, if you have any particular items to > bring up. > > Thanks and talk to you later today, > > Martin > > PS: Don't forget that we switched to Zoom - Link at the usual spot on the github > site. > > > -- > Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems > Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching > Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) > Email: schulzm(a)in.tum.de > > > > > _______________________________________________ > mpi-forum mailing list > mpi-forum(a)lists.mpi-forum.org > https://lists.mpi-forum.org/mailman/listinfo/mpi-forum -- Dr. Rolf Rabenseifner . . . . . . . . . .. email rabenseifner(a)hlrs.de . High Performance Computing Center (HLRS) . phone ++49(0)711/685-65530 . University of Stuttgart . . . . . . . . .. fax ++49(0)711 / 685-65832 . Head of Dpmt Parallel Computing . . . www.hlrs.de/people/rabenseifner . Nobelstr. 19, D-70550 Stuttgart, Germany . . . . (Office: Room 1.307) .

1 0

Reminder: virtual MPI Forum Meeting today (Wednesday) 4/21 10am US CT
by Martin Schulz 20 Apr '21

20 Apr '21

Hi all, We will have our usual MPI Forum virtual meeting today (Wednesday) 4/21 at 10am US Central Time. The agenda is, as usual, to cover the outstanding tickets that are needed for MPI 4.0 and ensure that we have consensus for them. If there are any particular or any other items to discuss, please let me know. Additionally, we wanted to use today's meeting to do presentations by candidates for MPI officers (chair, secretary, editor, treasurer) to have a discussion and be available for question from the forum. Once we are done with these elements, we can also focus on any of the new MPI 4.1 issues. Please let Wesley and me know, if you have any particular items to bring up. Thanks and talk to you later today, Martin PS: Don't forget that we switched to Zoom - Link at the usual spot on the github site. -- Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) Email: schulzm(a)in.tum.de

1 0

Re: [Mpi-forum] Reminder: virtual MPI Forum Meeting today (Wednesday) 4/14 10am US CT
by Martin Schulz 14 Apr '21

14 Apr '21

Hi all, We will have our usual MPI Forum virtual meeting today (Wednesday) 4/14 at 10am US Central Time. The agenda is, as usual, to cover the outstanding tickets that are needed for MPI 4.0 and ensure that we have consensus for them. If there are any particular or any other items to discuss, please let me know. Once we are done with these elements, we can also focus on any of the new MPI 4.1 issues. Thanks and talk to you later today, Martin PS: Don't forget that we switched to Zoom - Link at the usual spot on the github site. -- Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) Email: schulzm(a)in.tum.de

1 0

Registration Open for June 2021 MPI Forum Meeting
by Wesley Bland 12 Apr '21

12 Apr '21

Hi all, The registration page for the June meeting is now open. You can find the details on the logistics page <https://www.mpi-forum.org/meetings/2021/06/logistics>. As usual for our virtual meetings, registration is free, but required. The link directly to the registration form is here: https://forms.gle/ACFkW6oGy1bgT7pD9 <https://forms.gle/ACFkW6oGy1bgT7pD9> Registrations after the first voting block begins (usually scheduled for 12:00pm US Central on June 7, 2021) will not count toward voting eligibility for this meeting. If you have questions, please let me know. Thanks, Wes

1 0

Reminder: virtual MPI Forum Meeting today (Wednesday) 4/7 10am US CT
by Martin Schulz 06 Apr '21

06 Apr '21

Hi all, We will have our usual MPI Forum virtual meeting today (Wednesday) 4/7 at 10am US Central Time. The agenda is, as usual, to cover the outstanding tickets that are needed for MPI 4.0 and ensure that we have consensus for them. If there are any particular or any other items to discuss, please let me know. Thanks and talk to you later today, Martin PS: Don't forget that we switched to Zoom - Link at the usual spot on the github site. -- Prof. Dr. Martin Schulz, Chair of Computer Architecture and Parallel Systems Department of Informatics, TU-Munich, Boltzmannstraße 3, D-85748 Garching Member of the Board of Directors at the Leibniz Supercomputing Centre (LRZ) Email: schulzm(a)in.tum.de

1 0