Tortsten,
There seemed to be decent agreement on adding MPI_Win_all_flush_all
(equivalent to MPI_Win_flush_all called from every rank in the
communicator associated with the window) since this function can be
implemented far more efficiently as a collective than the equivalent
point-wise function calls.
Is there a problem with adding this to your proposal?
Jeff
On Sun, May 16, 2010 at 12:48 AM, Torsten Hoefler <htor(a)illinois.edu> wrote:
> Hello all,
>
> After the discussions at the last Forum I updated the group's first
> proposal.
>
> The proposal (one-side-2.pdf) is attached to the wiki page
> https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/RmaWikiPage
>
> The changes with regards to the last version are:
>
> 1) added MPI_NOOP to MPI_Get_accumulate and MPI_Accumulate_get
>
> 2) (re)added MPI_Win_flush and MPI_Win_flush_all to passive target mode
>
> Some remarks:
>
> 1) We didn't straw-vote on MPI_Accumulate_get, so this function might
> � go. The removal would be very clean.
>
> 2) Should we allow MPI_NOOP in MPI_Accumulate (this does not make sense
> � and is incorrect in my current proposal)
>
> 3) Should we allow MPI_REPLACE in MPI_Get_accumulate/MPI_Accumulate_get?
> � (this would make sense and is allowed in the current proposal but we
> � didn't talk about it in the group)
>
>
> All the Best,
> �Torsten
>
> --
> �bash$ :(){ :|:&};: --------------------- http://www.unixer.de/ -----
> Torsten Hoefler � � � � | Research Associate
> Blue Waters Directorate | University of Illinois
> 1205 W Clark Street � � | Urbana, IL, 61801
> NCSA Building � � � � � | +01 (217) 244-7736
> _______________________________________________
> mpi3-rma mailing list
> mpi3-rma(a)lists.mpi-forum.org
> http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-rma
>
--
Jeff Hammond
Argonne Leadership Computing Facility
jhammond(a)mcs.anl.gov / (630) 252-5381
http://www.linkedin.com/in/jeffhammond
Hello all,
After the discussions at the last Forum I updated the group's first
proposal.
The proposal (one-side-2.pdf) is attached to the wiki page
https://svn.mpi-forum.org/trac/mpi-forum-web/wiki/RmaWikiPage
The changes with regards to the last version are:
1) added MPI_NOOP to MPI_Get_accumulate and MPI_Accumulate_get
2) (re)added MPI_Win_flush and MPI_Win_flush_all to passive target mode
Some remarks:
1) We didn't straw-vote on MPI_Accumulate_get, so this function might
go. The removal would be very clean.
2) Should we allow MPI_NOOP in MPI_Accumulate (this does not make sense
and is incorrect in my current proposal)
3) Should we allow MPI_REPLACE in MPI_Get_accumulate/MPI_Accumulate_get?
(this would make sense and is allowed in the current proposal but we
didn't talk about it in the group)
All the Best,
Torsten
--
bash$ :(){ :|:&};: --------------------- http://www.unixer.de/ -----
Torsten Hoefler | Research Associate
Blue Waters Directorate | University of Illinois
1205 W Clark Street | Urbana, IL, 61801
NCSA Building | +01 (217) 244-7736
This is for Wed morning.
_____
From: Jeff Squyres [mailto:[email protected]]
Sent: Monday, May 03, 2010 8:14 AM
To: thakur(a)mcs.anl.gov
Subject: Meeting invitation: MPI-3 RMA Wed
Hello ,
Jeff Squyres invites you to attend this online meeting.
Topic: MPI-3 RMA Wed
Date: Wednesday, May 5, 2010
Time: 9:00 am, Eastern Daylight Time (New York, GMT-04:00)
Meeting Number: 206 637 656
Meeting Password: rma
-------------------------------------------------------
To join the online meeting (Now from iPhones and other Smartphones too!)
-------------------------------------------------------
1. Go to https://cisco.webex.com/ciscosales/j.php?ED=139589057
<https://cisco.webex.com/ciscosales/j.php?ED=139589057&UID=1309559897&PW=NNj…>
&UID=1309559897&PW=NNjNiZTE0N2Uw&RT=MiMxMQ%3D%3D
2. Enter your name and email address.
3. Enter the meeting password: rma
4. Click "Join Now".
To view in other time zones or languages, please click the link:
https://cisco.webex.com/ciscosales/j.php?ED=139589057
<https://cisco.webex.com/ciscosales/j.php?ED=139589057&UID=1309559897&PW=NNj…>
&UID=1309559897&PW=NNjNiZTE0N2Uw&ORT=MiMxMQ%3D%3D
----------------------------------------------------------------
ALERT:Toll-Free Dial Restrictions for (408) and (919) Area Codes
----------------------------------------------------------------
The affected toll free numbers are: (866) 432-9903 for the San Jose/Milpitas area and (866) 349-3520 for the RTP area.
Please dial the local access number for your area from the list below:
- San Jose/Milpitas (408) area: 525-6800
- RTP (919) area: 392-3330
-------------------------------------------------------
To join the teleconference only
-------------------------------------------------------
1. Dial into Cisco WebEx (view all Global Access Numbers at
http://cisco.com/en/US/about/doing_business/conferencing/index.html
2. Follow the prompts to enter the Meeting Number (listed above) or Access Code followed by the # sign.
San Jose, CA: +1.408.525.6800 RTP: +1.919.392.3330
US/Canada: +1.866.432.9903 United Kingdom: +44.20.8824.0117
India: +91.80.4350.1111 Germany: +49.619.6773.9002
Japan: +81.3.5763.9394 China: +86.10.8515.5666
-------------------------------------------------------
For assistance
-------------------------------------------------------
1. Go to https://cisco.webex.com/ciscosales/mc
2. On the left navigation bar, click "Support".
You can contact me at:
jsquyres(a)cisco.com
1-408-525 0971
To add this meeting to your calendar program (for example Microsoft Outlook), click this link:
https://cisco.webex.com/ciscosales/j.php?ED=139589057
<https://cisco.webex.com/ciscosales/j.php?ED=139589057&UID=1309559897&ICS=MI…
nTXL2/7g=&RT=MiMxMQ%3D%3D> &UID=1309559897&ICS=MI&LD=1&RD=2&ST=1&SHA2=ccHp2u23GvuMj7p4/aAnwwiKQ-q0OM2XnjnnTXL2/7g=&RT=MiMxMQ%3D%3D
The playback of UCF (Universal Communications Format) rich media files requires appropriate players. To view this type of rich media
files in the meeting, please check whether you have the players installed on your computer by going to
https://cisco.webex.com/ciscosales/systemdiagnosis.php
Sign up for a free trial of WebEx
http://www.webex.com/go/mcemfreetrialhttp://www.webex.com
CCP:+14085256800x206637656#
IMPORTANT NOTICE: This WebEx service includes a feature that allows audio and any documents and other materials exchanged or viewed
during the session to be recorded. By joining this session, you automatically consent to such recordings. If you do not consent to
the recording, do not join the session.
This is for the sessions tomorrow.
_____
From: Jeff Squyres [mailto:[email protected]]
Sent: Monday, May 03, 2010 8:14 AM
To: thakur(a)mcs.anl.gov
Subject: Meeting invitation: MPI-3 RMA wg Tue
Hello ,
Jeff Squyres invites you to attend this online meeting.
Topic: MPI-3 RMA wg Tue
Date: Tuesday, May 4, 2010
Time: 8:00 am, Central Daylight Time (Chicago, GMT-05:00)
Meeting Number: 203 433 242
Meeting Password: rma
-------------------------------------------------------
To join the online meeting (Now from iPhones and other Smartphones too!)
-------------------------------------------------------
1. Go to https://cisco.webex.com/ciscosales/j.php?ED=139589222
<https://cisco.webex.com/ciscosales/j.php?ED=139589222&UID=1309558822&PW=NZj…>
&UID=1309558822&PW=NZjdkODgzYmZi&RT=MiM3
2. Enter your name and email address.
3. Enter the meeting password: rma
4. Click "Join Now".
To view in other time zones or languages, please click the link:
https://cisco.webex.com/ciscosales/j.php?ED=139589222
<https://cisco.webex.com/ciscosales/j.php?ED=139589222&UID=1309558822&PW=NZj…>
&UID=1309558822&PW=NZjdkODgzYmZi&ORT=MiM3
----------------------------------------------------------------
ALERT:Toll-Free Dial Restrictions for (408) and (919) Area Codes
----------------------------------------------------------------
The affected toll free numbers are: (866) 432-9903 for the San Jose/Milpitas area and (866) 349-3520 for the RTP area.
Please dial the local access number for your area from the list below:
- San Jose/Milpitas (408) area: 525-6800
- RTP (919) area: 392-3330
-------------------------------------------------------
To join the teleconference only
-------------------------------------------------------
1. Dial into Cisco WebEx (view all Global Access Numbers at
http://cisco.com/en/US/about/doing_business/conferencing/index.html
2. Follow the prompts to enter the Meeting Number (listed above) or Access Code followed by the # sign.
San Jose, CA: +1.408.525.6800 RTP: +1.919.392.3330
US/Canada: +1.866.432.9903 United Kingdom: +44.20.8824.0117
India: +91.80.4350.1111 Germany: +49.619.6773.9002
Japan: +81.3.5763.9394 China: +86.10.8515.5666
-------------------------------------------------------
For assistance
-------------------------------------------------------
1. Go to https://cisco.webex.com/ciscosales/mc
2. On the left navigation bar, click "Support".
You can contact me at:
jsquyres(a)cisco.com
1-408-525 0971
To add this meeting to your calendar program (for example Microsoft Outlook), click this link:
https://cisco.webex.com/ciscosales/j.php?ED=139589222
<https://cisco.webex.com/ciscosales/j.php?ED=139589222&UID=1309558822&ICS=MI…
gj1PfOB0=&RT=MiM3> &UID=1309558822&ICS=MI&LD=1&RD=2&ST=1&SHA2=MpPd/rpD5o6B-roO8su8AalUihXtwtzMZSngj1PfOB0=&RT=MiM3
The playback of UCF (Universal Communications Format) rich media files requires appropriate players. To view this type of rich media
files in the meeting, please check whether you have the players installed on your computer by going to
https://cisco.webex.com/ciscosales/systemdiagnosis.php
Sign up for a free trial of WebEx
http://www.webex.com/go/mcemfreetrialhttp://www.webex.com
CCP:+14085256800x203433242#
IMPORTANT NOTICE: This WebEx service includes a feature that allows audio and any documents and other materials exchanged or viewed
during the session to be recorded. By joining this session, you automatically consent to such recordings. If you do not consent to
the recording, do not join the session.
Jeff has set up Webex concalls for the RMA working group meetings. This one is for the session this evening, 5.00-7.00
_____
From: Jeff Squyres [mailto:[email protected]]
Sent: Monday, May 03, 2010 8:09 AM
To: thakur(a)mcs.anl.gov
Subject: Meeting invitation: MPI-3 RMA wg
Hello ,
Jeff Squyres invites you to attend this online meeting.
Topic: MPI-3 RMA wg
Date: Monday, May 3, 2010
Time: 4:00 pm, Central Daylight Time (Chicago, GMT-05:00)
Meeting Number: 200 986 128
Meeting Password: rma
-------------------------------------------------------
To join the online meeting (Now from iPhones and other Smartphones too!)
-------------------------------------------------------
1. Go to https://cisco.webex.com/ciscosales/j.php?ED=139588947
<https://cisco.webex.com/ciscosales/j.php?ED=139588947&UID=1309556257&PW=NND…>
&UID=1309556257&PW=NNDNiMjQwNWU1&RT=MiM3
2. Enter your name and email address.
3. Enter the meeting password: rma
4. Click "Join Now".
To view in other time zones or languages, please click the link:
https://cisco.webex.com/ciscosales/j.php?ED=139588947
<https://cisco.webex.com/ciscosales/j.php?ED=139588947&UID=1309556257&PW=NND…>
&UID=1309556257&PW=NNDNiMjQwNWU1&ORT=MiM3
----------------------------------------------------------------
ALERT:Toll-Free Dial Restrictions for (408) and (919) Area Codes
----------------------------------------------------------------
The affected toll free numbers are: (866) 432-9903 for the San Jose/Milpitas area and (866) 349-3520 for the RTP area.
Please dial the local access number for your area from the list below:
- San Jose/Milpitas (408) area: 525-6800
- RTP (919) area: 392-3330
-------------------------------------------------------
To join the teleconference only
-------------------------------------------------------
1. Dial into Cisco WebEx (view all Global Access Numbers at
http://cisco.com/en/US/about/doing_business/conferencing/index.html
2. Follow the prompts to enter the Meeting Number (listed above) or Access Code followed by the # sign.
San Jose, CA: +1.408.525.6800 RTP: +1.919.392.3330
US/Canada: +1.866.432.9903 United Kingdom: +44.20.8824.0117
India: +91.80.4350.1111 Germany: +49.619.6773.9002
Japan: +81.3.5763.9394 China: +86.10.8515.5666
-------------------------------------------------------
For assistance
-------------------------------------------------------
1. Go to https://cisco.webex.com/ciscosales/mc
2. On the left navigation bar, click "Support".
You can contact me at:
jsquyres(a)cisco.com
1-408-525 0971
To add this meeting to your calendar program (for example Microsoft Outlook), click this link:
https://cisco.webex.com/ciscosales/j.php?ED=139588947
<https://cisco.webex.com/ciscosales/j.php?ED=139588947&UID=1309556257&ICS=MI…
MREHXpUM=&RT=MiM3> &UID=1309556257&ICS=MI&LD=1&RD=2&ST=1&SHA2=NkiyyKKlnOnZWKvS9pi3pkRLwZUjCBlfwa2MREHXpUM=&RT=MiM3
The playback of UCF (Universal Communications Format) rich media files requires appropriate players. To view this type of rich media
files in the meeting, please check whether you have the players installed on your computer by going to
https://cisco.webex.com/ciscosales/systemdiagnosis.php
Sign up for a free trial of WebEx
http://www.webex.com/go/mcemfreetrialhttp://www.webex.com
CCP:+14085256800x200986128#
IMPORTANT NOTICE: This WebEx service includes a feature that allows audio and any documents and other materials exchanged or viewed
during the session to be recorded. By joining this session, you automatically consent to such recordings. If you do not consent to
the recording, do not join the session.
So I didn't catch everything that went on because clearly Keith was
referring to things projected from his laptop but not enumerated out
loud. That, and 7-9 PM is usually beer-time not RMA-time in my house.
On the issue of "should MPI-3 support X (with performance)?" where
X={ARMCI,GASNet,etc.}, I think it is quite clear than MPI-3 RMA should
meet the criteria of implementing ARMCI RMA, either as ARMCI on top of
MPI-3 of GA on top of MPI-3 (replacing ARMCI altogether). The
distinction between the latter two choices is mostly irrelevant; ARMCI
over MPI-3 can be pretty close to an #define implementation rather
than an abstraction layer which affects performance. I suspect that
on some platforms, ARMCI may still be required to achieve optimal
performance for strided accumulate etc., but for leadership-class
machines with RDMA or otherwise powerful NICs, ARMCI will be nothing
more than syntactic sugar to make GA portable. This fact has been
clearly demonstrated by the DCMF port of ARMCI, which completely
bypasses the ARMCI data server but compensates with low-level
communication-helper-thread support.
Although I don't doubt that user-defined accumulate provides a
mechanism for active-messaging (AM) capability, I do not fully
subscribe to the notion - sorry Pavan - that MPI-3 accumulate is
sufficient to implement GASNet if performance is a consideration. I
sincerely hope that the Forum follows through on the AM working group
and produces a real AM interface that competes on all levels with
GASNet. Keith is right that GASNet's direct targeting of low-level AM
functionality will preclude MPI-3 from ever being a
performance-oriented compromise. However, it is useful to have MPI-3
as a portable fall-back for implementing AM via user-defined
accumulate.
Best,
Jeff
On Tue, Mar 9, 2010 at 6:32 PM, Jeff Hammond <jeff.science(a)gmail.com> wrote:
>> Tuesday: 4.15-7.00pm Pacific
>> Tel: (866) 432-9903 �OR �(408) 525-6800
>> Meeting Number: 200 438 253
>
> Is this happening? �I called in but no one else is on.
>
> Thanks,
>
> Jeff
>
>
> --
> Jeff Hammond
> Argonne Leadership Computing Facility
> jhammond(a)mcs.anl.gov / (630) 252-5381
> http://www.linkedin.com/in/jeffhammond
>
--
Jeff Hammond
Argonne Leadership Computing Facility
jhammond(a)mcs.anl.gov / (630) 252-5381
http://www.linkedin.com/in/jeffhammond
> Tuesday: 4.15-7.00pm Pacific
> Tel: (866) 432-9903 �OR �(408) 525-6800
> Meeting Number: 200 438 253
Is this happening? I called in but no one else is on.
Thanks,
Jeff
--
Jeff Hammond
Argonne Leadership Computing Facility
jhammond(a)mcs.anl.gov / (630) 252-5381
http://www.linkedin.com/in/jeffhammond
Hello,
> One set of slides (Pavan's) is attached. Torsten will mail you his
> slides separately.
here is the current version of the slides (some changes are still
pending as they came in late): http://www.unixer.de/sec/onesided.pdf
Best,
Torsten
--
bash$ :(){ :|:&};: --------------------- http://www.unixer.de/ -----
Torsten Hoefler | Research Associate
Blue Waters Directorate | University of Illinois
1205 W Clark Street | Urbana, IL, 61801
NCSA Building | +01 (217) 244-7736
I will try to participate when not on other conference calls :|
One addition to lock types is MPI_WIN_ASSOCIATIVE_LOCK, which would
obviate the need for locks on the window. Such a window would only
permit access via Get/Copy OR Acc (and no non-MPI access), since these
operations are invariant with respect to re-ordering. My motivation
for this feature is that read-only and accumulate-only are ubiquitous
usage patterns in application codes (over 90% of all GA/ARMCI calls in
codes I work with act within these epochs) and there are a variety of
optimizations that can occur if this window attribute is explicitly
specified.
For read-only and accumulate-only operations, message ordering within
the lifetime of the window (with this attribute active) is irrelevant
and there is almost no need for internal consistency checking.
Get/Copy calls can be completely overlapped in the implementation and
Acc calls can be overlapped as long as the accumulate function is
atomic.
Alternatively, if Acc is bad for non-cache-coherent then
MPI_WIN_READONLY_LOCK provides half of what I want and allows for even
more optimization in a heterogeneous context. Local memory attached
to a read-only window could be migrated to memory banks closer to the
NIC to prevent bus contention I observe on NUMA nodes. For a
Cell/GPU-like node where the window was on the attached processor (I
assume this will soon be possible), then such an optimization would be
very valuable.
Hopefully this idea isn't too stupid. If I need to provide more
justification, please let me know.
Jeff
On Sun, Mar 7, 2010 at 6:42 PM, Rajeev Thakur <thakur(a)mcs.anl.gov> wrote:
> For those who will not be present at the Forum meeting, you can
> participate via telecon. Below are the numbers to dial.
>
> One set of slides (Pavan's) is attached. Torsten will mail you his
> slides separately.
>
> Rajeev
>
>
> Monday: 1.00-5.00pm Pacific
> Tel: (866) 432-9903 �OR �(408) 525-6800
> Meeting Number: 202 751 887
>
> Tuesday: 4.15-7.00pm Pacific
> Tel: (866) 432-9903 �OR �(408) 525-6800
> Meeting Number: 200 438 253
>
> _______________________________________________
> mpi3-rma mailing list
> mpi3-rma(a)lists.mpi-forum.org
> http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-rma
>
>
--
Jeff Hammond
Argonne Leadership Computing Facility
jhammond(a)mcs.anl.gov / (630) 252-5381
http://www.linkedin.com/in/jeffhammond
Hi Rajeev,
I may try to call, although it doesn't fit so well with my
time zone. I have sent some comments to Torsten on his proposal
(which is somewhat as my old #139)
Best regards, enjoy the meeting
Jesper
On Sun, Mar 07, 2010 at 06:42:31PM -0600, Rajeev Thakur wrote:
> For those who will not be present at the Forum meeting, you can
> participate via telecon. Below are the numbers to dial.
>
> One set of slides (Pavan's) is attached. Torsten will mail you his
> slides separately.
>
> Rajeev
>
>
> Monday: 1.00-5.00pm Pacific
> Tel: (866) 432-9903 OR (408) 525-6800
> Meeting Number: 202 751 887
>
> Tuesday: 4.15-7.00pm Pacific
> Tel: (866) 432-9903 OR (408) 525-6800
> Meeting Number: 200 438 253
> _______________________________________________
> mpi3-rma mailing list
> mpi3-rma(a)lists.mpi-forum.org
> http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-rma
