- Intel-nda - mailman3.cels.anl.gov

Re: [JLSE-Intel-NDA] Action items from today's Intel call
by Ray Loy 10 May '16

10 May '16

mode. Isn't the goal to reboot the node in a different mode? > On May 10, 2016, at 5:44 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > New node? > > Ben > >> On May 10, 2016, at 5:31 PM, Ray Loy <rloy(a)alcf.anl.gov> wrote: >> >> >> Before the shutdown I assume you'd select the new mode somehow... >> >> >>> On May 10, 2016, at 5:22 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >>> >>> Yea I can hand out a shared account on the BMC that'll let you power cycle the machine from the logins via ipmitool to those that need it. >>> >>> The procedure will be something along the lines of: >>> >>> 1. run on knl00: shutdown -h now >>> 2. Wait for the node to be powered off check via: ipmitool -I lanplus -H knl00.fto -U <user> power status >>> 3. From login node: ipmitool -I lanplus -H knl00.fto -U <user> power on >>> 4. Wait 5-10 minutes for the machine to come up. >>> >>> We need to validate that this has the same affect as pulling the power from the machine. >>> >>> Ben >>> >>>> On May 10, 2016, at 5:09 PM, Scott Parker <sparker(a)anl.gov> wrote: >>>> >>>> >>>> Do we have a way for non-admin users to initiate a cold reboot? It would be useful to have that in the interim until >>>> we get a BIOS fix from Intel. Otherwise we are going to be severely limited in how frequently we can change the mode, >>>> and it will be hard to be certain if the node is in a good state. >>>> >>>> -Scott >>>> >>>> On 5/10/16 4:33 PM, Kumaran, Kalyan wrote: >>>>> * Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. >>>>> >>>>> * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. >>>>> >>>>> * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. >>>>> >>>>> * HACC and NeKbone slides will be used for ISC. >>>>> >>>>> * Intel to look into getting us the VTune update for KNL. >>>>> >>>>> -Kumar >>>>> >>>>> _______________________________________________ >>>>> Intel-nda mailing list >>>>> Intel-nda(a)lists.jlse.anl.gov >>>>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >>>> >>>> _______________________________________________ >>>> Intel-nda mailing list >>>> Intel-nda(a)lists.jlse.anl.gov >>>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >>> >>> _______________________________________________ >>> Intel-nda mailing list >>> Intel-nda(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >> >

1 0

Re: [JLSE-Intel-NDA] Action items from today's Intel call
by Allen, Benjamin S. 10 May '16

10 May '16

New node? Ben > On May 10, 2016, at 5:31 PM, Ray Loy <rloy(a)alcf.anl.gov> wrote: > > > Before the shutdown I assume you'd select the new mode somehow... > > >> On May 10, 2016, at 5:22 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >> >> Yea I can hand out a shared account on the BMC that'll let you power cycle the machine from the logins via ipmitool to those that need it. >> >> The procedure will be something along the lines of: >> >> 1. run on knl00: shutdown -h now >> 2. Wait for the node to be powered off check via: ipmitool -I lanplus -H knl00.fto -U <user> power status >> 3. From login node: ipmitool -I lanplus -H knl00.fto -U <user> power on >> 4. Wait 5-10 minutes for the machine to come up. >> >> We need to validate that this has the same affect as pulling the power from the machine. >> >> Ben >> >>> On May 10, 2016, at 5:09 PM, Scott Parker <sparker(a)anl.gov> wrote: >>> >>> >>> Do we have a way for non-admin users to initiate a cold reboot? It would be useful to have that in the interim until >>> we get a BIOS fix from Intel. Otherwise we are going to be severely limited in how frequently we can change the mode, >>> and it will be hard to be certain if the node is in a good state. >>> >>> -Scott >>> >>> On 5/10/16 4:33 PM, Kumaran, Kalyan wrote: >>>> * Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. >>>> >>>> * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. >>>> >>>> * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. >>>> >>>> * HACC and NeKbone slides will be used for ISC. >>>> >>>> * Intel to look into getting us the VTune update for KNL. >>>> >>>> -Kumar >>>> >>>> _______________________________________________ >>>> Intel-nda mailing list >>>> Intel-nda(a)lists.jlse.anl.gov >>>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >>> >>> _______________________________________________ >>> Intel-nda mailing list >>> Intel-nda(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >> >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >

1 0

Re: [JLSE-Intel-NDA] Action items from today's Intel call
by Ray Loy 10 May '16

10 May '16

Before the shutdown I assume you'd select the new mode somehow... > On May 10, 2016, at 5:22 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > Yea I can hand out a shared account on the BMC that'll let you power cycle the machine from the logins via ipmitool to those that need it. > > The procedure will be something along the lines of: > > 1. run on knl00: shutdown -h now > 2. Wait for the node to be powered off check via: ipmitool -I lanplus -H knl00.fto -U <user> power status > 3. From login node: ipmitool -I lanplus -H knl00.fto -U <user> power on > 4. Wait 5-10 minutes for the machine to come up. > > We need to validate that this has the same affect as pulling the power from the machine. > > Ben > >> On May 10, 2016, at 5:09 PM, Scott Parker <sparker(a)anl.gov> wrote: >> >> >> Do we have a way for non-admin users to initiate a cold reboot? It would be useful to have that in the interim until >> we get a BIOS fix from Intel. Otherwise we are going to be severely limited in how frequently we can change the mode, >> and it will be hard to be certain if the node is in a good state. >> >> -Scott >> >> On 5/10/16 4:33 PM, Kumaran, Kalyan wrote: >>> * Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. >>> >>> * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. >>> >>> * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. >>> >>> * HACC and NeKbone slides will be used for ISC. >>> >>> * Intel to look into getting us the VTune update for KNL. >>> >>> -Kumar >>> >>> _______________________________________________ >>> Intel-nda mailing list >>> Intel-nda(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >> >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Action items from today's Intel call
by Scott Parker 10 May '16

10 May '16

That would be be very helpful - I'm happy to try it out if you can set it up. -Scott On 5/10/16 5:22 PM, Allen, Benjamin S. wrote: > Yea I can hand out a shared account on the BMC that'll let you power cycle the machine from the logins via ipmitool to those that need it. > > The procedure will be something along the lines of: > > 1. run on knl00: shutdown -h now > 2. Wait for the node to be powered off check via: ipmitool -I lanplus -H knl00.fto -U <user> power status > 3. From login node: ipmitool -I lanplus -H knl00.fto -U <user> power on > 4. Wait 5-10 minutes for the machine to come up. > > We need to validate that this has the same affect as pulling the power from the machine. > > Ben > >> On May 10, 2016, at 5:09 PM, Scott Parker <sparker(a)anl.gov> wrote: >> >> >> Do we have a way for non-admin users to initiate a cold reboot? It would be useful to have that in the interim until >> we get a BIOS fix from Intel. Otherwise we are going to be severely limited in how frequently we can change the mode, >> and it will be hard to be certain if the node is in a good state. >> >> -Scott >> >> On 5/10/16 4:33 PM, Kumaran, Kalyan wrote: >>> * Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. >>> >>> * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. >>> >>> * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. >>> >>> * HACC and NeKbone slides will be used for ISC. >>> >>> * Intel to look into getting us the VTune update for KNL. >>> >>> -Kumar >>> >>> _______________________________________________ >>> Intel-nda mailing list >>> Intel-nda(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Action items from today's Intel call
by Allen, Benjamin S. 10 May '16

10 May '16

Yea I can hand out a shared account on the BMC that'll let you power cycle the machine from the logins via ipmitool to those that need it. The procedure will be something along the lines of: 1. run on knl00: shutdown -h now 2. Wait for the node to be powered off check via: ipmitool -I lanplus -H knl00.fto -U <user> power status 3. From login node: ipmitool -I lanplus -H knl00.fto -U <user> power on 4. Wait 5-10 minutes for the machine to come up. We need to validate that this has the same affect as pulling the power from the machine. Ben > On May 10, 2016, at 5:09 PM, Scott Parker <sparker(a)anl.gov> wrote: > > > Do we have a way for non-admin users to initiate a cold reboot? It would be useful to have that in the interim until > we get a BIOS fix from Intel. Otherwise we are going to be severely limited in how frequently we can change the mode, > and it will be hard to be certain if the node is in a good state. > > -Scott > > On 5/10/16 4:33 PM, Kumaran, Kalyan wrote: >> * Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. >> >> * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. >> >> * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. >> >> * HACC and NeKbone slides will be used for ISC. >> >> * Intel to look into getting us the VTune update for KNL. >> >> -Kumar >> >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Action items from today's Intel call
by Scott Parker 10 May '16

10 May '16

Do we have a way for non-admin users to initiate a cold reboot? It would be useful to have that in the interim until we get a BIOS fix from Intel. Otherwise we are going to be severely limited in how frequently we can change the mode, and it will be hard to be certain if the node is in a good state. -Scott On 5/10/16 4:33 PM, Kumaran, Kalyan wrote: > * Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. > > * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. > > * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. > > * HACC and NeKbone slides will be used for ISC. > > * Intel to look into getting us the VTune update for KNL. > > -Kumar > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

[JLSE-Intel-NDA] Action items from today's Intel call
by Kumaran, Kalyan 10 May '16

10 May '16

* Intel is seeing difference in STREAM triad results in the 4 clusters. They are aware of this issue and debugging it. They would like Scott to rerun using 1 thread and 2 threads per core and submit the results to them. They will hopefully have a fix in two weeks. * We made it clear to Intel that we need a BIOS fix for the issue with changing modes. Every time the mode is changed a cold reboot is required to fix the mapping on the cores. * Intel would like us to rerun the STREAM triad results in cache mode. They are expecting to see 300GB/s for Bin 3 parts. Scott was seeng 270GB/s. * HACC and NeKbone slides will be used for ISC. * Intel to look into getting us the VTune update for KNL. -Kumar

1 0

Re: [JLSE-Intel-NDA] KNL User Guide
by Allen, Benjamin S. 10 May '16

10 May '16

Reminder wiki.jlse.anl.gov uses the username and password used at https://accounts.jlse.anl.gov. If you've forgotten your password to https://accounts.jlse.anl.gov, you can reset it here https://accounts.jlse.anl.gov/index.php?tpl=reset_password.tpl. Ben > On May 10, 2016, at 10:22 AM, Christopher Knight <knightc(a)anl.gov> wrote: > > Looks like list was dropped. I'm able to login after requesting access to confluence from my jlse accounts page. > > chris > > > On May 10, 2016, at 9:38 AM, Harms, Kevin <harms(a)alcf.anl.gov> wrote: > > > you need to login to the accounts.jlse page and then select the confluence resource. > > kevin > > > > >> Hi Kevin, >> >> Tried viewing the page with jlse user/passwd and it returned an “operation not permitted” message. >> >> Does anyone else see similar message or has succeeded in viewing page? >> >> chris >> >> >> >> On May 9, 2016, at 4:27 PM, Harms, Kevin <harms(a)alcf.anl.gov> wrote: >> >> >> Here's a user guide for the KNL node. >> >> https://wiki.jlse.anl.gov/display/knl/Intel+KNL >> >> I believe anyone with Confluence access and in the 'intel' group should be able to edit it. Please make any corrections as needed. >> >> kevin >> >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] KNL User Guide
by Christopher Knight 10 May '16

10 May '16

Looks like list was dropped. I'm able to login after requesting access to confluence from my jlse accounts page. chris On May 10, 2016, at 9:38 AM, Harms, Kevin <harms(a)alcf.anl.gov> wrote: you need to login to the accounts.jlse page and then select the confluence resource. kevin > Hi Kevin, > > Tried viewing the page with jlse user/passwd and it returned an “operation not permitted” message. > > Does anyone else see similar message or has succeeded in viewing page? > > chris > > > > On May 9, 2016, at 4:27 PM, Harms, Kevin <harms(a)alcf.anl.gov> wrote: > > > Here's a user guide for the KNL node. > > https://wiki.jlse.anl.gov/display/knl/Intel+KNL > > I believe anyone with Confluence access and in the 'intel' group should be able to edit it. Please make any corrections as needed. > > kevin > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] KNL User Guide
by Kumaran, Kalyan 10 May '16

10 May '16

I get the same message. -Kumar > On May 10, 2016, at 9:21 AM, Christopher Knight <knightc(a)anl.gov> wrote: > > Hi Kevin, > > Tried viewing the page with jlse user/passwd and it returned an “operation not permitted” message. > > Does anyone else see similar message or has succeeded in viewing page? > > chris > > > > On May 9, 2016, at 4:27 PM, Harms, Kevin <harms(a)alcf.anl.gov> wrote: > > > Here's a user guide for the KNL node. > > https://wiki.jlse.anl.gov/display/knl/Intel+KNL > > I believe anyone with Confluence access and in the 'intel' group should be able to edit it. Please make any corrections as needed. > > kevin > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0