December 2016 - Intel-nda - mailman3.cels.anl.gov

Re: [JLSE-Intel-NDA] KNL Machine OS/Drivers Updates -- NOW MUCH SLOWER
by Steven C. Pieper 19 Dec '16

19 Dec '16

cache-quad. Here is my qsub: qsub -n 1 -t 80 --attrs knl_memory_mode=Cache -q knl_7250 donompi-m0_pn Steve Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 http://www.phy.anl.gov/theory/staff/scp.html On 12/19/16 11:33, Allen, Benjamin S. wrote: > With which KNL mode(s) are you seeing this? > > Ben > >> On Dec 19, 2016, at 11:22 AM, Steven C. Pieper <spieper(a)anl.gov> wrote: >> >> The JLSE KNL nodes (I've tried knl09 and knl10) are about 40% slower for me >> after this change. This is true for both running load modules made before the >> change and running new modules. The slow down is fairly uniform in all >> the computationally intensive (Intel Fortran compiler) subroutines that I individually time. >> This does not appear to be my deallocate problem because some of the >> subroutines do no explicit allocates or dealloctes. It is also not a communication >> problem because I am running a 1-node non-mpi job. I am using OpenMP with >> 10 threads. >> >> Have others compared speeds before and after the change? >> >> Steve >> >> Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov >> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 >> Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 >> http://www.phy.anl.gov/theory/staff/scp.html >> >> On 12/15/16 16:32, Allen, Benjamin S. wrote: >>> The OS image for the KNL machine has been updated to RHEL7.3 with kernel 3.10.0-514.2.2.el7.x86_64. RHEL7.3 is the first release where RedHat states it has KNL support. OmniPath OPA software has been updated to 10.3.0.0.81. >>> >>> Hopefully these fixes will help with the various recent crashing conditions on these nodes. >>> >>> Let me know what's broken. >>> >>> Ben >>> _______________________________________________ >>> Intel-nda mailing list >>> Intel-nda(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] KNL Machine OS/Drivers Updates -- NOW MUCH SLOWER
by Allen, Benjamin S. 19 Dec '16

19 Dec '16

With which KNL mode(s) are you seeing this? Ben > On Dec 19, 2016, at 11:22 AM, Steven C. Pieper <spieper(a)anl.gov> wrote: > > The JLSE KNL nodes (I've tried knl09 and knl10) are about 40% slower for me > after this change. This is true for both running load modules made before the > change and running new modules. The slow down is fairly uniform in all > the computationally intensive (Intel Fortran compiler) subroutines that I individually time. > This does not appear to be my deallocate problem because some of the > subroutines do no explicit allocates or dealloctes. It is also not a communication > problem because I am running a 1-node non-mpi job. I am using OpenMP with > 10 threads. > > Have others compared speeds before and after the change? > > Steve > > Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov > Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 > Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 > http://www.phy.anl.gov/theory/staff/scp.html > > On 12/15/16 16:32, Allen, Benjamin S. wrote: >> The OS image for the KNL machine has been updated to RHEL7.3 with kernel 3.10.0-514.2.2.el7.x86_64. RHEL7.3 is the first release where RedHat states it has KNL support. OmniPath OPA software has been updated to 10.3.0.0.81. >> >> Hopefully these fixes will help with the various recent crashing conditions on these nodes. >> >> Let me know what's broken. >> >> Ben >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >

1 0

Re: [JLSE-Intel-NDA] KNL Machine OS/Drivers Updates -- NOW MUCH SLOWER
by Steven C. Pieper 19 Dec '16

19 Dec '16

The JLSE KNL nodes (I've tried knl09 and knl10) are about 40% slower for me after this change. This is true for both running load modules made before the change and running new modules. The slow down is fairly uniform in all the computationally intensive (Intel Fortran compiler) subroutines that I individually time. This does not appear to be my deallocate problem because some of the subroutines do no explicit allocates or dealloctes. It is also not a communication problem because I am running a 1-node non-mpi job. I am using OpenMP with 10 threads. Have others compared speeds before and after the change? Steve Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 http://www.phy.anl.gov/theory/staff/scp.html On 12/15/16 16:32, Allen, Benjamin S. wrote: > The OS image for the KNL machine has been updated to RHEL7.3 with kernel 3.10.0-514.2.2.el7.x86_64. RHEL7.3 is the first release where RedHat states it has KNL support. OmniPath OPA software has been updated to 10.3.0.0.81. > > Hopefully these fixes will help with the various recent crashing conditions on these nodes. > > Let me know what's broken. > > Ben > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Omni-Path network down?
by Paul Hargrove 15 Dec '16

15 Dec '16

Ben, I wasn't able to confirm until today, but things *are* working again. Thanks, -Paul On Tue, Dec 13, 2016 at 8:30 AM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > Hi Paul, > > I had to restart the embedded subnet manager on the OmniPath switch. It > appears to be passing traffic again. > > Thanks for the heads up, > > Ben > > > On Dec 12, 2016, at 6:15 PM, Paul Hargrove <phhargrove(a)lbl.gov> wrote: > > > > As a developer of network middleware, part of my interest in the KNL > nodes at JLSE is the Omni-Path network. > > > > I had been successfully using both pshm2 and librabric (psm2 provider) > on the KNLs. > > However, sometime between Oct 11 and Dec 3 things ceased to work as they > had. > > Those are the dates of the latest successful run and earliest fail run. > > Sorry that I don't have anything between those dates. > > > > Both psm2 and libfabric based programs are now failing with messages > like: > > knl08.ftm.alcf.anl.gov.223177PSM found 0 available contexts on opa > device(s). (err=21) > > > > Additionally, /usr/sbin/opainfo says: > > {hargrove@knl04 ~}$ /usr/sbin/opainfo > > oib_utils ERROR: [23478] oib_open_port: can't open UMAD port (hfi1_0:1) > > opainfo: Unable to open hfi:port 0:1 > > (Though, in all honesty, I don't know if opainfo ever worked before). > > > > -Paul > > > > -- > > Paul H. Hargrove PHHargrove(a)lbl.gov > > Computer Languages & Systems Software (CLaSS) Group > > Computer Science Department Tel: +1-510-495-2352 > > Lawrence Berkeley National Laboratory Fax: +1-510-486-6900 > > _______________________________________________ > > Intel-nda mailing list > > Intel-nda(a)lists.jlse.anl.gov > > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > -- Paul H. Hargrove PHHargrove(a)lbl.gov Computer Languages & Systems Software (CLaSS) Group Computer Science Department Tel: +1-510-495-2352 Lawrence Berkeley National Laboratory Fax: +1-510-486-6900

1 0

[JLSE-Intel-NDA] KNL Machine OS/Drivers Updates
by Allen, Benjamin S. 15 Dec '16

15 Dec '16

The OS image for the KNL machine has been updated to RHEL7.3 with kernel 3.10.0-514.2.2.el7.x86_64. RHEL7.3 is the first release where RedHat states it has KNL support. OmniPath OPA software has been updated to 10.3.0.0.81. Hopefully these fixes will help with the various recent crashing conditions on these nodes. Let me know what's broken. Ben

1 0

Re: [JLSE-Intel-NDA] Using VTune remotely on the Phi
by Hammond, Jeff R 13 Dec '16

13 Dec '16

FWIW based upon my experience trying unsuccessfully to debug why NWChem won’t run in the Vtune GUI, I recommend always using Vtune CLI. It’s a bad habit to get used to fancy features like GUIs and dynamic memory allocation if you want to be a serious HPC person ;-) Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov<mailto:[email protected]>> on behalf of Will Boyd <wbinventor(a)gmail.com<mailto:[email protected]>> Date: Tuesday, December 13, 2016 at 3:00 PM To: "D'mello, Michael" <michael.dmello(a)intel.com<mailto:[email protected]>>, "intel-nda(a)jlse.anl.gov<mailto:[email protected]>" <intel-nda(a)jlse.anl.gov<mailto:[email protected]>> Subject: Re: [JLSE-Intel-NDA] Using VTune remotely on the Phi Thank you Michael and Jeff. Downloading the results from the VTune CLI and importing them into the VTune GUI locally works great. On Tue, Dec 13, 2016 at 5:35 PM D'mello, Michael <michael.dmello(a)intel.com<mailto:[email protected]>> wrote: Hi Will, You can use the command line interface to collect the profiling information. For example: > amplxe_cl –collect hotspots ./a.out You can then move the results (entire directory) over to the environment (Windows or Linux) in which you would like to view the results. regards -michael From: intel-nda-bounces(a)lists.jlse.anl.gov<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Will Boyd Sent: Tuesday, December 13, 2016 4:30 PM To: intel-nda(a)jlse.anl.gov<mailto:[email protected]> Subject: [JLSE-Intel-NDA] Using VTune remotely on the Phi I am interested in profiling an application on the Phi using Intel VTune. I would like to use the graphical interface for VTune, but have been unable to launch VTune remotely using my local instance of VTune. Does anyone have any recommendations for how to remotely profile my application on the Phi but view the results locally with the VTune GUI on my workstation? Thanks, Will

1 0

Re: [JLSE-Intel-NDA] Using VTune remotely on the Phi
by Will Boyd 13 Dec '16

13 Dec '16

Thank you Michael and Jeff. Downloading the results from the VTune CLI and importing them into the VTune GUI locally works great. On Tue, Dec 13, 2016 at 5:35 PM D'mello, Michael <michael.dmello(a)intel.com> wrote: > Hi Will, > > > > You can use the command line interface to collect the profiling > information. For example: > > > > Ø amplxe_cl –collect hotspots ./a.out > > > > You can then move the results (entire directory) over to the environment > (Windows or Linux) in which you would like to view the results. > > > > regards > > > > -michael > > > > > > *From:* intel-nda-bounces(a)lists.jlse.anl.gov [mailto: > intel-nda-bounces(a)lists.jlse.anl.gov] *On Behalf Of *Will Boyd > *Sent:* Tuesday, December 13, 2016 4:30 PM > *To:* intel-nda(a)jlse.anl.gov > > > *Subject:* [JLSE-Intel-NDA] Using VTune remotely on the Phi > > > > I am interested in profiling an application on the Phi using Intel VTune. > I would like to use the graphical interface for VTune, but have been unable > to launch VTune remotely using my local instance of VTune. Does anyone have > any recommendations for how to remotely profile my application on the Phi > but view the results locally with the VTune GUI on my workstation? > > > > Thanks, > > Will >

1 0

Re: [JLSE-Intel-NDA] Using VTune remotely on the Phi
by D'mello, Michael 13 Dec '16

13 Dec '16

Hi Will, You can use the command line interface to collect the profiling information. For example: Ø amplxe_cl –collect hotspots ./a.out You can then move the results (entire directory) over to the environment (Windows or Linux) in which you would like to view the results. regards -michael From: intel-nda-bounces(a)lists.jlse.anl.gov [mailto:[email protected]] On Behalf Of Will Boyd Sent: Tuesday, December 13, 2016 4:30 PM To: intel-nda(a)jlse.anl.gov Subject: [JLSE-Intel-NDA] Using VTune remotely on the Phi I am interested in profiling an application on the Phi using Intel VTune. I would like to use the graphical interface for VTune, but have been unable to launch VTune remotely using my local instance of VTune. Does anyone have any recommendations for how to remotely profile my application on the Phi but view the results locally with the VTune GUI on my workstation? Thanks, Will

1 0

Re: [JLSE-Intel-NDA] Using VTune remotely on the Phi
by Hammond, Jeff R 13 Dec '16

13 Dec '16

use the command line interface to dump the metadata. there’s a way to generate a single file with the minimum number of bytes, too. this is surely documented but I don’t have the details handy to copy-and-paste into this email. jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov<mailto:[email protected]>> on behalf of Will Boyd <wbinventor(a)gmail.com<mailto:[email protected]>> Date: Tuesday, December 13, 2016 at 2:29 PM To: "intel-nda(a)jlse.anl.gov<mailto:[email protected]>" <intel-nda(a)jlse.anl.gov<mailto:[email protected]>> Subject: [JLSE-Intel-NDA] Using VTune remotely on the Phi I am interested in profiling an application on the Phi using Intel VTune. I would like to use the graphical interface for VTune, but have been unable to launch VTune remotely using my local instance of VTune. Does anyone have any recommendations for how to remotely profile my application on the Phi but view the results locally with the VTune GUI on my workstation? Thanks, Will

1 0

[JLSE-Intel-NDA] Using VTune remotely on the Phi
by Will Boyd 13 Dec '16

13 Dec '16

I am interested in profiling an application on the Phi using Intel VTune. I would like to use the graphical interface for VTune, but have been unable to launch VTune remotely using my local instance of VTune. Does anyone have any recommendations for how to remotely profile my application on the Phi but view the results locally with the VTune GUI on my workstation? Thanks, Will

1 0