October 2016 - Intel-nda - mailman3.cels.anl.gov

[JLSE-Intel-NDA] Intel Fortran V17 beta license
by Steven Pieper 27 Oct '16

27 Oct '16

Ben, I have a Fortran program that produces the correct results with the Intel V17-beta compiler but wrong results with the production compiler. This has been submitted to Intel as issue 6000163313 which (after a month) still has the status "investigating." At my request the beta license was extended to Nov 6: [jlselogin2 ~] ifort -V Intel(R) Fortran Intel(R) 64 Compiler for applications running on Intel(R) 64, Version 17.0.0.042 Beta Build 20160315 Copyright (C) 1985-2016 Intel Corporation. All rights reserved. ifort: NOTE: The Beta evaluation period for this product ends on 6-nov-2016 UTC. [jlselogin2 ~] which ifort /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/bin/intel64/ifort It's clear that a correction will not be received in the next week so I am requesting that the beta license be extended again; on Theta it has been extended to Feb 2017. Thank you, Steve -- Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 http://www.phy.anl.gov/theory/staff/scp.html

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Jed Brown 18 Oct '16

18 Oct '16

Tom LeCompte <lecompte(a)anl.gov> writes: > Hi Kevin- > > Thanks. Sourcing the compilers did it. This is a common issue. I edited the wiki to suggest this instead of mpivars.sh (and to consistently use the Intel 17 release, versus mixing it with the beta). Hopefully the docs are consistent now. https://wiki.jlse.anl.gov/display/knl/Intel+KNL

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Tom LeCompte 18 Oct '16

18 Oct '16

Hi Kevin- Thanks. Sourcing the compilers did it. Cheers, Tom On 10/18/2016 9:45 AM, Harms, Kevin wrote: > Tom, > > the last one using ï¿½-static-intelï¿½ statically links the Intel libraries thus you donï¿½t have any issue loading dynamic libraries. As for your first item, it appears the mpivars.sh script only provides the MPI libraries and does not add the path for the Fortran runtime libraries. You will need to add sourcing of the compiler libraries as well: > > source /soft/compilers/intel/compilers_and_libraries/linux/bin/compilervars.sh intel64 > mpirun -f $COBALT_NODEFILE -ppn 2 ./toys > > It looks like the compilervars.sh adds all the libraries including MPI. > > kevin > > -----Original Message----- > From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of Tom LeCompte <lecompte(a)anl.gov> > Date: Tuesday, October 18, 2016 at 9:01 AM > To: "intel-nda(a)lists.jlse.anl.gov" <intel-nda(a)lists.jlse.anl.gov> > Subject: [JLSE-Intel-NDA] Fortran and shared libraries > > Hi everyone- > > I already have a workaround, but I am puzzled as to why I need one. > > If I compile with: > > mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys > mt19937.o toys.f > > and run with > > source > /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh > mpirun -f $COBALT_NODEFILE -ppn 2 ./toys > > I get the error (twice) > > ./toys: error while loading shared libraries: libifport.so.5: cannot > open shared object file: No such file or directory > > This persists when I put > /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic > in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run > area and put the run area in my LD_LIBRARY_PATH. Echoing > $LD_LIBRARY_PATH shows that this "took". > > If I instead compile with: > > mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f > > It runs perfectly. > > Any ideas? > > Cheers, > > Tom > > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > >

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Steven Pieper 18 Oct '16

18 Oct '16

I should have said that also source the the fortran compilervars.sh as suggested by Kevin. Steve Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 http://www.phy.anl.gov/theory/staff/scp.html On 10/18/2016 09:45 AM, Harms, Kevin wrote: > Tom, > > the last one using ‘-static-intel’ statically links the Intel libraries thus you don’t have any issue loading dynamic libraries. As for your first item, it appears the mpivars.sh script only provides the MPI libraries and does not add the path for the Fortran runtime libraries. You will need to add sourcing of the compiler libraries as well: > > source /soft/compilers/intel/compilers_and_libraries/linux/bin/compilervars.sh intel64 > mpirun -f $COBALT_NODEFILE -ppn 2 ./toys > > It looks like the compilervars.sh adds all the libraries including MPI. > > kevin > > -----Original Message----- > From:<intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of Tom LeCompte<lecompte(a)anl.gov> > Date: Tuesday, October 18, 2016 at 9:01 AM > To: "intel-nda(a)lists.jlse.anl.gov"<intel-nda(a)lists.jlse.anl.gov> > Subject: [JLSE-Intel-NDA] Fortran and shared libraries > > Hi everyone- > > I already have a workaround, but I am puzzled as to why I need one. > > If I compile with: > > mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys > mt19937.o toys.f > > and run with > > source > /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh > mpirun -f $COBALT_NODEFILE -ppn 2 ./toys > > I get the error (twice) > > ./toys: error while loading shared libraries: libifport.so.5: cannot > open shared object file: No such file or directory > > This persists when I put > /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic > in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run > area and put the run area in my LD_LIBRARY_PATH. Echoing > $LD_LIBRARY_PATH shows that this "took". > > If I instead compile with: > > mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f > > It runs perfectly. > > Any ideas? > > Cheers, > > Tom > > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Hammond, Jeff R 18 Oct '16

18 Oct '16

+1 to both. -static-intel is your friend. Ignore cilkrts warning with C/C++ (unless you use Cilk of course). Sent from my iPhone > On Oct 18, 2016, at 7:45 AM, Harms, Kevin <harms(a)alcf.anl.gov> wrote: > > Tom, > > the last one using ‘-static-intel’ statically links the Intel libraries thus you don’t have any issue loading dynamic libraries. As for your first item, it appears the mpivars.sh script only provides the MPI libraries and does not add the path for the Fortran runtime libraries. You will need to add sourcing of the compiler libraries as well: > > source /soft/compilers/intel/compilers_and_libraries/linux/bin/compilervars.sh intel64 > mpirun -f $COBALT_NODEFILE -ppn 2 ./toys > > It looks like the compilervars.sh adds all the libraries including MPI. > > kevin > > -----Original Message----- > From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of Tom LeCompte <lecompte(a)anl.gov> > Date: Tuesday, October 18, 2016 at 9:01 AM > To: "intel-nda(a)lists.jlse.anl.gov" <intel-nda(a)lists.jlse.anl.gov> > Subject: [JLSE-Intel-NDA] Fortran and shared libraries > > Hi everyone- > > I already have a workaround, but I am puzzled as to why I need one. > > If I compile with: > > mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys > mt19937.o toys.f > > and run with > > source > /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh > mpirun -f $COBALT_NODEFILE -ppn 2 ./toys > > I get the error (twice) > > ./toys: error while loading shared libraries: libifport.so.5: cannot > open shared object file: No such file or directory > > This persists when I put > /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic > in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run > area and put the run area in my LD_LIBRARY_PATH. Echoing > $LD_LIBRARY_PATH shows that this "took". > > If I instead compile with: > > mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f > > It runs perfectly. > > Any ideas? > > Cheers, > > Tom > > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > > > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Hammond, Jeff R 18 Oct '16

18 Oct '16

intel64_lin_mic might be for KNC. Try non-MIC path. Sent from my iPhone On Oct 18, 2016, at 7:43 AM, Tom LeCompte <lecompte(a)anl.gov<mailto:[email protected]>> wrote: Hi Jeff- This persists when I put /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run area and put the run area in my LD_LIBRARY_PATH. Echoing $LD_LIBRARY_PATH shows that this "took". What else should I do? Cheers, Tom On 10/18/2016 9:41 AM, Hammond, Jeff R wrote: LD LIBRARY PATH issue. Setup environment properly using modules or equivalent. Sent from my iPhone On Oct 18, 2016, at 7:35 AM, Steven Pieper <spieper(a)anl.gov<mailto:[email protected]>> wrote: Are you running interactively or by a script? I have your source command and an mpirun command (without -F) in a script and it works fine. I also have the same source command in my .bash_profile but I don't think that is relevant. Steve Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov<mailto:[email protected]> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 http://www.phy.anl.gov/theory/staff/scp.html On 10/18/2016 09:01 AM, Tom LeCompte wrote: Hi everyone- I already have a workaround, but I am puzzled as to why I need one. If I compile with: mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys mt19937.o toys.f and run with source /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh mpirun -f $COBALT_NODEFILE -ppn 2 ./toys I get the error (twice) ./toys: error while loading shared libraries: libifport.so.5: cannot open shared object file: No such file or directory This persists when I put /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run area and put the run area in my LD_LIBRARY_PATH. Echoing $LD_LIBRARY_PATH shows that this "took". If I instead compile with: mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f It runs perfectly. Any ideas? Cheers, Tom _______________________________________________ Intel-nda mailing list Intel-nda(a)lists.jlse.anl.gov<mailto:[email protected]> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda _______________________________________________ Intel-nda mailing list Intel-nda(a)lists.jlse.anl.gov<mailto:[email protected]> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda _______________________________________________ Intel-nda mailing list Intel-nda(a)lists.jlse.anl.gov<mailto:[email protected]> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda _______________________________________________ Intel-nda mailing list Intel-nda(a)lists.jlse.anl.gov<mailto:[email protected]> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Harms, Kevin 18 Oct '16

18 Oct '16

Tom, the last one using ‘-static-intel’ statically links the Intel libraries thus you don’t have any issue loading dynamic libraries. As for your first item, it appears the mpivars.sh script only provides the MPI libraries and does not add the path for the Fortran runtime libraries. You will need to add sourcing of the compiler libraries as well: source /soft/compilers/intel/compilers_and_libraries/linux/bin/compilervars.sh intel64 mpirun -f $COBALT_NODEFILE -ppn 2 ./toys It looks like the compilervars.sh adds all the libraries including MPI. kevin -----Original Message----- From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of Tom LeCompte <lecompte(a)anl.gov> Date: Tuesday, October 18, 2016 at 9:01 AM To: "intel-nda(a)lists.jlse.anl.gov" <intel-nda(a)lists.jlse.anl.gov> Subject: [JLSE-Intel-NDA] Fortran and shared libraries Hi everyone- I already have a workaround, but I am puzzled as to why I need one. If I compile with: mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys mt19937.o toys.f and run with source /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh mpirun -f $COBALT_NODEFILE -ppn 2 ./toys I get the error (twice) ./toys: error while loading shared libraries: libifport.so.5: cannot open shared object file: No such file or directory This persists when I put /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run area and put the run area in my LD_LIBRARY_PATH. Echoing $LD_LIBRARY_PATH shows that this "took". If I instead compile with: mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f It runs perfectly. Any ideas? Cheers, Tom _______________________________________________ Intel-nda mailing list Intel-nda(a)lists.jlse.anl.gov https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Tom LeCompte 18 Oct '16

18 Oct '16

Hi Jeff- This persists when I put /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run area and put the run area in my LD_LIBRARY_PATH. Echoing $LD_LIBRARY_PATH shows that this "took". What else should I do? Cheers, Tom On 10/18/2016 9:41 AM, Hammond, Jeff R wrote: > LD LIBRARY PATH issue. Setup environment properly using modules or equivalent. > > Sent from my iPhone > >> On Oct 18, 2016, at 7:35 AM, Steven Pieper <spieper(a)anl.gov> wrote: >> >> Are you running interactively or by a script? I have your source >> command and an mpirun command (without -F) in a script and it works >> fine. I also have the same source command in my .bash_profile but >> I don't think that is relevant. >> >> Steve >> >> Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov >> Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 >> Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 >> http://www.phy.anl.gov/theory/staff/scp.html >> >>> On 10/18/2016 09:01 AM, Tom LeCompte wrote: >>> Hi everyone- >>> >>> I already have a workaround, but I am puzzled as to why I need one. >>> >>> If I compile with: >>> >>> mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys mt19937.o toys.f >>> >>> and run with >>> >>> source /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh >>> mpirun -f $COBALT_NODEFILE -ppn 2 ./toys >>> >>> I get the error (twice) >>> >>> ./toys: error while loading shared libraries: libifport.so.5: cannot open shared object file: No such file or directory >>> >>> This persists when I put /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run area and put the run area in my LD_LIBRARY_PATH. Echoing $LD_LIBRARY_PATH shows that this "took". >>> >>> If I instead compile with: >>> >>> mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f >>> >>> It runs perfectly. >>> >>> Any ideas? >>> >>> Cheers, >>> >>> Tom >>> >>> >>> _______________________________________________ >>> Intel-nda mailing list >>> Intel-nda(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Hammond, Jeff R 18 Oct '16

18 Oct '16

LD LIBRARY PATH issue. Setup environment properly using modules or equivalent. Sent from my iPhone > On Oct 18, 2016, at 7:35 AM, Steven Pieper <spieper(a)anl.gov> wrote: > > Are you running interactively or by a script? I have your source > command and an mpirun command (without -F) in a script and it works > fine. I also have the same source command in my .bash_profile but > I don't think that is relevant. > > Steve > > Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov > Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 > Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, -4100 > http://www.phy.anl.gov/theory/staff/scp.html > >> On 10/18/2016 09:01 AM, Tom LeCompte wrote: >> Hi everyone- >> >> I already have a workaround, but I am puzzled as to why I need one. >> >> If I compile with: >> >> mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys mt19937.o toys.f >> >> and run with >> >> source /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh >> mpirun -f $COBALT_NODEFILE -ppn 2 ./toys >> >> I get the error (twice) >> >> ./toys: error while loading shared libraries: libifport.so.5: cannot open shared object file: No such file or directory >> >> This persists when I put /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the run area and put the run area in my LD_LIBRARY_PATH. Echoing $LD_LIBRARY_PATH shows that this "took". >> >> If I instead compile with: >> >> mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f >> >> It runs perfectly. >> >> Any ideas? >> >> Cheers, >> >> Tom >> >> >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

Re: [JLSE-Intel-NDA] Fortran and shared libraries
by Tom LeCompte 18 Oct '16

18 Oct '16

Hi Steve, A script: #! /bin/bash source /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh mpirun -f $COBALT_NODEFILE -ppn 256 ./toys submitted by: qsub -q knl_7210 -n 1 -t 10 run_toys.sh Cheers, Tom On 10/18/2016 9:34 AM, Steven Pieper wrote: > Are you running interactively or by a script? I have your source > command and an mpirun command (without -F) in a script and it works > fine. I also have the same source command in my .bash_profile but > I don't think that is relevant. > > Steve > > Steven C. Pieper, Senior Physicist Emeritus: spieper(a)anl.gov > Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL > 60439 > Phone: 630-252-4232 Fax -6008 Secretary, Debra Beres, > -4100 > http://www.phy.anl.gov/theory/staff/scp.html > > On 10/18/2016 09:01 AM, Tom LeCompte wrote: >> Hi everyone- >> >> I already have a workaround, but I am puzzled as to why I need one. >> >> If I compile with: >> >> mpiifort -O3 -xMIC_AVX512 -mcmodel medium -shared-intel -o toys >> mt19937.o toys.f >> >> and run with >> >> source >> /soft/compilers/intel/compilers_and_libraries/linux/mpi/bin64/mpivars.sh >> mpirun -f $COBALT_NODEFILE -ppn 2 ./toys >> >> I get the error (twice) >> >> ./toys: error while loading shared libraries: libifport.so.5: cannot >> open shared object file: No such file or directory >> >> This persists when I put >> /soft/compilers/intel_beta/compilers_and_libraries_2017.0.042/linux/compiler/lib/intel64_lin_mic >> in my LD_LIBRARY_PATH, and even when I copy libifport.so.5 into the >> run area and put the run area in my LD_LIBRARY_PATH. Echoing >> $LD_LIBRARY_PATH shows that this "took". >> >> If I instead compile with: >> >> mpiifort -O3 -xMIC_AVX512 -static-intel -o toys mt19937.o toys.f >> >> It runs perfectly. >> >> Any ideas? >> >> Cheers, >> >> Tom >> >> >> _______________________________________________ >> Intel-nda mailing list >> Intel-nda(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda > _______________________________________________ > Intel-nda mailing list > Intel-nda(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0