February 2017 - Intel-nda - mailman3.cels.anl.gov

Re: [JLSE-Intel-NDA] Timing in ScaLAPACK BLACS framework
by Jed Brown 21 Feb '17

21 Feb '17

"Hammond, Jeff R" <jeff.r.hammond(a)intel.com> writes: > MPI wtime returns a double. You are printing as a float so half the bits are lost. Try %lf. WUT? %f is for doubles. It actually isn't possible to pass float through varargs, they are implicitly promoted. Tania, have you printed t2-t1? The absolute value is of no significance.

1 0

Re: [JLSE-Intel-NDA] Timing in ScaLAPACK BLACS framework
by Hammond, Jeff R 21 Feb '17

21 Feb '17

MPI wtime returns a double. You are printing as a float so half the bits are lost. Try %lf. Compiler should have issued a warning about this... Jeff Sent from my iPhone On Feb 21, 2017, at 4:46 AM, Banerjee,Tania <tmishra(a)ufl.edu<mailto:[email protected]>> wrote: Hi, Is there any recommendation for which timer to use with the blacs library on KNL? MPI_Wtime() does not work. For example, the following code: blacs_get_( &i_negone, &i_zero, &ictxt ); blacs_gridinit_( &ictxt, "C", &nprocs, &i_one ); // timer t1 = MPI_Wtime(); printf("I am %d, t1=%f\n", iam, t1); // do work t2 = MPI_Wtime(); printf("I am %d, t2=%f\n", iam, t2); shows 1) The timer is not incremented, so t1=t2 2) For some processes, t1=t2=a negative number. Thanks, Tania _______________________________________________ Intel-nda mailing list Intel-nda(a)lists.jlse.anl.gov<mailto:[email protected]> https://lists.jlse.anl.gov/mailman/listinfo/intel-nda

1 0

[JLSE-Intel-NDA] Timing in ScaLAPACK BLACS framework
by Banerjee,Tania 21 Feb '17

21 Feb '17

Hi, Is there any recommendation for which timer to use with the blacs library on KNL? MPI_Wtime() does not work. For example, the following code: blacs_get_( &i_negone, &i_zero, &ictxt ); blacs_gridinit_( &ictxt, "C", &nprocs, &i_one ); // timer t1 = MPI_Wtime(); printf("I am %d, t1=%f\n", iam, t1); // do work t2 = MPI_Wtime(); printf("I am %d, t2=%f\n", iam, t2);? shows 1) The timer is not incremented, so t1=t2 2) For some processes, t1=t2=a negative number. Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by Hammond, Jeff R 20 Feb '17

20 Feb '17

Thanks for letting me know. I'll try to remember this link line in case someone else asks about it in the future. Best, Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 4:59 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Thanks Jeff. It worked for me when I dynamically linked the blacs library. So my compile line looked as: mpiicc -mkl ex.c /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_scalapack_lp64.a -Wl,-Bstatic -Wl,--start-group /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_intel_lp64.a /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_core.a /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_intel_thread.a -Wl,--end-group -Wl,-Bdynamic -o mult -lmkl_blacs_intelmpi_lp64 Best regards, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 7:01 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? You might post on the Intel Forum about this. It's going to be at least two weeks before I have time to do any debugging on JLSE. Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:59 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks for the links. So, its the MPI wrapper that needs to be resolved. I tried to follow the option that talks about adding -Wl,-Bstatic/dynamic and currently have this: MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,-Bstatic -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group -Wl,-Bdynamic Still I am not able to get the blacs_library* symbols below to appear with my executable: 21 00000000036a5f60 b blacs_library_loader_lock 22 00000000036a5f64 b blacs_library_lock_flag Beyond that it still is confusing. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 6:25 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? I have not seen that one before but I have a good idea where it comes from. Have you looked at https://software.intel.com/en-us/forums/intel-math-kernel-library/topic/590… or https://software.intel.com/en-us/articles/using-intel-mkl-mpi-wrapper-with-… yet? Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:19 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks a lot for your help. I am trying to figure it out, but currently I am getting an error: Intel MKL FATAL ERROR: Cannot load symbol MKLMPI_Get_wrappers. when I run my program. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 5:35 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Yes. It is in $MKLROOT if you source the Intel toolchain script (e.g. /soft/compilers/intel/bin/compilervars.sh). You can link single-threaded ScaLAPACK with -mkl=cluster or link it manually as follows (example is ScaLAPACK with threaded BLAS/LAPACK): MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group FFTW_INCL = -I${MKLROOT}/include/fftw/ FFTW_LIBS = ${MKL_STUFF} BLAS_LIBS = ${MKL_STUFF} SCALAPACK_LIBS = ${MKL_STUFF} Change lp64 to ilp64 as appropriate. Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 2:12 PM To: "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by Banerjee,Tania 20 Feb '17

20 Feb '17

Thanks Jeff. It worked for me when I dynamically linked the blacs library. So my compile line looked as: mpiicc -mkl ex.c /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_scalapack_lp64.a -Wl,-Bstatic -Wl,--start-group /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_intel_lp64.a /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_core.a /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64/libmkl_intel_thread.a -Wl,--end-group -Wl,-Bdynamic -o mult -lmkl_blacs_intelmpi_lp64 Best regards, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 7:01 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? You might post on the Intel Forum about this. It's going to be at least two weeks before I have time to do any debugging on JLSE. Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:59 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks for the links. So, its the MPI wrapper that needs to be resolved. I tried to follow the option that talks about adding -Wl,-Bstatic/dynamic and currently have this: MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,-Bstatic -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group -Wl,-Bdynamic Still I am not able to get the blacs_library* symbols below to appear with my executable: 21 00000000036a5f60 b blacs_library_loader_lock 22 00000000036a5f64 b blacs_library_lock_flag Beyond that it still is confusing. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 6:25 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? I have not seen that one before but I have a good idea where it comes from. Have you looked at https://software.intel.com/en-us/forums/intel-math-kernel-library/topic/590… or https://software.intel.com/en-us/articles/using-intel-mkl-mpi-wrapper-with-… yet? Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:19 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks a lot for your help. I am trying to figure it out, but currently I am getting an error: Intel MKL FATAL ERROR: Cannot load symbol MKLMPI_Get_wrappers. when I run my program. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 5:35 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Yes. It is in $MKLROOT if you source the Intel toolchain script (e.g. /soft/compilers/intel/bin/compilervars.sh). You can link single-threaded ScaLAPACK with -mkl=cluster or link it manually as follows (example is ScaLAPACK with threaded BLAS/LAPACK): MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group FFTW_INCL = -I${MKLROOT}/include/fftw/ FFTW_LIBS = ${MKL_STUFF} BLAS_LIBS = ${MKL_STUFF} SCALAPACK_LIBS = ${MKL_STUFF} Change lp64 to ilp64 as appropriate. Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 2:12 PM To: "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by Hammond, Jeff R 20 Feb '17

20 Feb '17

You might post on the Intel Forum about this. It's going to be at least two weeks before I have time to do any debugging on JLSE. Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:59 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks for the links. So, its the MPI wrapper that needs to be resolved. I tried to follow the option that talks about adding -Wl,-Bstatic/dynamic and currently have this: MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,-Bstatic -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group -Wl,-Bdynamic Still I am not able to get the blacs_library* symbols below to appear with my executable: 21 00000000036a5f60 b blacs_library_loader_lock 22 00000000036a5f64 b blacs_library_lock_flag Beyond that it still is confusing. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 6:25 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? I have not seen that one before but I have a good idea where it comes from. Have you looked at https://software.intel.com/en-us/forums/intel-math-kernel-library/topic/590… or https://software.intel.com/en-us/articles/using-intel-mkl-mpi-wrapper-with-… yet? Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:19 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks a lot for your help. I am trying to figure it out, but currently I am getting an error: Intel MKL FATAL ERROR: Cannot load symbol MKLMPI_Get_wrappers. when I run my program. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 5:35 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Yes. It is in $MKLROOT if you source the Intel toolchain script (e.g. /soft/compilers/intel/bin/compilervars.sh). You can link single-threaded ScaLAPACK with -mkl=cluster or link it manually as follows (example is ScaLAPACK with threaded BLAS/LAPACK): MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group FFTW_INCL = -I${MKLROOT}/include/fftw/ FFTW_LIBS = ${MKL_STUFF} BLAS_LIBS = ${MKL_STUFF} SCALAPACK_LIBS = ${MKL_STUFF} Change lp64 to ilp64 as appropriate. Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 2:12 PM To: "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by Banerjee,Tania 20 Feb '17

20 Feb '17

Hi Jeff, Thanks for the links. So, its the MPI wrapper that needs to be resolved. I tried to follow the option that talks about adding -Wl,-Bstatic/dynamic and currently have this: MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,-Bstatic -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group -Wl,-Bdynamic Still I am not able to get the blacs_library* symbols below to appear with my executable: 21 00000000036a5f60 b blacs_library_loader_lock 22 00000000036a5f64 b blacs_library_lock_flag? Beyond that it still is confusing. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 6:25 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? I have not seen that one before but I have a good idea where it comes from. Have you looked at https://software.intel.com/en-us/forums/intel-math-kernel-library/topic/590… or https://software.intel.com/en-us/articles/using-intel-mkl-mpi-wrapper-with-… yet? Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:19 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks a lot for your help. I am trying to figure it out, but currently I am getting an error: Intel MKL FATAL ERROR: Cannot load symbol MKLMPI_Get_wrappers. ?when I run my program. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 5:35 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Yes. It is in $MKLROOT if you source the Intel toolchain script (e.g. /soft/compilers/intel/bin/compilervars.sh). You can link single-threaded ScaLAPACK with -mkl=cluster or link it manually as follows (example is ScaLAPACK with threaded BLAS/LAPACK): MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group FFTW_INCL = -I${MKLROOT}/include/fftw/ FFTW_LIBS = ${MKL_STUFF} BLAS_LIBS = ${MKL_STUFF} SCALAPACK_LIBS = ${MKL_STUFF} Change lp64 to ilp64 as appropriate. Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 2:12 PM To: "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by Hammond, Jeff R 20 Feb '17

20 Feb '17

I have not seen that one before but I have a good idea where it comes from. Have you looked at https://software.intel.com/en-us/forums/intel-math-kernel-library/topic/590… or https://software.intel.com/en-us/articles/using-intel-mkl-mpi-wrapper-with-… yet? Jeff From: "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 3:19 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi Jeff, Thanks a lot for your help. I am trying to figure it out, but currently I am getting an error: Intel MKL FATAL ERROR: Cannot load symbol MKLMPI_Get_wrappers. when I run my program. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 5:35 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Yes. It is in $MKLROOT if you source the Intel toolchain script (e.g. /soft/compilers/intel/bin/compilervars.sh). You can link single-threaded ScaLAPACK with -mkl=cluster or link it manually as follows (example is ScaLAPACK with threaded BLAS/LAPACK): MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group FFTW_INCL = -I${MKLROOT}/include/fftw/ FFTW_LIBS = ${MKL_STUFF} BLAS_LIBS = ${MKL_STUFF} SCALAPACK_LIBS = ${MKL_STUFF} Change lp64 to ilp64 as appropriate. Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 2:12 PM To: "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by D'mello, Michael 20 Feb '17

20 Feb '17

You can find the relevant libs in (for example): /soft/compilers/intel/compilers_and_libraries_2017.1.132/linux/mkl/lib/intel64 or /soft/compilers/intel/compilers_and_libraries_2016.3.210/linux/mkl/lib/intel64 -michael From: intel-nda-bounces(a)lists.jlse.anl.gov [mailto:[email protected]] On Behalf Of Banerjee,Tania Sent: Monday, February 20, 2017 4:13 PM To: intel-nda(a)jlse.anl.gov Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0

Re: [JLSE-Intel-NDA] ScaLAPACK on KNL?
by Banerjee,Tania 20 Feb '17

20 Feb '17

Hi Jeff, Thanks a lot for your help. I am trying to figure it out, but currently I am getting an error: Intel MKL FATAL ERROR: Cannot load symbol MKLMPI_Get_wrappers. ?when I run my program. Thanks, Tania ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, February 20, 2017 5:35 PM To: Banerjee,Tania; intel-nda(a)jlse.anl.gov Subject: Re: [JLSE-Intel-NDA] ScaLAPACK on KNL? Yes. It is in $MKLROOT if you source the Intel toolchain script (e.g. /soft/compilers/intel/bin/compilervars.sh). You can link single-threaded ScaLAPACK with -mkl=cluster or link it manually as follows (example is ScaLAPACK with threaded BLAS/LAPACK): MKL_STUFF = ${MKLROOT}/lib/intel64/libmkl_scalapack_lp64.a \ -Wl,--start-group \ ${MKLROOT}/lib/intel64/libmkl_intel_lp64.a \ ${MKLROOT}/lib/intel64/libmkl_core.a \ ${MKLROOT}/lib/intel64/libmkl_intel_thread.a \ ${MKLROOT}/lib/intel64/libmkl_blacs_intelmpi_lp64.a \ -Wl,--end-group FFTW_INCL = -I${MKLROOT}/include/fftw/ FFTW_LIBS = ${MKL_STUFF} BLAS_LIBS = ${MKL_STUFF} SCALAPACK_LIBS = ${MKL_STUFF} Change lp64 to ilp64 as appropriate. Jeff From: <intel-nda-bounces(a)lists.jlse.anl.gov> on behalf of "Banerjee,Tania" <tmishra(a)ufl.edu> Date: Monday, February 20, 2017 at 2:12 PM To: "intel-nda(a)jlse.anl.gov" <intel-nda(a)jlse.anl.gov> Subject: [JLSE-Intel-NDA] ScaLAPACK on KNL? Hi, Is MKL ScaLAPACK installed on JLSE for use on KNL? Thanks, Tania

1 0