March 2018 - Anl-intel-lrz-knr - mailman3.cels.anl.gov

Re: [Anl-intel-csa] Updated ANL Prototype Compiler
by Hal Finkel 30 Mar '18

30 Mar '18

On 03/30/2018 09:06 AM, Hal Finkel wrote: > Hi everyone, > > I've updated the ANL prototype compiler installed in > /soft/restricted/intel_csa/apps/anl-llvm - some new features: > > 1. Pulled in upstream functionality improvements for 'omp declare > target' functions. > > 2. Added support for non-temporal loads and stores (i.e., the Clang > builtins __builtin_nontemporal_load/__builtin_nontemporal_store generate > memory accesses using MEMLEVEL_NTA instead of MEMLEVEL_T0). > > 3. Added support for memory prefetching (i.e., the Clang builtin > __builtin_prefetch generates prefetch instructions). > > 4. Atomic operations are now supported, including fences, and so atomic > operations can be generated using builtin atomic types (and/or the > __sync_* builtins). > > Regarding (4), the compiler makes use of the global-ordering > memory-access outputs in order to ensure correct global visibility > semantics. The mechanism employed implies an additional cost for all > other memory accesses (because acquire/release semantics imply a > relationship between the atomic and non-atomic accesses). Function calls > aren't supported, but in theory, correctness assumptions rely on > implicit fences being present on entry/exit to each function. Also, I'll add that the extra cost is incurred only when atomics are used somewhere in the function. Moreover, it depends on what kind of atomics are used (relaxed and similar have little cost, acquire/release have more cost, and sequentially-consistent atomics are even more expensive). Some consideration to how this works, I suspect, needs to be made when designing the calling convention(s) (so we don't need otherwise-unnecessary fences). -Hal > > -Hal > -- Hal Finkel Lead, Compiler Technology and Programming Languages Leadership Computing Facility Argonne National Laboratory

1 0

[Anl-intel-csa] Updated ANL Prototype Compiler
by Hal Finkel 30 Mar '18

30 Mar '18

Hi everyone, I've updated the ANL prototype compiler installed in /soft/restricted/intel_csa/apps/anl-llvm - some new features: 1. Pulled in upstream functionality improvements for 'omp declare target' functions. 2. Added support for non-temporal loads and stores (i.e., the Clang builtins __builtin_nontemporal_load/__builtin_nontemporal_store generate memory accesses using MEMLEVEL_NTA instead of MEMLEVEL_T0). 3. Added support for memory prefetching (i.e., the Clang builtin __builtin_prefetch generates prefetch instructions). 4. Atomic operations are now supported, including fences, and so atomic operations can be generated using builtin atomic types (and/or the __sync_* builtins). Regarding (4), the compiler makes use of the global-ordering memory-access outputs in order to ensure correct global visibility semantics. The mechanism employed implies an additional cost for all other memory accesses (because acquire/release semantics imply a relationship between the atomic and non-atomic accesses). Function calls aren't supported, but in theory, correctness assumptions rely on implicit fences being present on entry/exit to each function. -Hal -- Hal Finkel Lead, Compiler Technology and Programming Languages Leadership Computing Facility Argonne National Laboratory

1 0

[Anl-intel-csa] Canceled: ANL/Intel CSA Workload Characterization
by Petrini, Fabrizio 29 Mar '18

29 Mar '18

Placeholder for weekly ANL/Intel CSA Exascale workload characterization meeting ......................................................................................................................................... --> Join Skype Meeting<https://meet.intel.com/fabrizio.petrini/7K7FM32F> Trouble Joining? Try Skype Web App<https://meet.intel.com/fabrizio.petrini/7K7FM32F?sl=1> Join by phone +1(916)356-2663 (or your local bridge access #) Choose bridge 5.<tel:+1(916)356-2663%20(or%20your%20local%20bridge%20access%20#)%20Choose%20bridge%205.> (Global) English (United States) Find a local number<https://dial.intel.com> Conference ID: 791574018 Forgot your dial-in PIN?<https://dial.intel.com> |Help<https://o15.officeredir.microsoft.com/r/rlidLync15?clid=1033&p1=5&p2=2009> [!OC([1033])!] .........................................................................................................................................

1 0

Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation))
by Tannenbaum, Barry M 27 Mar '18

27 Mar '18

This looks like a compiler problem. Pablo, I've put it into Jira as CMPLRS-49490 and assigned it to you. From: Jin, Zheming [mailto:[email protected]] Sent: Tuesday, March 27, 2018 4:46 PM To: Tannenbaum, Barry M <barry.m.tannenbaum(a)intel.com>; Narayanaswamy, Ravi <ravi.narayanaswamy(a)intel.com>; anl-intel-csa(a)jlse.anl.gov Subject: Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) Hi Barry, Thank you very much for your answers! When I compile a Fortran file with -fopenmp-targets=csa, it produces segfault. Am I right ? Thanks, /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -O3 -fopenmp -fopenmp-targets=csa -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f #0 0x000000000313d478 llvm::sys::PrintStackTrace(llvm::raw_ostream&) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313d478) #1 0x000000000313d509 PrintStackTraceSignalHandler(void*) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313d509) #2 0x000000000313b99c llvm::sys::RunSignalHandlers() (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313b99c) #3 0x000000000313cd5f SignalHandler(int) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313cd5f) #4 0x00007f0c851525e0 __restore_rt (/usr/lib64/libpthread.so.0+0xf5e0) #5 0x0000000001e59d9c llvm::Twine::Twine(char const*) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x1e59d9c) #6 0x00000000038c4e80 clang::driver::tools::OffloadBundler::ConstructJobMultipleOutputs(clang::driver::Compilation&, clang::driver::JobAction const&, llvm::SmallVector<clang::driver::InputInfo, 4u> const&, llvm::SmallVector<clang::driver::InputInfo, 4u> const&, llvm::opt::ArgList const&, char const*) const (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x38c4e80) .... .... Stack dump: 0. Program arguments: /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -O3 -fopenmp -fopenmp-targets=csa -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f 1. Compilation construction 2. Building compilation jobs 3. Building compilation jobs 4. Building compilation jobs 5. Building compilation jobs 6. Building compilation jobs 7. Building compilation jobs 8. Building compilation jobs make: *** [rhs4th3fortsgstr.o] Segmentation fault ________________________________ From: Tannenbaum, Barry M <barry.m.tannenbaum(a)intel.com<mailto:[email protected]>> Sent: Tuesday, March 27, 2018 3:29:01 PM To: Narayanaswamy, Ravi; Jin, Zheming; anl-intel-csa(a)jlse.anl.gov<mailto:[email protected]> Subject: RE: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) To expand on Ravi's answer, you need to add the OpenMP options to all of the compilations. When OpenMP is used, the link step is assuming that all of the objects are "bundles" - files that contain multiple objects. The error is caused when the link step attempts to extract an object from the bundle, and it fails because some of the file simple objects, not bundles. The result is an empty .o, which causes the linker to give the "file not recognized: File truncated" error. The other workaround is to put the OpenMP code into a shared object, and link the main program against that shared object. All of the files built into the shared object need to be compiled and linked with the OpenMP options, but the main program does not. See $CSA_TOP/samples/omp-offload/shared-obj-demo for an example. From: anl-intel-csa [mailto:[email protected]] On Behalf Of Narayanaswamy, Ravi Sent: Tuesday, March 27, 2018 3:58 PM To: Jin, Zheming <zjin(a)anl.gov<mailto:[email protected]>>; anl-intel-csa(a)jlse.anl.gov<mailto:[email protected]> Subject: Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) You are adding -fopenmp -fopenmp-target=csa only in the link phase. Need to add it compilation phase also. Ravi From: anl-intel-csa [mailto:[email protected]] On Behalf Of Jin, Zheming Sent: Tuesday, March 27, 2018 12:53 PM To: anl-intel-csa(a)jlse.anl.gov<mailto:[email protected]> Subject: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) The location of the test is /soft/restricted/intel_csa/apps/benchmark/sw4lite/tests/testil. It has standalone tests. You can type 'make' in that directory. "CSA_OPTS := -fopenmp -fopenmp-targets=csa -lm" doesn't work and produces the error at the bottom of the email. Do you know what needs to be changed in the Makefile to fix the error ? Thanks, zheming /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o boundaryOp.o boundaryOp.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o curvilinear4sg.o curvilinear4sg.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o metric.o metric.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o addsgd4.o addsgd4.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg.o rhs4sg.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg_rev.o rhs4sg_rev.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o gettimec.o gettimec.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o grid-utilities.o grid-utilities.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv.o rhs4sgcurv.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv_rev.o rhs4sgcurv_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o metricC.o metricC.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort.o addsgd4fort.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort_rev.o addsgd4fort_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o testil.o testil.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -o main -O3 -fopenmp -fopenmp-targets=csa -lm -L /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/local/lib rhs4th3fortsgstr.o boundaryOp.o curvilinear4sg.o metric.o addsgd4.o rhs4sg.o rhs4sg_rev.o gettimec.o grid-utilities.o rhs4sgcurv.o rhs4sgcurv_rev.o metricC.o addsgd4fort.o addsgd4fort_rev.o testil.o /tmp/rhs4th3fortsgstr-46789e.o: file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)

1 0

Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation))
by Jin, Zheming 27 Mar '18

27 Mar '18

Hi Barry, Thank you very much for your answers! When I compile a Fortran file with -fopenmp-targets=csa, it produces segfault. Am I right ? Thanks, /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -O3 -fopenmp -fopenmp-targets=csa -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f #0 0x000000000313d478 llvm::sys::PrintStackTrace(llvm::raw_ostream&) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313d478) #1 0x000000000313d509 PrintStackTraceSignalHandler(void*) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313d509) #2 0x000000000313b99c llvm::sys::RunSignalHandlers() (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313b99c) #3 0x000000000313cd5f SignalHandler(int) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x313cd5f) #4 0x00007f0c851525e0 __restore_rt (/usr/lib64/libpthread.so.0+0xf5e0) #5 0x0000000001e59d9c llvm::Twine::Twine(char const*) (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x1e59d9c) #6 0x00000000038c4e80 clang::driver::tools::OffloadBundler::ConstructJobMultipleOutputs(clang::driver::Compilation&, clang::driver::JobAction const&, llvm::SmallVector<clang::driver::InputInfo, 4u> const&, llvm::SmallVector<clang::driver::InputInfo, 4u> const&, llvm::opt::ArgList const&, char const*) const (/soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang+0x38c4e80) .... .... Stack dump: 0. Program arguments: /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -O3 -fopenmp -fopenmp-targets=csa -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f 1. Compilation construction 2. Building compilation jobs 3. Building compilation jobs 4. Building compilation jobs 5. Building compilation jobs 6. Building compilation jobs 7. Building compilation jobs 8. Building compilation jobs make: *** [rhs4th3fortsgstr.o] Segmentation fault ________________________________ From: Tannenbaum, Barry M <barry.m.tannenbaum(a)intel.com> Sent: Tuesday, March 27, 2018 3:29:01 PM To: Narayanaswamy, Ravi; Jin, Zheming; anl-intel-csa(a)jlse.anl.gov Subject: RE: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) To expand on Ravi’s answer, you need to add the OpenMP options to all of the compilations. When OpenMP is used, the link step is assuming that all of the objects are “bundles” – files that contain multiple objects. The error is caused when the link step attempts to extract an object from the bundle, and it fails because some of the file simple objects, not bundles. The result is an empty .o, which causes the linker to give the “file not recognized: File truncated” error. The other workaround is to put the OpenMP code into a shared object, and link the main program against that shared object. All of the files built into the shared object need to be compiled and linked with the OpenMP options, but the main program does not. See $CSA_TOP/samples/omp-offload/shared-obj-demo for an example. From: anl-intel-csa [mailto:[email protected]] On Behalf Of Narayanaswamy, Ravi Sent: Tuesday, March 27, 2018 3:58 PM To: Jin, Zheming <zjin(a)anl.gov>; anl-intel-csa(a)jlse.anl.gov Subject: Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) You are adding –fopenmp –fopenmp-target=csa only in the link phase. Need to add it compilation phase also. Ravi From: anl-intel-csa [mailto:[email protected]] On Behalf Of Jin, Zheming Sent: Tuesday, March 27, 2018 12:53 PM To: anl-intel-csa(a)jlse.anl.gov<mailto:[email protected]> Subject: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) The location of the test is /soft/restricted/intel_csa/apps/benchmark/sw4lite/tests/testil. It has standalone tests. You can type 'make' in that directory. "CSA_OPTS := -fopenmp -fopenmp-targets=csa -lm" doesn't work and produces the error at the bottom of the email. Do you know what needs to be changed in the Makefile to fix the error ? Thanks, zheming /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o boundaryOp.o boundaryOp.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o curvilinear4sg.o curvilinear4sg.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o metric.o metric.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o addsgd4.o addsgd4.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg.o rhs4sg.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg_rev.o rhs4sg_rev.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o gettimec.o gettimec.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o grid-utilities.o grid-utilities.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv.o rhs4sgcurv.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv_rev.o rhs4sgcurv_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o metricC.o metricC.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort.o addsgd4fort.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort_rev.o addsgd4fort_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o testil.o testil.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -o main -O3 -fopenmp -fopenmp-targets=csa -lm -L /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/local/lib rhs4th3fortsgstr.o boundaryOp.o curvilinear4sg.o metric.o addsgd4.o rhs4sg.o rhs4sg_rev.o gettimec.o grid-utilities.o rhs4sgcurv.o rhs4sgcurv_rev.o metricC.o addsgd4fort.o addsgd4fort_rev.o testil.o /tmp/rhs4th3fortsgstr-46789e.o: file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)

1 0

Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation))
by Tannenbaum, Barry M 27 Mar '18

27 Mar '18

To expand on Ravi's answer, you need to add the OpenMP options to all of the compilations. When OpenMP is used, the link step is assuming that all of the objects are "bundles" - files that contain multiple objects. The error is caused when the link step attempts to extract an object from the bundle, and it fails because some of the file simple objects, not bundles. The result is an empty .o, which causes the linker to give the "file not recognized: File truncated" error. The other workaround is to put the OpenMP code into a shared object, and link the main program against that shared object. All of the files built into the shared object need to be compiled and linked with the OpenMP options, but the main program does not. See $CSA_TOP/samples/omp-offload/shared-obj-demo for an example. From: anl-intel-csa [mailto:[email protected]] On Behalf Of Narayanaswamy, Ravi Sent: Tuesday, March 27, 2018 3:58 PM To: Jin, Zheming <zjin(a)anl.gov>; anl-intel-csa(a)jlse.anl.gov Subject: Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) You are adding -fopenmp -fopenmp-target=csa only in the link phase. Need to add it compilation phase also. Ravi From: anl-intel-csa [mailto:[email protected]] On Behalf Of Jin, Zheming Sent: Tuesday, March 27, 2018 12:53 PM To: anl-intel-csa(a)jlse.anl.gov<mailto:[email protected]> Subject: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) The location of the test is /soft/restricted/intel_csa/apps/benchmark/sw4lite/tests/testil. It has standalone tests. You can type 'make' in that directory. "CSA_OPTS := -fopenmp -fopenmp-targets=csa -lm" doesn't work and produces the error at the bottom of the email. Do you know what needs to be changed in the Makefile to fix the error ? Thanks, zheming /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o boundaryOp.o boundaryOp.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o curvilinear4sg.o curvilinear4sg.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o metric.o metric.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o addsgd4.o addsgd4.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg.o rhs4sg.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg_rev.o rhs4sg_rev.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o gettimec.o gettimec.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o grid-utilities.o grid-utilities.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv.o rhs4sgcurv.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv_rev.o rhs4sgcurv_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o metricC.o metricC.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort.o addsgd4fort.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort_rev.o addsgd4fort_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o testil.o testil.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -o main -O3 -fopenmp -fopenmp-targets=csa -lm -L /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/local/lib rhs4th3fortsgstr.o boundaryOp.o curvilinear4sg.o metric.o addsgd4.o rhs4sg.o rhs4sg_rev.o gettimec.o grid-utilities.o rhs4sgcurv.o rhs4sgcurv_rev.o metricC.o addsgd4fort.o addsgd4fort_rev.o testil.o /tmp/rhs4th3fortsgstr-46789e.o: file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)

1 0

Re: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation))
by Narayanaswamy, Ravi 27 Mar '18

27 Mar '18

You are adding -fopenmp -fopenmp-target=csa only in the link phase. Need to add it compilation phase also. Ravi From: anl-intel-csa [mailto:[email protected]] On Behalf Of Jin, Zheming Sent: Tuesday, March 27, 2018 12:53 PM To: anl-intel-csa(a)jlse.anl.gov Subject: [Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)) The location of the test is /soft/restricted/intel_csa/apps/benchmark/sw4lite/tests/testil. It has standalone tests. You can type 'make' in that directory. "CSA_OPTS := -fopenmp -fopenmp-targets=csa -lm" doesn't work and produces the error at the bottom of the email. Do you know what needs to be changed in the Makefile to fix the error ? Thanks, zheming /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o boundaryOp.o boundaryOp.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o curvilinear4sg.o curvilinear4sg.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o metric.o metric.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o addsgd4.o addsgd4.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg.o rhs4sg.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg_rev.o rhs4sg_rev.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o gettimec.o gettimec.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o grid-utilities.o grid-utilities.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv.o rhs4sgcurv.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv_rev.o rhs4sgcurv_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o metricC.o metricC.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort.o addsgd4fort.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort_rev.o addsgd4fort_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o testil.o testil.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -o main -O3 -fopenmp -fopenmp-targets=csa -lm -L /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/local/lib rhs4th3fortsgstr.o boundaryOp.o curvilinear4sg.o metric.o addsgd4.o rhs4sg.o rhs4sg_rev.o gettimec.o grid-utilities.o rhs4sgcurv.o rhs4sgcurv_rev.o metricC.o addsgd4fort.o addsgd4fort_rev.o testil.o /tmp/rhs4th3fortsgstr-46789e.o: file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)

1 0

[Anl-intel-csa] building a mix of C and Fortran files (file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation))
by Jin, Zheming 27 Mar '18

27 Mar '18

The location of the test is /soft/restricted/intel_csa/apps/benchmark/sw4lite/tests/testil. It has standalone tests. You can type 'make' in that directory. "CSA_OPTS := -fopenmp -fopenmp-targets=csa -lm" doesn't work and produces the error at the bottom of the email. Do you know what needs to be changed in the Makefile to fix the error ? Thanks, zheming /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4th3fortsgstr.o rhs4th3fortsgstr.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o boundaryOp.o boundaryOp.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o curvilinear4sg.o curvilinear4sg.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o metric.o metric.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o addsgd4.o addsgd4.f /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg.o rhs4sg.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o rhs4sg_rev.o rhs4sg_rev.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang -c -o gettimec.o gettimec.c /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o grid-utilities.o grid-utilities.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv.o rhs4sgcurv.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o rhs4sgcurv_rev.o rhs4sgcurv_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o metricC.o metricC.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort.o addsgd4fort.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o addsgd4fort_rev.o addsgd4fort_rev.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -c -o testil.o testil.C /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/install/bin/clang++ -o main -O3 -fopenmp -fopenmp-targets=csa -lm -L /soft/restricted/intel_csa/comp/tools/2018-02-21-release/tools/local/lib rhs4th3fortsgstr.o boundaryOp.o curvilinear4sg.o metric.o addsgd4.o rhs4sg.o rhs4sg_rev.o gettimec.o grid-utilities.o rhs4sgcurv.o rhs4sgcurv_rev.o metricC.o addsgd4fort.o addsgd4fort_rev.o testil.o /tmp/rhs4th3fortsgstr-46789e.o: file not recognized: File truncated clang-6.0: error: csa-ld command failed with exit code 1 (use -v to see invocation)

1 0

[Anl-intel-csa] No call this Friday
by Kumaran, Kalyan 26 Mar '18

26 Mar '18

With a number of folks on vacation here this week, as it is Spring break, I’m leaning towards canceling our call. -Kumar

1 0

Re: [Anl-intel-csa] openmp support question
by Hammond, Jeff R 26 Mar '18

26 Mar '18

http://www.openmp.org/wp-content/uploads/openmp-tr6.pdf is already out, but I know of one controversial feature in there that will likely change (if only in name) before it is released. Jeff From: "Jin, Zheming" <zjin(a)anl.gov> Date: Monday, March 26, 2018 at 8:38 AM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "anl-intel-csa(a)jlse.anl.gov" <anl-intel-csa(a)jlse.anl.gov> Subject: Re: [Anl-intel-csa] openmp support question Thank you for your answers. I paste OpenMP5, which is new to me, for reference. http://www.openmp.org/wp-content/uploads/openmp-tr4.pdf ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Monday, March 26, 2018 9:50:14 AM To: Jin, Zheming; anl-intel-csa(a)jlse.anl.gov Subject: Re: [Anl-intel-csa] openmp support question The relative speed of reductions depends on where the data is (CSA LICs, CPU registers, CSA cache, Xeon cache, memory), what type it is, what the operator is, and what state the Xeon and CSA tiles are in (C-states, whether CSA reduce graph loaded already). At a fundamental level, CSA can execute a reduction tree for simple types/operators with far less overhead than a CPU core, but a well-written reduction on CPU will be something like O(loads) + O(log SIMD length) + O(log num threads). Of course, the loads can be ignored in the case of reductions on register data. The cache-to-cache overheads are much higher than the equivalent within a CSA graph, but reductions across multiple CSAs face the same issue. OpenACC is not relevant to CSA. We are focused on OpenMP 5. Intel does not support OpenACC in our compilers and this is unlikely to change. I assume we are supporting OpenMP reductions on CSA already, although user-defined reductions may be a challenge (personally, I have no user for these). Jeff From: "Jin, Zheming" <zjin(a)anl.gov> Date: Sunday, March 25, 2018 at 6:41 PM To: "Hammond, Jeff R" <jeff.r.hammond(a)intel.com>, "anl-intel-csa(a)jlse.anl.gov" <anl-intel-csa(a)jlse.anl.gov> Subject: Re: [Anl-intel-csa] openmp support question Hi Jeff, Is reduction faster on CPU or CSA ? You studied programming models as a research scientist. Maybe you can pleasantly give light on the application of OpenACC programming models to CSA programming model. Thank you ________________________________ From: Hammond, Jeff R <jeff.r.hammond(a)intel.com> Sent: Sunday, March 25, 2018 7:59:28 PM To: Jin, Zheming; anl-intel-csa(a)jlse.anl.gov Subject: Re: [Anl-intel-csa] openmp support question There's essentially no computation in those loops. They just setup data structures. They'll run faster - probably much faster - on the Xeon. Once they are created, you can use them on the CSA thanks to SVM. Jeff From: anl-intel-csa <anl-intel-csa-bounces(a)lists.jlse.anl.gov> on behalf of "Jin, Zheming" <zjin(a)anl.gov> Date: Sunday, March 25, 2018 at 5:11 PM To: "anl-intel-csa(a)jlse.anl.gov" <anl-intel-csa(a)jlse.anl.gov> Subject: [Anl-intel-csa] openmp support question Maybe the questions were answered. I happened to look at the openmp version the application. https://github.com/Mantevo/miniTri/blob/master/miniTri/linearAlgebraMethod2… We notice that the memory is dynamically created and there are list and map containers/iterators. Should users convert dynamic memories to arrays allocated on the host ? Which C++ data structures can be supported natively without user-defined containers ? I didn't study the support of C++ data structure in CSA, thank you for your summary. ================================================================ int tmpNNZ =0; #pragma omp parallel for schedule(static,CHUNK), reduction (+:tmpNNZ) for (int rownum=0; rownum<m; rownum++) { nnzInRow[rownum]=0; std::map<int,std::list<int> > newNZs; int nnzInRowA = A.getNNZInRow(rownum); for(int nzindxA=0; nzindxA<nnzInRowA; nzindxA++) { int colA=A.getCol(rownum, nzindxA); int nnzInRowB = B.getNNZInRow(colA); for(int nzindxB=0; nzindxB<nnzInRowB; nzindxB++) { int colB=B.getCol(colA, nzindxB); nnzInRow[rownum] += addNZ(newNZs,colB, colA); } } // If there are nonzeros in this row if(nnzInRow[rownum] > 0) { ///////////////////////////////////////// //Allocate memory for this row ///////////////////////////////////////// cols[rownum] = new int[nnzInRow[rownum]]; vals[rownum] = new std::list<int>[nnzInRow[rownum]]; ///////////////////////////////////////// //Copy new data into row ///////////////////////////////////////// std::map<int,std::list<int> >::iterator iter; int nzcnt=0; // Iterate through list for (iter=newNZs.begin(); iter!=newNZs.end(); iter++) { cols[rownum][nzcnt]= (*iter).first; const std::list<int> & lstRef = (*iter).second; std::list<int>::const_iterator lIter; for (lIter=lstRef.begin(); lIter!=lstRef.end(); lIter++) { vals[rownum][nzcnt].push_back(*lIter); } nzcnt++; } ///////////////////////////////////////// } else { cols[rownum] = 0; vals[rownum] = 0; } ///////////////////////////////////////// //MMW: not thread safe, needs reworking //nnz += nnzInRow[rownum]; tmpNNZ += nnzInRow[rownum]; } // end loop over rows

1 0