Ben, As far as I know, vtune is not meant to be launched directly from the MIC -- rather, it is meant to be launched on the host in a remote style with a specification of which target to run on (i.e., the "-target-system" argument). As for your example, I think think perhaps the issue is that the installed packages on the MIC are not the same version that vtune is expecting for some reason. I agree that libcrypto.so.1.0.0 is installed, but the error message says that vtune cannot find libcrypto.so.1.0.1e, which is a different shared object number. Perhaps some part of the compiler was updated but not others? I don't know what would cause this. Perhaps it would be a good idea to open a ticket with intel? Thanks for all the help, -John On Thu, Jan 22, 2015 at 12:21 PM, Allen, Benjamin S. <[email protected]> wrote:
Hi John,
Yea started working on this yesterday, testing on Lucie. Note your example below appears to be running on the host, not the MIC.
I'm running: amplxe-cl -collect advanced-hotspots -target-system=mic-native:1 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel.
I've actually installed all the debug packages I could find that contain the needed debug libraries, see /var/mpss/rpms. You can look at the file listing of the rpms with: rpm -qpl <file>.
Lets take libcyrpto.so.1.0.0 for example. openssl-dbg-1.0.0o-r15.1.k1om.rpm is the package that contains it. It's installing:
/lib64/.debug/libcrypto.so /lib64/.debug/libcrypto.so.1.0.0
Among other files. Any chance Vtune doesn't know where to look on the MIC for libraries with debug symbols? How about setting LD_LIBRARY_PATH, so /lib64/.debug/ and /usr/lib64/.debug preempt the normal dynamic libraries? Thus vtune might grab those instead of the default libraries.
intel_micveth.ko is located at /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko and is part of the mpss-modules-3.4.2-1.knightscorner package. There's no module debug package or kernel debug package.
Ben
On Jan 21, 2015, at 7:59 PM, John Tramm <[email protected]> wrote:
Hey Ben,
The intel compiler is working again now - thanks!
However, I'm still unable to get Vtune to work on the MIC. It still is having issues finding the correct shared object files. It looks like there are shared object files installed, but they are not the correct version that Vtune is expecting? Here's the error I'm getting:
jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native ./SimpleMOC-kernel amplxe: Using target: mic-native: amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r000ah' amplxe: Executing actions 16 % Resolving module symbols amplxe: Warning: Cannot locate file `/usr/lib64/libcrypto.so.1.0.1e'. amplxe: Warning: Cannot locate file `/lib64/libpthread-2.12.so'. amplxe: Warning: Cannot locate file `/lib64/ld-2.12.so'. amplxe: Warning: Cannot locate file `/lib64/libc-2.12.so'. amplxe: Executing actions 16 % Resolving information for `libcrypto.so.1.0.1e' amplxe: Warning: Cannot locate file `/usr/bin/ssh'. amplxe: Executing actions 16 % Resolving information for `ssh' amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.32-431.el6.x86_64/vmlinux'. amplxe: Executing actions 50 % Generating a report
General Exploration Metrics --------------------------- Parameter r000ah --------- ------
Collection and Platform Info ---------------------------- Parameter r000ah ------------------------ ---------------------- Application Command Line ./SimpleMOC-kernel Operating System 2.6.32-431.el6.x86_64 Computer Name lucie.ftm.alcf.anl.gov Result Size 1596019
CPU --- Parameter r000ah ----------------- -------------------------- Name Intel Xeon Phi coprocessor Logical CPU Count 32
Summary ------- Elapsed Time: 0.000
Event summary ------------- Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample ------------------- -------------------------
cycles 196000 49 4000 amplxe: Executing actions 100 % done
On Wed, Jan 21, 2015 at 2:17 PM, Allen, Benjamin S. < [email protected]> wrote: Hi John,
I had a mistake in the license file. Please try it again.
Ben
On Jan 21, 2015, at 10:54 AM, John Tramm <[email protected]> wrote:
Hey Ben,
I'm not able to get the intel compiler to work. When I call "icc", it simply hangs and the call never returns. Perhaps it's trying to connect somewhere to verify the license file but it can't find it?
Thanks for the help.
-John
On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. < [email protected]> wrote: Hi John,
The JLSE Intel license has been updated. Please let me know if you have any further issues.
Ben
On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. < [email protected]> wrote:
Hi John,
It appears our license expired on the 18th. Sorry I wasn't on top of that. I'll let you know when it's updated.
Ben
On Jan 20, 2015, at 10:36 AM, John Tramm <[email protected]> wrote:
Hey Ben,
I'm trying to compile my code, but I seem to be getting license errors when trying to use the intel compiler (I'm using the same environment that had been working previously, I believe):
jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model fast=2 -openmp -DOPENMP -c main.c -o main.o
Error: A license for CCompL is not available now (-97,121).
A connection to the license server could not be made. You should make sure that your license daemon process is running: both an lmgrd process and an INTEL process should be running if your license limits you to a specified number of licenses in use at a time. Also, check to see if the wrong port@host or the wrong license file is being used, or if the port or hostname in the license file has changed.
License file(s) used were (in this order): 1. Trusted Storage ** 2. 28518@ftsn2 ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses ** 4. /opt/intel/licenses ** 5. /home/jtramm/intel/licenses ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses ** 7. /Users/Shared/Library/Application Support/Intel/Licenses ** 8. /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic
Please visit http://software.intel.com/sites/support/ if you require technical assistance.
icc: error #10052: could not checkout FLEXlm license make: *** [main.o] Error 1
On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <[email protected]> wrote: Ben,
That sounds like a good plan. Thanks for the help!
-John
On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. < [email protected]> wrote: Hi John,
Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is the actual app you're trying to profile, I can start with the packages referenced in the "Cannot locate debugging symbols" below.
Ben
On Jan 14, 2015, at 8:15 PM, John Tramm <[email protected]> wrote:
Hey Ben,
Thanks for doing this! I would ideally like all of the packages installed, as I'm not sure which ones I need and which I don't. My app doesn't have any outside dependencies, and it really just uses pretty normal C and OpenMP includes, so I'm guessing if it has issues with just that I will probably need them all (unless you have reason to believe otherwise).
Thanks again!
-John
On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. < [email protected]> wrote: Hi John,
Yea I can do this. I should be able to get to it sometime this week, at worst early next week. Do you want all of the dbg packages installed, or do you have a specific list you want?
Ben
On Jan 14, 2015, at 11:21 AM, John Tramm <[email protected]> wrote:
Ben,
I tried running through the CLI mode, and had the same problems. It would be really great if you could install the required packages, as Vtune offers a lot in terms of performance analysis that can't be done any other way on the MIC. I understand the desire to keep the install bloat to a minimum, but Vtune is pretty essential to working with the MIC. I'm really in the dark as to what's going on with my application without being able to use Vtune, as even simple things like grpof don't work on there.
Here's what I'm getting:
jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export INTEL_LICENSE_FILE=28518@ftsn2 jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh Copyright (C) 2009-2014 Intel Corporation. All rights reserved. Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native:0 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel amplxe: Using target: mic-native:0 amplxe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: amplxe-cl -r /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. amplxe: Collection stopped. amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' amplxe: Executing actions 16 % Resolving module symbols amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' on the remote system amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the remote system amplxe: Executing actions 16 % Resolving information for ` libc-2.14.90.so' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote system amplxe: Locating file `/boot/vmlinuz' on the remote system amplxe: Executing actions 16 % Resolving information for ` ld-2.14.90.so' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. amplxe: Executing actions 17 % Resolving information for ` ld-2.14.90.so' amplxe: Locating file `intel_micveth.ko' on the remote system amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/ 2.6.38.8+mpss3.4.2/vmlinux'. amplxe: Executing actions 18 % Resolving information for dangling locations amplxe: Warning: Cannot locate file `intel_micveth.ko'. amplxe: Executing actions 18 % Resolving information for `libgnutls.so.26.22.0' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. amplxe: Executing actions 18 % Resolving information for `libgcrypt.so.11.7.0' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. amplxe: Executing actions 19 % Resolving information for ` libnss_ldap-2.12.2.so amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so '. amplxe: Executing actions 19 % Resolving information for `sshd' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. amplxe: Executing actions 19 % Resolving information for `libcrypto.so.1.0.0' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. amplxe: Executing actions 20 % Resolving information for `libtasn1.so.3.1.13' amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. amplxe: Executing actions 50 % Generating a report
General Exploration Metrics --------------------------- Parameter r001ah -------------------- --------- CPU Time 0.300 Clockticks 372000558 Instructions Retired 95333238 CPI Rate 3.902 Cache Usage 0.0 Vectorization Usage 0.0 TLB Usage 0.0
Collection and Platform Info ---------------------------- Parameter r001ah ------------------------
Application Command Line /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel User Name jtramm Operating System Intel MIC Platform Software Stack (Built by Poky 7.0) 3.4.2 \n \l Computer Name lucie-mic0.ftm.alcf.anl.gov Result Size 2272316
CPU --- Parameter r001ah ----------------- -------------------------- Name Intel Xeon Phi coprocessor Frequency 1238000000 Logical CPU Count 244
Summary ------- Elapsed Time: 0.392 CPU Time: 0.300 Average CPU Usage: 0.548 CPI Rate: 3.902
Event summary ------------- Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample --------------------- -------------------------
CPU_CLK_UNHALTED 372000558 186 2000003 INSTRUCTIONS_EXECUTED 95333238 77 1238094 amplxe: Executing actions 100 % done
Thanks for your help!
-John
On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. < [email protected]> wrote: I have little to no experience with VTune. However looking at the screen cap the kernel modules referenced can be found on the MIC at:
/lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko
If I'd have to guess, the debugging symbols are missing because I don't have any of the k1om debug packages installed on the MICs themselves, i.e. "dbg" RPMs from http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I try to keep the packages installed directly on the MICs to a minimum as they appear to sit in a RAM disk.
Perhaps try running with CLI version of Vtune, amplxe-cl to see if it outputs anymore useful information?
Example:
export INTEL_LICENSE_FILE=28518@ftsn2 source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh amplxe-cl -collect advanced-hotspots -target-system=mic-native ls -CF /usr/bin
Ben
On Jan 7, 2015, at 1:07 PM, John Tramm <[email protected]> wrote:
Ben,
Thanks for re-deploying - it definitely seems to have helped. I'm now able to run the vtune GUI.
However, now I'm running into a new issue. When I run vtune from the host, in order to analyze an app run on the device, it doesn't appear to be launching successfully (i.e., nothing is output to the terminal, and the resulting vtune analysis says the code only ran for a fraction of a second, when it should be at least several seconds on the MIC).
It also outputs this set of errors when running my project:
<Screen Shot 2015-01-07 at 12.56.50 PM.png>
Can you think of anything that might cause this?
Thanks again so much for your help!
-John Tramm
On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. < [email protected]> wrote: Hi John,
The RHEL6 image was missing libXxf86vm, I've re-deployed the three servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated "sep", which is the sampling kernel module for both the MIC and the host. I doesn't look like Intel included the Power sampling kernel module with Vtune Amplifier XE 2015 however, ie. /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src.
Let me know if you run into any more problems.
Ben
On Jan 6, 2015, at 2:50 PM, John Tramm <[email protected]> wrote:
Ben,
I'm trying to use vtune to analyze performance of my application on the mic. I can't seem to get Vtune to run on the host node (either lucie or jenny). I keep getting the following error:
amplxe-gui: error while loading shared libraries: libXxf86vm.so.1: cannot open shared object file: No such file or directory
There seems to be a shared library file missing somewhere that I can't seem to find. Perhaps I need to add something to my linker path?
Thanks for your help!
-John
On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <[email protected]> wrote: Allen,
Yes, everything seems to be working great now. Thanks!
-John
On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. < [email protected]> wrote: Hi John,
This should be fixed. Let me know if you run into further issues.
Ben
On Jan 5, 2015, at 11:53 AM, John Tramm <[email protected]> wrote:
Greetings,
I'm trying to use the JLSE MIC nodes, but I can't seem to get my home directory to show up on mic0 itself. It is available on the host, but it doesn't seem to be able to connect on the MIC. I recall a few months ago I was able to access my home dir on the mic.
Do I need to run anything to get access to the home dir?
Thanks!
-John Tramm _______________________________________________ Admins mailing list [email protected] https://lists.jlse.anl.gov/mailman/listinfo/admins