Hey Ben,

The intel compiler is working again now - thanks!

However, I'm still unable to get Vtune to work on the MIC. It still is having issues finding the correct shared object files. It looks like there are shared object files installed, but they are not the correct version that Vtune is expecting? Here's the error I'm getting:

jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native ./SimpleMOC-kernel
amplxe: Using target: mic-native:
amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r000ah'
amplxe: Executing actions 16 % Resolving module symbols
amplxe: Warning: Cannot locate file `/usr/lib64/libcrypto.so.1.0.1e'.
amplxe: Warning: Cannot locate file `/lib64/libpthread-2.12.so'.
amplxe: Warning: Cannot locate file `/lib64/ld-2.12.so'.
amplxe: Warning: Cannot locate file `/lib64/libc-2.12.so'.
amplxe: Executing actions 16 % Resolving information for `libcrypto.so.1.0.1e'
amplxe: Warning: Cannot locate file `/usr/bin/ssh'.
amplxe: Executing actions 16 % Resolving information for `ssh'
amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.32-431.el6.x86_64/vmlinux'.
amplxe: Executing actions 50 % Generating a report

General Exploration Metrics
---------------------------
Parameter  r000ah
---------  ------

Collection and Platform Info
----------------------------
Parameter                 r000ah
------------------------  ----------------------
Application Command Line  ./SimpleMOC-kernel
Operating System          2.6.32-431.el6.x86_64
Computer Name             lucie.ftm.alcf.anl.gov
Result Size               1596019

CPU
---
Parameter          r000ah
-----------------  --------------------------
Name               Intel Xeon Phi coprocessor
Logical CPU Count  32

Summary
-------
Elapsed Time:  0.000

Event summary
-------------
Hardware Event Type  Hardware Event Count:Self  Hardware Event Sample Count:Self  Events Per Sample
-------------------  -------------------------  --------------------------------  -----------------
cycles                                  196000                                49  4000
amplxe: Executing actions 100 % done

On Wed, Jan 21, 2015 at 2:17 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
Hi John,

I had a mistake in the license file. Please try it again.

Ben

> On Jan 21, 2015, at 10:54 AM, John Tramm <jtramm@mcs.anl.gov> wrote:
>
> Hey Ben,
>
> I'm not able to get the intel compiler to work. When I call "icc", it simply hangs and the call never returns. Perhaps it's trying to connect somewhere to verify the license file but it can't find it?
>
> Thanks for the help.
>
> -John
>
> On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> Hi John,
>
> The JLSE Intel license has been updated. Please let me know if you have any further issues.
>
> Ben
>
> > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> >
> > Hi John,
> >
> > It appears our license expired on the 18th. Sorry I wasn't on top of that. I'll let you know when it's updated.
> >
> > Ben
> >
> >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>
> >> Hey Ben,
> >>
> >> I'm trying to compile my code, but I seem to be getting license errors when trying to use the intel compiler (I'm using the same environment that had been working previously, I believe):
> >>
> >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make
> >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model fast=2 -openmp -DOPENMP -c main.c -o main.o
> >>
> >> Error: A license for CCompL is not available now (-97,121).
> >>
> >> A connection to the license server could not be made.  You should
> >> make sure that your license daemon process is running: both an
> >> lmgrd process and an INTEL process should be running
> >> if your license limits you to a specified number of licenses in use
> >> at a time.  Also, check to see if the wrong port@host or the wrong
> >> license file is being used, or if the port or hostname in the license
> >> file has changed.
> >>
> >> License file(s) used were (in this order):
> >>    1.  Trusted Storage
> >> **  2.  28518@ftsn2
> >> **  3.  /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses
> >> **  4.  /opt/intel/licenses
> >> **  5.  /home/jtramm/intel/licenses
> >> **  6.  /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses
> >> **  7.  /Users/Shared/Library/Application Support/Intel/Licenses
> >> **  8.  /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic
> >>
> >> Please visit http://software.intel.com/sites/support/ if you require technical assistance.
> >>
> >> icc: error #10052: could not checkout FLEXlm license
> >> make: *** [main.o] Error 1
> >>
> >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >> Ben,
> >>
> >> That sounds like a good plan. Thanks for the help!
> >>
> >> -John
> >>
> >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> >> Hi John,
> >>
> >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is the actual app you're trying to profile, I can start with the packages referenced in the "Cannot locate debugging symbols" below.
> >>
> >> Ben
> >>
> >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>>
> >>> Hey Ben,
> >>>
> >>> Thanks for doing this! I would ideally like all of the packages installed, as I'm not sure which ones I need and which I don't. My app doesn't have any outside dependencies, and it really just uses pretty normal C and OpenMP includes, so I'm guessing if it has issues with just that I will probably need them all (unless you have reason to believe otherwise).
> >>>
> >>> Thanks again!
> >>>
> >>> -John
> >>>
> >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> >>> Hi John,
> >>>
> >>> Yea I can do this. I should be able to get to it sometime this week, at worst early next week. Do you want all of the dbg packages installed, or do you have a specific list you want?
> >>>
> >>> Ben
> >>>
> >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>>>
> >>>> Ben,
> >>>>
> >>>> I tried running through the CLI mode, and had the same problems. It would be really great if you could install the required packages, as Vtune offers a lot in terms of performance analysis that can't be done any other way on the MIC. I understand the desire to keep the install bloat to a minimum, but Vtune is pretty essential to working with the MIC. I'm really in the dark as to what's going on with my application without being able to use Vtune, as even simple things like grpof don't work on there.
> >>>>
> >>>> Here's what I'm getting:
> >>>>
> >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export INTEL_LICENSE_FILE=28518@ftsn2
> >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh
> >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved.
> >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310)
> >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native:0 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel
> >>>> amplxe: Using target: mic-native:0
> >>>> amplxe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: amplxe-cl -r /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop.
> >>>> amplxe: Collection stopped.
> >>>> amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah'
> >>>> amplxe: Executing actions 16 % Resolving module symbols
> >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' on the remote system
> >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the remote system
> >>>> amplxe: Executing actions 16 % Resolving information for `libc-2.14.90.so'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'.
> >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote system
> >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system
> >>>> amplxe: Executing actions 16 % Resolving information for `ld-2.14.90.so'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'.
> >>>> amplxe: Executing actions 17 % Resolving information for `ld-2.14.90.so'
> >>>> amplxe: Locating file `intel_micveth.ko' on the remote system
> >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux'.
> >>>> amplxe: Executing actions 18 % Resolving information for dangling locations
> >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'.
> >>>> amplxe: Executing actions 18 % Resolving information for `libgnutls.so.26.22.0'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'.
> >>>> amplxe: Executing actions 18 % Resolving information for `libgcrypt.so.11.7.0'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'.
> >>>> amplxe: Executing actions 19 % Resolving information for `libnss_ldap-2.12.2.so
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so'.
> >>>> amplxe: Executing actions 19 % Resolving information for `sshd'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'.
> >>>> amplxe: Executing actions 19 % Resolving information for `libcrypto.so.1.0.0'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'.
> >>>> amplxe: Executing actions 20 % Resolving information for `libtasn1.so.3.1.13'
> >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'.
> >>>> amplxe: Executing actions 50 % Generating a report
> >>>>
> >>>> General Exploration Metrics
> >>>> ---------------------------
> >>>> Parameter             r001ah
> >>>> --------------------  ---------
> >>>> CPU Time              0.300
> >>>> Clockticks            372000558
> >>>> Instructions Retired  95333238
> >>>> CPI Rate              3.902
> >>>> Cache Usage           0.0
> >>>> Vectorization Usage   0.0
> >>>> TLB Usage             0.0
> >>>>
> >>>> Collection and Platform Info
> >>>> ----------------------------
> >>>> Parameter                 r001ah
> >>>> ------------------------  -----------------------------------------------------------------
> >>>> Application Command Line  /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel
> >>>> User Name                 jtramm
> >>>> Operating System          Intel MIC Platform Software Stack (Built by Poky 7.0) 3.4.2 \n \l
> >>>> Computer Name             lucie-mic0.ftm.alcf.anl.gov
> >>>> Result Size               2272316
> >>>>
> >>>> CPU
> >>>> ---
> >>>> Parameter          r001ah
> >>>> -----------------  --------------------------
> >>>> Name               Intel Xeon Phi coprocessor
> >>>> Frequency          1238000000
> >>>> Logical CPU Count  244
> >>>>
> >>>> Summary
> >>>> -------
> >>>> Elapsed Time:       0.392
> >>>> CPU Time:           0.300
> >>>> Average CPU Usage:  0.548
> >>>> CPI Rate:           3.902
> >>>>
> >>>> Event summary
> >>>> -------------
> >>>> Hardware Event Type    Hardware Event Count:Self  Hardware Event Sample Count:Self  Events Per Sample
> >>>> ---------------------  -------------------------  --------------------------------  -----------------
> >>>> CPU_CLK_UNHALTED                       372000558                               186  2000003
> >>>> INSTRUCTIONS_EXECUTED                   95333238                                77  1238094
> >>>> amplxe: Executing actions 100 % done
> >>>>
> >>>>
> >>>> Thanks for your help!
> >>>>
> >>>> -John
> >>>>
> >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> >>>> I have little to no experience with VTune. However looking at the screen cap the kernel modules referenced can be found on the MIC at:
> >>>>
> >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko
> >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko
> >>>>
> >>>> If I'd have to guess, the debugging symbols are missing because I don't have any of the k1om debug packages installed on the MICs themselves, i.e. "dbg" RPMs from http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I try to keep the packages installed directly on the MICs to a minimum as they appear to sit in a RAM disk.
> >>>>
> >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see if it outputs anymore useful information?
> >>>>
> >>>> Example:
> >>>>
> >>>> export INTEL_LICENSE_FILE=28518@ftsn2
> >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh
> >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls -CF /usr/bin
> >>>>
> >>>> Ben
> >>>>
> >>>>
> >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>>>>
> >>>>> Ben,
> >>>>>
> >>>>> Thanks for re-deploying - it definitely seems to have helped. I'm now able to run the vtune GUI.
> >>>>>
> >>>>> However, now I'm running into a new issue. When I run vtune from the host, in order to analyze an app run on the device, it doesn't appear to be launching successfully (i.e., nothing is output to the terminal, and the resulting vtune analysis says the code only ran for a fraction of a second, when it should be at least several seconds on the MIC).
> >>>>>
> >>>>> It also outputs this set of errors when running my project:
> >>>>>
> >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png>
> >>>>>
> >>>>>
> >>>>> Can you think of anything that might cause this?
> >>>>>
> >>>>> Thanks again so much for your help!
> >>>>>
> >>>>> -John Tramm
> >>>>>
> >>>>>
> >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> >>>>> Hi John,
> >>>>>
> >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the three servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated "sep", which is the sampling kernel module for both the MIC and the host. I doesn't look like Intel included the Power sampling kernel module with Vtune Amplifier XE 2015 however, ie. /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src.
> >>>>>
> >>>>> Let me know if you run into any more problems.
> >>>>>
> >>>>> Ben
> >>>>>
> >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>>>>>
> >>>>>> Ben,
> >>>>>>
> >>>>>> I'm trying to use vtune to analyze performance of my application on the mic. I can't seem to get Vtune to run on the host node (either lucie or jenny). I keep getting the following error:
> >>>>>>
> >>>>>> amplxe-gui: error while loading shared libraries: libXxf86vm.so.1: cannot open shared object file: No such file or directory
> >>>>>>
> >>>>>> There seems to be a shared library file missing somewhere that I can't seem to find. Perhaps I need to add something to my linker path?
> >>>>>>
> >>>>>> Thanks for your help!
> >>>>>>
> >>>>>> -John
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>>>>> Allen,
> >>>>>>
> >>>>>> Yes, everything seems to be working great now. Thanks!
> >>>>>>
> >>>>>> -John
> >>>>>>
> >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. <bsallen@alcf.anl.gov> wrote:
> >>>>>> Hi John,
> >>>>>>
> >>>>>> This should be fixed. Let me know if you run into further issues.
> >>>>>>
> >>>>>> Ben
> >>>>>>
> >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm@mcs.anl.gov> wrote:
> >>>>>>>
> >>>>>>> Greetings,
> >>>>>>>
> >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get my home directory to show up on mic0 itself. It is available on the host, but it doesn't seem to be able to connect on the MIC. I recall a few months ago I was able to access my home dir on the mic.
> >>>>>>>
> >>>>>>> Do I need to run anything to get access to the home dir?
> >>>>>>>
> >>>>>>> Thanks!
> >>>>>>>
> >>>>>>> -John Tramm
> >>>>>>> _______________________________________________
> >>>>>>> Admins mailing list
> >>>>>>> Admins@lists.jlse.anl.gov
> >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >>
> >
>
>