January 2015 - Admins - mailman3.cels.anl.gov

Re: [JLSE-Admins] JLSE MIC home directory
by John Tramm 21 Jan '15

21 Jan '15

Hey Ben, The intel compiler is working again now - thanks! However, I'm still unable to get Vtune to work on the MIC. It still is having issues finding the correct shared object files. It looks like there are shared object files installed, but they are not the correct version that Vtune is expecting? Here's the error I'm getting: jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native ./SimpleMOC-kernel amplxe: Using target: mic-native: amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r000ah' amplxe: Executing actions 16 % Resolving module symbols amplxe: Warning: Cannot locate file `/usr/lib64/libcrypto.so.1.0.1e'. amplxe: Warning: Cannot locate file `/lib64/libpthread-2.12.so'. amplxe: Warning: Cannot locate file `/lib64/ld-2.12.so'. amplxe: Warning: Cannot locate file `/lib64/libc-2.12.so'. amplxe: Executing actions 16 % Resolving information for `libcrypto.so.1.0.1e' amplxe: Warning: Cannot locate file `/usr/bin/ssh'. amplxe: Executing actions 16 % Resolving information for `ssh' amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.32-431.el6.x86_64/vmlinux'. amplxe: Executing actions 50 % Generating a report General Exploration Metrics --------------------------- Parameter r000ah --------- ------ Collection and Platform Info ---------------------------- Parameter r000ah ------------------------ ---------------------- Application Command Line ./SimpleMOC-kernel Operating System 2.6.32-431.el6.x86_64 Computer Name lucie.ftm.alcf.anl.gov Result Size 1596019 CPU --- Parameter r000ah ----------------- -------------------------- Name Intel Xeon Phi coprocessor Logical CPU Count 32 Summary ------- Elapsed Time: 0.000 Event summary ------------- Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample ------------------- ------------------------- -------------------------------- ----------------- cycles 196000 49 4000 amplxe: Executing actions 100 % done On Wed, Jan 21, 2015 at 2:17 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > Hi John, > > I had a mistake in the license file. Please try it again. > > Ben > > > On Jan 21, 2015, at 10:54 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > > > Hey Ben, > > > > I'm not able to get the intel compiler to work. When I call "icc", it > simply hangs and the call never returns. Perhaps it's trying to connect > somewhere to verify the license file but it can't find it? > > > > Thanks for the help. > > > > -John > > > > On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > Hi John, > > > > The JLSE Intel license has been updated. Please let me know if you have > any further issues. > > > > Ben > > > > > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> > wrote: > > > > > > Hi John, > > > > > > It appears our license expired on the 18th. Sorry I wasn't on top of > that. I'll let you know when it's updated. > > > > > > Ben > > > > > >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >> > > >> Hey Ben, > > >> > > >> I'm trying to compile my code, but I seem to be getting license > errors when trying to use the intel compiler (I'm using the same > environment that had been working previously, I believe): > > >> > > >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make > > >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model > fast=2 -openmp -DOPENMP -c main.c -o main.o > > >> > > >> Error: A license for CCompL is not available now (-97,121). > > >> > > >> A connection to the license server could not be made. You should > > >> make sure that your license daemon process is running: both an > > >> lmgrd process and an INTEL process should be running > > >> if your license limits you to a specified number of licenses in use > > >> at a time. Also, check to see if the wrong port@host or the wrong > > >> license file is being used, or if the port or hostname in the license > > >> file has changed. > > >> > > >> License file(s) used were (in this order): > > >> 1. Trusted Storage > > >> ** 2. 28518@ftsn2 > > >> ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses > > >> ** 4. /opt/intel/licenses > > >> ** 5. /home/jtramm/intel/licenses > > >> ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses > > >> ** 7. /Users/Shared/Library/Application Support/Intel/Licenses > > >> ** 8. > /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic > > >> > > >> Please visit http://software.intel.com/sites/support/ if you require > technical assistance. > > >> > > >> icc: error #10052: could not checkout FLEXlm license > > >> make: *** [main.o] Error 1 > > >> > > >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > >> Ben, > > >> > > >> That sounds like a good plan. Thanks for the help! > > >> > > >> -John > > >> > > >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > >> Hi John, > > >> > > >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is > the actual app you're trying to profile, I can start with the packages > referenced in the "Cannot locate debugging symbols" below. > > >> > > >> Ben > > >> > > >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>> > > >>> Hey Ben, > > >>> > > >>> Thanks for doing this! I would ideally like all of the packages > installed, as I'm not sure which ones I need and which I don't. My app > doesn't have any outside dependencies, and it really just uses pretty > normal C and OpenMP includes, so I'm guessing if it has issues with just > that I will probably need them all (unless you have reason to believe > otherwise). > > >>> > > >>> Thanks again! > > >>> > > >>> -John > > >>> > > >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > >>> Hi John, > > >>> > > >>> Yea I can do this. I should be able to get to it sometime this week, > at worst early next week. Do you want all of the dbg packages installed, or > do you have a specific list you want? > > >>> > > >>> Ben > > >>> > > >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > >>>> > > >>>> Ben, > > >>>> > > >>>> I tried running through the CLI mode, and had the same problems. It > would be really great if you could install the required packages, as Vtune > offers a lot in terms of performance analysis that can't be done any other > way on the MIC. I understand the desire to keep the install bloat to a > minimum, but Vtune is pretty essential to working with the MIC. I'm really > in the dark as to what's going on with my application without being able to > use Vtune, as even simple things like grpof don't work on there. > > >>>> > > >>>> Here's what I'm getting: > > >>>> > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export > INTEL_LICENSE_FILE=28518@ftsn2 > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source > /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > > >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved. > > >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect > advanced-hotspots -target-system=mic-native:0 -- > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > > >>>> amplxe: Using target: mic-native:0 > > >>>> amplxe: Collection started. To stop the collection, either press > CTRL-C or enter from another console window: amplxe-cl -r > /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. > > >>>> amplxe: Collection stopped. > > >>>> amplxe: Using result path > `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' > > >>>> amplxe: Executing actions 16 % Resolving module symbols > > >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' > on the remote system > > >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the > remote system > > >>>> amplxe: Executing actions 16 % Resolving information for ` > libc-2.14.90.so' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. > > >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote > system > > >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system > > >>>> amplxe: Executing actions 16 % Resolving information for ` > ld-2.14.90.so' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. > > >>>> amplxe: Executing actions 17 % Resolving information for ` > ld-2.14.90.so' > > >>>> amplxe: Locating file `intel_micveth.ko' on the remote system > > >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/ > 2.6.38.8+mpss3.4.2/vmlinux'. > > >>>> amplxe: Executing actions 18 % Resolving information for dangling > locations > > >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'. > > >>>> amplxe: Executing actions 18 % Resolving information for > `libgnutls.so.26.22.0' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. > > >>>> amplxe: Executing actions 18 % Resolving information for > `libgcrypt.so.11.7.0' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. > > >>>> amplxe: Executing actions 19 % Resolving information for ` > libnss_ldap-2.12.2.so > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so > '. > > >>>> amplxe: Executing actions 19 % Resolving information for `sshd' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. > > >>>> amplxe: Executing actions 19 % Resolving information for > `libcrypto.so.1.0.0' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. > > >>>> amplxe: Executing actions 20 % Resolving information for > `libtasn1.so.3.1.13' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. > > >>>> amplxe: Executing actions 50 % Generating a report > > >>>> > > >>>> General Exploration Metrics > > >>>> --------------------------- > > >>>> Parameter r001ah > > >>>> -------------------- --------- > > >>>> CPU Time 0.300 > > >>>> Clockticks 372000558 > > >>>> Instructions Retired 95333238 > > >>>> CPI Rate 3.902 > > >>>> Cache Usage 0.0 > > >>>> Vectorization Usage 0.0 > > >>>> TLB Usage 0.0 > > >>>> > > >>>> Collection and Platform Info > > >>>> ---------------------------- > > >>>> Parameter r001ah > > >>>> ------------------------ > ----------------------------------------------------------------- > > >>>> Application Command Line > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > > >>>> User Name jtramm > > >>>> Operating System Intel MIC Platform Software Stack (Built > by Poky 7.0) 3.4.2 \n \l > > >>>> Computer Name lucie-mic0.ftm.alcf.anl.gov > > >>>> Result Size 2272316 > > >>>> > > >>>> CPU > > >>>> --- > > >>>> Parameter r001ah > > >>>> ----------------- -------------------------- > > >>>> Name Intel Xeon Phi coprocessor > > >>>> Frequency 1238000000 > > >>>> Logical CPU Count 244 > > >>>> > > >>>> Summary > > >>>> ------- > > >>>> Elapsed Time: 0.392 > > >>>> CPU Time: 0.300 > > >>>> Average CPU Usage: 0.548 > > >>>> CPI Rate: 3.902 > > >>>> > > >>>> Event summary > > >>>> ------------- > > >>>> Hardware Event Type Hardware Event Count:Self Hardware Event > Sample Count:Self Events Per Sample > > >>>> --------------------- ------------------------- > -------------------------------- ----------------- > > >>>> CPU_CLK_UNHALTED 372000558 > 186 2000003 > > >>>> INSTRUCTIONS_EXECUTED 95333238 > 77 1238094 > > >>>> amplxe: Executing actions 100 % done > > >>>> > > >>>> > > >>>> Thanks for your help! > > >>>> > > >>>> -John > > >>>> > > >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > >>>> I have little to no experience with VTune. However looking at the > screen cap the kernel modules referenced can be found on the MIC at: > > >>>> > > >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko > > >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko > > >>>> > > >>>> If I'd have to guess, the debugging symbols are missing because I > don't have any of the k1om debug packages installed on the MICs themselves, > i.e. "dbg" RPMs from > http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I > try to keep the packages installed directly on the MICs to a minimum as > they appear to sit in a RAM disk. > > >>>> > > >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see if > it outputs anymore useful information? > > >>>> > > >>>> Example: > > >>>> > > >>>> export INTEL_LICENSE_FILE=28518@ftsn2 > > >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > > >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls > -CF /usr/bin > > >>>> > > >>>> Ben > > >>>> > > >>>> > > >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>>>> > > >>>>> Ben, > > >>>>> > > >>>>> Thanks for re-deploying - it definitely seems to have helped. I'm > now able to run the vtune GUI. > > >>>>> > > >>>>> However, now I'm running into a new issue. When I run vtune from > the host, in order to analyze an app run on the device, it doesn't appear > to be launching successfully (i.e., nothing is output to the terminal, and > the resulting vtune analysis says the code only ran for a fraction of a > second, when it should be at least several seconds on the MIC). > > >>>>> > > >>>>> It also outputs this set of errors when running my project: > > >>>>> > > >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png> > > >>>>> > > >>>>> > > >>>>> Can you think of anything that might cause this? > > >>>>> > > >>>>> Thanks again so much for your help! > > >>>>> > > >>>>> -John Tramm > > >>>>> > > >>>>> > > >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > >>>>> Hi John, > > >>>>> > > >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the three > servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated > "sep", which is the sampling kernel module for both the MIC and the host. I > doesn't look like Intel included the Power sampling kernel module with > Vtune Amplifier XE 2015 however, ie. > /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src. > > >>>>> > > >>>>> Let me know if you run into any more problems. > > >>>>> > > >>>>> Ben > > >>>>> > > >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > >>>>>> > > >>>>>> Ben, > > >>>>>> > > >>>>>> I'm trying to use vtune to analyze performance of my application > on the mic. I can't seem to get Vtune to run on the host node (either lucie > or jenny). I keep getting the following error: > > >>>>>> > > >>>>>> amplxe-gui: error while loading shared libraries: > libXxf86vm.so.1: cannot open shared object file: No such file or directory > > >>>>>> > > >>>>>> There seems to be a shared library file missing somewhere that I > can't seem to find. Perhaps I need to add something to my linker path? > > >>>>>> > > >>>>>> Thanks for your help! > > >>>>>> > > >>>>>> -John > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > >>>>>> Allen, > > >>>>>> > > >>>>>> Yes, everything seems to be working great now. Thanks! > > >>>>>> > > >>>>>> -John > > >>>>>> > > >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > >>>>>> Hi John, > > >>>>>> > > >>>>>> This should be fixed. Let me know if you run into further issues. > > >>>>>> > > >>>>>> Ben > > >>>>>> > > >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > >>>>>>> > > >>>>>>> Greetings, > > >>>>>>> > > >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get my > home directory to show up on mic0 itself. It is available on the host, but > it doesn't seem to be able to connect on the MIC. I recall a few months ago > I was able to access my home dir on the mic. > > >>>>>>> > > >>>>>>> Do I need to run anything to get access to the home dir? > > >>>>>>> > > >>>>>>> Thanks! > > >>>>>>> > > >>>>>>> -John Tramm > > >>>>>>> _______________________________________________ > > >>>>>>> Admins mailing list > > >>>>>>> Admins(a)lists.jlse.anl.gov > > >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>> > > >>>>> > > >>>> > > >>>> > > >>> > > >>> > > >> > > >> > > >> > > > > > > > > >

1 0

Re: [JLSE-Admins] JLSE MIC home directory
by Allen, Benjamin S. 21 Jan '15

21 Jan '15

Hi John, I had a mistake in the license file. Please try it again. Ben > On Jan 21, 2015, at 10:54 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > Hey Ben, > > I'm not able to get the intel compiler to work. When I call "icc", it simply hangs and the call never returns. Perhaps it's trying to connect somewhere to verify the license file but it can't find it? > > Thanks for the help. > > -John > > On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > Hi John, > > The JLSE Intel license has been updated. Please let me know if you have any further issues. > > Ben > > > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > > > Hi John, > > > > It appears our license expired on the 18th. Sorry I wasn't on top of that. I'll let you know when it's updated. > > > > Ben > > > >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >> > >> Hey Ben, > >> > >> I'm trying to compile my code, but I seem to be getting license errors when trying to use the intel compiler (I'm using the same environment that had been working previously, I believe): > >> > >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make > >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model fast=2 -openmp -DOPENMP -c main.c -o main.o > >> > >> Error: A license for CCompL is not available now (-97,121). > >> > >> A connection to the license server could not be made. You should > >> make sure that your license daemon process is running: both an > >> lmgrd process and an INTEL process should be running > >> if your license limits you to a specified number of licenses in use > >> at a time. Also, check to see if the wrong port@host or the wrong > >> license file is being used, or if the port or hostname in the license > >> file has changed. > >> > >> License file(s) used were (in this order): > >> 1. Trusted Storage > >> ** 2. 28518@ftsn2 > >> ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses > >> ** 4. /opt/intel/licenses > >> ** 5. /home/jtramm/intel/licenses > >> ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses > >> ** 7. /Users/Shared/Library/Application Support/Intel/Licenses > >> ** 8. /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic > >> > >> Please visit http://software.intel.com/sites/support/ if you require technical assistance. > >> > >> icc: error #10052: could not checkout FLEXlm license > >> make: *** [main.o] Error 1 > >> > >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >> Ben, > >> > >> That sounds like a good plan. Thanks for the help! > >> > >> -John > >> > >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > >> Hi John, > >> > >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is the actual app you're trying to profile, I can start with the packages referenced in the "Cannot locate debugging symbols" below. > >> > >> Ben > >> > >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>> > >>> Hey Ben, > >>> > >>> Thanks for doing this! I would ideally like all of the packages installed, as I'm not sure which ones I need and which I don't. My app doesn't have any outside dependencies, and it really just uses pretty normal C and OpenMP includes, so I'm guessing if it has issues with just that I will probably need them all (unless you have reason to believe otherwise). > >>> > >>> Thanks again! > >>> > >>> -John > >>> > >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > >>> Hi John, > >>> > >>> Yea I can do this. I should be able to get to it sometime this week, at worst early next week. Do you want all of the dbg packages installed, or do you have a specific list you want? > >>> > >>> Ben > >>> > >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>> > >>>> Ben, > >>>> > >>>> I tried running through the CLI mode, and had the same problems. It would be really great if you could install the required packages, as Vtune offers a lot in terms of performance analysis that can't be done any other way on the MIC. I understand the desire to keep the install bloat to a minimum, but Vtune is pretty essential to working with the MIC. I'm really in the dark as to what's going on with my application without being able to use Vtune, as even simple things like grpof don't work on there. > >>>> > >>>> Here's what I'm getting: > >>>> > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export INTEL_LICENSE_FILE=28518@ftsn2 > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved. > >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native:0 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > >>>> amplxe: Using target: mic-native:0 > >>>> amplxe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: amplxe-cl -r /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. > >>>> amplxe: Collection stopped. > >>>> amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' > >>>> amplxe: Executing actions 16 % Resolving module symbols > >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' on the remote system > >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the remote system > >>>> amplxe: Executing actions 16 % Resolving information for `libc-2.14.90.so' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. > >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote system > >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system > >>>> amplxe: Executing actions 16 % Resolving information for `ld-2.14.90.so' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. > >>>> amplxe: Executing actions 17 % Resolving information for `ld-2.14.90.so' > >>>> amplxe: Locating file `intel_micveth.ko' on the remote system > >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux'. > >>>> amplxe: Executing actions 18 % Resolving information for dangling locations > >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'. > >>>> amplxe: Executing actions 18 % Resolving information for `libgnutls.so.26.22.0' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. > >>>> amplxe: Executing actions 18 % Resolving information for `libgcrypt.so.11.7.0' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. > >>>> amplxe: Executing actions 19 % Resolving information for `libnss_ldap-2.12.2.so > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so'. > >>>> amplxe: Executing actions 19 % Resolving information for `sshd' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. > >>>> amplxe: Executing actions 19 % Resolving information for `libcrypto.so.1.0.0' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. > >>>> amplxe: Executing actions 20 % Resolving information for `libtasn1.so.3.1.13' > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. > >>>> amplxe: Executing actions 50 % Generating a report > >>>> > >>>> General Exploration Metrics > >>>> --------------------------- > >>>> Parameter r001ah > >>>> -------------------- --------- > >>>> CPU Time 0.300 > >>>> Clockticks 372000558 > >>>> Instructions Retired 95333238 > >>>> CPI Rate 3.902 > >>>> Cache Usage 0.0 > >>>> Vectorization Usage 0.0 > >>>> TLB Usage 0.0 > >>>> > >>>> Collection and Platform Info > >>>> ---------------------------- > >>>> Parameter r001ah > >>>> ------------------------ ----------------------------------------------------------------- > >>>> Application Command Line /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > >>>> User Name jtramm > >>>> Operating System Intel MIC Platform Software Stack (Built by Poky 7.0) 3.4.2 \n \l > >>>> Computer Name lucie-mic0.ftm.alcf.anl.gov > >>>> Result Size 2272316 > >>>> > >>>> CPU > >>>> --- > >>>> Parameter r001ah > >>>> ----------------- -------------------------- > >>>> Name Intel Xeon Phi coprocessor > >>>> Frequency 1238000000 > >>>> Logical CPU Count 244 > >>>> > >>>> Summary > >>>> ------- > >>>> Elapsed Time: 0.392 > >>>> CPU Time: 0.300 > >>>> Average CPU Usage: 0.548 > >>>> CPI Rate: 3.902 > >>>> > >>>> Event summary > >>>> ------------- > >>>> Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample > >>>> --------------------- ------------------------- -------------------------------- ----------------- > >>>> CPU_CLK_UNHALTED 372000558 186 2000003 > >>>> INSTRUCTIONS_EXECUTED 95333238 77 1238094 > >>>> amplxe: Executing actions 100 % done > >>>> > >>>> > >>>> Thanks for your help! > >>>> > >>>> -John > >>>> > >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > >>>> I have little to no experience with VTune. However looking at the screen cap the kernel modules referenced can be found on the MIC at: > >>>> > >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko > >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko > >>>> > >>>> If I'd have to guess, the debugging symbols are missing because I don't have any of the k1om debug packages installed on the MICs themselves, i.e. "dbg" RPMs from http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I try to keep the packages installed directly on the MICs to a minimum as they appear to sit in a RAM disk. > >>>> > >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see if it outputs anymore useful information? > >>>> > >>>> Example: > >>>> > >>>> export INTEL_LICENSE_FILE=28518@ftsn2 > >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls -CF /usr/bin > >>>> > >>>> Ben > >>>> > >>>> > >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>>> > >>>>> Ben, > >>>>> > >>>>> Thanks for re-deploying - it definitely seems to have helped. I'm now able to run the vtune GUI. > >>>>> > >>>>> However, now I'm running into a new issue. When I run vtune from the host, in order to analyze an app run on the device, it doesn't appear to be launching successfully (i.e., nothing is output to the terminal, and the resulting vtune analysis says the code only ran for a fraction of a second, when it should be at least several seconds on the MIC). > >>>>> > >>>>> It also outputs this set of errors when running my project: > >>>>> > >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png> > >>>>> > >>>>> > >>>>> Can you think of anything that might cause this? > >>>>> > >>>>> Thanks again so much for your help! > >>>>> > >>>>> -John Tramm > >>>>> > >>>>> > >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > >>>>> Hi John, > >>>>> > >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the three servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated "sep", which is the sampling kernel module for both the MIC and the host. I doesn't look like Intel included the Power sampling kernel module with Vtune Amplifier XE 2015 however, ie. /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src. > >>>>> > >>>>> Let me know if you run into any more problems. > >>>>> > >>>>> Ben > >>>>> > >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>>>> > >>>>>> Ben, > >>>>>> > >>>>>> I'm trying to use vtune to analyze performance of my application on the mic. I can't seem to get Vtune to run on the host node (either lucie or jenny). I keep getting the following error: > >>>>>> > >>>>>> amplxe-gui: error while loading shared libraries: libXxf86vm.so.1: cannot open shared object file: No such file or directory > >>>>>> > >>>>>> There seems to be a shared library file missing somewhere that I can't seem to find. Perhaps I need to add something to my linker path? > >>>>>> > >>>>>> Thanks for your help! > >>>>>> > >>>>>> -John > >>>>>> > >>>>>> > >>>>>> > >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>>>> Allen, > >>>>>> > >>>>>> Yes, everything seems to be working great now. Thanks! > >>>>>> > >>>>>> -John > >>>>>> > >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > >>>>>> Hi John, > >>>>>> > >>>>>> This should be fixed. Let me know if you run into further issues. > >>>>>> > >>>>>> Ben > >>>>>> > >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>>>>> > >>>>>>> Greetings, > >>>>>>> > >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get my home directory to show up on mic0 itself. It is available on the host, but it doesn't seem to be able to connect on the MIC. I recall a few months ago I was able to access my home dir on the mic. > >>>>>>> > >>>>>>> Do I need to run anything to get access to the home dir? > >>>>>>> > >>>>>>> Thanks! > >>>>>>> > >>>>>>> -John Tramm > >>>>>>> _______________________________________________ > >>>>>>> Admins mailing list > >>>>>>> Admins(a)lists.jlse.anl.gov > >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins > >>>>>> > >>>>>> > >>>>>> > >>>>> > >>>>> > >>>> > >>>> > >>> > >>> > >> > >> > >> > > > >

1 0

Re: [JLSE-Admins] JLSE MIC home directory
by John Tramm 21 Jan '15

21 Jan '15

Hey Ben, I'm not able to get the intel compiler to work. When I call "icc", it simply hangs and the call never returns. Perhaps it's trying to connect somewhere to verify the license file but it can't find it? Thanks for the help. -John On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > Hi John, > > The JLSE Intel license has been updated. Please let me know if you have > any further issues. > > Ben > > > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> > wrote: > > > > Hi John, > > > > It appears our license expired on the 18th. Sorry I wasn't on top of > that. I'll let you know when it's updated. > > > > Ben > > > >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >> > >> Hey Ben, > >> > >> I'm trying to compile my code, but I seem to be getting license errors > when trying to use the intel compiler (I'm using the same environment that > had been working previously, I believe): > >> > >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make > >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model > fast=2 -openmp -DOPENMP -c main.c -o main.o > >> > >> Error: A license for CCompL is not available now (-97,121). > >> > >> A connection to the license server could not be made. You should > >> make sure that your license daemon process is running: both an > >> lmgrd process and an INTEL process should be running > >> if your license limits you to a specified number of licenses in use > >> at a time. Also, check to see if the wrong port@host or the wrong > >> license file is being used, or if the port or hostname in the license > >> file has changed. > >> > >> License file(s) used were (in this order): > >> 1. Trusted Storage > >> ** 2. 28518@ftsn2 > >> ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses > >> ** 4. /opt/intel/licenses > >> ** 5. /home/jtramm/intel/licenses > >> ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses > >> ** 7. /Users/Shared/Library/Application Support/Intel/Licenses > >> ** 8. > /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic > >> > >> Please visit http://software.intel.com/sites/support/ if you require > technical assistance. > >> > >> icc: error #10052: could not checkout FLEXlm license > >> make: *** [main.o] Error 1 > >> > >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > >> Ben, > >> > >> That sounds like a good plan. Thanks for the help! > >> > >> -John > >> > >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > >> Hi John, > >> > >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is the > actual app you're trying to profile, I can start with the packages > referenced in the "Cannot locate debugging symbols" below. > >> > >> Ben > >> > >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>> > >>> Hey Ben, > >>> > >>> Thanks for doing this! I would ideally like all of the packages > installed, as I'm not sure which ones I need and which I don't. My app > doesn't have any outside dependencies, and it really just uses pretty > normal C and OpenMP includes, so I'm guessing if it has issues with just > that I will probably need them all (unless you have reason to believe > otherwise). > >>> > >>> Thanks again! > >>> > >>> -John > >>> > >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > >>> Hi John, > >>> > >>> Yea I can do this. I should be able to get to it sometime this week, > at worst early next week. Do you want all of the dbg packages installed, or > do you have a specific list you want? > >>> > >>> Ben > >>> > >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>> > >>>> Ben, > >>>> > >>>> I tried running through the CLI mode, and had the same problems. It > would be really great if you could install the required packages, as Vtune > offers a lot in terms of performance analysis that can't be done any other > way on the MIC. I understand the desire to keep the install bloat to a > minimum, but Vtune is pretty essential to working with the MIC. I'm really > in the dark as to what's going on with my application without being able to > use Vtune, as even simple things like grpof don't work on there. > >>>> > >>>> Here's what I'm getting: > >>>> > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export > INTEL_LICENSE_FILE=28518@ftsn2 > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source > /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved. > >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect > advanced-hotspots -target-system=mic-native:0 -- > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > >>>> amplxe: Using target: mic-native:0 > >>>> amplxe: Collection started. To stop the collection, either press > CTRL-C or enter from another console window: amplxe-cl -r > /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. > >>>> amplxe: Collection stopped. > >>>> amplxe: Using result path > `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' > >>>> amplxe: Executing actions 16 % Resolving module symbols > >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' > on the remote system > >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the > remote system > >>>> amplxe: Executing actions 16 % Resolving information for ` > libc-2.14.90.so' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. > >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote > system > >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system > >>>> amplxe: Executing actions 16 % Resolving information for ` > ld-2.14.90.so' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. > >>>> amplxe: Executing actions 17 % Resolving information for ` > ld-2.14.90.so' > >>>> amplxe: Locating file `intel_micveth.ko' on the remote system > >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/ > 2.6.38.8+mpss3.4.2/vmlinux'. > >>>> amplxe: Executing actions 18 % Resolving information for dangling > locations > >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'. > >>>> amplxe: Executing actions 18 % Resolving information for > `libgnutls.so.26.22.0' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. > >>>> amplxe: Executing actions 18 % Resolving information for > `libgcrypt.so.11.7.0' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. > >>>> amplxe: Executing actions 19 % Resolving information for ` > libnss_ldap-2.12.2.so > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so > '. > >>>> amplxe: Executing actions 19 % Resolving information for `sshd' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. > >>>> amplxe: Executing actions 19 % Resolving information for > `libcrypto.so.1.0.0' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. > >>>> amplxe: Executing actions 20 % Resolving information for > `libtasn1.so.3.1.13' > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. > >>>> amplxe: Executing actions 50 % Generating a report > >>>> > >>>> General Exploration Metrics > >>>> --------------------------- > >>>> Parameter r001ah > >>>> -------------------- --------- > >>>> CPU Time 0.300 > >>>> Clockticks 372000558 > >>>> Instructions Retired 95333238 > >>>> CPI Rate 3.902 > >>>> Cache Usage 0.0 > >>>> Vectorization Usage 0.0 > >>>> TLB Usage 0.0 > >>>> > >>>> Collection and Platform Info > >>>> ---------------------------- > >>>> Parameter r001ah > >>>> ------------------------ > ----------------------------------------------------------------- > >>>> Application Command Line > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > >>>> User Name jtramm > >>>> Operating System Intel MIC Platform Software Stack (Built by > Poky 7.0) 3.4.2 \n \l > >>>> Computer Name lucie-mic0.ftm.alcf.anl.gov > >>>> Result Size 2272316 > >>>> > >>>> CPU > >>>> --- > >>>> Parameter r001ah > >>>> ----------------- -------------------------- > >>>> Name Intel Xeon Phi coprocessor > >>>> Frequency 1238000000 > >>>> Logical CPU Count 244 > >>>> > >>>> Summary > >>>> ------- > >>>> Elapsed Time: 0.392 > >>>> CPU Time: 0.300 > >>>> Average CPU Usage: 0.548 > >>>> CPI Rate: 3.902 > >>>> > >>>> Event summary > >>>> ------------- > >>>> Hardware Event Type Hardware Event Count:Self Hardware Event > Sample Count:Self Events Per Sample > >>>> --------------------- ------------------------- > -------------------------------- ----------------- > >>>> CPU_CLK_UNHALTED 372000558 > 186 2000003 > >>>> INSTRUCTIONS_EXECUTED 95333238 > 77 1238094 > >>>> amplxe: Executing actions 100 % done > >>>> > >>>> > >>>> Thanks for your help! > >>>> > >>>> -John > >>>> > >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > >>>> I have little to no experience with VTune. However looking at the > screen cap the kernel modules referenced can be found on the MIC at: > >>>> > >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko > >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko > >>>> > >>>> If I'd have to guess, the debugging symbols are missing because I > don't have any of the k1om debug packages installed on the MICs themselves, > i.e. "dbg" RPMs from > http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I > try to keep the packages installed directly on the MICs to a minimum as > they appear to sit in a RAM disk. > >>>> > >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see if it > outputs anymore useful information? > >>>> > >>>> Example: > >>>> > >>>> export INTEL_LICENSE_FILE=28518@ftsn2 > >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls -CF > /usr/bin > >>>> > >>>> Ben > >>>> > >>>> > >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>>> > >>>>> Ben, > >>>>> > >>>>> Thanks for re-deploying - it definitely seems to have helped. I'm > now able to run the vtune GUI. > >>>>> > >>>>> However, now I'm running into a new issue. When I run vtune from the > host, in order to analyze an app run on the device, it doesn't appear to be > launching successfully (i.e., nothing is output to the terminal, and the > resulting vtune analysis says the code only ran for a fraction of a second, > when it should be at least several seconds on the MIC). > >>>>> > >>>>> It also outputs this set of errors when running my project: > >>>>> > >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png> > >>>>> > >>>>> > >>>>> Can you think of anything that might cause this? > >>>>> > >>>>> Thanks again so much for your help! > >>>>> > >>>>> -John Tramm > >>>>> > >>>>> > >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > >>>>> Hi John, > >>>>> > >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the three > servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated > "sep", which is the sampling kernel module for both the MIC and the host. I > doesn't look like Intel included the Power sampling kernel module with > Vtune Amplifier XE 2015 however, ie. > /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src. > >>>>> > >>>>> Let me know if you run into any more problems. > >>>>> > >>>>> Ben > >>>>> > >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > >>>>>> > >>>>>> Ben, > >>>>>> > >>>>>> I'm trying to use vtune to analyze performance of my application on > the mic. I can't seem to get Vtune to run on the host node (either lucie or > jenny). I keep getting the following error: > >>>>>> > >>>>>> amplxe-gui: error while loading shared libraries: libXxf86vm.so.1: > cannot open shared object file: No such file or directory > >>>>>> > >>>>>> There seems to be a shared library file missing somewhere that I > can't seem to find. Perhaps I need to add something to my linker path? > >>>>>> > >>>>>> Thanks for your help! > >>>>>> > >>>>>> -John > >>>>>> > >>>>>> > >>>>>> > >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > >>>>>> Allen, > >>>>>> > >>>>>> Yes, everything seems to be working great now. Thanks! > >>>>>> > >>>>>> -John > >>>>>> > >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > >>>>>> Hi John, > >>>>>> > >>>>>> This should be fixed. Let me know if you run into further issues. > >>>>>> > >>>>>> Ben > >>>>>> > >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > >>>>>>> > >>>>>>> Greetings, > >>>>>>> > >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get my > home directory to show up on mic0 itself. It is available on the host, but > it doesn't seem to be able to connect on the MIC. I recall a few months ago > I was able to access my home dir on the mic. > >>>>>>> > >>>>>>> Do I need to run anything to get access to the home dir? > >>>>>>> > >>>>>>> Thanks! > >>>>>>> > >>>>>>> -John Tramm > >>>>>>> _______________________________________________ > >>>>>>> Admins mailing list > >>>>>>> Admins(a)lists.jlse.anl.gov > >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins > >>>>>> > >>>>>> > >>>>>> > >>>>> > >>>>> > >>>> > >>>> > >>> > >>> > >> > >> > >> > > > >

1 0

Re: [JLSE-Admins] JLSE Confluence
by Kazutomo Yoshii 21 Jan '15

21 Jan '15

public read-only sounds good to me as well. - kaz On 01/21/2015 08:15 AM, Kalyan Kumaran wrote: > Did not read your entire email. The read only access sounds good. > > >> On Jan 21, 2015, at 8:15 AM, Kalyan Kumaran <kumaran(a)anl.gov> wrote: >> >> This is fine. >> >> Should we even encourage folks to join in as we have not had any one using the resource? We can add the admins ourselves. There is a link to the hardware page on confluence from the website. We can remove this. >> >> >> >>> On Jan 20, 2015, at 5:54 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >>> >>> I'm going to ask Ti and John to create an opt-in Confluence userbase resource, where all existing JLSE Confluence users will be removed. When people go to request the new Confluence resource they'll be added back in. Is this OK? This should be the lowest overhead to cleanup userbase accounts. >>> >>> I'm also thinking that we could open read-only access to the majority of the documentation like the hardware status list, etc, so people don't necessarily needs accounts to browse documentation. >>> >>> Thoughts? >>> >>> Ben >>> _______________________________________________ >>> Admins mailing list >>> Admins(a)lists.jlse.anl.gov >>> https://lists.jlse.anl.gov/mailman/listinfo/admins >> _______________________________________________ >> Admins mailing list >> Admins(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/admins > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

Re: [JLSE-Admins] JLSE Confluence
by Kalyan Kumaran 21 Jan '15

21 Jan '15

Did not read your entire email. The read only access sounds good. > On Jan 21, 2015, at 8:15 AM, Kalyan Kumaran <kumaran(a)anl.gov> wrote: > > This is fine. > > Should we even encourage folks to join in as we have not had any one using the resource? We can add the admins ourselves. There is a link to the hardware page on confluence from the website. We can remove this. > > > >> On Jan 20, 2015, at 5:54 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >> >> I'm going to ask Ti and John to create an opt-in Confluence userbase resource, where all existing JLSE Confluence users will be removed. When people go to request the new Confluence resource they'll be added back in. Is this OK? This should be the lowest overhead to cleanup userbase accounts. >> >> I'm also thinking that we could open read-only access to the majority of the documentation like the hardware status list, etc, so people don't necessarily needs accounts to browse documentation. >> >> Thoughts? >> >> Ben >> _______________________________________________ >> Admins mailing list >> Admins(a)lists.jlse.anl.gov >> https://lists.jlse.anl.gov/mailman/listinfo/admins > > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

Re: [JLSE-Admins] JLSE Confluence
by Kalyan Kumaran 21 Jan '15

21 Jan '15

This is fine. Should we even encourage folks to join in as we have not had any one using the resource? We can add the admins ourselves. There is a link to the hardware page on confluence from the website. We can remove this. > On Jan 20, 2015, at 5:54 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > I'm going to ask Ti and John to create an opt-in Confluence userbase resource, where all existing JLSE Confluence users will be removed. When people go to request the new Confluence resource they'll be added back in. Is this OK? This should be the lowest overhead to cleanup userbase accounts. > > I'm also thinking that we could open read-only access to the majority of the documentation like the hardware status list, etc, so people don't necessarily needs accounts to browse documentation. > > Thoughts? > > Ben > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

Re: [JLSE-Admins] JLSE Confluence
by Thakur, Rajeev 20 Jan '15

20 Jan '15

Fine with me. Rajeev On Jan 20, 2015, at 5:54 PM, "Allen, Benjamin S." <bsallen(a)alcf.anl.gov> wrote: > I'm going to ask Ti and John to create an opt-in Confluence userbase resource, where all existing JLSE Confluence users will be removed. When people go to request the new Confluence resource they'll be added back in. Is this OK? This should be the lowest overhead to cleanup userbase accounts. > > I'm also thinking that we could open read-only access to the majority of the documentation like the hardware status list, etc, so people don't necessarily needs accounts to browse documentation. > > Thoughts? > > Ben > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

[JLSE-Admins] Fwd: Follow up on SC14 SCC from NVIDIA
by Allen, Benjamin S. 20 Jan '15

20 Jan '15

All, Do we have any interest in adding the K40 GPUs from IIT/SCC'14 back into JLSE? I'm sure there will be some amount of paperwork that will be needed to loan hardware for IIT. Thanks, Ben > Begin forwarded message: > > Date: January 20, 2015 at 2:26:57 PM CST > From: Ioan Raicu <iraicu(a)cs.iit.edu> > Reply-To: <iraicu(a)cs.iit.edu> > To: "Allen, Benjamin S." <bsallen(a)alcf.anl.gov> > Cc: "Scullin, William R." <wscullin(a)alcf.anl.gov> > Subject: Re: Follow up on SC14 SCC from NVIDIA > > Hi Ben, > Since we will be trying for SCC again this year, our undergrads could be using them to get more familiar with GPUs, writing CUDA code, etc, in an environment most similar to what they will likely have again. We have machines at IIT to put them in, but they are 6 or 8 core nodes, 16GB of RAM, and 1Gb/sec Ethernet, nothing compared to the 36-core, 128GB RAM, and 56Gb/sec IB the SCC nodes have. My understanding is that the SCC students (there are 6 of them at this point) will get JLSE accounts and will do much of their testing and tinkering on JLSE until new hardware would arrive in August/September. So, at least our UG students could use these K40 accelerators. But again, if its too much trouble, and paperwork, etc, we will bring them online at IIT. > Thanks for looking into this. > Ioan > > On 1/20/2015 2:09 PM, Allen, Benjamin S. wrote: >> Hi Ioan, >> >> Let me ask around with JLSE folks. Generally our users aren't that interested in GPUs, but we'll see. >> >> Thanks so much for the offer, and I'll let you know hopefully be the end of this week. >> >> Ben >> >>> On Jan 20, 2015, at 12:41 PM, Ioan Raicu <iraicu(a)cs.iit.edu> wrote: >>> >>> Hi William, Ben, >>> We have these 8 NVIDIA cards that NVIDIA has graciously allowed us to keep. If you think we could load them up in the old 8-node SCC cluster, I'd be happy to loan them to you/ANL. If its too much trouble, then I'll load them up in a 20-node cluster we have here at IIT. Let me know what you decide. >>> Cheers, >>> Ioan >>> >>> >>> -------- Original Message -------- >>> Subject: RE: Follow up on SC14 SCC from NVIDIA >>> Date: Tue, 20 Jan 2015 18:04:26 +0000 >>> From: Mark Ebersole <mebersole(a)nvidia.com> >>> To: iraicu(a)cs.iit.edu <iraicu(a)cs.iit.edu> >>> >>> >>> “Provide us with more than 8 GPUs, perhaps 12, or even 16. Some of the applications were not driving the GPUs that hard, and we could have fit more than 8 GPUs in the power budget” – hardest part about this is budget. With the majority of teams using GPUs for every cluster competition throughout the year, it’s hard to give more than 8 per team! Teams are welcome to ask other vendors (like their server vendor) for more GPUs in addition to what NVIDIA gives. >>> “Have other GPUs available, such as the Titans, etc. Some of the other GPUs compared to the Tesla's, might make the competition more interesting.” – Teams are welcome to ask us for different GPUs J I try not to dictate what should be used, just provide the necessary information for teams to make their own decisions. >>> “Who do I need to talk to in order to return the K40s that were sent to us for the competition?” – If you’re going to use them, Keep them!! >>> From: Ioan Raicu [mailto:[email protected]] >>> Sent: Wednesday, January 14, 2015 8:08 PM >>> To: Mark Ebersole >>> Subject: Re: Follow up on SC14 SCC from NVIDIA >>> Hi Mark, >>> Sorry your email got buried under many other emails. I am just now starting to recover from SC14 and the holidays. >>> >>> See my answers below inline: >>> On 11/25/2014 11:11 AM, Mark Ebersole wrote: >>> [BCC advisors for teams using GPUs] >>> All, >>> Hopefully everyone made it back home safely from New Orleans! While I was stuck in our booth most of the time, I enjoyed the interactions I did get with the teams. >>> I wanted to get in touch while the competition is still fresh in everyone’s minds. Would you mind taking some time to help answer the following questions so I can try to help improve NVIDIA’s involvement in future competitions? It would be great if you could ask some or all of these questions to your team members as well. >>> What can NVIDIA do better for the next competition? >>> Provide us with more than 8 GPUs, perhaps 12, or even 16. Some of the applications were not driving the GPUs that hard, and we could have fit more than 8 GPUs in the power budget. >>> >>> What could the committee change to make the competition more fair/interesting/relevant/etc.? >>> Have other GPUs available, such as the Titans, etc. Some of the other GPUs compared to the Tesla's, might make the competition more interesting. >>> >>> What did your team enjoy most about the competition? >>> We learned a whole lot, very practical things. We will try again next year, and hopefully we will do that much more next time! >>> >>> What worked well? >>> Everything went smoothly, once we got our hardware! >>> >>> Do you plan on using GPUs (probably K80s) in your next competition? >>> Yes, definitly! >>> >>> Anything else? Who do I need to talk to in order to return the K40s that were sent to us for the competition? Since K80 GPUs are now available, perhaps the K40 GPUs are not as valuable to NVIDIA. Is there any way we could keep the GPUs on loan for longer? At IIT, we are both a CUDA Research and Teaching center, and we have built a cluster of 20 nodes with GPUs (mostly donated from NVIDIA) so that we can teach CUDA in the classroom. At the moment, we have 1 K40, 1 K20, and a bunch of low end GPUs with 384-cores each, that have no double precision performance. If we could keep the 8 K40 GPUs we had on loan, for an extended loan, we could get half the cluster to house K20/K40 GPUs, and get more students to use the K40s instead of the low end gaming GPUs. If you are not the right person to be asking about this, perhaps you can put us in touch with who is? If you don't know, I'll track back through my emails and figure out who sent me the GPUs in the first place. >>> >>> Cheers, >>> Ioan >>> >>> Thanks! >>> P.S. If you have any team members looking for internships/jobs at NVIDIA, please have them send me their resume. >>> Mark Ebersole >>> CUDA Educator | NVIDIA Corporation >>> mebersole(a)nvidia.com >>> Click to learn: <Mail Attachment.png> >>> <Mail Attachment.jpeg> >>> This email message is for the sole use of the intended recipient(s) and may contain confidential information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. >>> >>> >>> -- >>> ================================================================= >>> Ioan Raicu, Ph.D. >>> Assistant Professor, Illinois Institute of Technology (IIT) >>> Guest Research Faculty, Argonne National Laboratory (ANL) >>> ================================================================= >>> Data-Intensive Distributed Systems Laboratory, CS/IIT >>> Distributed Systems Laboratory, MCS/ANL >>> ================================================================= >>> Editor: IEEE TCC, Springer Cluster, Springer JoCCASA >>> Chair: IEEE/ACM MTAGS, ACM ScienceCloud >>> ================================================================= >>> Cel: 1-847-722-0876 >>> Office: 1-312-567-5704 >>> Email: iraicu(a)cs.iit.edu >>> Web: http://www.cs.iit.edu/~iraicu/ >>> Web: http://datasys.cs.iit.edu/ >>> LinkedIn: http://www.linkedin.com/in/ioanraicu >>> Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ >>> ================================================================= >>> ================================================================= >>> >>> >>> > > -- > ================================================================= > Ioan Raicu, Ph.D. > Assistant Professor, Illinois Institute of Technology (IIT) > Guest Research Faculty, Argonne National Laboratory (ANL) > ================================================================= > Data-Intensive Distributed Systems Laboratory, CS/IIT > Distributed Systems Laboratory, MCS/ANL > ================================================================= > Editor: IEEE TCC, Springer Cluster, Springer JoCCASA > Chair: IEEE/ACM MTAGS, ACM ScienceCloud > ================================================================= > Cel: 1-847-722-0876 > Office: 1-312-567-5704 > Email: iraicu(a)cs.iit.edu > Web: http://www.cs.iit.edu/~iraicu/ > Web: http://datasys.cs.iit.edu/ > LinkedIn: http://www.linkedin.com/in/ioanraicu > Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ > ================================================================= > ================================================================= > >

1 0

Re: [JLSE-Admins] JLSE MIC home directory
by Allen, Benjamin S. 20 Jan '15

20 Jan '15

Hi John, The JLSE Intel license has been updated. Please let me know if you have any further issues. Ben > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > Hi John, > > It appears our license expired on the 18th. Sorry I wasn't on top of that. I'll let you know when it's updated. > > Ben > >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >> >> Hey Ben, >> >> I'm trying to compile my code, but I seem to be getting license errors when trying to use the intel compiler (I'm using the same environment that had been working previously, I believe): >> >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model fast=2 -openmp -DOPENMP -c main.c -o main.o >> >> Error: A license for CCompL is not available now (-97,121). >> >> A connection to the license server could not be made. You should >> make sure that your license daemon process is running: both an >> lmgrd process and an INTEL process should be running >> if your license limits you to a specified number of licenses in use >> at a time. Also, check to see if the wrong port@host or the wrong >> license file is being used, or if the port or hostname in the license >> file has changed. >> >> License file(s) used were (in this order): >> 1. Trusted Storage >> ** 2. 28518@ftsn2 >> ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses >> ** 4. /opt/intel/licenses >> ** 5. /home/jtramm/intel/licenses >> ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses >> ** 7. /Users/Shared/Library/Application Support/Intel/Licenses >> ** 8. /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic >> >> Please visit http://software.intel.com/sites/support/ if you require technical assistance. >> >> icc: error #10052: could not checkout FLEXlm license >> make: *** [main.o] Error 1 >> >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >> Ben, >> >> That sounds like a good plan. Thanks for the help! >> >> -John >> >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >> Hi John, >> >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is the actual app you're trying to profile, I can start with the packages referenced in the "Cannot locate debugging symbols" below. >> >> Ben >> >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >>> >>> Hey Ben, >>> >>> Thanks for doing this! I would ideally like all of the packages installed, as I'm not sure which ones I need and which I don't. My app doesn't have any outside dependencies, and it really just uses pretty normal C and OpenMP includes, so I'm guessing if it has issues with just that I will probably need them all (unless you have reason to believe otherwise). >>> >>> Thanks again! >>> >>> -John >>> >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >>> Hi John, >>> >>> Yea I can do this. I should be able to get to it sometime this week, at worst early next week. Do you want all of the dbg packages installed, or do you have a specific list you want? >>> >>> Ben >>> >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >>>> >>>> Ben, >>>> >>>> I tried running through the CLI mode, and had the same problems. It would be really great if you could install the required packages, as Vtune offers a lot in terms of performance analysis that can't be done any other way on the MIC. I understand the desire to keep the install bloat to a minimum, but Vtune is pretty essential to working with the MIC. I'm really in the dark as to what's going on with my application without being able to use Vtune, as even simple things like grpof don't work on there. >>>> >>>> Here's what I'm getting: >>>> >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export INTEL_LICENSE_FILE=28518@ftsn2 >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved. >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native:0 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel >>>> amplxe: Using target: mic-native:0 >>>> amplxe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: amplxe-cl -r /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. >>>> amplxe: Collection stopped. >>>> amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' >>>> amplxe: Executing actions 16 % Resolving module symbols >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' on the remote system >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the remote system >>>> amplxe: Executing actions 16 % Resolving information for `libc-2.14.90.so' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote system >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system >>>> amplxe: Executing actions 16 % Resolving information for `ld-2.14.90.so' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. >>>> amplxe: Executing actions 17 % Resolving information for `ld-2.14.90.so' >>>> amplxe: Locating file `intel_micveth.ko' on the remote system >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux'. >>>> amplxe: Executing actions 18 % Resolving information for dangling locations >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'. >>>> amplxe: Executing actions 18 % Resolving information for `libgnutls.so.26.22.0' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. >>>> amplxe: Executing actions 18 % Resolving information for `libgcrypt.so.11.7.0' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. >>>> amplxe: Executing actions 19 % Resolving information for `libnss_ldap-2.12.2.so >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so'. >>>> amplxe: Executing actions 19 % Resolving information for `sshd' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. >>>> amplxe: Executing actions 19 % Resolving information for `libcrypto.so.1.0.0' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. >>>> amplxe: Executing actions 20 % Resolving information for `libtasn1.so.3.1.13' >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. >>>> amplxe: Executing actions 50 % Generating a report >>>> >>>> General Exploration Metrics >>>> --------------------------- >>>> Parameter r001ah >>>> -------------------- --------- >>>> CPU Time 0.300 >>>> Clockticks 372000558 >>>> Instructions Retired 95333238 >>>> CPI Rate 3.902 >>>> Cache Usage 0.0 >>>> Vectorization Usage 0.0 >>>> TLB Usage 0.0 >>>> >>>> Collection and Platform Info >>>> ---------------------------- >>>> Parameter r001ah >>>> ------------------------ ----------------------------------------------------------------- >>>> Application Command Line /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel >>>> User Name jtramm >>>> Operating System Intel MIC Platform Software Stack (Built by Poky 7.0) 3.4.2 \n \l >>>> Computer Name lucie-mic0.ftm.alcf.anl.gov >>>> Result Size 2272316 >>>> >>>> CPU >>>> --- >>>> Parameter r001ah >>>> ----------------- -------------------------- >>>> Name Intel Xeon Phi coprocessor >>>> Frequency 1238000000 >>>> Logical CPU Count 244 >>>> >>>> Summary >>>> ------- >>>> Elapsed Time: 0.392 >>>> CPU Time: 0.300 >>>> Average CPU Usage: 0.548 >>>> CPI Rate: 3.902 >>>> >>>> Event summary >>>> ------------- >>>> Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample >>>> --------------------- ------------------------- -------------------------------- ----------------- >>>> CPU_CLK_UNHALTED 372000558 186 2000003 >>>> INSTRUCTIONS_EXECUTED 95333238 77 1238094 >>>> amplxe: Executing actions 100 % done >>>> >>>> >>>> Thanks for your help! >>>> >>>> -John >>>> >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >>>> I have little to no experience with VTune. However looking at the screen cap the kernel modules referenced can be found on the MIC at: >>>> >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko >>>> >>>> If I'd have to guess, the debugging symbols are missing because I don't have any of the k1om debug packages installed on the MICs themselves, i.e. "dbg" RPMs from http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I try to keep the packages installed directly on the MICs to a minimum as they appear to sit in a RAM disk. >>>> >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see if it outputs anymore useful information? >>>> >>>> Example: >>>> >>>> export INTEL_LICENSE_FILE=28518@ftsn2 >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls -CF /usr/bin >>>> >>>> Ben >>>> >>>> >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >>>>> >>>>> Ben, >>>>> >>>>> Thanks for re-deploying - it definitely seems to have helped. I'm now able to run the vtune GUI. >>>>> >>>>> However, now I'm running into a new issue. When I run vtune from the host, in order to analyze an app run on the device, it doesn't appear to be launching successfully (i.e., nothing is output to the terminal, and the resulting vtune analysis says the code only ran for a fraction of a second, when it should be at least several seconds on the MIC). >>>>> >>>>> It also outputs this set of errors when running my project: >>>>> >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png> >>>>> >>>>> >>>>> Can you think of anything that might cause this? >>>>> >>>>> Thanks again so much for your help! >>>>> >>>>> -John Tramm >>>>> >>>>> >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >>>>> Hi John, >>>>> >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the three servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated "sep", which is the sampling kernel module for both the MIC and the host. I doesn't look like Intel included the Power sampling kernel module with Vtune Amplifier XE 2015 however, ie. /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src. >>>>> >>>>> Let me know if you run into any more problems. >>>>> >>>>> Ben >>>>> >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >>>>>> >>>>>> Ben, >>>>>> >>>>>> I'm trying to use vtune to analyze performance of my application on the mic. I can't seem to get Vtune to run on the host node (either lucie or jenny). I keep getting the following error: >>>>>> >>>>>> amplxe-gui: error while loading shared libraries: libXxf86vm.so.1: cannot open shared object file: No such file or directory >>>>>> >>>>>> There seems to be a shared library file missing somewhere that I can't seem to find. Perhaps I need to add something to my linker path? >>>>>> >>>>>> Thanks for your help! >>>>>> >>>>>> -John >>>>>> >>>>>> >>>>>> >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >>>>>> Allen, >>>>>> >>>>>> Yes, everything seems to be working great now. Thanks! >>>>>> >>>>>> -John >>>>>> >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: >>>>>> Hi John, >>>>>> >>>>>> This should be fixed. Let me know if you run into further issues. >>>>>> >>>>>> Ben >>>>>> >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: >>>>>>> >>>>>>> Greetings, >>>>>>> >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get my home directory to show up on mic0 itself. It is available on the host, but it doesn't seem to be able to connect on the MIC. I recall a few months ago I was able to access my home dir on the mic. >>>>>>> >>>>>>> Do I need to run anything to get access to the home dir? >>>>>>> >>>>>>> Thanks! >>>>>>> >>>>>>> -John Tramm >>>>>>> _______________________________________________ >>>>>>> Admins mailing list >>>>>>> Admins(a)lists.jlse.anl.gov >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>> >>>> >>> >>> >> >> >> >

1 0

Re: [JLSE-Admins] Any Haswell-EP systems in JLSE?
by Allen, Benjamin S. 20 Jan '15

20 Jan '15

> On Jan 20, 2015, at 5:36 PM, John Valdes <valdes(a)anl.gov> wrote: > >> We're more than happy to help out. We do request that you put in a project request here: http://press3.mcs.anl.gov/jlse/projects/project-request-form/, so we can track who is using JLSE and what people are using the hardware for. > > Will do; actually, some of the existing projects involve topics I'm > interested in exploring (Linux Containers for HPC; Campus Storage > Service). We have most of Eureka's nodes (~90 nodes) available if you need dedicated hardware but can deal with old hardware for things like testing out containers. We also have about half of Intrepid's old DDN storage and file servers available for projects. Again its old, and uses Myrinet but can provide an interesting testbed. We have ported the MX kernel module all the way up to the 3.13 kernel so far. We've stripped most of Intrepid's MX network, so it is a significantly more basic topology. No optics, and thus stable. We should talk more in-depth about our Petrel testbed, which is a campus storage project. > >> If you end up requiring specific hardware to be purchased, we may be able to accommodate depending on cost, and how much use the testbed would see beyond your own project. If LRCR has budget for test hardware and wants JLSE to host it, thats likely something we can accommodate as well. > > That's good to know, thanks. Do you guys get vendor no-cost-loans? > Do you do storage system evaluations as well, by which I'm mainly mean > commercial storage products (arrays and storage software) rather than > home-built storage systems. We've received loan hardware from Intel, Mellanox, and Nvidia on a regular basis. We're open to getting loaners from other companies as long as their NDAs/terms/etc are acceptable with procurement and legal. If you want anything that resembles fast turn around, ask the vendor to not provide their own T&Cs for the loan outside of when they want it back. We'll likely be getting a loaner DDN Infinite Memory Engine (IME) burst buffer box on loan at some point. There will also be a Cray Sonexion 2000 (Xyratex ClusterStor 9000) Lustre eval system that's being installed at the same time as Cooley (Tukey replacement from Cray). JLSE shortly will be sharing Vesta's FDR10 fabric, so we'll be able to use Vesta as clients for I/O testbeds that live in JLSE. In addition to any other of our nodes that live in 240. We can certainly host commercial storage system evals as long as we have floor space or rack space. Unless it's directly applicable to ALCF3 work, LCF staff (including myself) likely won't be able to provide much labor todo the actual evaluation however. Ben

1 0