January 2015 - Admins - mailman3.cels.anl.gov

[JLSE-Admins] JLSE meeting
by Kalyan Kumaran 23 Jan '15

23 Jan '15

I might not be able to make it today as we have a candidate’s seminar presentation. You guys can go ahead without me or just cancel the meeting if there is nothing pressing. -Kumar

1 0

Re: [JLSE-Admins] JLSE MIC home directory
by John Tramm 22 Jan '15

22 Jan '15

Ben, As far as I know, vtune is not meant to be launched directly from the MIC -- rather, it is meant to be launched on the host in a remote style with a specification of which target to run on (i.e., the "-target-system" argument). As for your example, I think think perhaps the issue is that the installed packages on the MIC are not the same version that vtune is expecting for some reason. I agree that libcrypto.so.1.0.0 is installed, but the error message says that vtune cannot find libcrypto.so.1.0.1e, which is a different shared object number. Perhaps some part of the compiler was updated but not others? I don't know what would cause this. Perhaps it would be a good idea to open a ticket with intel? Thanks for all the help, -John On Thu, Jan 22, 2015 at 12:21 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > Hi John, > > Yea started working on this yesterday, testing on Lucie. Note your example > below appears to be running on the host, not the MIC. > > I'm running: amplxe-cl -collect advanced-hotspots > -target-system=mic-native:1 -- > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel. > > I've actually installed all the debug packages I could find that contain > the needed debug libraries, see /var/mpss/rpms. You can look at the file > listing of the rpms with: rpm -qpl <file>. > > Lets take libcyrpto.so.1.0.0 for example. > openssl-dbg-1.0.0o-r15.1.k1om.rpm is the package that contains it. It's > installing: > > /lib64/.debug/libcrypto.so > /lib64/.debug/libcrypto.so.1.0.0 > > Among other files. Any chance Vtune doesn't know where to look on the MIC > for libraries with debug symbols? How about setting LD_LIBRARY_PATH, so > /lib64/.debug/ and /usr/lib64/.debug preempt the normal dynamic libraries? > Thus vtune might grab those instead of the default libraries. > > intel_micveth.ko is located at /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko > and is part of the mpss-modules-3.4.2-1.knightscorner package. There's no > module debug package or kernel debug package. > > Ben > > > On Jan 21, 2015, at 7:59 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > > > Hey Ben, > > > > The intel compiler is working again now - thanks! > > > > However, I'm still unable to get Vtune to work on the MIC. It still is > having issues finding the correct shared object files. It looks like there > are shared object files installed, but they are not the correct version > that Vtune is expecting? Here's the error I'm getting: > > > > jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect > advanced-hotspots -target-system=mic-native ./SimpleMOC-kernel > > amplxe: Using target: mic-native: > > amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r000ah' > > amplxe: Executing actions 16 % Resolving module symbols > > amplxe: Warning: Cannot locate file `/usr/lib64/libcrypto.so.1.0.1e'. > > amplxe: Warning: Cannot locate file `/lib64/libpthread-2.12.so'. > > amplxe: Warning: Cannot locate file `/lib64/ld-2.12.so'. > > amplxe: Warning: Cannot locate file `/lib64/libc-2.12.so'. > > amplxe: Executing actions 16 % Resolving information for > `libcrypto.so.1.0.1e' > > amplxe: Warning: Cannot locate file `/usr/bin/ssh'. > > amplxe: Executing actions 16 % Resolving information for `ssh' > > amplxe: Warning: Cannot locate file > `/usr/lib/debug/lib/modules/2.6.32-431.el6.x86_64/vmlinux'. > > amplxe: Executing actions 50 % Generating a report > > > > General Exploration Metrics > > --------------------------- > > Parameter r000ah > > --------- ------ > > > > Collection and Platform Info > > ---------------------------- > > Parameter r000ah > > ------------------------ ---------------------- > > Application Command Line ./SimpleMOC-kernel > > Operating System 2.6.32-431.el6.x86_64 > > Computer Name lucie.ftm.alcf.anl.gov > > Result Size 1596019 > > > > CPU > > --- > > Parameter r000ah > > ----------------- -------------------------- > > Name Intel Xeon Phi coprocessor > > Logical CPU Count 32 > > > > Summary > > ------- > > Elapsed Time: 0.000 > > > > Event summary > > ------------- > > Hardware Event Type Hardware Event Count:Self Hardware Event Sample > Count:Self Events Per Sample > > ------------------- ------------------------- > -------------------------------- ----------------- > > cycles 196000 > 49 4000 > > amplxe: Executing actions 100 % done > > > > On Wed, Jan 21, 2015 at 2:17 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > Hi John, > > > > I had a mistake in the license file. Please try it again. > > > > Ben > > > > > On Jan 21, 2015, at 10:54 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > > > > > Hey Ben, > > > > > > I'm not able to get the intel compiler to work. When I call "icc", it > simply hangs and the call never returns. Perhaps it's trying to connect > somewhere to verify the license file but it can't find it? > > > > > > Thanks for the help. > > > > > > -John > > > > > > On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > Hi John, > > > > > > The JLSE Intel license has been updated. Please let me know if you > have any further issues. > > > > > > Ben > > > > > > > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > > > > > > Hi John, > > > > > > > > It appears our license expired on the 18th. Sorry I wasn't on top of > that. I'll let you know when it's updated. > > > > > > > > Ben > > > > > > > >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >> > > > >> Hey Ben, > > > >> > > > >> I'm trying to compile my code, but I seem to be getting license > errors when trying to use the intel compiler (I'm using the same > environment that had been working previously, I believe): > > > >> > > > >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make > > > >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model > fast=2 -openmp -DOPENMP -c main.c -o main.o > > > >> > > > >> Error: A license for CCompL is not available now (-97,121). > > > >> > > > >> A connection to the license server could not be made. You should > > > >> make sure that your license daemon process is running: both an > > > >> lmgrd process and an INTEL process should be running > > > >> if your license limits you to a specified number of licenses in use > > > >> at a time. Also, check to see if the wrong port@host or the wrong > > > >> license file is being used, or if the port or hostname in the > license > > > >> file has changed. > > > >> > > > >> License file(s) used were (in this order): > > > >> 1. Trusted Storage > > > >> ** 2. 28518@ftsn2 > > > >> ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses > > > >> ** 4. /opt/intel/licenses > > > >> ** 5. /home/jtramm/intel/licenses > > > >> ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses > > > >> ** 7. /Users/Shared/Library/Application Support/Intel/Licenses > > > >> ** 8. > /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic > > > >> > > > >> Please visit http://software.intel.com/sites/support/ if you > require technical assistance. > > > >> > > > >> icc: error #10052: could not checkout FLEXlm license > > > >> make: *** [main.o] Error 1 > > > >> > > > >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >> Ben, > > > >> > > > >> That sounds like a good plan. Thanks for the help! > > > >> > > > >> -John > > > >> > > > >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > >> Hi John, > > > >> > > > >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is > the actual app you're trying to profile, I can start with the packages > referenced in the "Cannot locate debugging symbols" below. > > > >> > > > >> Ben > > > >> > > > >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >>> > > > >>> Hey Ben, > > > >>> > > > >>> Thanks for doing this! I would ideally like all of the packages > installed, as I'm not sure which ones I need and which I don't. My app > doesn't have any outside dependencies, and it really just uses pretty > normal C and OpenMP includes, so I'm guessing if it has issues with just > that I will probably need them all (unless you have reason to believe > otherwise). > > > >>> > > > >>> Thanks again! > > > >>> > > > >>> -John > > > >>> > > > >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > >>> Hi John, > > > >>> > > > >>> Yea I can do this. I should be able to get to it sometime this > week, at worst early next week. Do you want all of the dbg packages > installed, or do you have a specific list you want? > > > >>> > > > >>> Ben > > > >>> > > > >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >>>> > > > >>>> Ben, > > > >>>> > > > >>>> I tried running through the CLI mode, and had the same problems. > It would be really great if you could install the required packages, as > Vtune offers a lot in terms of performance analysis that can't be done any > other way on the MIC. I understand the desire to keep the install bloat to > a minimum, but Vtune is pretty essential to working with the MIC. I'm > really in the dark as to what's going on with my application without being > able to use Vtune, as even simple things like grpof don't work on there. > > > >>>> > > > >>>> Here's what I'm getting: > > > >>>> > > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export > INTEL_LICENSE_FILE=28518@ftsn2 > > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source > /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > > > >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved. > > > >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) > > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect > advanced-hotspots -target-system=mic-native:0 -- > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > > > >>>> amplxe: Using target: mic-native:0 > > > >>>> amplxe: Collection started. To stop the collection, either press > CTRL-C or enter from another console window: amplxe-cl -r > /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. > > > >>>> amplxe: Collection stopped. > > > >>>> amplxe: Using result path > `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' > > > >>>> amplxe: Executing actions 16 % Resolving module symbols > > > >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' > on the remote system > > > >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the > remote system > > > >>>> amplxe: Executing actions 16 % Resolving information for ` > libc-2.14.90.so' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. > > > >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote > system > > > >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system > > > >>>> amplxe: Executing actions 16 % Resolving information for ` > ld-2.14.90.so' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. > > > >>>> amplxe: Executing actions 17 % Resolving information for ` > ld-2.14.90.so' > > > >>>> amplxe: Locating file `intel_micveth.ko' on the remote system > > > >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/ > 2.6.38.8+mpss3.4.2/vmlinux'. > > > >>>> amplxe: Executing actions 18 % Resolving information for dangling > locations > > > >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'. > > > >>>> amplxe: Executing actions 18 % Resolving information for > `libgnutls.so.26.22.0' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. > > > >>>> amplxe: Executing actions 18 % Resolving information for > `libgcrypt.so.11.7.0' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. > > > >>>> amplxe: Executing actions 19 % Resolving information for ` > libnss_ldap-2.12.2.so > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ > libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so > '. > > > >>>> amplxe: Executing actions 19 % Resolving information for `sshd' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. > > > >>>> amplxe: Executing actions 19 % Resolving information for > `libcrypto.so.1.0.0' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. > > > >>>> amplxe: Executing actions 20 % Resolving information for > `libtasn1.so.3.1.13' > > > >>>> amplxe: Warning: Cannot locate debugging symbols for file > `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. > > > >>>> amplxe: Executing actions 50 % Generating a report > > > >>>> > > > >>>> General Exploration Metrics > > > >>>> --------------------------- > > > >>>> Parameter r001ah > > > >>>> -------------------- --------- > > > >>>> CPU Time 0.300 > > > >>>> Clockticks 372000558 > > > >>>> Instructions Retired 95333238 > > > >>>> CPI Rate 3.902 > > > >>>> Cache Usage 0.0 > > > >>>> Vectorization Usage 0.0 > > > >>>> TLB Usage 0.0 > > > >>>> > > > >>>> Collection and Platform Info > > > >>>> ---------------------------- > > > >>>> Parameter r001ah > > > >>>> ------------------------ > ----------------------------------------------------------------- > > > >>>> Application Command Line > /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > > > >>>> User Name jtramm > > > >>>> Operating System Intel MIC Platform Software Stack > (Built by Poky 7.0) 3.4.2 \n \l > > > >>>> Computer Name lucie-mic0.ftm.alcf.anl.gov > > > >>>> Result Size 2272316 > > > >>>> > > > >>>> CPU > > > >>>> --- > > > >>>> Parameter r001ah > > > >>>> ----------------- -------------------------- > > > >>>> Name Intel Xeon Phi coprocessor > > > >>>> Frequency 1238000000 > > > >>>> Logical CPU Count 244 > > > >>>> > > > >>>> Summary > > > >>>> ------- > > > >>>> Elapsed Time: 0.392 > > > >>>> CPU Time: 0.300 > > > >>>> Average CPU Usage: 0.548 > > > >>>> CPI Rate: 3.902 > > > >>>> > > > >>>> Event summary > > > >>>> ------------- > > > >>>> Hardware Event Type Hardware Event Count:Self Hardware Event > Sample Count:Self Events Per Sample > > > >>>> --------------------- ------------------------- > -------------------------------- ----------------- > > > >>>> CPU_CLK_UNHALTED 372000558 > 186 2000003 > > > >>>> INSTRUCTIONS_EXECUTED 95333238 > 77 1238094 > > > >>>> amplxe: Executing actions 100 % done > > > >>>> > > > >>>> > > > >>>> Thanks for your help! > > > >>>> > > > >>>> -John > > > >>>> > > > >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > >>>> I have little to no experience with VTune. However looking at the > screen cap the kernel modules referenced can be found on the MIC at: > > > >>>> > > > >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko > > > >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko > > > >>>> > > > >>>> If I'd have to guess, the debugging symbols are missing because I > don't have any of the k1om debug packages installed on the MICs themselves, > i.e. "dbg" RPMs from > http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I > try to keep the packages installed directly on the MICs to a minimum as > they appear to sit in a RAM disk. > > > >>>> > > > >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see > if it outputs anymore useful information? > > > >>>> > > > >>>> Example: > > > >>>> > > > >>>> export INTEL_LICENSE_FILE=28518@ftsn2 > > > >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > > > >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls > -CF /usr/bin > > > >>>> > > > >>>> Ben > > > >>>> > > > >>>> > > > >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >>>>> > > > >>>>> Ben, > > > >>>>> > > > >>>>> Thanks for re-deploying - it definitely seems to have helped. > I'm now able to run the vtune GUI. > > > >>>>> > > > >>>>> However, now I'm running into a new issue. When I run vtune from > the host, in order to analyze an app run on the device, it doesn't appear > to be launching successfully (i.e., nothing is output to the terminal, and > the resulting vtune analysis says the code only ran for a fraction of a > second, when it should be at least several seconds on the MIC). > > > >>>>> > > > >>>>> It also outputs this set of errors when running my project: > > > >>>>> > > > >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png> > > > >>>>> > > > >>>>> > > > >>>>> Can you think of anything that might cause this? > > > >>>>> > > > >>>>> Thanks again so much for your help! > > > >>>>> > > > >>>>> -John Tramm > > > >>>>> > > > >>>>> > > > >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > >>>>> Hi John, > > > >>>>> > > > >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the > three servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also > updated "sep", which is the sampling kernel module for both the MIC and the > host. I doesn't look like Intel included the Power sampling kernel module > with Vtune Amplifier XE 2015 however, ie. > /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src. > > > >>>>> > > > >>>>> Let me know if you run into any more problems. > > > >>>>> > > > >>>>> Ben > > > >>>>> > > > >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >>>>>> > > > >>>>>> Ben, > > > >>>>>> > > > >>>>>> I'm trying to use vtune to analyze performance of my > application on the mic. I can't seem to get Vtune to run on the host node > (either lucie or jenny). I keep getting the following error: > > > >>>>>> > > > >>>>>> amplxe-gui: error while loading shared libraries: > libXxf86vm.so.1: cannot open shared object file: No such file or directory > > > >>>>>> > > > >>>>>> There seems to be a shared library file missing somewhere that > I can't seem to find. Perhaps I need to add something to my linker path? > > > >>>>>> > > > >>>>>> Thanks for your help! > > > >>>>>> > > > >>>>>> -John > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >>>>>> Allen, > > > >>>>>> > > > >>>>>> Yes, everything seems to be working great now. Thanks! > > > >>>>>> > > > >>>>>> -John > > > >>>>>> > > > >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. < > bsallen(a)alcf.anl.gov> wrote: > > > >>>>>> Hi John, > > > >>>>>> > > > >>>>>> This should be fixed. Let me know if you run into further > issues. > > > >>>>>> > > > >>>>>> Ben > > > >>>>>> > > > >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm(a)mcs.anl.gov> > wrote: > > > >>>>>>> > > > >>>>>>> Greetings, > > > >>>>>>> > > > >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get > my home directory to show up on mic0 itself. It is available on the host, > but it doesn't seem to be able to connect on the MIC. I recall a few months > ago I was able to access my home dir on the mic. > > > >>>>>>> > > > >>>>>>> Do I need to run anything to get access to the home dir? > > > >>>>>>> > > > >>>>>>> Thanks! > > > >>>>>>> > > > >>>>>>> -John Tramm > > > >>>>>>> _______________________________________________ > > > >>>>>>> Admins mailing list > > > >>>>>>> Admins(a)lists.jlse.anl.gov > > > >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins > > > >>>>>> > > > >>>>>> > > > >>>>>> > > > >>>>> > > > >>>>> > > > >>>> > > > >>>> > > > >>> > > > >>> > > > >> > > > >> > > > >> > > > > > > > > > > > > > > > >

1 0

Re: [JLSE-Admins] [JLSE-Users] Reminder to acknowledge JLSE in your publications
by Smith, Micheal A. 22 Jan '15

22 Jan '15

Ron answered the question, Thanks all and sorry for the extra emails. Mike From: Kalyan Kumaran [mailto:[email protected]] Sent: Thursday, January 22, 2015 2:03 PM To: Smith, Micheal A. Cc: <admins(a)jlse.anl.gov> Subject: Re: [JLSE-Users] Reminder to acknowledge JLSE in your publications The options on Intel are the Intel compilers. You can use PGI with the Nvidia GPUs. For ARM it is GNU. -Kumar On Jan 22, 2015, at 1:41 PM, Smith, Micheal A. <masmith(a)anl.gov<mailto:[email protected]>> wrote: Is there a master document which states which compilers are available and are known to work with the various hardware? Or is this one of those I must install my own compiler type of deals? Thanks, Mike From: users-bounces(a)lists.jlse.anl.gov<mailto:[email protected]> [mailto:[email protected]] On Behalf Of Kalyan Kumaran Sent: Wednesday, November 12, 2014 9:38 AM To: users(a)jlse.anl.gov<mailto:[email protected]> Subject: [JLSE-Users] Reminder to acknowledge JLSE in your publications Dear users, We request that you acknowledge the use of JLSE resources in your publications. Also please do send us accepted publications for posting on our website. For more details please see: http://jlse.anl.gov/publications/ Thanks, Kumar

1 0

Re: [JLSE-Admins] [JLSE-Users] Reminder to acknowledge JLSE in your publications
by Smith, Micheal A. 22 Jan '15

22 Jan '15

Sounds both logical and reasonable. So where are they installed then? I tried the wiki but could not figure this out and am tired of looking at / trying to figure it out. I have used all three before so I guess I am good to go then. Thanks again, Mike From: Kalyan Kumaran [mailto:[email protected]] Sent: Thursday, January 22, 2015 2:03 PM To: Smith, Micheal A. Cc: <admins(a)jlse.anl.gov> Subject: Re: [JLSE-Users] Reminder to acknowledge JLSE in your publications The options on Intel are the Intel compilers. You can use PGI with the Nvidia GPUs. For ARM it is GNU. -Kumar On Jan 22, 2015, at 1:41 PM, Smith, Micheal A. <masmith(a)anl.gov<mailto:[email protected]>> wrote: Is there a master document which states which compilers are available and are known to work with the various hardware? Or is this one of those I must install my own compiler type of deals? Thanks, Mike From: users-bounces(a)lists.jlse.anl.gov<mailto:[email protected]> [mailto:[email protected]] On Behalf Of Kalyan Kumaran Sent: Wednesday, November 12, 2014 9:38 AM To: users(a)jlse.anl.gov<mailto:[email protected]> Subject: [JLSE-Users] Reminder to acknowledge JLSE in your publications Dear users, We request that you acknowledge the use of JLSE resources in your publications. Also please do send us accepted publications for posting on our website. For more details please see: http://jlse.anl.gov/publications/ Thanks, Kumar

1 0

Re: [JLSE-Admins] [JLSE-Users] Reminder to acknowledge JLSE in your publications
by Kalyan Kumaran 22 Jan '15

22 Jan '15

The options on Intel are the Intel compilers. You can use PGI with the Nvidia GPUs. For ARM it is GNU. -Kumar > On Jan 22, 2015, at 1:41 PM, Smith, Micheal A. <masmith(a)anl.gov> wrote: > > Is there a master document which states which compilers are available and are known to work with the various hardware? > > Or is this one of those I must install my own compiler type of deals? > > Thanks, > > Mike > > From: users-bounces(a)lists.jlse.anl.gov <mailto:[email protected]> [mailto:[email protected] <mailto:[email protected]>] On Behalf Of Kalyan Kumaran > Sent: Wednesday, November 12, 2014 9:38 AM > To: users(a)jlse.anl.gov <mailto:[email protected]> > Subject: [JLSE-Users] Reminder to acknowledge JLSE in your publications > > Dear users, > > We request that you acknowledge the use of JLSE resources in your publications. Also please do send us accepted publications for posting on our website. For more details please see: > > http://jlse.anl.gov/publications/ <http://jlse.anl.gov/publications/> > > Thanks, > Kumar

1 0

Re: [JLSE-Admins] JLSE MIC home directory
by Allen, Benjamin S. 22 Jan '15

22 Jan '15

Hi John, Yea started working on this yesterday, testing on Lucie. Note your example below appears to be running on the host, not the MIC. I'm running: amplxe-cl -collect advanced-hotspots -target-system=mic-native:1 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel. I've actually installed all the debug packages I could find that contain the needed debug libraries, see /var/mpss/rpms. You can look at the file listing of the rpms with: rpm -qpl <file>. Lets take libcyrpto.so.1.0.0 for example. openssl-dbg-1.0.0o-r15.1.k1om.rpm is the package that contains it. It's installing: /lib64/.debug/libcrypto.so /lib64/.debug/libcrypto.so.1.0.0 Among other files. Any chance Vtune doesn't know where to look on the MIC for libraries with debug symbols? How about setting LD_LIBRARY_PATH, so /lib64/.debug/ and /usr/lib64/.debug preempt the normal dynamic libraries? Thus vtune might grab those instead of the default libraries. intel_micveth.ko is located at /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko and is part of the mpss-modules-3.4.2-1.knightscorner package. There's no module debug package or kernel debug package. Ben > On Jan 21, 2015, at 7:59 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > Hey Ben, > > The intel compiler is working again now - thanks! > > However, I'm still unable to get Vtune to work on the MIC. It still is having issues finding the correct shared object files. It looks like there are shared object files installed, but they are not the correct version that Vtune is expecting? Here's the error I'm getting: > > jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native ./SimpleMOC-kernel > amplxe: Using target: mic-native: > amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r000ah' > amplxe: Executing actions 16 % Resolving module symbols > amplxe: Warning: Cannot locate file `/usr/lib64/libcrypto.so.1.0.1e'. > amplxe: Warning: Cannot locate file `/lib64/libpthread-2.12.so'. > amplxe: Warning: Cannot locate file `/lib64/ld-2.12.so'. > amplxe: Warning: Cannot locate file `/lib64/libc-2.12.so'. > amplxe: Executing actions 16 % Resolving information for `libcrypto.so.1.0.1e' > amplxe: Warning: Cannot locate file `/usr/bin/ssh'. > amplxe: Executing actions 16 % Resolving information for `ssh' > amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.32-431.el6.x86_64/vmlinux'. > amplxe: Executing actions 50 % Generating a report > > General Exploration Metrics > --------------------------- > Parameter r000ah > --------- ------ > > Collection and Platform Info > ---------------------------- > Parameter r000ah > ------------------------ ---------------------- > Application Command Line ./SimpleMOC-kernel > Operating System 2.6.32-431.el6.x86_64 > Computer Name lucie.ftm.alcf.anl.gov > Result Size 1596019 > > CPU > --- > Parameter r000ah > ----------------- -------------------------- > Name Intel Xeon Phi coprocessor > Logical CPU Count 32 > > Summary > ------- > Elapsed Time: 0.000 > > Event summary > ------------- > Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample > ------------------- ------------------------- -------------------------------- ----------------- > cycles 196000 49 4000 > amplxe: Executing actions 100 % done > > On Wed, Jan 21, 2015 at 2:17 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > Hi John, > > I had a mistake in the license file. Please try it again. > > Ben > > > On Jan 21, 2015, at 10:54 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > > > Hey Ben, > > > > I'm not able to get the intel compiler to work. When I call "icc", it simply hangs and the call never returns. Perhaps it's trying to connect somewhere to verify the license file but it can't find it? > > > > Thanks for the help. > > > > -John > > > > On Tue, Jan 20, 2015 at 6:55 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > Hi John, > > > > The JLSE Intel license has been updated. Please let me know if you have any further issues. > > > > Ben > > > > > On Jan 20, 2015, at 10:39 AM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > > > > > Hi John, > > > > > > It appears our license expired on the 18th. Sorry I wasn't on top of that. I'll let you know when it's updated. > > > > > > Ben > > > > > >> On Jan 20, 2015, at 10:36 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >> > > >> Hey Ben, > > >> > > >> I'm trying to compile my code, but I seem to be getting license errors when trying to use the intel compiler (I'm using the same environment that had been working previously, I believe): > > >> > > >> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ make > > >> icc -std=gnu99 -mmic -O3 -ansi-alias -no-prec-div -DINTEL -fp-model fast=2 -openmp -DOPENMP -c main.c -o main.o > > >> > > >> Error: A license for CCompL is not available now (-97,121). > > >> > > >> A connection to the license server could not be made. You should > > >> make sure that your license daemon process is running: both an > > >> lmgrd process and an INTEL process should be running > > >> if your license limits you to a specified number of licenses in use > > >> at a time. Also, check to see if the wrong port@host or the wrong > > >> license file is being used, or if the port or hostname in the license > > >> file has changed. > > >> > > >> License file(s) used were (in this order): > > >> 1. Trusted Storage > > >> ** 2. 28518@ftsn2 > > >> ** 3. /soft/compilers/intel/composer_xe_2013_sp1.1.106/licenses > > >> ** 4. /opt/intel/licenses > > >> ** 5. /home/jtramm/intel/licenses > > >> ** 6. /soft/compilers/intel/composer_xe_2013_sp1.1.106/Licenses > > >> ** 7. /Users/Shared/Library/Application Support/Intel/Licenses > > >> ** 8. /soft/compilers/intel/composer_xe_2013_sp1.1.106/bin/intel64/*.lic > > >> > > >> Please visit http://software.intel.com/sites/support/ if you require technical assistance. > > >> > > >> icc: error #10052: could not checkout FLEXlm license > > >> make: *** [main.o] Error 1 > > >> > > >> On Fri, Jan 16, 2015 at 10:33 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >> Ben, > > >> > > >> That sounds like a good plan. Thanks for the help! > > >> > > >> -John > > >> > > >> On Thu, Jan 15, 2015 at 3:05 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > >> Hi John, > > >> > > >> Assuming /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel is the actual app you're trying to profile, I can start with the packages referenced in the "Cannot locate debugging symbols" below. > > >> > > >> Ben > > >> > > >>> On Jan 14, 2015, at 8:15 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>> > > >>> Hey Ben, > > >>> > > >>> Thanks for doing this! I would ideally like all of the packages installed, as I'm not sure which ones I need and which I don't. My app doesn't have any outside dependencies, and it really just uses pretty normal C and OpenMP includes, so I'm guessing if it has issues with just that I will probably need them all (unless you have reason to believe otherwise). > > >>> > > >>> Thanks again! > > >>> > > >>> -John > > >>> > > >>> On Wed, Jan 14, 2015 at 6:58 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > >>> Hi John, > > >>> > > >>> Yea I can do this. I should be able to get to it sometime this week, at worst early next week. Do you want all of the dbg packages installed, or do you have a specific list you want? > > >>> > > >>> Ben > > >>> > > >>>> On Jan 14, 2015, at 11:21 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>>> > > >>>> Ben, > > >>>> > > >>>> I tried running through the CLI mode, and had the same problems. It would be really great if you could install the required packages, as Vtune offers a lot in terms of performance analysis that can't be done any other way on the MIC. I understand the desire to keep the install bloat to a minimum, but Vtune is pretty essential to working with the MIC. I'm really in the dark as to what's going on with my application without being able to use Vtune, as even simple things like grpof don't work on there. > > >>>> > > >>>> Here's what I'm getting: > > >>>> > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ export INTEL_LICENSE_FILE=28518@ftsn2 > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > > >>>> Copyright (C) 2009-2014 Intel Corporation. All rights reserved. > > >>>> Intel(R) VTune(TM) Amplifier XE 2015 (build 380310) > > >>>> jtramm@lucie:~/SimpleMOC-kernel/src/cpu$ amplxe-cl -collect advanced-hotspots -target-system=mic-native:0 -- /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > > >>>> amplxe: Using target: mic-native:0 > > >>>> amplxe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: amplxe-cl -r /home/jtramm/SimpleMOC-kernel/src/cpu/r001ah -command stop. > > >>>> amplxe: Collection stopped. > > >>>> amplxe: Using result path `/home/jtramm/SimpleMOC-kernel/src/cpu/r001ah' > > >>>> amplxe: Executing actions 16 % Resolving module symbols > > >>>> amplxe: Locating file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux' on the remote system > > >>>> amplxe: Locating file `/boot/vmlinuz-2.6.38.8+mpss3.4.2' on the remote system > > >>>> amplxe: Executing actions 16 % Resolving information for `libc-2.14.90.so' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libc-2.14.90.so/45397051311f95599054edd6ac8d616d/libc-2.14.90.so'. > > >>>> amplxe: Locating file `vmlinux-2.6.38.8+mpss3.4.2' on the remote system > > >>>> amplxe: Locating file `/boot/vmlinuz' on the remote system > > >>>> amplxe: Executing actions 16 % Resolving information for `ld-2.14.90.so' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/ld-2.14.90.so/5152c3600c8161c8d9c8d152b5ad591e/ld-2.14.90.so'. > > >>>> amplxe: Executing actions 17 % Resolving information for `ld-2.14.90.so' > > >>>> amplxe: Locating file `intel_micveth.ko' on the remote system > > >>>> amplxe: Warning: Cannot locate file `/usr/lib/debug/lib/modules/2.6.38.8+mpss3.4.2/vmlinux'. > > >>>> amplxe: Executing actions 18 % Resolving information for dangling locations > > >>>> amplxe: Warning: Cannot locate file `intel_micveth.ko'. > > >>>> amplxe: Executing actions 18 % Resolving information for `libgnutls.so.26.22.0' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgnutls.so.26.22.0/9d99eae1cacffaa3f20e5a2312f69282/libgnutls.so.26.22.0'. > > >>>> amplxe: Executing actions 18 % Resolving information for `libgcrypt.so.11.7.0' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libgcrypt.so.11.7.0/587958b33eac1b807e852f640262da62/libgcrypt.so.11.7.0'. > > >>>> amplxe: Executing actions 19 % Resolving information for `libnss_ldap-2.12.2.so > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libnss_ldap-2.12.2.so/0d6aa4bfd689f60ef5b0b94edf8d3ed1/libnss_ldap-2.12.2.so'. > > >>>> amplxe: Executing actions 19 % Resolving information for `sshd' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/sshd/4354ab1d5cd53de91c85d8abe4000899/sshd'. > > >>>> amplxe: Executing actions 19 % Resolving information for `libcrypto.so.1.0.0' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libcrypto.so.1.0.0/2fc14f872d9ca6c49501676046029554/libcrypto.so.1.0.0'. > > >>>> amplxe: Executing actions 20 % Resolving information for `libtasn1.so.3.1.13' > > >>>> amplxe: Warning: Cannot locate debugging symbols for file `/tmp/amplxe-tmp-jtramm/modules.mic-native_0/libtasn1.so.3.1.13/0ba82903ca399644d103aed874e3ba7c/libtasn1.so.3.1.13'. > > >>>> amplxe: Executing actions 50 % Generating a report > > >>>> > > >>>> General Exploration Metrics > > >>>> --------------------------- > > >>>> Parameter r001ah > > >>>> -------------------- --------- > > >>>> CPU Time 0.300 > > >>>> Clockticks 372000558 > > >>>> Instructions Retired 95333238 > > >>>> CPI Rate 3.902 > > >>>> Cache Usage 0.0 > > >>>> Vectorization Usage 0.0 > > >>>> TLB Usage 0.0 > > >>>> > > >>>> Collection and Platform Info > > >>>> ---------------------------- > > >>>> Parameter r001ah > > >>>> ------------------------ ----------------------------------------------------------------- > > >>>> Application Command Line /home/jtramm/SimpleMOC-kernel/src/cpu/SimpleMOC-kernel > > >>>> User Name jtramm > > >>>> Operating System Intel MIC Platform Software Stack (Built by Poky 7.0) 3.4.2 \n \l > > >>>> Computer Name lucie-mic0.ftm.alcf.anl.gov > > >>>> Result Size 2272316 > > >>>> > > >>>> CPU > > >>>> --- > > >>>> Parameter r001ah > > >>>> ----------------- -------------------------- > > >>>> Name Intel Xeon Phi coprocessor > > >>>> Frequency 1238000000 > > >>>> Logical CPU Count 244 > > >>>> > > >>>> Summary > > >>>> ------- > > >>>> Elapsed Time: 0.392 > > >>>> CPU Time: 0.300 > > >>>> Average CPU Usage: 0.548 > > >>>> CPI Rate: 3.902 > > >>>> > > >>>> Event summary > > >>>> ------------- > > >>>> Hardware Event Type Hardware Event Count:Self Hardware Event Sample Count:Self Events Per Sample > > >>>> --------------------- ------------------------- -------------------------------- ----------------- > > >>>> CPU_CLK_UNHALTED 372000558 186 2000003 > > >>>> INSTRUCTIONS_EXECUTED 95333238 77 1238094 > > >>>> amplxe: Executing actions 100 % done > > >>>> > > >>>> > > >>>> Thanks for your help! > > >>>> > > >>>> -John > > >>>> > > >>>> On Wed, Jan 7, 2015 at 2:44 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > >>>> I have little to no experience with VTune. However looking at the screen cap the kernel modules referenced can be found on the MIC at: > > >>>> > > >>>> /lib/modules/2.6.38.8+mpss3.4.2/extra/vnet/intel_micveth.ko > > >>>> /sep3.15/sep3_15-k1om-2.6.38.8+mpss3.4.2smp.ko > > >>>> > > >>>> If I'd have to guess, the debugging symbols are missing because I don't have any of the k1om debug packages installed on the MICs themselves, i.e. "dbg" RPMs from http://registrationcenter.intel.com/irc_nas/5017/mpss-3.4.2-k1om.tar. I try to keep the packages installed directly on the MICs to a minimum as they appear to sit in a RAM disk. > > >>>> > > >>>> Perhaps try running with CLI version of Vtune, amplxe-cl to see if it outputs anymore useful information? > > >>>> > > >>>> Example: > > >>>> > > >>>> export INTEL_LICENSE_FILE=28518@ftsn2 > > >>>> source /soft/compilers/intel/vtune_amplifier_xe/amplxe-vars.sh > > >>>> amplxe-cl -collect advanced-hotspots -target-system=mic-native ls -CF /usr/bin > > >>>> > > >>>> Ben > > >>>> > > >>>> > > >>>>> On Jan 7, 2015, at 1:07 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>>>> > > >>>>> Ben, > > >>>>> > > >>>>> Thanks for re-deploying - it definitely seems to have helped. I'm now able to run the vtune GUI. > > >>>>> > > >>>>> However, now I'm running into a new issue. When I run vtune from the host, in order to analyze an app run on the device, it doesn't appear to be launching successfully (i.e., nothing is output to the terminal, and the resulting vtune analysis says the code only ran for a fraction of a second, when it should be at least several seconds on the MIC). > > >>>>> > > >>>>> It also outputs this set of errors when running my project: > > >>>>> > > >>>>> <Screen Shot 2015-01-07 at 12.56.50 PM.png> > > >>>>> > > >>>>> > > >>>>> Can you think of anything that might cause this? > > >>>>> > > >>>>> Thanks again so much for your help! > > >>>>> > > >>>>> -John Tramm > > >>>>> > > >>>>> > > >>>>> On Wed, Jan 7, 2015 at 12:47 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > >>>>> Hi John, > > >>>>> > > >>>>> The RHEL6 image was missing libXxf86vm, I've re-deployed the three servers (Ruth, Lucie, Jenny) with libXxf86vm installed. I've also updated "sep", which is the sampling kernel module for both the MIC and the host. I doesn't look like Intel included the Power sampling kernel module with Vtune Amplifier XE 2015 however, ie. /soft/compilers/intel/vtune_amplifier_xe_2013/powerdk/src. > > >>>>> > > >>>>> Let me know if you run into any more problems. > > >>>>> > > >>>>> Ben > > >>>>> > > >>>>>> On Jan 6, 2015, at 2:50 PM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>>>>> > > >>>>>> Ben, > > >>>>>> > > >>>>>> I'm trying to use vtune to analyze performance of my application on the mic. I can't seem to get Vtune to run on the host node (either lucie or jenny). I keep getting the following error: > > >>>>>> > > >>>>>> amplxe-gui: error while loading shared libraries: libXxf86vm.so.1: cannot open shared object file: No such file or directory > > >>>>>> > > >>>>>> There seems to be a shared library file missing somewhere that I can't seem to find. Perhaps I need to add something to my linker path? > > >>>>>> > > >>>>>> Thanks for your help! > > >>>>>> > > >>>>>> -John > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> On Tue, Jan 6, 2015 at 10:35 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>>>>> Allen, > > >>>>>> > > >>>>>> Yes, everything seems to be working great now. Thanks! > > >>>>>> > > >>>>>> -John > > >>>>>> > > >>>>>> On Mon, Jan 5, 2015 at 2:26 PM, Allen, Benjamin S. <bsallen(a)alcf.anl.gov> wrote: > > >>>>>> Hi John, > > >>>>>> > > >>>>>> This should be fixed. Let me know if you run into further issues. > > >>>>>> > > >>>>>> Ben > > >>>>>> > > >>>>>>> On Jan 5, 2015, at 11:53 AM, John Tramm <jtramm(a)mcs.anl.gov> wrote: > > >>>>>>> > > >>>>>>> Greetings, > > >>>>>>> > > >>>>>>> I'm trying to use the JLSE MIC nodes, but I can't seem to get my home directory to show up on mic0 itself. It is available on the host, but it doesn't seem to be able to connect on the MIC. I recall a few months ago I was able to access my home dir on the mic. > > >>>>>>> > > >>>>>>> Do I need to run anything to get access to the home dir? > > >>>>>>> > > >>>>>>> Thanks! > > >>>>>>> > > >>>>>>> -John Tramm > > >>>>>>> _______________________________________________ > > >>>>>>> Admins mailing list > > >>>>>>> Admins(a)lists.jlse.anl.gov > > >>>>>>> https://lists.jlse.anl.gov/mailman/listinfo/admins > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>> > > >>>>> > > >>>> > > >>>> > > >>> > > >>> > > >> > > >> > > >> > > > > > > > > >

1 0

Re: [JLSE-Admins] Home full on jenny
by Krishna, Jayesh 22 Jan '15

22 Jan '15

Thanks! -Jayesh ________________________________________ From: Allen, Benjamin S. Sent: Thursday, January 22, 2015 10:29 AM To: Krishna, Jayesh Cc: admins(a)jlse.anl.gov Subject: Re: [JLSE-Admins] Home full on jenny As a quick fix, I grew ft_home to 768GB, and set it to autogrow upto a 1TB. ft_home and ft_soft are currently hosted by one of ALCF's production NetApp filers, so we have fancy functionality like that. On my back burner is settings up ~40TB GPFS filesystem thats dedicated to JLSE. Once it's setup we'll migrate ft_home and ft_soft to it. Ben > On Jan 22, 2015, at 10:13 AM, Krishna, Jayesh <jayesh(a)mcs.anl.gov> wrote: > > Hi, > The home directory is full on Jenny. > > [jayesh@jenny]bash$:~/software/esmf$ df > Filesystem 1K-blocks Used Available Use% Mounted on > none 33036144 2379852 30656292 8% / > tmpfs 33036144 0 33036144 0% /dev/shm > /dev/sda1 39693864 416044 37277328 2% /var > /dev/sda2 154123936 191948 146164564 1% /tmp > /dev/sdb1 193818908 191816 183859172 1% /mnt/ssd1 > garfunkel-b:/vol/ft_home 536870912 535853776 1017136 100% /home > garfunkel-b:/vol/ft_soft/x86_64 99614720 82698416 16916304 84% /sof > > Regards, > Jayesh > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

Re: [JLSE-Admins] Home full on jenny
by Allen, Benjamin S. 22 Jan '15

22 Jan '15

As a quick fix, I grew ft_home to 768GB, and set it to autogrow upto a 1TB. ft_home and ft_soft are currently hosted by one of ALCF's production NetApp filers, so we have fancy functionality like that. On my back burner is settings up ~40TB GPFS filesystem thats dedicated to JLSE. Once it's setup we'll migrate ft_home and ft_soft to it. Ben > On Jan 22, 2015, at 10:13 AM, Krishna, Jayesh <jayesh(a)mcs.anl.gov> wrote: > > Hi, > The home directory is full on Jenny. > > [jayesh@jenny]bash$:~/software/esmf$ df > Filesystem 1K-blocks Used Available Use% Mounted on > none 33036144 2379852 30656292 8% / > tmpfs 33036144 0 33036144 0% /dev/shm > /dev/sda1 39693864 416044 37277328 2% /var > /dev/sda2 154123936 191948 146164564 1% /tmp > /dev/sdb1 193818908 191816 183859172 1% /mnt/ssd1 > garfunkel-b:/vol/ft_home 536870912 535853776 1017136 100% /home > garfunkel-b:/vol/ft_soft/x86_64 99614720 82698416 16916304 84% /sof > > Regards, > Jayesh > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

Re: [JLSE-Admins] Home full on jenny
by Allen, Benjamin S. 22 Jan '15

22 Jan '15

Yea I know. Now to find who did it. Ben > On Jan 22, 2015, at 10:13 AM, Krishna, Jayesh <jayesh(a)mcs.anl.gov> wrote: > > Hi, > The home directory is full on Jenny. > > [jayesh@jenny]bash$:~/software/esmf$ df > Filesystem 1K-blocks Used Available Use% Mounted on > none 33036144 2379852 30656292 8% / > tmpfs 33036144 0 33036144 0% /dev/shm > /dev/sda1 39693864 416044 37277328 2% /var > /dev/sda2 154123936 191948 146164564 1% /tmp > /dev/sdb1 193818908 191816 183859172 1% /mnt/ssd1 > garfunkel-b:/vol/ft_home 536870912 535853776 1017136 100% /home > garfunkel-b:/vol/ft_soft/x86_64 99614720 82698416 16916304 84% /sof > > Regards, > Jayesh > _______________________________________________ > Admins mailing list > Admins(a)lists.jlse.anl.gov > https://lists.jlse.anl.gov/mailman/listinfo/admins

1 0

[JLSE-Admins] Home full on jenny
by Krishna, Jayesh 22 Jan '15

22 Jan '15

Hi, The home directory is full on Jenny. [jayesh@jenny]bash$:~/software/esmf$ df Filesystem 1K-blocks Used Available Use% Mounted on none 33036144 2379852 30656292 8% / tmpfs 33036144 0 33036144 0% /dev/shm /dev/sda1 39693864 416044 37277328 2% /var /dev/sda2 154123936 191948 146164564 1% /tmp /dev/sdb1 193818908 191816 183859172 1% /mnt/ssd1 garfunkel-b:/vol/ft_home 536870912 535853776 1017136 100% /home garfunkel-b:/vol/ft_soft/x86_64 99614720 82698416 16916304 84% /sof Regards, Jayesh

1 0