January 2020 - Ecp-aurora-sdk-discuss

ComputeCpp v1.3.0 available
by Christopher Knight 31 Jan '20

31 Jan '20

Just an FYI that the sycl_codeplay modules have been updated to point to v1.3.0 this morning. This is the version that ‘module load sycl_codeplay’ will make accessible. The README file has been updated with reported improvements and bug fixes. chris ============= Community Edition 1.3.0 New features ARM Mali public driver support for HiKey 960 devices. User experience may vary dependant on SYCL ecosystem application. Configuration option scheduler_sleep_time_ns for setting scheduler sleep time (Professional Edition only) LLVM version updated to 8 Improvement Improvements to configuration options computecpp_info reports target bitcodes supported by each device Minor scheduler improvements Bug Fixes Fixed cl::sycl::memory_order not compatible with C++20 Various minor device compiler and runtime fixes

1 0

New A21 SDK available in JLSE
by Rosales-fernandez, Carlos 30 Jan '20

30 Jan '20

Hi all, We are pleased to announce that a new A21 SDK has been deployed in JLSE. This version 2020.01.30.005 includes multiple improvements and bug fixes. For additional details please refer to the latest release notes in the Wiki: https://wiki.jlse.anl.gov/display/inteldga/DGA+SDK+Release+Notes Modules will enable the newer SDK by default, but the older versions remain available for regression testing. As usual, please let us know of any issues you encounter and any improvements we can include. Important note: The new release of Intel Advisor requires python 3.6 when using any of the Offload Advisor python scripts (collect.py, analyze.py, run_oa.py). This works well with the system python3 default in the iris nodes, but will not work with the system “python” command, which defaults to 2.7.5. This change may affect some of your scripts. The RSNDA version of Advisor is built in a different manner and supports both Python2 and Python3. Regards, Carlos

1 0

Update to A21 SDK coming this afternoon
by Rosales-fernandez, Carlos 30 Jan '20

30 Jan '20

Hi all, An update of the current A21 SDK will be installed in JLSE today. Around 3pm CST the default modulefiles will switch to the new version. Running jobs will not be affected by this update. A confirmation message with further details will be sent after the update is complete. Regards, Carlos

1 0

Re: [Ecp-aurora-sdk-discuss] vtune information and concurrent gpu kernels
by Bertoni, Colleen 20 Jan '20

20 Jan '20

Hi Charles, With the Iris Node OS Upgrade that Ben did last week, the Vtune error should be fixed now. Could you give it a try and let us know? Thanks, Colleen ________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Charles Leggett via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Friday, December 13, 2019 4:58 PM To: ecp-aurora-sdk-discuss(a)jlse.anl.gov <ecp-aurora-sdk-discuss(a)jlse.anl.gov> Subject: [Ecp-aurora-sdk-discuss] vtune information and concurrent gpu kernels I'm looking at the output of some trivial kernels, and have some questions: - can we run vtune on the iris nodes with the new SDK from 11/15? When I tried to run just now, I got this error: vtune: Error: The following events cannot be collected: UNC_IMC_DRAM_DATA_READS,UNC_IMC_DRAM_DATA_WRITES. Consider removing the events from the collection, loading the VTune Profiler (beta) sampling driver using the root credentials, or updating the OS kernel. vtune: Collection failed. this was the command: > vtune -collect gpu-offload -knob enable-stack-collection=true -target-duration-type=veryshort -finalization-mode=full -- PROGRAM - running the publicly available beta 0.3 on my desktop, vtune doesn't show the name of the function being executed in the graphs (see image attached), it just shows "func @ memory address". The programs are compiled with -g, and if I click on the relevant line in the "CPU Time" window, it shows the source, so it can indeed find it. Double clicking on the CPU chart bar, produces a page that says "Source / assembly code for the selected object is not available. Possible reasons are:.... (and a bunch of reasons)". The debug info should be available. Are there special opts for the compilation other than "-g" that one should use? - the GPU kernels are very small (parallel_for is only 1024 wide), have no data dependencies between them, and should be able to run concurrently. They are submitted from separate std::threads using a shared sycl::queue. What is preventing them from running concurrently? thanks, Charles. -- Charles Leggett <CGLeggett(a)lbl.gov<mailto:[email protected]>> Lawrence Berkeley National Lab 1 Cyclotron Road, MS 50F-1650, Berkeley, CA 94720 tel: 510.495.2930

1 0

Iris Node OS Upgrade
by Allen, Benjamin S. 16 Jan '20

16 Jan '20

All, I'm upgrading the image on the Iris nodes to: 1. Distro: RHEL7.7 2. Kernel: 5.4.10-1.E3_v5_patched.el7.x86_64 - Patched to enable uncore_imc perf events on the E3-1500v5 series of CPUs. This allows VTune to collect UNC_IMC_DRAM_DATA_READS and UNC_IMC_DRAM_DATA_WRITES via perf when stack collection is enabled, eg: vtune -collect gpu-offload -knob collect-memory-bandwidth=true -knob enable-stack-collection=true -finalization-mode=full -- ./myApp. 3. Intel Vtune Sampling Drivers based on /soft/restricted/intel_dga/sdk/2019.11.15.015 This work is starting shortly. Please let me know if you see issues with the nodes afterwards. Thanks, Ben

1 0

Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK
by Huhn, William Paul 08 Jan '20

08 Jan '20

Thanks @Applencourt, Thomas<mailto:[email protected]> and @Videau, Brice<mailto:[email protected]>! I'll just go with one of the Gen 9.5s for now. P. S. @Harms, Kevin<mailto:[email protected]> Personally, I'll believe the NUC 9 when I see it. It looks like the thermals on those systems will be a nightmare. ________________________________ From: Applencourt, Thomas <tapplencourt(a)anl.gov> Sent: Wednesday, January 8, 2020 11:24 AM To: Huhn, William Paul <whuhn(a)anl.gov>; Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK In this case, I suggest indeed a Gen9.*. At least it will be able to run some toy double-precision calculations, and the back-end toolchain will be more mature. Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Huhn, William Paul <whuhn(a)anl.gov> Sent: Wednesday, January 8, 2020 10:09 To: Applencourt, Thomas <tapplencourt(a)anl.gov>; Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK I wasn't planning on any performance testing, just compilation and toy calculations, but that's good to know since I am solidly in the double precision camp. Should I just settle for the UHD Graphics 630 found in the i7-9850H, then? Seems to be the norm in the non-Xeon workstations. ________________________________ From: Applencourt, Thomas <tapplencourt(a)anl.gov> Sent: Wednesday, January 8, 2020 10:46 AM To: Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov>; Huhn, William Paul <whuhn(a)anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK As a remainder, the performance of Gen11 for double precision is horrible (double precision is emulated), so it depends on what kind of local development you want to do : ). Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Wednesday, January 8, 2020 09:23 To: Huhn, William Paul <whuhn(a)anl.gov>; ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK Hello Will, I have one of those myself, you can drop by my office and we can discuss it together if you want. My office is 1121. Brice On 08/01/2020 08:34, Huhn, William Paul via Ecp-aurora-sdk-discuss wrote: Hey all, Has anyone tried to run the SDK on one of the commercially available Gen 11 systems, specifically the Iris Plus Graphics G7 embedded in the i7-1065G7 (which appears to be the only option out there right now?) I'm shopping for a new laptop and was wondering if this would be viable for local development. - Will

1 0

Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK
by Applencourt, Thomas 08 Jan '20

08 Jan '20

In this case, I suggest indeed a Gen9.*. At least it will be able to run some toy double-precision calculations, and the back-end toolchain will be more mature. Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Huhn, William Paul <whuhn(a)anl.gov> Sent: Wednesday, January 8, 2020 10:09 To: Applencourt, Thomas <tapplencourt(a)anl.gov>; Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK I wasn't planning on any performance testing, just compilation and toy calculations, but that's good to know since I am solidly in the double precision camp. Should I just settle for the UHD Graphics 630 found in the i7-9850H, then? Seems to be the norm in the non-Xeon workstations. ________________________________ From: Applencourt, Thomas <tapplencourt(a)anl.gov> Sent: Wednesday, January 8, 2020 10:46 AM To: Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov>; Huhn, William Paul <whuhn(a)anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK As a remainder, the performance of Gen11 for double precision is horrible (double precision is emulated), so it depends on what kind of local development you want to do : ). Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Wednesday, January 8, 2020 09:23 To: Huhn, William Paul <whuhn(a)anl.gov>; ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK Hello Will, I have one of those myself, you can drop by my office and we can discuss it together if you want. My office is 1121. Brice On 08/01/2020 08:34, Huhn, William Paul via Ecp-aurora-sdk-discuss wrote: Hey all, Has anyone tried to run the SDK on one of the commercially available Gen 11 systems, specifically the Iris Plus Graphics G7 embedded in the i7-1065G7 (which appears to be the only option out there right now?) I'm shopping for a new laptop and was wondering if this would be viable for local development. - Will

1 0

Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK
by Harms, Kevin 08 Jan '20

08 Jan '20

I don't know how this unit will turn on out or when it will be available but something to consider depending on what you're looking for: https://www.theverge.com/2020/1/7/21051879/intel-pc-nuc-9-extreme-ghost-can… kevin ________________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Huhn, William Paul via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Wednesday, January 8, 2020 10:09 AM To: Applencourt, Thomas; Videau, Brice via Ecp-aurora-sdk-discuss Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK I wasn't planning on any performance testing, just compilation and toy calculations, but that's good to know since I am solidly in the double precision camp. Should I just settle for the UHD Graphics 630 found in the i7-9850H, then? Seems to be the norm in the non-Xeon workstations. ________________________________ From: Applencourt, Thomas <tapplencourt(a)anl.gov> Sent: Wednesday, January 8, 2020 10:46 AM To: Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov>; Huhn, William Paul <whuhn(a)anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK As a remainder, the performance of Gen11 for double precision is horrible (double precision is emulated), so it depends on what kind of local development you want to do : ). Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Wednesday, January 8, 2020 09:23 To: Huhn, William Paul <whuhn(a)anl.gov>; ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK Hello Will, I have one of those myself, you can drop by my office and we can discuss it together if you want. My office is 1121. Brice On 08/01/2020 08:34, Huhn, William Paul via Ecp-aurora-sdk-discuss wrote: Hey all, Has anyone tried to run the SDK on one of the commercially available Gen 11 systems, specifically the Iris Plus Graphics G7 embedded in the i7-1065G7 (which appears to be the only option out there right now?) I'm shopping for a new laptop and was wondering if this would be viable for local development. - Will

1 0

Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK
by Huhn, William Paul 08 Jan '20

08 Jan '20

I wasn't planning on any performance testing, just compilation and toy calculations, but that's good to know since I am solidly in the double precision camp. Should I just settle for the UHD Graphics 630 found in the i7-9850H, then? Seems to be the norm in the non-Xeon workstations. ________________________________ From: Applencourt, Thomas <tapplencourt(a)anl.gov> Sent: Wednesday, January 8, 2020 10:46 AM To: Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov>; Huhn, William Paul <whuhn(a)anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK As a remainder, the performance of Gen11 for double precision is horrible (double precision is emulated), so it depends on what kind of local development you want to do : ). Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Wednesday, January 8, 2020 09:23 To: Huhn, William Paul <whuhn(a)anl.gov>; ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK Hello Will, I have one of those myself, you can drop by my office and we can discuss it together if you want. My office is 1121. Brice On 08/01/2020 08:34, Huhn, William Paul via Ecp-aurora-sdk-discuss wrote: Hey all, Has anyone tried to run the SDK on one of the commercially available Gen 11 systems, specifically the Iris Plus Graphics G7 embedded in the i7-1065G7 (which appears to be the only option out there right now?) I'm shopping for a new laptop and was wondering if this would be viable for local development. - Will

1 0

Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK
by Applencourt, Thomas 08 Jan '20

08 Jan '20

As a remainder, the performance of Gen11 for double precision is horrible (double precision is emulated), so it depends on what kind of local development you want to do : ). Thomas Applencourt Leadership Computing Facility Argonne National Laboratory Building 240 Office - 1.D.18 9700 S Cass Av., Lemont Il, 60439 (630) 252-0036 ________________________________ From: Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss-bounces(a)lists.jlse.anl.gov> on behalf of Videau, Brice via Ecp-aurora-sdk-discuss <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Sent: Wednesday, January 8, 2020 09:23 To: Huhn, William Paul <whuhn(a)anl.gov>; ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov <ecp-aurora-sdk-discuss(a)lists.jlse.anl.gov> Subject: Re: [Ecp-aurora-sdk-discuss] Gen 11 Support for SDK Hello Will, I have one of those myself, you can drop by my office and we can discuss it together if you want. My office is 1121. Brice On 08/01/2020 08:34, Huhn, William Paul via Ecp-aurora-sdk-discuss wrote: Hey all, Has anyone tried to run the SDK on one of the commercially available Gen 11 systems, specifically the Iris Plus Graphics G7 embedded in the i7-1065G7 (which appears to be the only option out there right now?) I'm shopping for a new laptop and was wondering if this would be viable for local development. - Will

1 0