August 2017 - Allocations-admins - mailman3.cels.anl.gov

New LCRC report submitted for IntensitySim
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=IntensitySim

1 0

New LCRC report submitted for ignition-plasma
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=ignition-plas…

1 0

New LCRC report submitted for GDI_lean_burn
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=GDI_lean_burn

1 0

New LCRC report submitted for FOA_dual_fuel
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=FOA_dual_fuel

1 0

New LCRC report submitted for Comp_POP_Catalysts
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=Comp_POP_Cata…

1 0

New LCRC report submitted for PROTEUS_APP
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=PROTEUS_APP

1 0

Outstanding Allocations Questions 8/30/17
by Bair, Raymond A. 30 Aug '17

30 Aug '17

LCRC, Since I am traveling today, here are what I see as the open issues for LCRC Allocations this week. Radix, request to add 500K. Ray sent to Allocations Committee for decision. 3DDES, early user/new project, requests interim 1M in Q4 on Bebop. Ray sent to Allocations Committee for decision. See new project requests below. These did not come in as “year allocation”. Do they want FY17 start? Or, do we need to move these to the FY18 allocation requests? Please check with PIs. NEMphyValidation, 80K IP-ML, 250K BEM_Uncertainty, 55K in Q4 REMM, 483K in Q4 ATLAS-HEP-group, 100K in Q4 Regards, Ray

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: 3DDES
by Bair, Raymond A. 30 Aug '17

30 Aug '17

Ramesh, Your 1M request has been sent to the LCRC Allocations Committee for their decision. Regards, Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago From: "Balakrishnan, Ramesh" <bramesh(a)alcf.anl.gov> Date: Monday, August 28, 2017 at 3:51 PM To: "Aithal, Shashikant M." <aithal(a)cels.anl.gov> Cc: "Balakrishnan, Ramesh" <bramesh(a)alcf.anl.gov>, Raymond Bair <rbair(a)anl.gov> Subject: Re: [LCRC Accounts] Project Request: 3DDES Thanks, Shashi. Just sent in an interim allocation request of 1M core hours for 3DDES from (08/28, 09/30], 2017. Ramesh On Aug 28, 2017, at 3:03 PM, Aithal, Shashikant M. <aithal(a)cels.anl.gov<mailto:[email protected]>> wrote: You can send in an allocation request for FY2017 (from now till end of Sept). Your FY2018 begins in October 2017. You will have to send in a time request to support(a)lcrc.anl.gov<mailto:[email protected]>, since the website is now set-up for next year's allocation. Shashi ________________________________ From: Balakrishnan, Ramesh Sent: Monday, August 28, 2017 2:55 PM To: Aithal, Shashikant M. Cc: Balakrishnan, Ramesh; Bair, Raymond A. Subject: Re: [LCRC Accounts] Project Request: 3DDES Shashi, Is there something I can do from now to mid-September, by way of a small pilot allocation, on Bebop? Thanks, Ramesh On Aug 28, 2017, at 2:52 PM, Aithal, Shashikant M. <aithal(a)cels.anl.gov<mailto:[email protected]>> wrote: Thanks, Ramesh. The allocation committee will be meeting around mid-September and based on the total time-requests from all projects and available time, we would be able to determine the time that can be alloted to your project. Shashi ________________________________ From: Balakrishnan, Ramesh Sent: Monday, August 28, 2017 2:43 PM To: Bair, Raymond A.; Aithal, Shashikant M. Subject: Fwd: [LCRC Accounts] Project Request: 3DDES Hello Ray, Shashi, I sent in the following request for a project allocation on Bebop. Do let me know if you have any questions regarding my request. Thanks, Ramesh Begin forwarded message: From: <accounts(a)lcrc.anl.gov<mailto:[email protected]>> Subject: [LCRC Accounts] Project Request: 3DDES Date: August 28, 2017 at 11:52:19 AM CDT To: <bramesh(a)lcrc.anl.gov<mailto:[email protected]>> Reply-To: <accounts(a)lcrc.anl.gov<mailto:[email protected]>> Ramesh Balakrishnan, Thank you for your project request. It has been sent to the LCRC Allocations Committee for consideration. You will be notified when a decision is made. Below is a copy of your request, for your records: Applicant's Name: Ramesh Balakrishnan Applicant's Division: LCF Project Name: 3DDES Project Title: Detached Eddy Simulation of Separated High Reynolds Number Flows Associated Funding: ASCR Funding via ALCF Other Systems: Theta, Mira, Bebop Science: I am requesting 10M core hours, for the whole year, on Bebop, to develop detached eddy simulation models that can serve as a wall model for moderately separated flow in thick boundary layers. Examples of such flow are the atmospheric boundary layer (ABL) over complex terrain, large eddy breakup devices (LEBU), and separated flow past airfoils at high angles of attack (i.e. greater than 10 degrees). Project Description: Preliminary simulations of the ABL over Complex Terrain have been carried out on Bebop during the Early User Period, where the PI had an opportunity to run and test out modified version(s) of OpenFOAM, SU2, and FDL3DI on Bebop. The simulations were run on meshes ranging from 28M grid points to 140M grid points, and on a maximum of 4096 cores of Bebop. The codes make use of MPI and can optionally use OpenMP. In addition, one can vectorize the code for the KNL nodes (in which case OpenMP is not needed at all). During the early user period, the vectorization and OpenMP options were not tested out. The flat MPI codes do scale well on both the KNL and Broadwell nodes, although the time-to-solution is about five to six times slower on the KNL nodes (when compared to the Broadwell nodes). This is something that I plan to investigate in more detail as part of this allocation request. Industry Partnership: None at this time. Project URL: Requested allocation: 10000000 for Q1: 2500000 for Q2: 2500000 for Q3: 2500000 for Q4: 2500000 Efficiency: modified OpenFOAM: 35,000 finite volumes per core (on smallest number of cores) ======================================= cores time/time_step 4096 (KNL) 27 seconds (64 cores/node x 64 nodes) 2048 (KNL) 43 seconds (64 cores/node x 32 nodes) 1024 (KNL) 75 seconds (64 cores/node x 16 nodes) 4096 (BDW) 2 seconds (32 cores/node x 128 nodes) 2048 (BDW) 5 seconds (32 cores/node x 64 nodes) Please note that the 10M core hours (for the whole year) is requested on Bebop. 1024 (BDW) 12 seconds (32 cores/node x 32 nodes) modified SU2: 12,000 finite volumes per core (on smallest # of cores) ================================= solver cores time/time_step FV 1024 (KNL) 11 seconds FE_DG (p4) 1024 (KNL) 16 seconds (same # finite volumes/core) FV 2048 (KNL) 8 seconds FE_DG (p4) 2048 (KNL) 11 seconds (same # finite volumes per core) Storage Requirements: 5TB I will be generating quite a few time slices of the simulation. The LCRC Accounts System

1 0

New LCRC report submitted for UrbanAir
by support＠lcrc.anl.gov 30 Aug '17

30 Aug '17

Full project report at https://accounts.lcrc.anl.gov/reporting/project/2017/?project=UrbanAir

1 0

Re: [allocations-admins] [lcrc-core] Allocation question
by Bair, Raymond A. 30 Aug '17

30 Aug '17

That sounds fine. Thanks, Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago From: "Sergienko, Stanislav Y" <ssergien(a)anl.gov> Date: Monday, August 28, 2017 at 3:58 PM To: Raymond Bair <rbair(a)anl.gov> Subject: Re: [lcrc-core] Allocation question Ray, He requested reallocation for the DFT_ALD_SiC project. His 458K balance on blues is actually a mistake that I made. He was approved for only 150K hours. John added hours to it. Me not knowing that he added these hours I added more hours to it. His balance should be 158K instead of 458K. Should we just add additional 150K to his Bebop allocation in this case? Thanks. Stas Sergienko HPC System Admin From: "Bair, Raymond A." <rbair(a)anl.gov> Date: Monday, August 28, 2017 at 12:46 PM To: "Sergienko, Stanislav Y" <ssergien(a)anl.gov>, "lcrc-core(a)lcrc.anl.gov" <lcrc-core(a)lcrc.anl.gov> Subject: Re: [lcrc-core] Allocation question He has 2 projects: DFT_ALD_SiC 458K balance PF-gas-bubble 158K balance I do not see any problem with providing that much time on Bebop in Q4. Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago From: lcrc-core <lcrc-core-bounces(a)lists.lcrc.anl.gov> on behalf of "Sergienko, Stanislav Y" <ssergien(a)anl.gov> Date: Monday, August 28, 2017 at 11:14 AM To: LCRC Core <lcrc-core(a)lcrc.anl.gov> Subject: [lcrc-core] Allocation question Core, User Zhi-Gang Mei is asking if it is possible to reallocate all of his Blues hours to Bebop. Thanks. Stas Sergienko HPC System Admin

1 0