June 2017 - Allocations-admins - mailman3.cels.anl.gov

Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2
by Aithal, Shashikant M. 28 Jun '17

28 Jun '17

Yes, I will. Thanks, Shashi ________________________________ From: Bair, Raymond A. Sent: Wednesday, June 28, 2017 10:16 AM To: Aithal, Shashikant M. Cc: LCRC Allocations Admins Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2 Shashi, Please follow up with them in my absence. Thanks, Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago From: "Aithal, Shashikant M." <aithal(a)cels.anl.gov> Date: Wednesday, June 28, 2017 at 7:27 AM To: Raymond Bair <rbair(a)anl.gov> Cc: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2 Ray: I do not. I did see that it was a big request. Seeing the team members it looks like Yassry Gohar's team. They have not provided any computational details about the core-hours/job and typical number of jobs etc. They also want 490 K for Q3 which has 3 days left! We can ask them for more computational details and give them 150K for Q4. Shashi ________________________________ From: Bair, Raymond A. Sent: Tuesday, June 27, 2017 7:29 PM To: Aithal, Shashikant M. Cc: LCRC Allocations Admins Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2 Shashi, This is a big request. Do you know about this team’s project? Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/27/17, 4:47 PM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: alberto talamo Applicant's institution: ANL Applicant's division: NE Project Name: ibr2 Project title: IBR-2M Transient Associated funding: NNSA M3 Other Systems: eddy cluster of NE Science: The transient of the IBR-2M research reactor of Russia will be simulated using the Serpent and OpenFOAM software and the simulations results will be compared with the experimental data. At present, no neutronics software can model the IBR-2M transient because the reactor is moderated by two reflectors rotating, in opposite directions, very rapidly and this invalidates the point kinetics equations that are inside the computer programs used in nuclear engineering. The precursor-based delayed neutron emission model, unique of the Serpent software, does not rely on the point kinetics equations and can successfully model the IBR-2M transient. Serpent is developed at VTT Technical Research Center of Finland. During the transient, the reactor changes from subcritical to supercritical and delivers a peak power of 1,850 MW. Serpent simulations will model the rotation of the two movable reflectors and the thermal feedback from the power excursion of the IBR-2M reactor will be modeled using the OpenFOAM CFD software developed at Argonne National Laboratory. The IBR-2M reactor uses high enriched plutonium fuel, has a fast neutron spectrum, and is cooled by sodium. Argonne National Laboratory has an outstanding record in the design and modeling of sodium cooled nuclear reactors. Project description: The IBR-2M research reactor is located in Dubna (Russia) and has been in operation since the end of 2011. The facility mainly consists of a sodium-cooled pulsed nuclear reactor loading high-enriched plutonium fuel. Two reflectors, that rotate in opposite directions generate, for about 200 ms, a neutron pulse and change the reactor configuration from deep subcritical to supercritical. Supercriticality is reached when both nickel reflectors are aligned with the fuel zone. The blades of the two rotating reflectors are made of nickel alloy; the main rotating reflector blade has two rounded rectangle holes, whereas the auxiliary rotating reflector blade has just one rounded rectangular hole. The nickel blades are attached to steel blade-holders. In the fuel rods zone, the fuel assembly has hexagonal shape and contains 7 fuel rods and 6 steel displacers. The average thermal power during the pulse repetition period is 2 MWth; the peak thermal power is 1830 MWth. The previous number reduces to 0.16 MWth when the reflectors are not aligned with the fuel. The IBR-2M reactor includes: the core (containing the fuel rods and the fuel assemblies), the vessel, the stationary and rotating reflectors, the control rods in the stationary reflector, the cooling system of the stationary and rotating reflectors, and the shielding. The facility is used for experiments in many branches of physics, including: condensed matter, biology, chemistry, and material science. The IBR-2M reactor has been modeled using the Serpent software (written in C laguage and developed at VTT Finland) at Argonne National Laboratory using stereolithography (STL) geometry with unstructured meshes. In the STL geometry representation, volumes are defined by the union of triangular surfaces (facets). When SERPENT uses the STL geometry, it defines a regular lattice of cells superimposed to the STL geometry and starts a ray-tracing procedure from the triangular surfaces. This ray-tracing procedure defines the volume that a neutron enters after crossing a triangular facet and is referred to as adaptive search mesh. The adaptive search mesh algorithm of SERPENT attaches to each STL facet a list of the intersected regular lattice cells. The latter define a rectangular bounding box containing the minimum and maximum values of the three vertices of the triangular facets. The adaptive search mesh algorithm for the STL geometry has been introduced in the Serpent software to reduce the computing time. The rotating reflector blades move so fast that point kinetics equations fail to accurately model the power transient. The Serpent software does not use point kinetics equations, it relies on the precursor-based delayed neutrons emission model, and can accurately describe the power transient. The objective of this project is modeling the IBR-2M transient by the Serpent software and including the thermal-hydraulic feedback by the OpenFOAM software. The milestones of the project are the following: 1. perform the IBR-2M Serpent simulation of the power transient without any thermahydraulics feedback; 2. achieving a strong scalability for the simulations at point 1; 3. repeating the IBR-2M analyses with the inclusion of the thermalhydraulics feedback from OpenFOAM simulations. The simulation of the IBR-2M research reactor transient will be accomplished by the following team: â€¢ Dr. Alberto Talamo (ANL USA) will be responsible for the project coordination, the geometry modeling of the IBR-2M research reactor, and the Serpent simulations. â€¢ Dr. Jaakko LeppÃ¤nen (VTT Finland) is the head of the Serpent development team, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Ville Valtavirta (VTT Finland) has written the moving geometry and thermal feedback subroutines of the Serpent software, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Yousry Gohar (ANL USA) is Argonne National Laboratory fellow, he has more than 40 years experience in nuclear engineering and will act as advisor for accomplishing high fidelity simulations. The only member of the team who will access the Blues cluster is Dr. Alberto Talamo. Industry partnership: Project URL: http://flnph.jinr.ru/en/facilities/ibr-2 IBR-2<http://flnph.jinr.ru/en/facilities/ibr-2> flnph.jinr.ru The IBR-2 reactor hall. Virtual excursion on the complex of spectrometers of the IBR-2 pulsed reactor. The IBR-2 reactor with its unique technical approach produces ... Requested allocation: 980000 Q1: 0 Q2: 0 Q3: 490000 Q4: 490000 Justification: A static simulation (no transient) of the IBR-2M reactor takes 2 days using 32 cores of the eddy cluster of the NE division. Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php LCRC Accounts - Log In<https://accounts.lcrc.anl.gov/projects.php> accounts.lcrc.anl.gov You have to login in order to access this restricted page. You may login with one of the following: your LCRC username and password; this is the password you ... Thank You, The LCRC Accounts System

1 0

Re: [allocations-admins] [LCRC Accounts] Project Allocation Request
by Bair, Raymond A. 28 Jun '17

28 Jun '17

Please add 26170 to project Meso for Q3. ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/28/17, 8:41 AM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A change in allocation has been requested: Requester: heinonen (Olle Heinonen) Project: Meso Title: Mesoscale computational materials science Description: This project has three thrusts: (i) development of computational codes and algorithms for mesoscale modeling of inhomogeneous materials systems and applications of these codes, (ii) modeling of magnetic micron- and nano-scale systems, and (iii) first-principle modeling of metal/oxide/metal heterostructures and complex oxides. In the first thrust, we are developing scalable finite element codes for coupled elastic-ferroic systems, as well as charged particles immersed in a dielectric fluid subjected to electric fields. The code developments build on libraries such as libmesh and PETSc to achieve portable, scalable and highly efficiently parallelized codes. In particular, we are developing codes that combine fast-multipole methods with boundary element methods (FMM-BEM)to calculate long-range electrostatic and magnetostatic fields from bound and free surface charges. Within the MOOSE framework, we are also developing solvers for coupled ferroelectric/ferromagnetic-elastic systems. We will in the coming year integrate the FMM-BEM method with the MOOSE framework and apply the codes to study ferroelectric or ferromagnetic thin films and nanoparticles, as well as inhomogeneous composite multiferroic systems. We are in contact with a number of experimental groups with which we expect to collaborate. The work in this first thrust is integrated into codes under the MICCoM computational materials center led by Giulia Galli. The codes developed under this thrust are also massively scalable to leadership-class computer platforms. The programming language for these developments is C++. As we move from development to production phases we expect to run on up to 248 cores on fusion and blues. The MOOSE framework has been shown to scale almost linearly up to some 100k cores on BG/Q without any BG/Q-specific optimization. For the FMM-BEM method we have already shown linear scaling with the number of cores (using hybrid MPI-threading) to hundreds of cores. In the second thrust we are modeling static and dynamic magnet configurations in a variety of magnetic systems. This work is in collaboration with a number of experimental groups at Argonne and around the world. The workhorse of this thrust is a homemade micromagnetic code, or set of codes, in FORTRAN90 parallellized using OpenMP in addition to mkl libraries (in particular mkl dft); they only run on one node at a time but have been optimized and are highly efficient, typically running at 95% efficiency on eight to 32 cores. These runs typically consume one node on fusion or blues (all cores on the node), including the msd queue's Haswell nodes for one to 30 wall-hours. In thrust (iii), we are using the SIESTA/smeagol (a development version), quantum espresso (QE) and FHI-aims density functional theory based codes. All have been built and optimized for blues/fusion and we can routinely run on up to a few hundred cores (up to some tens of thousand cores on BG/Q) using hybrid parallelization (smeagol) or just MPI tasks (QE and FHI-aims). We are continuing to model electronic structure and transport properties of oxide heterostructures and complex oxides. The focus is shifting a bit FY2017 since this thrust will be aligned with the BES-funded computational materials center (led by ORNL). We expect there to be about seven members in this project (PI, two co-PIs, three post-docs and one graduate student). Current: undetermined amount Justification: The codes we will use have all been tested and optimized and run efficiently on blues. Requested: 26170 A specific reason has been given: We are out of our allocation for this quarter and need some more core-hours until next allocation July 1; also need to go into the new quarter with positive or at least zero balance This needs to be approved and the final allocation amount decided upon. Thank You, The LCRC Accounts System _______________________________________________ allocations-admins mailing list allocations-admins(a)lcrc.anl.gov https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2
by Bair, Raymond A. 28 Jun '17

28 Jun '17

Shashi, Please follow up with them in my absence. Thanks, Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago From: "Aithal, Shashikant M." <aithal(a)cels.anl.gov> Date: Wednesday, June 28, 2017 at 7:27 AM To: Raymond Bair <rbair(a)anl.gov> Cc: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2 Ray: I do not. I did see that it was a big request. Seeing the team members it looks like Yassry Gohar's team. They have not provided any computational details about the core-hours/job and typical number of jobs etc. They also want 490 K for Q3 which has 3 days left! We can ask them for more computational details and give them 150K for Q4. Shashi ________________________________ From: Bair, Raymond A. Sent: Tuesday, June 27, 2017 7:29 PM To: Aithal, Shashikant M. Cc: LCRC Allocations Admins Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2 Shashi, This is a big request. Do you know about this team’s project? Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/27/17, 4:47 PM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: alberto talamo Applicant's institution: ANL Applicant's division: NE Project Name: ibr2 Project title: IBR-2M Transient Associated funding: NNSA M3 Other Systems: eddy cluster of NE Science: The transient of the IBR-2M research reactor of Russia will be simulated using the Serpent and OpenFOAM software and the simulations results will be compared with the experimental data. At present, no neutronics software can model the IBR-2M transient because the reactor is moderated by two reflectors rotating, in opposite directions, very rapidly and this invalidates the point kinetics equations that are inside the computer programs used in nuclear engineering. The precursor-based delayed neutron emission model, unique of the Serpent software, does not rely on the point kinetics equations and can successfully model the IBR-2M transient. Serpent is developed at VTT Technical Research Center of Finland. During the transient, the reactor changes from subcritical to supercritical and delivers a peak power of 1,850 MW. Serpent simulations will model the rotation of the two movable reflectors and the thermal feedback from the power excursion of the IBR-2M reactor will be modeled using the OpenFOAM CFD software developed at Argonne National Laboratory. The IBR-2M reactor uses high enriched plutonium fuel, has a fast neutron spectrum, and is cooled by sodium. Argonne National Laboratory has an outstanding record in the design and modeling of sodium cooled nuclear reactors. Project description: The IBR-2M research reactor is located in Dubna (Russia) and has been in operation since the end of 2011. The facility mainly consists of a sodium-cooled pulsed nuclear reactor loading high-enriched plutonium fuel. Two reflectors, that rotate in opposite directions generate, for about 200 ms, a neutron pulse and change the reactor configuration from deep subcritical to supercritical. Supercriticality is reached when both nickel reflectors are aligned with the fuel zone. The blades of the two rotating reflectors are made of nickel alloy; the main rotating reflector blade has two rounded rectangle holes, whereas the auxiliary rotating reflector blade has just one rounded rectangular hole. The nickel blades are attached to steel blade-holders. In the fuel rods zone, the fuel assembly has hexagonal shape and contains 7 fuel rods and 6 steel displacers. The average thermal power during the pulse repetition period is 2 MWth; the peak thermal power is 1830 MWth. The previous number reduces to 0.16 MWth when the reflectors are not aligned with the fuel. The IBR-2M reactor includes: the core (containing the fuel rods and the fuel assemblies), the vessel, the stationary and rotating reflectors, the control rods in the stationary reflector, the cooling system of the stationary and rotating reflectors, and the shielding. The facility is used for experiments in many branches of physics, including: condensed matter, biology, chemistry, and material science. The IBR-2M reactor has been modeled using the Serpent software (written in C laguage and developed at VTT Finland) at Argonne National Laboratory using stereolithography (STL) geometry with unstructured meshes. In the STL geometry representation, volumes are defined by the union of triangular surfaces (facets). When SERPENT uses the STL geometry, it defines a regular lattice of cells superimposed to the STL geometry and starts a ray-tracing procedure from the triangular surfaces. This ray-tracing procedure defines the volume that a neutron enters after crossing a triangular facet and is referred to as adaptive search mesh. The adaptive search mesh algorithm of SERPENT attaches to each STL facet a list of the intersected regular lattice cells. The latter define a rectangular bounding box containing the minimum and maximum values of the three vertices of the triangular facets. The adaptive search mesh algorithm for the STL geometry has been introduced in the Serpent software to reduce the computing time. The rotating reflector blades move so fast that point kinetics equations fail to accurately model the power transient. The Serpent software does not use point kinetics equations, it relies on the precursor-based delayed neutrons emission model, and can accurately describe the power transient. The objective of this project is modeling the IBR-2M transient by the Serpent software and including the thermal-hydraulic feedback by the OpenFOAM software. The milestones of the project are the following: 1. perform the IBR-2M Serpent simulation of the power transient without any thermahydraulics feedback; 2. achieving a strong scalability for the simulations at point 1; 3. repeating the IBR-2M analyses with the inclusion of the thermalhydraulics feedback from OpenFOAM simulations. The simulation of the IBR-2M research reactor transient will be accomplished by the following team: â€¢ Dr. Alberto Talamo (ANL USA) will be responsible for the project coordination, the geometry modeling of the IBR-2M research reactor, and the Serpent simulations. â€¢ Dr. Jaakko LeppÃ¤nen (VTT Finland) is the head of the Serpent development team, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Ville Valtavirta (VTT Finland) has written the moving geometry and thermal feedback subroutines of the Serpent software, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Yousry Gohar (ANL USA) is Argonne National Laboratory fellow, he has more than 40 years experience in nuclear engineering and will act as advisor for accomplishing high fidelity simulations. The only member of the team who will access the Blues cluster is Dr. Alberto Talamo. Industry partnership: Project URL: http://flnph.jinr.ru/en/facilities/ibr-2 IBR-2<http://flnph.jinr.ru/en/facilities/ibr-2> flnph.jinr.ru The IBR-2 reactor hall. Virtual excursion on the complex of spectrometers of the IBR-2 pulsed reactor. The IBR-2 reactor with its unique technical approach produces ... Requested allocation: 980000 Q1: 0 Q2: 0 Q3: 490000 Q4: 490000 Justification: A static simulation (no transient) of the IBR-2M reactor takes 2 days using 32 cores of the eddy cluster of the NE division. Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php LCRC Accounts - Log In<https://accounts.lcrc.anl.gov/projects.php> accounts.lcrc.anl.gov You have to login in order to access this restricted page. You may login with one of the following: your LCRC username and password; this is the password you ... Thank You, The LCRC Accounts System

1 0

Re: [allocations-admins] [LCRC Accounts] Project Allocation Request
by Roberts, John E. 28 Jun '17

28 Jun '17

This time has been granted. -- John Roberts Argonne National Laboratory CELS Systems jeroberts(a)anl.gov On 6/27/17, 4:09 PM, "allocations-admins on behalf of Bair, Raymond A." <allocations-admins-bounces(a)lcrc.anl.gov on behalf of rbair(a)anl.gov> wrote: This request looks OK to me. In the past, FOAM has only requested time when they needed it, and they have a reasonable justification. Recommend we approve. Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/26/17, 11:16 PM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A change in allocation has been requested: Requester: jacob (Robert Jacob) Project: foam Title: Global Climate Modeling with the Fast Ocean Atmosphere Model Description: Our major objectives for FY15 focus on the ensemble based parameter estimation and coupled data assimilation in a coupled ocean-atmosphere general circulation model (CGCM). We will use FOAM as the CGCM. The uncertainties of model parameters are one of the important sources of model bias in a CGCM. The traditional method of tuning parameters through trial-and-error sensitivity experiments is subjective and very inefficient. An ensemble-based filter (EnKF) potentially provides a novel approach for systematic parameter estimation in a CGCM. In FY14 we have successful implemented ensemble based parameter estimation in FOAM for both single parameter estimation and multiple parameter in a twin model framework. In FY15 we will continue this study. We will investigate the ensemble based parameter estimation using real observations. We have successfully developed a coupled data assimilation system in FOAM using EnKF in FY13 and FY14. However the coupled data assimilation system is far from mature. In FY15 we will continue to work on the improvement of the system. We mainly focus on improving the analysis quality by applying coupled covariance to ocean. We also will investigate the challenges of coupled data assimilation using real observations and test some possible solutions. In FY15, We will further investigate the coupled data assimilation and parameter estimation in FOAM this year. We will investigate single and multi-parameter estimations in FOAM using real observations. We will use model short time forecast and long-term variabilities of model simulation to valid the estimations Good parameter estimation requires good data assimilation. We also need to refine our pure data assimilation skills that will provide support for us to estimate parameter using real observation in the future. We will investigate the effect of coupled covariance to the quality of analysis data in both perfect framework and real world system. For the parameter estimation experiments, we request fifty members (50 copies) will be used for each experiment. We expect about 150 different sets of experiments for parameter estimation. We measured the cost of 1 core-hours per simulated year. Each simulation should take 30 years such that the total model years are: 1. Parameter estimation experiments: 50x30x150 = 225k hours For the validation of parameter estimation, we request 200 10-year forecast experiments and 30 100-year assimilations. The total model years for the experiments are: 2. Parameter estimation validation 50*(100*30+200*10)=250k hours For the improvement of coupled data assimilation and the testing in both perfect framework and real world system we also request 150 different sets of experiments. Each experiment uses fifty members and 30 model years. 3. Pure data assimilation experiments for improving the system 50x30x150 = 225k hours Total core hours for experiments: 225+225+250=700k core hours Current: undetermined amount Justification: The total experiments are independent and can be run simultaneously. FOAM is very scalable between 4 and 64 processors. We choose to run an individual ensemble member on 16 or 32 because the additional parallelism comes from the ensemble members. We could effectively use the entire machine if it was available. Requested: 100000 A specific reason has been given: We will be running some experiments with the data-assimilation version of FOAM to perpare a technical paper on its design. This needs to be approved and the final allocation amount decided upon. Thank You, The LCRC Accounts System _______________________________________________ allocations-admins mailing list allocations-admins(a)lcrc.anl.gov https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins _______________________________________________ allocations-admins mailing list allocations-admins(a)lcrc.anl.gov https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins

1 0

[LCRC Accounts] Project Allocation Request
by accounts＠lcrc.anl.gov 28 Jun '17

28 Jun '17

Hello, A change in allocation has been requested: Requester: heinonen (Olle Heinonen) Project: Meso Title: Mesoscale computational materials science Description: This project has three thrusts: (i) development of computational codes and algorithms for mesoscale modeling of inhomogeneous materials systems and applications of these codes, (ii) modeling of magnetic micron- and nano-scale systems, and (iii) first-principle modeling of metal/oxide/metal heterostructures and complex oxides. In the first thrust, we are developing scalable finite element codes for coupled elastic-ferroic systems, as well as charged particles immersed in a dielectric fluid subjected to electric fields. The code developments build on libraries such as libmesh and PETSc to achieve portable, scalable and highly efficiently parallelized codes. In particular, we are developing codes that combine fast-multipole methods with boundary element methods (FMM-BEM)to calculate long-range electrostatic and magnetostatic fields from bound and free surface charges. Within the MOOSE framework, we are also developing solvers for coupled ferroelectric/ferromagnetic-elastic systems. We will in the coming year integrate the FMM-BEM method with the MOOSE framework and apply the codes to study ferroelectric or ferromagnetic thin films and nanoparticles, as well as inhomogeneous composite multiferroic systems. We are in contact with a number of experimental groups with which we expect to collaborate. The work in this first thrust is integrated into codes under the MICCoM computational materials center led by Giulia Galli. The codes developed under this thrust are also massively scalable to leadership-class computer platforms. The programming language for these developments is C++. As we move from development to production phases we expect to run on up to 248 cores on fusion and blues. The MOOSE framework has been shown to scale almost linearly up to some 100k cores on BG/Q without any BG/Q-specific optimization. For the FMM-BEM method we have already shown linear scaling with the number of cores (using hybrid MPI-threading) to hundreds of cores. In the second thrust we are modeling static and dynamic magnet configurations in a variety of magnetic systems. This work is in collaboration with a number of experimental groups at Argonne and around the world. The workhorse of this thrust is a homemade micromagnetic code, or set of codes, in FORTRAN90 parallellized using OpenMP in addition to mkl libraries (in particular mkl dft); they only run on one node at a time but have been optimized and are highly efficient, typically running at 95% efficiency on eight to 32 cores. These runs typically consume one node on fusion or blues (all cores on the node), including the msd queue's Haswell nodes for one to 30 wall-hours. In thrust (iii), we are using the SIESTA/smeagol (a development version), quantum espresso (QE) and FHI-aims density functional theory based codes. All have been built and optimized for blues/fusion and we can routinely run on up to a few hundred cores (up to some tens of thousand cores on BG/Q) using hybrid parallelization (smeagol) or just MPI tasks (QE and FHI-aims). We are continuing to model electronic structure and transport properties of oxide heterostructures and complex oxides. The focus is shifting a bit FY2017 since this thrust will be aligned with the BES-funded computational materials center (led by ORNL). We expect there to be about seven members in this project (PI, two co-PIs, three post-docs and one graduate student). Current: undetermined amount Justification: The codes we will use have all been tested and optimized and run efficiently on blues. Requested: 26170 A specific reason has been given: We are out of our allocation for this quarter and need some more core-hours until next allocation July 1; also need to go into the new quarter with positive or at least zero balance This needs to be approved and the final allocation amount decided upon. Thank You, The LCRC Accounts System

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2
by Aithal, Shashikant M. 28 Jun '17

28 Jun '17

Ray: I do not. I did see that it was a big request. Seeing the team members it looks like Yassry Gohar's team. They have not provided any computational details about the core-hours/job and typical number of jobs etc. They also want 490 K for Q3 which has 3 days left! We can ask them for more computational details and give them 150K for Q4. Shashi ________________________________ From: Bair, Raymond A. Sent: Tuesday, June 27, 2017 7:29 PM To: Aithal, Shashikant M. Cc: LCRC Allocations Admins Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2 Shashi, This is a big request. Do you know about this team’s project? Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/27/17, 4:47 PM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: alberto talamo Applicant's institution: ANL Applicant's division: NE Project Name: ibr2 Project title: IBR-2M Transient Associated funding: NNSA M3 Other Systems: eddy cluster of NE Science: The transient of the IBR-2M research reactor of Russia will be simulated using the Serpent and OpenFOAM software and the simulations results will be compared with the experimental data. At present, no neutronics software can model the IBR-2M transient because the reactor is moderated by two reflectors rotating, in opposite directions, very rapidly and this invalidates the point kinetics equations that are inside the computer programs used in nuclear engineering. The precursor-based delayed neutron emission model, unique of the Serpent software, does not rely on the point kinetics equations and can successfully model the IBR-2M transient. Serpent is developed at VTT Technical Research Center of Finland. During the transient, the reactor changes from subcritical to supercritical and delivers a peak power of 1,850 MW. Serpent simulations will model the rotation of the two movable reflectors and the thermal feedback from the power excursion of the IBR-2M reactor will be modeled using the OpenFOAM CFD software developed at Argonne National Laboratory. The IBR-2M reactor uses high enriched plutonium fuel, has a fast neutron spectrum, and is cooled by sodium. Argonne National Laboratory has an outstanding record in the design and modeling of sodium cooled nuclear reactors. Project description: The IBR-2M research reactor is located in Dubna (Russia) and has been in operation since the end of 2011. The facility mainly consists of a sodium-cooled pulsed nuclear reactor loading high-enriched plutonium fuel. Two reflectors, that rotate in opposite directions generate, for about 200 ms, a neutron pulse and change the reactor configuration from deep subcritical to supercritical. Supercriticality is reached when both nickel reflectors are aligned with the fuel zone. The blades of the two rotating reflectors are made of nickel alloy; the main rotating reflector blade has two rounded rectangle holes, whereas the auxiliary rotating reflector blade has just one rounded rectangular hole. The nickel blades are attached to steel blade-holders. In the fuel rods zone, the fuel assembly has hexagonal shape and contains 7 fuel rods and 6 steel displacers. The average thermal power during the pulse repetition period is 2 MWth; the peak thermal power is 1830 MWth. The previous number reduces to 0.16 MWth when the reflectors are not aligned with the fuel. The IBR-2M reactor includes: the core (containing the fuel rods and the fuel assemblies), the vessel, the stationary and rotating reflectors, the control rods in the stationary reflector, the cooling system of the stationary and rotating reflectors, and the shielding. The facility is used for experiments in many branches of physics, including: condensed matter, biology, chemistry, and material science. The IBR-2M reactor has been modeled using the Serpent software (written in C laguage and developed at VTT Finland) at Argonne National Laboratory using stereolithography (STL) geometry with unstructured meshes. In the STL geometry representation, volumes are defined by the union of triangular surfaces (facets). When SERPENT uses the STL geometry, it defines a regular lattice of cells superimposed to the STL geometry and starts a ray-tracing procedure from the triangular surfaces. This ray-tracing procedure defines the volume that a neutron enters after crossing a triangular facet and is referred to as adaptive search mesh. The adaptive search mesh algorithm of SERPENT attaches to each STL facet a list of the intersected regular lattice cells. The latter define a rectangular bounding box containing the minimum and maximum values of the three vertices of the triangular facets. The adaptive search mesh algorithm for the STL geometry has been introduced in the Serpent software to reduce the computing time. The rotating reflector blades move so fast that point kinetics equations fail to accurately model the power transient. The Serpent software does not use point kinetics equations, it relies on the precursor-based delayed neutrons emission model, and can accurately describe the power transient. The objective of this project is modeling the IBR-2M transient by the Serpent software and including the thermal-hydraulic feedback by the OpenFOAM software. The milestones of the project are the following: 1. perform the IBR-2M Serpent simulation of the power transient without any thermahydraulics feedback; 2. achieving a strong scalability for the simulations at point 1; 3. repeating the IBR-2M analyses with the inclusion of the thermalhydraulics feedback from OpenFOAM simulations. The simulation of the IBR-2M research reactor transient will be accomplished by the following team: â€¢ Dr. Alberto Talamo (ANL USA) will be responsible for the project coordination, the geometry modeling of the IBR-2M research reactor, and the Serpent simulations. â€¢ Dr. Jaakko LeppÃ¤nen (VTT Finland) is the head of the Serpent development team, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Ville Valtavirta (VTT Finland) has written the moving geometry and thermal feedback subroutines of the Serpent software, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Yousry Gohar (ANL USA) is Argonne National Laboratory fellow, he has more than 40 years experience in nuclear engineering and will act as advisor for accomplishing high fidelity simulations. The only member of the team who will access the Blues cluster is Dr. Alberto Talamo. Industry partnership: Project URL: http://flnph.jinr.ru/en/facilities/ibr-2 IBR-2<http://flnph.jinr.ru/en/facilities/ibr-2> flnph.jinr.ru The IBR-2 reactor hall. Virtual excursion on the complex of spectrometers of the IBR-2 pulsed reactor. The IBR-2 reactor with its unique technical approach produces ... Requested allocation: 980000 Q1: 0 Q2: 0 Q3: 490000 Q4: 490000 Justification: A static simulation (no transient) of the IBR-2M reactor takes 2 days using 32 cores of the eddy cluster of the NE division. Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php LCRC Accounts - Log In<https://accounts.lcrc.anl.gov/projects.php> accounts.lcrc.anl.gov You have to login in order to access this restricted page. You may login with one of the following: your LCRC username and password; this is the password you ... Thank You, The LCRC Accounts System

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: ibr2
by Bair, Raymond A. 27 Jun '17

27 Jun '17

Shashi, This is a big request. Do you know about this team’s project? Ray ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/27/17, 4:47 PM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: alberto talamo Applicant's institution: ANL Applicant's division: NE Project Name: ibr2 Project title: IBR-2M Transient Associated funding: NNSA M3 Other Systems: eddy cluster of NE Science: The transient of the IBR-2M research reactor of Russia will be simulated using the Serpent and OpenFOAM software and the simulations results will be compared with the experimental data. At present, no neutronics software can model the IBR-2M transient because the reactor is moderated by two reflectors rotating, in opposite directions, very rapidly and this invalidates the point kinetics equations that are inside the computer programs used in nuclear engineering. The precursor-based delayed neutron emission model, unique of the Serpent software, does not rely on the point kinetics equations and can successfully model the IBR-2M transient. Serpent is developed at VTT Technical Research Center of Finland. During the transient, the reactor changes from subcritical to supercritical and delivers a peak power of 1,850 MW. Serpent simulations will model the rotation of the two movable reflectors and the thermal feedback from the power excursion of the IBR-2M reactor will be modeled using the OpenFOAM CFD software developed at Argonne National Laboratory. The IBR-2M reactor uses high enriched plutonium fuel, has a fast neutron spectrum, and is cooled by sodium. Argonne National Laboratory has an outstanding record in the design and modeling of sodium cooled nuclear reactors. Project description: The IBR-2M research reactor is located in Dubna (Russia) and has been in operation since the end of 2011. The facility mainly consists of a sodium-cooled pulsed nuclear reactor loading high-enriched plutonium fuel. Two reflectors, that rotate in opposite directions generate, for about 200 ms, a neutron pulse and change the reactor configuration from deep subcritical to supercritical. Supercriticality is reached when both nickel reflectors are aligned with the fuel zone. The blades of the two rotating reflectors are made of nickel alloy; the main rotating reflector blade has two rounded rectangle holes, whereas the auxiliary rotating reflector blade has just one rounded rectangular hole. The nickel blades are attached to steel blade-holders. In the fuel rods zone, the fuel assembly has hexagonal shape and contains 7 fuel rods and 6 steel displacers. The average thermal power during the pulse repetition period is 2 MWth; the peak thermal power is 1830 MWth. The previous number reduces to 0.16 MWth when the reflectors are not aligned with the fuel. The IBR-2M reactor includes: the core (containing the fuel rods and the fuel assemblies), the vessel, the stationary and rotating reflectors, the control rods in the stationary reflector, the cooling system of the stationary and rotating reflectors, and the shielding. The facility is used for experiments in many branches of physics, including: condensed matter, biology, chemistry, and material science. The IBR-2M reactor has been modeled using the Serpent software (written in C laguage and developed at VTT Finland) at Argonne National Laboratory using stereolithography (STL) geometry with unstructured meshes. In the STL geometry representation, volumes are defined by the union of triangular surfaces (facets). When SERPENT uses the STL geometry, it defines a regular lattice of cells superimposed to the STL geometry and starts a ray-tracing procedure from the triangular surfaces. This ray-tracing procedure defines the volume that a neutron enters after crossing a triangular facet and is referred to as adaptive search mesh. The adaptive search mesh algorithm of SERPENT attaches to each STL facet a list of the intersected regular lattice cells. The latter define a rectangular bounding box containing the minimum and maximum values of the three vertices of the triangular facets. The adaptive search mesh algorithm for the STL geometry has been introduced in the Serpent software to reduce the computing time. The rotating reflector blades move so fast that point kinetics equations fail to accurately model the power transient. The Serpent software does not use point kinetics equations, it relies on the precursor-based delayed neutrons emission model, and can accurately describe the power transient. The objective of this project is modeling the IBR-2M transient by the Serpent software and including the thermal-hydraulic feedback by the OpenFOAM software. The milestones of the project are the following: 1. perform the IBR-2M Serpent simulation of the power transient without any thermahydraulics feedback; 2. achieving a strong scalability for the simulations at point 1; 3. repeating the IBR-2M analyses with the inclusion of the thermalhydraulics feedback from OpenFOAM simulations. The simulation of the IBR-2M research reactor transient will be accomplished by the following team: â€¢ Dr. Alberto Talamo (ANL USA) will be responsible for the project coordination, the geometry modeling of the IBR-2M research reactor, and the Serpent simulations. â€¢ Dr. Jaakko LeppÃ¤nen (VTT Finland) is the head of the Serpent development team, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Ville Valtavirta (VTT Finland) has written the moving geometry and thermal feedback subroutines of the Serpent software, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. â€¢ Dr. Yousry Gohar (ANL USA) is Argonne National Laboratory fellow, he has more than 40 years experience in nuclear engineering and will act as advisor for accomplishing high fidelity simulations. The only member of the team who will access the Blues cluster is Dr. Alberto Talamo. Industry partnership: Project URL: http://flnph.jinr.ru/en/facilities/ibr-2 Requested allocation: 980000 Q1: 0 Q2: 0 Q3: 490000 Q4: 490000 Justification: A static simulation (no transient) of the IBR-2M reactor takes 2 days using 32 cores of the eddy cluster of the NE division. Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php Thank You, The LCRC Accounts System

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: eic
by Bair, Raymond A. 27 Jun '17

27 Jun '17

This looks fine. Recommend we approve 50K for Q3 and 100K for Q4. ----------------------------------------- Ray Bair Argonne National Laboratory and the University of Chicago On 6/27/17, 5:34 PM, "allocations-admins on behalf of accounts(a)lcrc.anl.gov" <allocations-admins-bounces(a)lcrc.anl.gov on behalf of accounts(a)lcrc.anl.gov> wrote: Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: Whitney Armstrong Applicant's institution: ANL Applicant's division: PHY Project Name: eic Project title: EIC Simulations Associated funding: ANL LDRD Other Systems: Science: We will be running detector simulations for the EIC. This will include running Monte Carlo event generators, running full detector (Geant4) simulations, and reconstructing the simulated data. The goal is to help guild the design and construction of the Electron Ion Collider and develop a new Argonne-led detector concept. Project description: We will run a variety of event generators. The main detector simulation will be Geant4 based. The reconstruction chain will have many interchangeable pieces and will be under active development. We will be using the blues and bebop systems. We will build and run ROOT (root.cern.ch), Geant4 (geant4.cern.ch), and many other interconnected libraries. The current code base is not currently tuned for HPC, mostly because the limitations of the Blue Gene to running the software needed. With the intel based machines, we can run the full software stack, however, we will need to work on maximizing the efficiency. This will be the primary focus of our initial work. Initially most of the jobs will be single core jobs but we plan on exploiting the parallelism and concurrency available in the hardware and software. Industry partnership: Project URL: Requested allocation: 150000 Q1: 0 Q2: 0 Q3: 50000 Q4: 100000 Justification: Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php Thank You, The LCRC Accounts System _______________________________________________ allocations-admins mailing list allocations-admins(a)lcrc.anl.gov https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins

1 0

[LCRC Accounts] Project Request: eic
by accounts＠lcrc.anl.gov 27 Jun '17

27 Jun '17

Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: Whitney Armstrong Applicant's institution: ANL Applicant's division: PHY Project Name: eic Project title: EIC Simulations Associated funding: ANL LDRD Other Systems: Science: We will be running detector simulations for the EIC. This will include running Monte Carlo event generators, running full detector (Geant4) simulations, and reconstructing the simulated data. The goal is to help guild the design and construction of the Electron Ion Collider and develop a new Argonne-led detector concept. Project description: We will run a variety of event generators. The main detector simulation will be Geant4 based. The reconstruction chain will have many interchangeable pieces and will be under active development. We will be using the blues and bebop systems. We will build and run ROOT (root.cern.ch), Geant4 (geant4.cern.ch), and many other interconnected libraries. The current code base is not currently tuned for HPC, mostly because the limitations of the Blue Gene to running the software needed. With the intel based machines, we can run the full software stack, however, we will need to work on maximizing the efficiency. This will be the primary focus of our initial work. Initially most of the jobs will be single core jobs but we plan on exploiting the parallelism and concurrency available in the hardware and software. Industry partnership: Project URL: Requested allocation: 150000 Q1: 0 Q2: 0 Q3: 50000 Q4: 100000 Justification: Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php Thank You, The LCRC Accounts System

1 0

[LCRC Accounts] Project Request: ibr2
by accounts＠lcrc.anl.gov 27 Jun '17

27 Jun '17

Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: alberto talamo Applicant's institution: ANL Applicant's division: NE Project Name: ibr2 Project title: IBR-2M Transient Associated funding: NNSA M3 Other Systems: eddy cluster of NE Science: The transient of the IBR-2M research reactor of Russia will be simulated using the Serpent and OpenFOAM software and the simulations results will be compared with the experimental data. At present, no neutronics software can model the IBR-2M transient because the reactor is moderated by two reflectors rotating, in opposite directions, very rapidly and this invalidates the point kinetics equations that are inside the computer programs used in nuclear engineering. The precursor-based delayed neutron emission model, unique of the Serpent software, does not rely on the point kinetics equations and can successfully model the IBR-2M transient. Serpent is developed at VTT Technical Research Center of Finland. During the transient, the reactor changes from subcritical to supercritical and delivers a peak power of 1,850 MW. Serpent simulations will model the rotation of the two movable reflectors and the thermal feedback from the power excursion of the IBR-2M reactor will be modeled using the OpenFOAM CFD software developed at Argonne National Laboratory. The IBR-2M reactor uses high enriched plutonium fuel, has a fast neutron spectrum, and is cooled by sodium. Argonne National Laboratory has an outstanding record in the design and modeling of sodium cooled nuclear reactors. Project description: The IBR-2M research reactor is located in Dubna (Russia) and has been in operation since the end of 2011. The facility mainly consists of a sodium-cooled pulsed nuclear reactor loading high-enriched plutonium fuel. Two reflectors, that rotate in opposite directions generate, for about 200 ms, a neutron pulse and change the reactor configuration from deep subcritical to supercritical. Supercriticality is reached when both nickel reflectors are aligned with the fuel zone. The blades of the two rotating reflectors are made of nickel alloy; the main rotating reflector blade has two rounded rectangle holes, whereas the auxiliary rotating reflector blade has just one rounded rectangular hole. The nickel blades are attached to steel blade-holders. In the fuel rods zone, the fuel assembly has hexagonal shape and contains 7 fuel rods and 6 steel displacers. The average thermal power during the pulse repetition period is 2 MWth; the peak thermal power is 1830 MWth. The previous number reduces to 0.16 MWth when the reflectors are not aligned with the fuel. The IBR-2M reactor includes: the core (containing the fuel rods and the fuel assemblies), the vessel, the stationary and rotating reflectors, the control rods in the stationary reflector, the cooling system of the stationary and rotating reflectors, and the shielding. The facility is used for experiments in many branches of physics, including: condensed matter, biology, chemistry, and material science. The IBR-2M reactor has been modeled using the Serpent software (written in C laguage and developed at VTT Finland) at Argonne National Laboratory using stereolithography (STL) geometry with unstructured meshes. In the STL geometry representation, volumes are defined by the union of triangular surfaces (facets). When SERPENT uses the STL geometry, it defines a regular lattice of cells superimposed to the STL geometry and starts a ray-tracing procedure from the triangular surfaces. This ray-tracing procedure defines the volume that a neutron enters after crossing a triangular facet and is referred to as adaptive search mesh. The adaptive search mesh algorithm of SERPENT attaches to each STL facet a list of the intersected regular lattice cells. The latter define a rectangular bounding box containing the minimum and maximum values of the three vertices of the triangular facets. The adaptive search mesh algorithm for the STL geometry has been introduced in the Serpent software to reduce the computing time. The rotating reflector blades move so fast that point kinetics equations fail to accurately model the power transient. The Serpent software does not use point kinetics equations, it relies on the precursor-based delayed neutrons emission model, and can accurately describe the power transient. The objective of this project is modeling the IBR-2M transient by the Serpent software and including the thermal-hydraulic feedback by the OpenFOAM software. The milestones of the project are the following: 1. perform the IBR-2M Serpent simulation of the power transient without any thermahydraulics feedback; 2. achieving a strong scalability for the simulations at point 1; 3. repeating the IBR-2M analyses with the inclusion of the thermalhydraulics feedback from OpenFOAM simulations. The simulation of the IBR-2M research reactor transient will be accomplished by the following team: • Dr. Alberto Talamo (ANL USA) will be responsible for the project coordination, the geometry modeling of the IBR-2M research reactor, and the Serpent simulations. • Dr. Jaakko Leppänen (VTT Finland) is the head of the Serpent development team, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. • Dr. Ville Valtavirta (VTT Finland) has written the moving geometry and thermal feedback subroutines of the Serpent software, he will provide the support to efficiently run the Serpent software program and act as consultant for the Serpent simulations. • Dr. Yousry Gohar (ANL USA) is Argonne National Laboratory fellow, he has more than 40 years experience in nuclear engineering and will act as advisor for accomplishing high fidelity simulations. The only member of the team who will access the Blues cluster is Dr. Alberto Talamo. Industry partnership: Project URL: http://flnph.jinr.ru/en/facilities/ibr-2 Requested allocation: 980000 Q1: 0 Q2: 0 Q3: 490000 Q4: 490000 Justification: A static simulation (no transient) of the IBR-2M reactor takes 2 days using 32 cores of the eddy cluster of the NE division. Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php Thank You, The LCRC Accounts System

1 0