February 2012 - Allocations-admins - mailman3.cels.anl.gov

Re: [allocations-admins] Fwd: a request of new allocation for project anl-dcc
by Steven Pieper 22 Feb '12

22 Feb '12

I do approve this request for more time. I note that (at their request) we gave anl-dcc most of its allocation in the 1st quarter. Unfortunately they weren't quite as ready as they thought they were and lost a lot of that allocation at the end of December. Since fusion was very full then, this unused allocation did not significantly impact fusion's use. Lately fusion looks quite empty, so it should not hurt to give them the additional allocation. Steve Steven C. Pieper: spieper(a)anl.gov Argonne National Laboratory, Physics Division, Bldg. 203, Argonne, IL 60439 Phone: 630-252-4232 Fax -6008 Secretary, Debra Morrison, -4100 On 02/22/2012 06:18 PM, John Valdes wrote: > FYI, another request from project anl-dcc. This is in addition to the > 50K we just recently gave them. Also, since they're asking for 200K > more for this quarter and our limit is 100K (or so), in principle I > think we'd need the Alloc Committee's approval for this, although > since Steve is this project's PoC on the committee, I'm sure his > approval will be sufficient. > > John > > ----- Forwarded message from Harry Lee<lee(a)phy.anl.gov> ----- > > Date: Wed, 22 Feb 2012 16:54:02 -0600 > From: Harry Lee<lee(a)phy.anl.gov> > To: support(a)lcrc.anl.gov > Cc: Steven Pieper<pieper(a)phy.anl.gov> > Subject: [lcrc-support #106852] a request of new allocation for project anl-dcc > Reply-To: support(a)lcrc.anl.gov, Harry Lee<lee(a)phy.anl.gov> > > > > > Dear LCRC Support Team: > > I would like to request a "new" allocation > of 200,000 hrs for the project "anl-dcc" (PI: tslee). > The justification of this request is given below. > > Thanks, > > Harry (PI (tslee) of the project "anl-dcc") > > ------------------------------------------------------------- > > Justification of the new allocation to the project "anl-dcc" (PI:tshlee) > > The project "anl-dcc" is for the Physics Division to complete > a DOE milestone HP3 to extract the nucleon resonances from the > data of Jefferson Laboratory. In an understanding with DOE, > we need to complete a paper on our results of this six-year effort > by March 31, 2012, when our association with Jefferson Laboratory > will be ended and a new project on this research subject > will start at Argonne. > > To meet this deadline, we had drastically increased our use of Fusion > in the past two months in performing large-scale chi**2-fits to > very extensive data of pion-nucleon and photon-nucleon reactions > (about 30,000 data points and about 50 parameters of the employed > reaction model need to be determined with high precision). > For each run, we typically used 240 processors and 24 hrs cpu > (about 5500 hrs charged to our account for each run). To complete > our task by March 31, we need to do at least 30 runs with the similar > hours for each run to get acceptable chi**2. > > We now only have about 45,000 hrs left in our account, and we thus > expect that our resource will be used completely by the end of > February, 2012. To complete this project by March 31, 2012 to > reach DOE milestone HP3, we here request an allocation of > 200,000 hrs to the project "anl-dcc". > > > > > > ----- End forwarded message -----

1 0

Fwd: a request of new allocation for project anl-dcc
by John Valdes 22 Feb '12

22 Feb '12

FYI, another request from project anl-dcc. This is in addition to the 50K we just recently gave them. Also, since they're asking for 200K more for this quarter and our limit is 100K (or so), in principle I think we'd need the Alloc Committee's approval for this, although since Steve is this project's PoC on the committee, I'm sure his approval will be sufficient. John ----- Forwarded message from Harry Lee <lee(a)phy.anl.gov> ----- Date: Wed, 22 Feb 2012 16:54:02 -0600 From: Harry Lee <lee(a)phy.anl.gov> To: support(a)lcrc.anl.gov Cc: Steven Pieper <pieper(a)phy.anl.gov> Subject: [lcrc-support #106852] a request of new allocation for project anl-dcc Reply-To: support(a)lcrc.anl.gov, Harry Lee <lee(a)phy.anl.gov> Dear LCRC Support Team: I would like to request a "new" allocation of 200,000 hrs for the project "anl-dcc" (PI: tslee). The justification of this request is given below. Thanks, Harry (PI (tslee) of the project "anl-dcc") ------------------------------------------------------------- Justification of the new allocation to the project "anl-dcc" (PI:tshlee) The project "anl-dcc" is for the Physics Division to complete a DOE milestone HP3 to extract the nucleon resonances from the data of Jefferson Laboratory. In an understanding with DOE, we need to complete a paper on our results of this six-year effort by March 31, 2012, when our association with Jefferson Laboratory will be ended and a new project on this research subject will start at Argonne. To meet this deadline, we had drastically increased our use of Fusion in the past two months in performing large-scale chi**2-fits to very extensive data of pion-nucleon and photon-nucleon reactions (about 30,000 data points and about 50 parameters of the employed reaction model need to be determined with high precision). For each run, we typically used 240 processors and 24 hrs cpu (about 5500 hrs charged to our account for each run). To complete our task by March 31, we need to do at least 30 runs with the similar hours for each run to get acceptable chi**2. We now only have about 45,000 hrs left in our account, and we thus expect that our resource will be used completely by the end of February, 2012. To complete this project by March 31, 2012 to reach DOE milestone HP3, we here request an allocation of 200,000 hrs to the project "anl-dcc". ----- End forwarded message -----

1 0

requests for Atmos_Chem and WRF-CHEM-GVAX
by John Valdes 20 Feb '12

20 Feb '12

Forwarding to allocations list so I don't lose track of this request. John ----- Forwarded message from Rao Kotamarthi <vrkotamarthi(a)anl.gov> ----- Date: Thu, 16 Feb 2012 13:00:14 -0600 From: Rao Kotamarthi <vrkotamarthi(a)anl.gov> To: "Bair, Raymond A." <rbair(a)anl.gov> Cc: "Valdes, John P." <valdes(a)mcs.anl.gov> Subject: Re: Fusion accounts Ray That should work. Thanks. Rao ----- Reply message ----- From: "Bair, Raymond A." <rbair(a)anl.gov> Date: Thu, Feb 16, 2012 12:30 pm Subject: Fusion accounts To: "Kotamarthi, Veerabhadra R." <vrkotamarthi(a)anl.gov> Cc: "Valdes, John P." <valdes(a)mcs.anl.gov> Rao, Is this what you need? >>>> WRF-CHEM-GVAX (256K nearly exhausted) >>>> Q1 128K (actual allocation) >>>> Q2 128K (actual allocation) add 120K to current allocation >>>> Q3 100K (requested) request 115K for Q3 >>>> Q4 50K (requested) request 115K for Q4 >>>> >>>> ATMOS_CHEM (all 40K has been used) >>>> Q1 10K (actual allocation) >>>> Q2 10K (actual allocation) add 20K to current allocation >>>> Q3 10K (actual allocation) request 40K >>>> Q4 10K (actual allocation) request 40K ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov Phone: (630)252-5751 ----- End forwarded message -----

1 0

Fwd: [lcrc-support #104946] request of 50, 000 hrs Fusion for project anl-dcc
by John Valdes 06 Feb '12

06 Feb '12

The PI for anl-dcc, Harry Lee, is asking that 50K from his 2nd half allocation be advanced now. FYI, he had requested 300K for the 1st half (split as 200K for 1st Qtr, 100K for 2nd Qtr) and was granted 250K (167K + 83K). He used about 40K during the 1st Qtr and 60K so far this quarter leaving anl-dcc w/ a current balance about 23K (since the unused 167K - 40K from the 1st Qtr expired on 12/31). He requested 100K (50K + 50K) for the 2nd half of the FY. https://www.lcrc.anl.gov/jazz/CSAC/project-reports-2012/Individual/anl-dcc.… OK to advance anl-dcc 50K? John ----- Forwarded message from Harry Lee <lee(a)phy.anl.gov> ----- Date: Mon, 06 Feb 2012 16:11:00 -0600 From: Harry Lee <lee(a)phy.anl.gov> To: systems(a)lcrc.anl.gov Subject: [lcrc-support #104946] request of 50,000 hrs Fusion for project anl-dcc Reply-To: support(a)lcrc.anl.gov, Harry Lee <lee(a)phy.anl.gov> Hi, I am the PI (username:tslee) of the project "anl-dcc" of Fusion. Since we are in the "final" production stage for the project anl-dcc to complete it by March 31, 2012 for this PHY's commitment to DOE, can we take out 50,000 hrs of the 2nd half year allocation to us and start to use this 50,000 hr now ? Thanks, Tsung-Shung H. Lee (tslee) ----- End forwarded message -----

1 0

Re: [allocations-admins] Allocation request
by Bair, Raymond A. 06 Feb '12

06 Feb '12

Yes, I approve. They are trying to finish up some studies for publication. Ray On 2/6/12 2:35 PM, "John Valdes" <valdes(a)mcs.anl.gov> wrote: > Ray Bair wrote: >> >> Rob Jacob requests Q2 advances of 100K for Foam and 100K for >> Climate_emulator. > > As PoC, I assume you approve? > > John > > _______________________________________________ > allocations-admins mailing list > allocations-admins(a)lists.lcrc.anl.gov > https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov Phone: (630)252-5751

1 0

Re: [allocations-admins] Allocation request
by John Valdes 06 Feb '12

06 Feb '12

Ray Bair wrote: > > Rob Jacob requests Q2 advances of 100K for Foam and 100K for > Climate_emulator. As PoC, I assume you approve? John

1 0

Allocation request
by John Valdes 06 Feb '12

06 Feb '12

----- Forwarded message from "Bair, Raymond A." <rbair(a)anl.gov> ----- Date: Mon, 6 Feb 2012 14:18:25 -0600 From: "Bair, Raymond A." <rbair(a)anl.gov> To: LCRC Support via RT <support(a)lcrc.anl.gov> Cc: LCRC Core <lcrc-core(a)lcrc.anl.gov> Subject: [lcrc-core] Allocation request Rob Jacob requests Q2 advances of 100K for Foam and 100K for Climate_emulator. Ray ------ Forwarded Message From: Rob Jacob <jacob(a)mcs.anl.gov> Date: Mon, 6 Feb 2012 14:15:56 -0600 To: Raymond Bair <rbair(a)anl.gov> Subject: Re: [LCRC Accounts] Your LCRC project has been given a new allocation Yes it would! Thanks. Rob On 2/6/12 1:45 PM, Bair, Raymond A. wrote: > We could advance you 100K each project. Would that suffice through March? > > Ray > > > On 2/6/12 1:39 PM, "Rob Jacob"<jacob(a)mcs.anl.gov> wrote: > >> >> >> Hi Ray, >> >> Foam has 150K coming in the second half of FY12 and Climate_emulator has >> 200K. They are both currently negative and need time. I'm not sure how >> much but can we have all of it and then ask for more if we run out in >> August or so? >> >> I originally sent the Climate_emulator request to systems@lcrc. Maybe >> that's what you didn't see it. But I never got a message saying "send >> this to accounts". >> >> Rob ------ End of Forwarded Message _______________________________________________ lcrc-core mailing list lcrc-core(a)lists.lcrc.anl.gov https://lists.lcrc.anl.gov/mailman/listinfo/lcrc-core ----- End forwarded message -----

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: XRayFuelSpray
by John Valdes 31 Jan '12

31 Jan '12

Actually, this was just me [re]submitting this request via the accounts website (I'm getting caught up on the backlog of requests); we already reviewed this project at the Dec Alloc meeting and approved 50K for the 2nd quarter. John On Tue, Jan 31, 2012 at 06:02:43PM -0600, Bair, Raymond A. wrote: > Shashi, > > How does this look to you? > > If it looks reasonable could grant the 560K for this quarter and leave the > rest to the committee. > > Ray > > > On 1/31/12 5:51 PM, "accounts(a)lcrc.anl.gov" <accounts(a)lcrc.anl.gov> wrote: > > > Hello, > > > > A new project on the LCRC cluster has been requested. Please forward > > the information on to the LCRC Allocation sub-committee. > > > > Applicant's name: Chris Powell > > Applicant's institution: ANL > > Applicant's division: ES > > Project Name: XRayFuelSpray > > Project title: Fuel Injection and Sprays Studied Using X-Ray > > Diagnostics > > Associated funding: DOE-EERE > > Other Systems: None > > Science: At the Advanced Photon Source Sector 7-BM at Argonne > > National Laboratory, we are presently engaged in an ongoing investigation of > > sprays in high pressure fuel injection systems using X-ray diagnostic > > techniques. An improved understanding spray formation physics is essential to > > the development of more efficient engine technology. As a part of this > > ongoing research, we are investigating the presence of cavitation phenomena in > > fuel injection systems and how these phenomena impact spray formation. > > > > Cavitation is a problem in fuel injection systems which operate under high > > pressure. At the Advanced Photon Source, we are undertaking a series of > > experiments to develop a novel methodology for measuring real-time cavitation > > inside fuel injection systems using advanced X-ray imaging techniques. A > > model nozzle and fuel injection system have been designed specifically for > > this purpose. > > > > In order to develop these novel experimental techniques, it is necessary to > > have an accurate and detailed prediction of the cavitation zones inside the > > model nozzle at precisely defined boundary conditions, so that the measurement > > may be compared against an accurate baseline. To achieve this, numerical > > simulations of the fluid flow are necessary. > > > > The prediction of cavitation in a turbulent flow at high pressure requires the > > use of a high-resolution three-dimensional mesh with high levels of local > > refinement. As such, the computation time for these highly resolved meshes is > > beyond the reasonable capability of a desktop computer. The Fusion cluster > > will allow us to make these computations. > > > > The availability of accurate and detailed prediction of cavitation zones in a > > model nozzle will permit the exposition of these new experimental techniques, > > which will enable the measurement of cavitation zones in fuel injection > > systems and lead to improved design for purpose to reduce or enhance local > > cavitation. > > Project description: A CFD model will be used to predict the cavitation > > zones in a custom-meshed model of a 0.5mm diameter nozzle. > > > > Two codes will be employed: > > 1. An incompressible large eddy simulation, to provide an accurate pressure > > and velocity distribution without cavitation effects. > > 2. A barotropic compressible large eddy simulation, to provide prediction of > > cavitation zones. > > > > Comparison of both solutions permits the observation of expected differences > > in velocity and pressure due to local cavitation effects, and also permits > > prediction of geometric zones where cavitation may be expected over a range of > > supply pressures and back pressures. > > > > Large Eddy Simulation (LES) is employed in preference to the typically used > > RANS codes, as the local Reynolds Number is relatively high (up to approx. Re > > = 30,000) and it is necessary to consider the effects of turbulent shear > > between the higher and lower velocity regions in the expansion and contraction > > zones on the local cavitation which also occurs in these high-shear regions. > > The use of LES adds some computation penalty over RANS but the trade-off is a > > more accurate prediction of the mean turbulent fluctuations in the high shear > > regions. The subgrid scaling properties of LES are advantageous for the > > prediction of bubble behaviour in nucleation zones which will be smaller than > > the mesh resolution. > > > > The mesh of the custom model nozzle consists of approximately 2.4 million > > cells, and is locally refined in the expansion/contraction region of the > > nozzle to capture the features of interest. A grid independence study has > > been carried out on a series of coarse mesh solutions with several stages of > > refinement. The mesh to be used in the final simulation is refined to be > > within 1% of the grid-independent centreline velocity and pressure solution, > > based on a Richardson extrapolation of the incompressible LES solution. > > Further adaptive local refinement in the cavitation zones is also undertaken > > in the multiphase model. > > > > The boundary conditions are supplied via prescribed supply pressure and back > > pressure. The solver iterates to find the velocity solution to the LES form > > of the Navier-Stokes Equations based on the desired pressure. The solution > > will be verified via mass flow measurements made during the experimental > > analysis at the Advanced Photon Source. > > > > The variables of the simulations will include different fluid properties > > (water and gasoline) as well as a range of supply pressures and back > > pressures. For this initial study, fluid temperature is maintained around 20 > > degrees C. > > > > The code to be used is the free, GNU Public License CFD package OpenFOAM. For > > single-phase modeling, the incompressible iterative solver "pisoFoam" will be > > used. We have adapted the source code for a self-adjusting time step to > > ensure stability of the solution. For cavitation modeling, the barotropic > > compressible "cavitatingFoam" solver will be used. > > > > The single-phase incompressible turbulence solver includes the following > > features: > > > > * Large eddy simulation for closure of turbulent fluctuation terms > > * Iterative corrector PISO algorithm to solve for velocity from pressure > > * Adaptive time step code for stable solution (local Courant number limiter) > > > > In addition to the above, the multiphase cavitation solver includes a > > barotropic multiphase model using tabulated, known physical properties. The > > present code is well-suited for the identification of cavitation zones, which > > is the primary aim of the project. If more detailed modeling of the transport > > and collapse of cavitation bubble clouds is necessary, the code may be adapted > > to include compressible acoustic effects, as the local sound speed inside the > > vapor bubbles is low, and the Mach number is high. > > > > The OpenFOAM solver permits a simple discretisation of the domain for parallel > > computation. This parallelisation scales well up to 16 cores. Scaling to > > larger numbers of cores results in diminishing returns due to I/O overhead at > > cell boundaries, and due to the requirement of implicitly solving the velocity > > field from the specified pressure gradient through the Navier-Stokes > > equations. As such, we plan to run longer wall times on fewer CPUs, to > > maximise the efficiency of the calculation. If further parallelisation > > efficiency is required, the source code may be adjusted to permit cross-node > > communication of velocity & pressure on a time step interval rather than every > > time step. This approach has been shown to be highly effective in comparable > > LES studies. The OpenFOAM code is well established and the stability of the > > solver has been verified for coarser mesh solutions on a desktop computer, and > > is ready for scale-up to cluster application. > > > > Project URL: > > Requested allocation: 150000 > > Q1: 0 > > Q2: 50000 > > Q3: 50000 > > Q4: 50000 > > Justification: > > > > > > The requester has used undetermined amount hours of their initial startup > > project. > > > > In addition to approving an initial amount, please specify a Category > > and Subcategory for this project. For a list of the current selection > > of approved categories, please see: > > > > https://wiki.lcrc.anl.gov/wiki/Processes/Categories > > > > Once the Allocation committee has approved the project, please go to > > the Project Management page to create it: > > > > https://accounts.lcrc.anl.gov/projects.php > > > > Thank You, > > The LCRC Accounts System > > _______________________________________________ > > allocations-admins mailing list > > allocations-admins(a)lists.lcrc.anl.gov > > https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins > > > ----------------------------------------- > Ray Bair > Computing, Environment, and Life Sciences > Argonne National Laboratory > and the University of Chicago > TCS Building 240, Room 4122 > 9700 South Cass Avenue > Argonne, IL 60439 > email: rbair(at)anl.gov > Phone: (630)252-5751 > > >

1 0