Hello, A change in allocation has been requested: Requester: dduke (Daniel Duke) Project: XRayFuelSpray Title: Fuel Injection and Sprays Studied Using X-Ray Diagnostics Description: The cavitation modeling component of the project is being performed using the OpenFOAM framework. A number of state-of-the-art numerical solvers have been implemented in OpenFOAM; namely incompressible-liquid and fully compressible homogeneous relaxation cavitation models and more recently a fully compressible homogeneous relaxation cavitation model which includes non-condensable gas modeling (HRMFoam). These codes were developed by Schmidt et al at the University of Massachusetts-Amherst, and we continue to collaborate with them on code development and efficiency improvements. In the last year, we have made some substantial improvements to the cavitation model and the parallel efficiency of its implementation on Blues/Fusion. With the support of LCRC technical staff and our collaborators at the University of Massachusetts-Amherst, we have implemented a custom build of OpenFOAM-3.0 on Blues against the system native MPI, and we have made the necessary changes to the HRMFoam solver’s source code in order to move from the older OpenFOAM-1.6 to the new 3.0 framework. This has led to substantial gains in parallel performance; up to 20% on 32 cores and 12% on 64 cores on Blues. A scalability study has been performed with the new code, and details are given in the Large Allocation Efficiency statement. In the new OpenFOAM-3.0 build, we have successfully implemented both Large Eddy Simulation (LES) and Realizable k-epsilon (KE) turbulence models. Furthermore, we have implemented code which allows us to take virtual projections of the three-dimensional simulations so that they may be quantitatively compared with the x-ray experiments. In the following year, we plan to extend high-fidelity cavitation simulations by undertaking longer simulation times in order to capture lower-frequency hydrodynamic phenomena which we have observed in our experiments. Improvements in efficiency will allows us to pursue longer run-time simulations. We also intend to simulate the effects of varying pressure and flow rate on cavitation, in order to compare against new x-ray fluorescence data from APS. The gas jet simulations which we plan to undertake in Q1 are performed with the CONVERGE CFD software, its use is already well established at LCRC. Tomographic reconstruction of gasoline direct injection spray measurements from APS will be conducted using the TomoPy software package developed at APS. We intend to run single-node jobs to efficiently perform multiple reconstructions of large (multi-GB) datasets. We have also successfully compiled a Paraview server on our Fusion dedicated nodes which allows us to rapidly visualize the results of our simulations and reconstructions. Using Blues and Fusion will allow us to achieve rapid turnaround of results during beamtime. This will be a significant aid to the experimental program. As the quantity of tomography work increases, we may consider purchasing more dedicated nodes. Current: undetermined amount Justification: Our requested allocation for next year will exceed 0.5M core-hours in order to encompass the gas jet simulations in Q1 and tomographic reconstruction work in Q2-4. The majority of core hours will still be dedicated to OpenFOAM simulations, which will be undertaken on both dedicated Fusion nodes and also on Blues, using OpenFOAM-3.0. We have demonstrated notable improvements in scalability on Blues as detailed above. A scalability study of OpenFOAM-3.0 performance with multi-million cell meshes has been undertaken, demonstrating excellent linear scalability. We observe 81% efficiency relative to single-CPU performance, scaling linearly up to 320 cores (20 nodes) with a 15-million cell mesh (a typical upper limit). We have implemented Scotch decomposition in order to ensure good load balancing & minimization of cross-processor communication boundaries. The present OpenFOAM simulations use static meshes, so load rebalancing at runtime is not a concern. We intend to run typical job sizes of 64 to 128 cores; smaller than the maximum job size for which good scalability has been demonstrated. Further details regarding scalability studies can be obtained by contacting the project PIs. Requested: 100000 A specific reason has been given: We would like to request an additional 100k core hours to continue ongoing numerical simulations work for rapid publication, which we intend to complete before FY2016 allocations are assessed. Our prior allocation was exhausted due to the need to perform additional simulations (for conference papers) which were not originally planned, and to perform tomographic reconstructions of x-ray data from APS. We will use the additional hours to perform OpenFOAM simulations; scalability test data are available upon request (up to 300 cores using system MPI). We intend to run 100-200 core sized jobs. If 100k allocation is not possible, we would benefit from any additional allocation that can be made available. This needs to be approved and the final allocation amount decided upon. Thank You, The LCRC Accounts System