March 2010 - Allocations-admins - mailman3.cels.anl.gov

[LCRC Accounts] Yearly Allocation Request from Electromagnetics
by accounts＠lcrc.anl.gov 08 Mar '10

08 Mar '10

Hello, A yearly allocation for the LCRC cluster has been requested with the following updated information: Submitter/PI: Misun Min Project Name: Electromagnetics Division: MCS Project title: Computational Electromagnetics Associated funding: DOE AMR program and LDRD strategic Other Systems: BG/P (Intrepid) Science: Advanced nanomaterials with SERS (Surface Enhanced Raman Scattering) and particle accelerator physics Project description: This project has focused on development of highly scalable, efficient, and accurate numerical algorithms as an innovative tool to provide optimal geometric configurations for sensing devices at nanoscale and accelerator devices. Our recent research, based on the development of the time-domain electromagnetic solver NekCEM, has shown significant progress in high-performance electromagnetic modeling at the terascale and petascale. The aim of this project is to add a new framework that will increase both computational capability and efficiency of our high-order code. Specifically, the following key capabilities will be designed and implemented: (1) enhancement of geometric flexibility with simplicial elements, (2) development of efficient eigenvalue and frequency-domain solvers, and (3) extension of scalable parallel algorithms to higher processor counts (4) upgrade of communication kernel and parallel I/O. This project includes potential users of 8-10. Project URL: http://www.mcs.anl.gov/research/projects/nekcem/index.php Current FY Hours Used: undetermined amount New FY Requested allocation: 299999 Justification: Thank You, The LCRC Accounts System

1 0

[LCRC Accounts] Yearly Allocation Request from ESMF
by accounts＠lcrc.anl.gov 08 Mar '10

08 Mar '10

Hello, A yearly allocation for the LCRC cluster has been requested with the following updated information: Submitter/PI: Silverio Vasquez Project Name: ESMF Division: MCS Project title: Earth System Modeling Framework Associated funding: DOD, NASA, NSF Other Systems: external: NERSC, NCAR, ORNL, NCSA, NASA Science: The scientific challenge of developing advanced Earth system applications is daunting. Independently developed components may have incompatible interfaces or may be written in different computer languages. The high-performance computer (HPC) platforms required by numerically intensive Earth system applications are complex, varied, rapidly evolving and multi-part systems themselves. The goal of the Earth System Modeling Framework project is to build high-performance, flexible software infrastructure to increase ease of use, performance portability, interoperability, and reuse in climate, numerical weather prediction, data assimilation, and other Earth science applications. We are aiming to create a framework usable by individual researchers as well as major operational and research centers, and seek to engage the community in its development. Project description: 1. What science or engineering question is your project addressing? Specific details are fine, but please provide a larger picture that will illustrate the importance of the research to scientists not in your field. The Earth System Modeling Framework (ESMF) consists of software infrastructure for constructing and combining high-performance model components in the Earth science domain. The ESMF hierarchical, component-based architecture facilitates the systematic construction of very complex climate and weather applications and the interoperability of model components. ESMF also offers application developers an extensive toolkit for standard modeling functions such as grid transformations, data communication, logging, and calendar management. ESMF component interfaces have been implemented in most of the prominent climate and weather codes in the U.S.: CCSM, WRF, NASA GEOS-5, EMC GFS/NEMS, NRL COAMPS and the GFDL MOM4 ocean. In general, componentization with ESMF has been implemented at the level of major physical domains, where simulated interactions require inter-component data communications (e.g. atmosphere, ocean). This implementation is compatible with codes such as WRF that impose their own interoperability conventions at the level of individual physics parameterizations. The codes listed above, plus the full GFDL modeling system under FMS, can now operate within a component-based, hierarchical architecture in which large-scale components can be called as subroutines. This was not the case when ESMF began. The current level of ESMF adoption represents a major and necessary step towards enabling U.S. centers to exchange large-scale components, and is an excellent basis for further advances in code interoperability. 2. What new results were obtained with Jazz in FY2009? Additionally, how did Jazz support your research? During 2009, the ESMF team was able to build rapidly on mesh and array data structures that had been redesigned for greater flexibility during the previous two years. One of the highlights of a new public release, ESMF 4.0.0r, is a remapping utility that produces interpolation weights, in parallel or serial, 2D or 3D, for grids that can be represented by triangles or quadrilaterals. The remapping utility supports bilinear or higher order weights. A conservative algorithm is being developed for release in 2010 in collaboration with mathematicians from NCAR's IMaGe group.Users can also read in external interpolation weights, from a package such as SCRIP, if they need an interpolation option ESMF does not provide. The ESMF team used Jazz to run exhaustive nightly unit and system tests and examples, taking advantage of the assortment of Jazz compilers. These tests were instrumental in ensuring that the ESMF software was robust and portable. The ESMF team also used Jazz as a development platform. 3. What impact have these computations had, or are expected to have? Widespread use of ESMF represents a paradigm shift in the way weather and climate models are constructed. Through increased code interoperability, community building, and standard tools, ESMF is beginning to make model development easier and to facilitate new, multi-agency science collaborations. The end result is an Earth science community better equipped to explore basic research issues and better equipped to answer questions about the impacts of Earth science on society. 4. What new software capabilities were developed in FY2009? This can include large code changes or additions, scalability, performance, etc. Work in FY09 on unstructured grids has included the development of C interfaces, improvements to the unstructured grid (Mesh class) documentation and more Mesh usage examples, and various bug fixes. Bugs have tended to be caused by non-portable C++ features used in the Mesh implementation, which are being replaced or corrected. Regridding to/from fields built on unstructured grids has been demonstrated and the documentation and examples now include examples of this. The Mesh code and regridding software supports meshes with elements that can be represented as triangles or quadrilaterals, in 2-D or 3-D. Improvements to the Mesh software are included in public release ESMF v4.0.0r, which was delivered in October 2009. A conservative regridding strategy has been implemented in test code. It performs a local conservative correction to an interpolation algorithm of choice, where current options in ESMF are either bilinear or higher order. An advantage of the algorithm is that derivatives of the field values do not need to be supplied along with the values. The test code has shown good preliminary results and a production version of the algorithm is being implemented in ESMF. The algorithm was developed in collaboration with Amik St. Cyr, a mathematician from the Institute for Mathematics in the Geosciences (IMaGe) at NCAR. The conservative algorithm is expected to be released in early 2010. Overall, the regrid capability in ESMF has grown increasingly flexible, with options to generate weights on-line or offline, and in parallel or serial. Currently the on-line version of regridding supports all the grids that ESMF does (structured/unstructured), while the off-line utility only supports single-patch logically rectangular grids. The work needed to create interfaces for the other grid types in the off-line version is straightforward. 5. Please include a high resolution graphic showing a key feature of your results. Please see attached. 6. Please list publications, presentations and grants arising from this work. PUBLICATIONS: Final Report from the National Unified Operational Prediction Capability (NUOPC) Interim Committee on Common Model Architecture (CMA) May 4, 2009 (Revised 18 June). PRESENTATIONS: Earth System Modeling Infrastructure, includes: Overview and ESMF Update (Cecelia DeLuca/NCAR); ESMF Web Services (Kathy Saint/SGI); ESMF in CCSM4 (Bob Oehmke/NCAR, Fei Liu/SGI); Towards CCSM Self-Describing Workflows/Ufuk Turuncoglu/Istanbul Technical University); and CCSM Metadata for IPCC AR5 (Sylvia Murphy/NCAR), CCSM Software Engineering Working Group, Breckenridge, CO, June 17, 2009. Earth System Modeling Framework, Cecelia Deluca/NCAR, 2nd Workshop on a Community Hydrologic Modeling Platform (CHyMP), Memphis, TN, March 31-April 1, 2009. A TIME-GCM CAM Multi-Executable Coupled Model using ESMF and InterComm, Rober Oehmke/NCAR, Michael Wiltberger/NCAR, Alan Sussman/University of Maryland, Wenbin Wang/NCAR, and Norman Lo/University of Maryland, American Meteorological Society Meeting, Phoenix, AZ, January 13, 2009. AWARDS NSF CDI program/Award #0941375 -- "/Scaling Up: Introducing Commoditized Governance into Community Earth Science Modeling"/, 2010-2013, PI Cecelia DeLuca, 2010-2013, $917,124, PI Cecelia DeLuca. NOAA Climate Program Office -- "/Global Interoperability Program"/, 2009, $1M, PI Cecelia DeLuca. Project URL: http://www.earthsystemmodeling.org Current FY Hours Used: undetermined amount New FY Requested allocation: 50000 Justification: Thank You, The LCRC Accounts System

1 0

[LCRC Accounts] Project Allocation Request
by accounts＠lcrc.anl.gov 08 Mar '10

08 Mar '10

Hello, A change in allocation has been requested: Requester: svasquez (Silverio Vasquez) Project: ESMF Title: Earth System Modeling Framework Description: The goal of the Earth System Modeling Framework project is to build high-performance, flexible software infrastructure to increase ease of use, performance portability, interoperability, and reuse in climate, numerical weather prediction, data assimilation, and other Earth science applications. We are aiming to create a framework usable by individual researchers as well as major operational and research centers. The ESMF project will deliver an API specification, a reference implementation accompanied by extensive documentation, and a set of tutorial examples. The ESMF software will consist of a superstructure for coupling and exchanging data between component models (e.g., atmosphere, ocean) and model subcomponents (e.g., physics, dynamics); and an infrastructure consisting of 1) data structures for representing grids and fields and 2) an optimized, portable set of low-level utilities. The data constructs and low-level utilities will be used by the coupling superstructure and may also be used separately to compose scientific applications. ESMF uses a mixture of C++ and F90. Most of the low level classes are implemented in C++ and given hand-written F90 interfaces. We have worked out a detailed interoperability specification which allows F90/C++ to interact on multiple platforms. Communication is handled using a combination of pthreads and MPI which allows ESMF to support both pure-distributed, pure-shared, and hybrid parallel programming models. In FY09, we will continue to use the extensive compiler set on Jazz to run the equally extensive ESMF test suite. Current: undetermined amount Justification: Requested: 70000 A specific reason has been given: We plan to regression test ESMF daily on 4 compiler (intel, pgi, gfortran and g95). We measured that each compiler should take about 3 hours on 8 processors. 4 compilers X 3 hours X 8 processors X 365 days = 35040 per year. Since we are testing the ESMF Trunk and a branch we must double the number to get 70,000 per year. This needs to be approved and the final allocation amount decided upon. Thank You, The LCRC Accounts System

1 0