[LCRC Accounts] Yearly Allocation Request for HELIOS
Hello, A yearly allocation for the LCRC cluster has been requested with the following updated information: Submitter/PI: Calem Hoffman Project Name: HELIOS Division: PHY Project title: Real-Time Processing of Digitized Data from the ATLAS User Facility Associated funding: DOE Office of Science - Nuclear Physics Other Systems: None Science: The mission of the ATLAS User Facility is to provide the nuclear physics community with the most intense stable heavy-ion beams, and the associated experimental equipment, to allow for fundamental studies of the structure of nuclei. In particular, our community is focused on answering fundamental questions pertaining to the origin of the elements and how protons and neutrons behave under extreme conditions. The experiments performed at ATLAS range across many fundamental questions, while also touching on practical applications such as isotope production / harvesting and the robustness of materials to radiation. The proposed project aims to increase our data analysis and processing speed by more than ten-times our current capability with our in-division computing power. Utilizing the LCRC resource will allow for a large improvement in the physics output from one of the major user facilities here at ANL, specifically in the field of nuclear structure physics. As an in itial input into the LCRC computing, we will focus on processing data from the HELIOS Spectrometer and its new data acquisition DigiOS to better understand the single-particle structure of nuclei through transfer reactions. This device has been chosen as it is the precursor to a device currently under design or order $2-4 Million for future use at the future Facility for Rare Isotope Beams under construction on the campus of Michigan State University. Project description: Achievements from FY17: As an initial input into the LCRC computing facility (our project has only been live for ~2.5 months), we have focused on processing data already available from the HELIOS Spectrometer and its new data acquisition, DigiOS. We have been successful and made progress on a number of fronts, including; i) porting over all of our data analysis analysis software to the LCRC ii) transferring large amounts of data quickly using GLOBUS iii) processing the data using swift software or through job submissions and the parallel processing capabilities of the ROOT software packages At this point, we are now capable of post-processing ~1.0 TB of data in less than ~1.5 hrs, a >x12 improvement over our past analysis pipeline. Hence, we have already achieved our goal of x10 improvement for post-processing data. In addition, we have been successful in generating a spectrum of gamma-rays that was generated from the processing (merging, generating events, sorting, etc.) of ~200 files summing to ~1.0 TB. There were ~150,000,000 pieces of data (~15,000,000 events) to start, and after processing we are able to extract the remaining ~200,000events of interest for further physics analysis. All of this has been done using far less core-hours than expected and our FY18 request reflects this. Goals for FY18: At present, our work is focused on the real-time processing of data taken by the HELIOS spectrometer. This will allow data taken at HELIOS to be immediately sent-processed-returned by the LCRC. In particular, we are working on generating sift software to complete all of these actions: 1) transfer data files to the LCRC 2) Merge our data files by time 3) Generate events based on a time range 4) Apply physics calculations to events 5) Push final results back to local machines Each step has been proven independently, however, we now plan to merge these processes into a single entity. This is the primary goal for early FY18 (CY17). This would greatly reduce user overhead for data processing as well as improving our data workflow/throughput. Once the process is streamlined, we plan a larger-scale rollout to other users within the Physics Division as well as the low-energy nuclear physics community at large how participate on experiments at ATLAS. This will likely cause a spike in the number of core-hours, however, the amount will still be small compared to other projects. Our request for hours reflects this increase for the 3rd-4th quarters of FY18. The current amount of the storage available is still more than adequate. Industry partnership: None Project URL: http://www.phy.anl.gov/atlas/helios https://wiki.anl.gov/heliosdaq/Main_Page Current FY Hours Used: undetermined amount New FY Requested allocation: 55000 Q1: 10000 Q2: 10000 Q3: 15000 Q4: 20000 Justification: Storage requirements: We request 12 TB of storage to accommodate one development experiment and two actual experiments along with the duplication of the raw data that takes place following the time sorting. Hence, ~4 TB / experiment through FY2018. Thank You, The LCRC Accounts System
participants (1)
-
accounts@lcrc.anl.gov