Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: Sheng Di Applicant's institution: ANL Applicant's division: MCS Project Name: ECP-EZ Project title: High Performance Lossy Compressor for Scientific Data Associated funding: DOE Other Systems: MIRA, Titan, and NERSC Science: Provide a robust and effective production level lossy compressor for scientific data responding to ECP user needs. Project description: computational methods: SZ compressor (prediction model + quantization + lossless compression) See https://collab.cels.anl.gov/display/ESR/SZ for details. programming model: currently, it's serial program, and it can run in parallel with MPI program now. In the future, we'll support multi-thread version or so. scalability issues: Good scalability because there are no or very limited communication cost across MPI ranks (also confirmed by our experiments). experiments planned: Perform compression tests using a small number of nodes (such as 16 or less) in most of the time, and also need to submit the jobs each with 1024 cores some times. software requirements: SZ compressor, ZFP compressor, Z-checker (https://github.com/CODARcode/Z-checker), MPICH. technical details: SZ compressor (prediction model + quantization + lossless compression) See https://collab.cels.anl.gov/display/ESR/SZ for details. Performance achieved: Compression rate is about 100+MB/s on one core, and the compression ratio is from 4:1 to 100+:1, depending on the data set. the efficiency of the code: Please see our paper for details: https://arxiv.org/abs/1706.03791 expected number of project members: 4-10. Industry partnership: Project URL: Requested allocation: 400000 Q1: 0 Q2: 0 Q3: 0 Q4: 400000 Justification: Storage requirements: 5TB (reason: we need to store large volume of data for our experiments because we are dealing with data compression issue) The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php Thank You, The LCRC Accounts System