[LCRC Accounts] Yearly Allocation Request for LCRC_on_demand
Hello, A yearly allocation for the LCRC cluster has been requested with the following updated information: Submitter/PI: Pierre Riteau Project Name: LCRC_on_demand Division: MCS Project title: Providing on-demand resources in the LCRC environment Associated funding: Other Systems: Chameleon Cloud: 20000 node-hours Science: Develop a system capable of providing on-demand resources inside a batch environment. Project description: The LCRC on Demand project aims to explore a confluence of on-demand availability, environment management, and HPC scheduling to find methods that will allow us to combine support for on-demand, currently requested by our APS users, and support for batch computing, currently the only mode of computing available in LCRC. This project has the following objectives: - To combine batch scheduling as currently used in LCRC with on-demand workload such that we can schedule as many on-demand requests as possible with as little impact on utilization as possible - Provide it in parallel with batch scheduling capability currently supported in LCRC, with the least possible disruption, other than in terms of policy, to LCRC users, i.e., where possible using the same interfaces and the same technology as used currently. - The solution should be flexible in order to support different modalities: running on-demand computing as jobs, running them via providing access to containers / VMs where users can execute the jobs themselves, or use the containers / VM for independent access, e.g., via SSH - The solution should be flexible in that it does not pre-suppose a specific policy or particular job submission patterns not currently assumed in the batch scheduling environment - The solution should be flexible in terms of technologies used Our proposed architecture is to at any given time divide up nodes in the cluster into two pools: an on-demand pool and a batch (on-availability) pool and implement a mechanism that will dynamically move nodes from one pool to the other to maximize the objective stated above. Industry partnership: Project URL: Current FY Hours Used: undetermined amount New FY Requested allocation: 100000 Q1: 25000 Q2: 25000 Q3: 25000 Q4: 25000 Justification: Storage requirements: Thank You, The LCRC Accounts System
participants (1)
-
accounts@lcrc.anl.gov