Lets steer people to Swift, where applicable, rather than some other tool. Ray ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov Phone: (630)252-5751 On 3/24/15, 2:33 PM, "Aithal, Shashikant M." <[email protected]> wrote:
Yang could also check out https://www.nersc.gov/users/computational-systems/hopper/running-jobs/exam ple-batch-scripts/
which shows many ways of running serial jobs in parallel.
Shashi ________________________________________ From: [email protected] [[email protected]] on behalf of Low, John J. [[email protected]] Sent: Tuesday, March 24, 2015 1:31 PM To: LCRC Allocations Admins Subject: Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
Ray,
It seems to me that we should at least require Mr. Yang to write a script to run 16 processes simultaneously on a single node, otherwise he would be wasting over 90% of his allocation.
It would not be difficult to do this with a bash script. See https://pebblesinthesand.wordpress.com/2008/05/22/a-srcipt-for-running-pro cesses-in-parallel-in-bash/ for example.
John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/
From: <Bair>, "Bair, Raymond A." <[email protected]<mailto:[email protected]>> Reply-To: LCRC Allocations Admins <[email protected]<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 1:22 PM To: LCRC Allocations Admins <[email protected]<mailto:[email protected]>> Subject: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
From: Guang Yang <[email protected]<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 12:17 PM To: Ray Bair <[email protected]<mailto:[email protected]>> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: NeutrinoSim
Hi Ray,
Typically, I would submit job without MPI, each single jobs might need 10 hours, to each node. But I am considering using MPI if that can make the jobs way more efficient.(not guaranteed but will try)
I will graduate by next summer.
I think you are absolutely right, I would adjust the core hours to: Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 9000 Apr-Jun 2015 Q3: 400000 Jul-Sep 2015 Q4: 90000
Actually, the request is not only for me, but also for some other people including Zelimir Djurcic, who is my advisor in Argonne. They might use the resource not for now, but in the Q3,Q4.
For now(Q2), I think I am the only one who will submit jobs to the cluster. I have some urgent jobs to run.
Thanks, Guang
On Mon, Mar 23, 2015 at 4:48 PM, Bair, Raymond A. <[email protected]<mailto:[email protected]>> wrote: Dear Guang Yang,
We received your request for a new LCRC project and have a few follow-up questions about it.
Please tell us a little more about the codes you will use. Are they parallel codes (e.g., using MPI)? LCRC's Blues computer has 16-core nodes. How many nodes will you be using for a typical job? How many wall-clock hours will a typical job take?
I see that you are a PhD student at IIT with advisors there and at Argonne. When do you expect to graduate?
Note that we use the Federal fiscal year, so the 2nd quarter ends in about a week (March 31). So your request is:
Requested allocation: 490000 Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 200000 Apr-Jun 2015 Q3: 200000 Jul-Sep 2015 Q4: 90000
Is that what you intended with your request?
Best regards,
Ray
----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov<http://anl.gov> Phone: (630)252-5751<tel:%28630%29252-5751>
On 3/23/15, 4:05 PM, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> wrote:
Hello,
A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee.
Applicant's name: Guang Yang Applicant's institution: ANL Applicant's division: HEP Project Name: NeutrinoSim Project title: Neutrino Simulation Associated funding: DOE Other Systems: Science: Doing the simulation related to neutrino physics. Argonne HEP do participate quite lots of neutrino projects, including Double Chooz, Nova, LBNF, MINOS, JUNO and so on. Large amount of simulation is needed. Project description: Submitting simulation jobs to simulate reactor antineutrino detector response by using offline softwares. Industry partnership: Project URL: Requested allocation: 490000 Q1: 0 Q2: 200000 Q3: 200000 Q4: 90000 Justification: Storage requirements:
The requester has used undetermined amount hours of their initial startup project.
In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see:
https://wiki.lcrc.anl.gov/wiki/Processes/Categories
Once the Allocation committee has approved the project, please go to the Project Management page to create it:
https://accounts.lcrc.anl.gov/projects.php
Thank You, The LCRC Accounts System
_______________________________________________ allocations-admins mailing list [email protected] https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins