March 2015 - Allocations-admins - mailman3.cels.anl.gov

FW: FW: [LCRC Accounts] Project Request: NeutrinoSim
by Low, John J. 25 Mar '15

25 Mar '15

As discussed in today’s meeting please allocate 50K core-hours to NeutrinoSim. Thanks, John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/ From: <Low>, "John J." <jlow(a)mcs.anl.gov<mailto:[email protected]>> Date: Wednesday, March 25, 2015 at 4:56 PM To: "Yang, Guang" <gyang9(a)hawk.iit.edu<mailto:[email protected]>> Subject: Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim Guang, We will allocate 50K core-hours to your project to parallelize your code with MPI and to get started. When you can demonstrate good parallel scaling up to hundreds or core with your code, we can discuss increasing your allocation. John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/ From: Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 7:21 PM To: "Low, John J." <jlow(a)mcs.anl.gov<mailto:[email protected]>> Subject: Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim Hi John, I also learned how to use MPI just now from a guy in our division. I think I got clear with this thing and could run jobs with MPI. So for the non-sequential jobs with only different random seeds, I can efficiently use the cores. Please let me know if we could get the core hours. Thanks, Guang On Tue, Mar 24, 2015 at 3:02 PM, Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> wrote: Hi John, Thank you very much. I read it and I think the task farmer and apron with listing different job scripts methods are quite straightforward to me. My jobs can run in parallel. For example, generating 100,000 random events takes too long. So I would break it into 100 jobs *1000 events. (1,000 events takes 1 hour and half.) They are not sequential. Just make sure that if I can do something like: 1.#PBS -q regular 02.#PBS -l mppwidth=144 03.#PBS -l walltime=12:00:00 04.#PBS -N my_job 05.#PBS -e my_job.$PBS_JOBID.err 06.#PBS -o my_job.$PBS_JOBID.out 07. 08.cd $PBS_O_WORKDIR 09.aprun -n 32 ./a.out & 10.aprun -n 65 ./b.out & 11.aprun -n 24 ./c.out & 12.wait Then I can definitely run them in parallel. I may just have 16 exactly same job scripts. Thanks, Guang On Tue, Mar 24, 2015 at 2:38 PM, Low, John J. <jlow(a)mcs.anl.gov<mailto:[email protected]>> wrote: Guang, Shashi Aithal suggested this link to more examples of running parallel jobs in this link. https://www.nersc.gov/users/computational-systems/hopper/running-jobs/examp le-batch-scripts/<https://www.nersc.gov/users/computational-systems/hopper/running-jobs/examp…> John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045<tel:630-252-0045> www.linkedin.com/pub/john-low/15/8b0/5aa/<http://www.linkedin.com/pub/john-low/15/8b0/5aa/>

1 0

Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
by Bair, Raymond A. 25 Mar '15

25 Mar '15

I suggest that we give him 50K to start. When he gets to the point that he can run with MPI he can ask for more. Ray ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov Phone: (630)252-5751 From: <Low>, John Low <Jlow(a)mcs.anl.gov<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 8:48 PM To: Ray Bair <rbair(a)anl.gov<mailto:[email protected]>> Subject: FW: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim Ray, Guang learned to MPI from some guy in his division. Does that sound good enough to you? John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/ ________________________________ From: Guang Yang [gyang9(a)hawk.iit.edu<mailto:[email protected]>] Sent: Tuesday, March 24, 2015 7:21 PM To: Low, John J. Subject: Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim Hi John, I also learned how to use MPI just now from a guy in our division. I think I got clear with this thing and could run jobs with MPI. So for the non-sequential jobs with only different random seeds, I can efficiently use the cores. Please let me know if we could get the core hours. Thanks, Guang On Tue, Mar 24, 2015 at 3:02 PM, Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> wrote: Hi John, Thank you very much. I read it and I think the task farmer and apron with listing different job scripts methods are quite straightforward to me. My jobs can run in parallel. For example, generating 100,000 random events takes too long. So I would break it into 100 jobs *1000 events. (1,000 events takes 1 hour and half.) They are not sequential. Just make sure that if I can do something like: 1.#PBS -q regular 02.#PBS -l mppwidth=144 03.#PBS -l walltime=12:00:00 04.#PBS -N my_job 05.#PBS -e my_job.$PBS_JOBID.err 06.#PBS -o my_job.$PBS_JOBID.out 07. 08.cd $PBS_O_WORKDIR 09.aprun -n 32 ./a.out & 10.aprun -n 65 ./b.out & 11.aprun -n 24 ./c.out & 12.wait Then I can definitely run them in parallel. I may just have 16 exactly same job scripts. Thanks, Guang On Tue, Mar 24, 2015 at 2:38 PM, Low, John J. <jlow(a)mcs.anl.gov<mailto:[email protected]>> wrote: Guang, Shashi Aithal suggested this link to more examples of running parallel jobs in this link. https://www.nersc.gov/users/computational-systems/hopper/running-jobs/examp le-batch-scripts/<https://www.nersc.gov/users/computational-systems/hopper/running-jobs/examp…> John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045<tel:630-252-0045> www.linkedin.com/pub/john-low/15/8b0/5aa/<http://www.linkedin.com/pub/john-low/15/8b0/5aa/>

1 0

Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
by Bair, Raymond A. 24 Mar '15

24 Mar '15

Lets steer people to Swift, where applicable, rather than some other tool. Ray ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov Phone: (630)252-5751 On 3/24/15, 2:33 PM, "Aithal, Shashikant M." <aithal(a)cels.anl.gov> wrote: >Yang could also check out >https://www.nersc.gov/users/computational-systems/hopper/running-jobs/exam >ple-batch-scripts/ > >which shows many ways of running serial jobs in parallel. > >Shashi >________________________________________ >From: allocations-admins-bounces(a)lcrc.anl.gov >[allocations-admins-bounces(a)lcrc.anl.gov] on behalf of Low, John J. >[jlow(a)mcs.anl.gov] >Sent: Tuesday, March 24, 2015 1:31 PM >To: LCRC Allocations Admins >Subject: Re: [allocations-admins] FW: [LCRC Accounts] Project Request: >NeutrinoSim > >Ray, > >It seems to me that we should at least require Mr. Yang to write a script >to run 16 processes simultaneously on a single node, otherwise he would >be wasting over 90% of his allocation. > >It would not be difficult to do this with a bash script. See >https://pebblesinthesand.wordpress.com/2008/05/22/a-srcipt-for-running-pro >cesses-in-parallel-in-bash/ for example. > >John J. Low >Principal Computational Science Specialist >Computing, Environment and Life Sciences >Building 240, 2143 >9700 South Cass Avenue >Argonne National Laboratory >Argonne, IL 60439. >630-252-0045 >www.linkedin.com/pub/john-low/15/8b0/5aa/ > >From: <Bair>, "Bair, Raymond A." <rbair(a)anl.gov<mailto:[email protected]>> >Reply-To: LCRC Allocations Admins ><allocations-admins(a)lcrc.anl.gov<mailto:[email protected]>> >Date: Tuesday, March 24, 2015 at 1:22 PM >To: LCRC Allocations Admins ><allocations-admins(a)lcrc.anl.gov<mailto:[email protected]>> >Subject: [allocations-admins] FW: [LCRC Accounts] Project Request: >NeutrinoSim > > > > >From: Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> >Date: Tuesday, March 24, 2015 at 12:17 PM >To: Ray Bair <rbair(a)anl.gov<mailto:[email protected]>> >Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: >NeutrinoSim > >Hi Ray, > >Typically, I would submit job without MPI, each single jobs might need 10 >hours, to each node. >But I am considering using MPI if that can make the jobs way more >efficient.(not guaranteed but will try) > >I will graduate by next summer. > >I think you are absolutely right, I would adjust the core hours to: >Oct-Dec 2014 Q1: 0 >Jan-Mar 2015 Q2: 9000 >Apr-Jun 2015 Q3: 400000 >Jul-Sep 2015 Q4: 90000 > >Actually, the request is not only for me, but also for some other people >including Zelimir Djurcic, who is my advisor in Argonne. They might use >the resource not for now, but in the Q3,Q4. > >For now(Q2), I think I am the only one who will submit jobs to the >cluster. I have some urgent jobs to run. > >Thanks, >Guang > > >On Mon, Mar 23, 2015 at 4:48 PM, Bair, Raymond A. ><rbair(a)anl.gov<mailto:[email protected]>> wrote: >Dear Guang Yang, > >We received your request for a new LCRC project and have a few follow-up >questions about it. > >Please tell us a little more about the codes you will use. Are they >parallel codes (e.g., using MPI)? LCRC's Blues computer has 16-core >nodes. How many nodes will you be using for a typical job? How many >wall-clock hours will a typical job take? > >I see that you are a PhD student at IIT with advisors there and at >Argonne. When do you expect to graduate? > >Note that we use the Federal fiscal year, so the 2nd quarter ends in about >a week (March 31). So your request is: > >Requested allocation: 490000 >Oct-Dec 2014 Q1: 0 >Jan-Mar 2015 Q2: 200000 >Apr-Jun 2015 Q3: 200000 >Jul-Sep 2015 Q4: 90000 > >Is that what you intended with your request? > > >Best regards, > >Ray > >----------------------------------------- >Ray Bair >Computing, Environment, and Life Sciences >Argonne National Laboratory > and the University of Chicago >TCS Building 240, Room 4122 >9700 South Cass Avenue >Argonne, IL 60439 >email: rbair(at)anl.gov<http://anl.gov> >Phone: (630)252-5751<tel:%28630%29252-5751> > > > > > >On 3/23/15, 4:05 PM, >"accounts(a)lcrc.anl.gov<mailto:[email protected]>" ><accounts(a)lcrc.anl.gov<mailto:[email protected]>> wrote: > >>Hello, >> >>A new project on the LCRC cluster has been requested. Please forward >>the information on to the LCRC Allocation sub-committee. >> >> Applicant's name: Guang Yang >>Applicant's institution: ANL >> Applicant's division: HEP >> Project Name: NeutrinoSim >> Project title: Neutrino Simulation >> Associated funding: DOE >> Other Systems: >> Science: Doing the simulation related to neutrino >>physics. >>Argonne HEP do participate quite lots of neutrino projects, including >>Double Chooz, Nova, LBNF, MINOS, JUNO and so on. Large amount of >>simulation is needed. >> Project description: Submitting simulation jobs to simulate reactor >>antineutrino detector response by using offline softwares. >> Industry partnership: >> Project URL: >> Requested allocation: 490000 >> Q1: 0 >> Q2: 200000 >> Q3: 200000 >> Q4: 90000 >> Justification: >> Storage requirements: >> >> >>The requester has used undetermined amount hours of their initial startup >>project. >> >>In addition to approving an initial amount, please specify a Category >>and Subcategory for this project. For a list of the current selection >>of approved categories, please see: >> >> https://wiki.lcrc.anl.gov/wiki/Processes/Categories >> >>Once the Allocation committee has approved the project, please go to >>the Project Management page to create it: >> >>https://accounts.lcrc.anl.gov/projects.php >> >>Thank You, >>The LCRC Accounts System > > >_______________________________________________ >allocations-admins mailing list >allocations-admins(a)lcrc.anl.gov >https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins

1 0

Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
by Low, John J. 24 Mar '15

24 Mar '15

Guang, Shashi Aithal suggested this link to more examples of running parallel jobs in this link. https://www.nersc.gov/users/computational-systems/hopper/running-jobs/examp le-batch-scripts/ John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/

1 0

Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
by Aithal, Shashikant M. 24 Mar '15

24 Mar '15

Yang could also check out https://www.nersc.gov/users/computational-systems/hopper/running-jobs/examp… which shows many ways of running serial jobs in parallel. Shashi ________________________________________ From: allocations-admins-bounces(a)lcrc.anl.gov [allocations-admins-bounces(a)lcrc.anl.gov] on behalf of Low, John J. [jlow(a)mcs.anl.gov] Sent: Tuesday, March 24, 2015 1:31 PM To: LCRC Allocations Admins Subject: Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim Ray, It seems to me that we should at least require Mr. Yang to write a script to run 16 processes simultaneously on a single node, otherwise he would be wasting over 90% of his allocation. It would not be difficult to do this with a bash script. See https://pebblesinthesand.wordpress.com/2008/05/22/a-srcipt-for-running-proc… for example. John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/ From: <Bair>, "Bair, Raymond A." <rbair(a)anl.gov<mailto:[email protected]>> Reply-To: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 1:22 PM To: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov<mailto:[email protected]>> Subject: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim From: Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 12:17 PM To: Ray Bair <rbair(a)anl.gov<mailto:[email protected]>> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: NeutrinoSim Hi Ray, Typically, I would submit job without MPI, each single jobs might need 10 hours, to each node. But I am considering using MPI if that can make the jobs way more efficient.(not guaranteed but will try) I will graduate by next summer. I think you are absolutely right, I would adjust the core hours to: Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 9000 Apr-Jun 2015 Q3: 400000 Jul-Sep 2015 Q4: 90000 Actually, the request is not only for me, but also for some other people including Zelimir Djurcic, who is my advisor in Argonne. They might use the resource not for now, but in the Q3,Q4. For now(Q2), I think I am the only one who will submit jobs to the cluster. I have some urgent jobs to run. Thanks, Guang On Mon, Mar 23, 2015 at 4:48 PM, Bair, Raymond A. <rbair(a)anl.gov<mailto:[email protected]>> wrote: Dear Guang Yang, We received your request for a new LCRC project and have a few follow-up questions about it. Please tell us a little more about the codes you will use. Are they parallel codes (e.g., using MPI)? LCRC's Blues computer has 16-core nodes. How many nodes will you be using for a typical job? How many wall-clock hours will a typical job take? I see that you are a PhD student at IIT with advisors there and at Argonne. When do you expect to graduate? Note that we use the Federal fiscal year, so the 2nd quarter ends in about a week (March 31). So your request is: Requested allocation: 490000 Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 200000 Apr-Jun 2015 Q3: 200000 Jul-Sep 2015 Q4: 90000 Is that what you intended with your request? Best regards, Ray ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov<http://anl.gov> Phone: (630)252-5751<tel:%28630%29252-5751> On 3/23/15, 4:05 PM, "accounts(a)lcrc.anl.gov<mailto:[email protected]>" <accounts(a)lcrc.anl.gov<mailto:[email protected]>> wrote: >Hello, > >A new project on the LCRC cluster has been requested. Please forward >the information on to the LCRC Allocation sub-committee. > > Applicant's name: Guang Yang >Applicant's institution: ANL > Applicant's division: HEP > Project Name: NeutrinoSim > Project title: Neutrino Simulation > Associated funding: DOE > Other Systems: > Science: Doing the simulation related to neutrino >physics. >Argonne HEP do participate quite lots of neutrino projects, including >Double Chooz, Nova, LBNF, MINOS, JUNO and so on. Large amount of >simulation is needed. > Project description: Submitting simulation jobs to simulate reactor >antineutrino detector response by using offline softwares. > Industry partnership: > Project URL: > Requested allocation: 490000 > Q1: 0 > Q2: 200000 > Q3: 200000 > Q4: 90000 > Justification: > Storage requirements: > > >The requester has used undetermined amount hours of their initial startup >project. > >In addition to approving an initial amount, please specify a Category >and Subcategory for this project. For a list of the current selection >of approved categories, please see: > > https://wiki.lcrc.anl.gov/wiki/Processes/Categories > >Once the Allocation committee has approved the project, please go to >the Project Management page to create it: > >https://accounts.lcrc.anl.gov/projects.php > >Thank You, >The LCRC Accounts System

1 0

Re: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim
by Low, John J. 24 Mar '15

24 Mar '15

Ray, It seems to me that we should at least require Mr. Yang to write a script to run 16 processes simultaneously on a single node, otherwise he would be wasting over 90% of his allocation. It would not be difficult to do this with a bash script. See https://pebblesinthesand.wordpress.com/2008/05/22/a-srcipt-for-running-proc… for example. John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/ From: <Bair>, "Bair, Raymond A." <rbair(a)anl.gov<mailto:[email protected]>> Reply-To: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 1:22 PM To: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov<mailto:[email protected]>> Subject: [allocations-admins] FW: [LCRC Accounts] Project Request: NeutrinoSim From: Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 12:17 PM To: Ray Bair <rbair(a)anl.gov<mailto:[email protected]>> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: NeutrinoSim Hi Ray, Typically, I would submit job without MPI, each single jobs might need 10 hours, to each node. But I am considering using MPI if that can make the jobs way more efficient.(not guaranteed but will try) I will graduate by next summer. I think you are absolutely right, I would adjust the core hours to: Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 9000 Apr-Jun 2015 Q3: 400000 Jul-Sep 2015 Q4: 90000 Actually, the request is not only for me, but also for some other people including Zelimir Djurcic, who is my advisor in Argonne. They might use the resource not for now, but in the Q3,Q4. For now(Q2), I think I am the only one who will submit jobs to the cluster. I have some urgent jobs to run. Thanks, Guang On Mon, Mar 23, 2015 at 4:48 PM, Bair, Raymond A. <rbair(a)anl.gov<mailto:[email protected]>> wrote: Dear Guang Yang, We received your request for a new LCRC project and have a few follow-up questions about it. Please tell us a little more about the codes you will use. Are they parallel codes (e.g., using MPI)? LCRC's Blues computer has 16-core nodes. How many nodes will you be using for a typical job? How many wall-clock hours will a typical job take? I see that you are a PhD student at IIT with advisors there and at Argonne. When do you expect to graduate? Note that we use the Federal fiscal year, so the 2nd quarter ends in about a week (March 31). So your request is: Requested allocation: 490000 Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 200000 Apr-Jun 2015 Q3: 200000 Jul-Sep 2015 Q4: 90000 Is that what you intended with your request? Best regards, Ray ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov<http://anl.gov> Phone: (630)252-5751<tel:%28630%29252-5751> On 3/23/15, 4:05 PM, "accounts(a)lcrc.anl.gov<mailto:[email protected]>" <accounts(a)lcrc.anl.gov<mailto:[email protected]>> wrote: >Hello, > >A new project on the LCRC cluster has been requested. Please forward >the information on to the LCRC Allocation sub-committee. > > Applicant's name: Guang Yang >Applicant's institution: ANL > Applicant's division: HEP > Project Name: NeutrinoSim > Project title: Neutrino Simulation > Associated funding: DOE > Other Systems: > Science: Doing the simulation related to neutrino >physics. >Argonne HEP do participate quite lots of neutrino projects, including >Double Chooz, Nova, LBNF, MINOS, JUNO and so on. Large amount of >simulation is needed. > Project description: Submitting simulation jobs to simulate reactor >antineutrino detector response by using offline softwares. > Industry partnership: > Project URL: > Requested allocation: 490000 > Q1: 0 > Q2: 200000 > Q3: 200000 > Q4: 90000 > Justification: > Storage requirements: > > >The requester has used undetermined amount hours of their initial startup >project. > >In addition to approving an initial amount, please specify a Category >and Subcategory for this project. For a list of the current selection >of approved categories, please see: > > https://wiki.lcrc.anl.gov/wiki/Processes/Categories > >Once the Allocation committee has approved the project, please go to >the Project Management page to create it: > >https://accounts.lcrc.anl.gov/projects.php > >Thank You, >The LCRC Accounts System

1 0

FW: [LCRC Accounts] Project Request: NeutrinoSim
by Bair, Raymond A. 24 Mar '15

24 Mar '15

From: Guang Yang <gyang9(a)hawk.iit.edu<mailto:[email protected]>> Date: Tuesday, March 24, 2015 at 12:17 PM To: Ray Bair <rbair(a)anl.gov<mailto:[email protected]>> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: NeutrinoSim Hi Ray, Typically, I would submit job without MPI, each single jobs might need 10 hours, to each node. But I am considering using MPI if that can make the jobs way more efficient.(not guaranteed but will try) I will graduate by next summer. I think you are absolutely right, I would adjust the core hours to: Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 9000 Apr-Jun 2015 Q3: 400000 Jul-Sep 2015 Q4: 90000 Actually, the request is not only for me, but also for some other people including Zelimir Djurcic, who is my advisor in Argonne. They might use the resource not for now, but in the Q3,Q4. For now(Q2), I think I am the only one who will submit jobs to the cluster. I have some urgent jobs to run. Thanks, Guang On Mon, Mar 23, 2015 at 4:48 PM, Bair, Raymond A. <rbair(a)anl.gov<mailto:[email protected]>> wrote: Dear Guang Yang, We received your request for a new LCRC project and have a few follow-up questions about it. Please tell us a little more about the codes you will use. Are they parallel codes (e.g., using MPI)? LCRC's Blues computer has 16-core nodes. How many nodes will you be using for a typical job? How many wall-clock hours will a typical job take? I see that you are a PhD student at IIT with advisors there and at Argonne. When do you expect to graduate? Note that we use the Federal fiscal year, so the 2nd quarter ends in about a week (March 31). So your request is: Requested allocation: 490000 Oct-Dec 2014 Q1: 0 Jan-Mar 2015 Q2: 200000 Apr-Jun 2015 Q3: 200000 Jul-Sep 2015 Q4: 90000 Is that what you intended with your request? Best regards, Ray ----------------------------------------- Ray Bair Computing, Environment, and Life Sciences Argonne National Laboratory and the University of Chicago TCS Building 240, Room 4122 9700 South Cass Avenue Argonne, IL 60439 email: rbair(at)anl.gov<http://anl.gov> Phone: (630)252-5751<tel:%28630%29252-5751> On 3/23/15, 4:05 PM, "accounts(a)lcrc.anl.gov<mailto:[email protected]>" <accounts(a)lcrc.anl.gov<mailto:[email protected]>> wrote: >Hello, > >A new project on the LCRC cluster has been requested. Please forward >the information on to the LCRC Allocation sub-committee. > > Applicant's name: Guang Yang >Applicant's institution: ANL > Applicant's division: HEP > Project Name: NeutrinoSim > Project title: Neutrino Simulation > Associated funding: DOE > Other Systems: > Science: Doing the simulation related to neutrino >physics. >Argonne HEP do participate quite lots of neutrino projects, including >Double Chooz, Nova, LBNF, MINOS, JUNO and so on. Large amount of >simulation is needed. > Project description: Submitting simulation jobs to simulate reactor >antineutrino detector response by using offline softwares. > Industry partnership: > Project URL: > Requested allocation: 490000 > Q1: 0 > Q2: 200000 > Q3: 200000 > Q4: 90000 > Justification: > Storage requirements: > > >The requester has used undetermined amount hours of their initial startup >project. > >In addition to approving an initial amount, please specify a Category >and Subcategory for this project. For a list of the current selection >of approved categories, please see: > > https://wiki.lcrc.anl.gov/wiki/Processes/Categories > >Once the Allocation committee has approved the project, please go to >the Project Management page to create it: > >https://accounts.lcrc.anl.gov/projects.php > >Thank You, >The LCRC Accounts System

1 0

FW: Access to fast Linux machines?
by Bair, Raymond A. 23 Mar '15

23 Mar '15

FYI ... On 3/23/15, 4:30 PM, "Catlett, Charlie" <catlett(a)anl.gov> wrote: >Perfect, thanks! > >CeC > >> On Mar 23, 2015, at 1:41 PM, Bair, Raymond A. <rbair(a)anl.gov> wrote: >> >> Charlie, >> >> Everyone who does not have an LCRC account needs to go here. It would >>be >> best if you did this first; then you can be the sponsor for the others. >> >> https://accounts.lcrc.anl.gov/request.php >> >> Once you have an account, request a project for you and the students. >>You >> can do this before all the students have accounts and add them later. >> >> https://accounts.lcrc.anl.gov/projects.php >> >> Regards, >> >> Ray >> >> >> ----------------------------------------- >> Ray Bair >> Computing, Environment, and Life Sciences >> Argonne National Laboratory >> and the University of Chicago >> TCS Building 240, Room 4122 >> 9700 South Cass Avenue >> Argonne, IL 60439 >> email: rbair(at)anl.gov >> Phone: (630)252-5751 >> >> >> >> >> >>> On 3/23/15, 9:25 AM, "Catlett, Charlie" <catlett(a)anl.gov> wrote: >>> >>> Thanks Ray- >>> There are two grad students working with a Harris professor, me, and >>> Brett Goldstein (harris/ci fellow) with a small amount of $ from the >>> Arnold Foundation. One student is a US citizen; the other I think is >>>not >>> (Asian guy). >>> >>> They are using Python and R to implement some data analytics algorithms >>> to examine the impact of weather on violent crime, and doing it on >>> laptops that are bogging down and don't have enough memory. >>> >>> Is there a web form I can fill out? >>> >>> Thanks! >>> CeC >>> >>>> On Mar 23, 2015, at 8:37 AM, Bair, Raymond A. <rbair(a)anl.gov> wrote: >>>> >>>> Hi Charlie, >>>> >>>> From time to time LCRC hosts UC student projects/classes if they have >>>>an >>>> ANL professor/leader (you?). >>>> >>>> What scale of resources are needed, e.g., # nodes, # core-hours? Is >>>> this >>>> a semester long project? >>>> >>>> How many students? Is an industry/city person involved too? >>>> >>>> The process works, but one needs to allow lead time for the 593s. By >>>> the >>>> time all the foreign students actually enter their data and it gets >>>> approved, it can take a while. >>>> >>>> Ray >>>> >>>> ----------------------------------------- >>>> Ray Bair >>>> Computing, Environment, and Life Sciences >>>> Argonne National Laboratory >>>> and the University of Chicago >>>> TCS Building 240, Room 4122 >>>> 9700 South Cass Avenue >>>> Argonne, IL 60439 >>>> email: rbair(at)anl.gov >>>> Phone: (630)252-5751 >>>> >>>> >>>> >>>> >>>> >>>>> On 3/23/15, 6:38 AM, "Catlett, Charlie" <catlett(a)anl.gov> wrote: >>>>> >>>>> Ray is there a process I need to follow to get Uchicago grad students >>>>> access to fast linux machines? Might need training as well. It is >>>>>for >>>>> a >>>>> project looking at crime and weather. >>>>> >>>>> Thx >>>>> >>>>> CeC >>

1 0

[LCRC Accounts] Project Request: NeutrinoSim
by accounts＠lcrc.anl.gov 23 Mar '15

23 Mar '15

Hello, A new project on the LCRC cluster has been requested. Please forward the information on to the LCRC Allocation sub-committee. Applicant's name: Guang Yang Applicant's institution: ANL Applicant's division: HEP Project Name: NeutrinoSim Project title: Neutrino Simulation Associated funding: DOE Other Systems: Science: Doing the simulation related to neutrino physics. Argonne HEP do participate quite lots of neutrino projects, including Double Chooz, Nova, LBNF, MINOS, JUNO and so on. Large amount of simulation is needed. Project description: Submitting simulation jobs to simulate reactor antineutrino detector response by using offline softwares. Industry partnership: Project URL: Requested allocation: 490000 Q1: 0 Q2: 200000 Q3: 200000 Q4: 90000 Justification: Storage requirements: The requester has used undetermined amount hours of their initial startup project. In addition to approving an initial amount, please specify a Category and Subcategory for this project. For a list of the current selection of approved categories, please see: https://wiki.lcrc.anl.gov/wiki/Processes/Categories Once the Allocation committee has approved the project, please go to the Project Management page to create it: https://accounts.lcrc.anl.gov/projects.php Thank You, The LCRC Accounts System

1 0

Re: [allocations-admins] [LCRC Accounts] Project Request: DopingP
by Low, John J. 23 Mar '15

23 Mar '15

Alejandro works for Peter Littlewood. He has been publishing between 1 and 2 papers per month from his fusion allocations. Although he is using Siesta, which does not scale well. He is making good progress with longer serial jobs. By the way, This reminds me a recent modification of Siesta which claims good scaling. See attached paper. Alejandro is satisfied with the throughput he gets with the current version of Siesta. I have sent him a copy of Lin’s paper, Alejandro did not express an interest in it. Since there appears a fair amount of use of Siesta, in spite of poor parallel performance. Perhaps I should consider building SIESTA-PEXI. If I build it, they may use it. John J. Low Principal Computational Science Specialist Computing, Environment and Life Sciences Building 240, 2143 9700 South Cass Avenue Argonne National Laboratory Argonne, IL 60439. 630-252-0045 www.linkedin.com/pub/john-low/15/8b0/5aa/ -----Original Message----- From: <Bair>, "Bair, Raymond A." <rbair(a)anl.gov> Reply-To: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov> Date: Monday, March 23, 2015 at 3:37 PM To: LCRC Allocations Admins <allocations-admins(a)lcrc.anl.gov> Subject: Re: [allocations-admins] [LCRC Accounts] Project Request: DopingP >This one came in after the Allocations Committee Meeting. Popping it back >on the stack. > >Ray > > > > >On 3/19/15, 4:59 PM, "accounts(a)lcrc.anl.gov" <accounts(a)lcrc.anl.gov> >wrote: > >>Hello, >> >>A new project on the LCRC cluster has been requested. Please forward >>the information on to the LCRC Allocation sub-committee. >> >> Applicant's name: Alejandro Lopez Bezanilla >>Applicant's institution: ANL >> Applicant's division: MSD >> Project Name: DopingP >> Project title: Transport Properties Of Doped Phosphorene >>Nanoribbons >> Associated funding: >> Other Systems: >> Science: I will perform a numerical study of electronic >>transport properties of chemically modified phosporene monolayers. By >>means of first-principle calculations a self-consistent scattering >>potential will be derived for substitutions with rows II and III >>elements. The quantum-mechanical Landauer-Buttiker approach will be used >>to evaluate the conductivities of doped systems with various impurity >>concentrations. Quantum interference effects at zero temperature will be >>modeled to show the effect on the band gap of randomly distributed >>defects over 1 micrometer long P nanoribbons. The expected mobility gaps >>created upon doping may lead to greater efficiency in the design of new >>black-P based devices. >> Project description: As with previous projects developed in Blues, I >>will use a mixed of density functional theory based method with quantum >>transport codes. >> >>SIESTA code as compiled by the LCRC team will be extensively used to >>generated the energetic description of various doped systems. The codes >>run with an excellent performance on 1 node/16 cores. In the order of 400 >>jobs, running in 1 core each are expected to produce the data for the >>second part of the project. >> >>A code based on the Landauer-Buttiker approach will compute transmission >>coefficients of the defected systems. The code is currently running in >>Blues with a linear scalability on up to 16 nodes. >> >>Both codes are implemented in Fortran and use standard MPI >>parallelization. Several publications have been produced along the FY2014 >>using this approaches. >> >> Industry partnership: >> Project URL: >> Requested allocation: 375000 >> Q1: 0 >> Q2: 100000 >> Q3: 125000 >> Q4: 150000 >> Justification: >> Storage requirements: 1 TB >> >> >>The requester has used undetermined amount hours of their initial startup >>project. >> >>In addition to approving an initial amount, please specify a Category >>and Subcategory for this project. For a list of the current selection >>of approved categories, please see: >> >> https://wiki.lcrc.anl.gov/wiki/Processes/Categories >> >>Once the Allocation committee has approved the project, please go to >>the Project Management page to create it: >> >>https://accounts.lcrc.anl.gov/projects.php >> >>Thank You, >>The LCRC Accounts System >>_______________________________________________ >>allocations-admins mailing list >>allocations-admins(a)lcrc.anl.gov >>https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins > >_______________________________________________ >allocations-admins mailing list >allocations-admins(a)lcrc.anl.gov >https://lists.lcrc.anl.gov/mailman/listinfo/allocations-admins

1 0