September 2011 - Kbase-hw - mailman3.cels.anl.gov

FW: Presentation and notes from microbes session and datatypes
by Brettin, Thomas S. 23 Sep '11

23 Sep '11

Thomas Brettin Oak Ridge National Laboratory 865-603-7760 (mobile) 865-574-0455 (office) ________________________________________ From: Christopher Henry [chrisshenry(a)gmail.com] Sent: Thursday, September 22, 2011 11:08 PM To: Brettin, Thomas S. Cc: Rick Stevens Subject: Presentation and notes from microbes session and datatypes Hi Tom, As I recall, we're supposed to send you the documents for distribution to the meeting attendees. They're attached. The presentation isn't an exact replica since it's missing 2 slides (accidentally lost them). The microbes notes includes the complete datatypes list we made on slide 2. Let me know if you have questions or need anything else. Chris

1 0

apparmor
by Hunter Matthews 22 Sep '11

22 Sep '11

I've moved the mysql storage area from /var/lib/mysql to /sandbox/kbase/projects/prototype/mysql. I did not know that ubuntu had apparmor. I've modified the apparmor definition to allow mysql equivalent access to this area. Resstarted mysql. My intent is this afternoon to do the same for postgres.

1 0

Re: [Kbase-hw] kb store and hw deployment
by Hunter Matthews 20 Sep '11

20 Sep '11

New version sent to Tom. On Sep 20, 2011, at 1:53 PM, Rick Stevens wrote: > lets edit it so we don't have an angry mob on our hands :-) > > > On Sep 20, 2011, at 1:52 PM, Hunter Matthews wrote: > >> I put that on the slide just to have SOME kind of config listed for the VM's. I'm starting to regret that. >> >> >> On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: >> >>> That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. >>> >>> There will also be some security things to work out as well. (was reminded by Gene stopping by my office) >>> >>> What do you mean 1G images? >>> -nld >>> >>> On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: >>> >>>> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >>>> >>>> In any event, we cannot run the production services on a bunch of 1G images. >>>> >>>> --bob >>>> >>>> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >>>> >>>>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>>>> -nld >>>>> >>>>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>>>> >>>>>> oh, it has to be remade first? >>>>>> >>>>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>>>> >>>>>>> That is the eventual plan, once we remake magellan. >>>>>>> >>>>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>>>> >>>>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>>>> >>>>>>>> --bob >>>>>>>> >>>>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>>>> >>>>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>>>> <kbase-hw-rollout.pdf> >>>>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>>>> >>>>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Hunter Matthews Unix Administrator >>>>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Kbase-hw mailing list >>>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Kbase-hw mailing list >>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>> >>>>>>> Rick Stevens >>>>>>> Associate Laboratory Director >>>>>>> Computing, Environment and Life Science >>>>>>> Argonne National Laboratory >>>>>>> >>>>>>> Professor of Computer Science >>>>>>> Senior Fellow Computation Institute >>>>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>>>> The University of Chicago >>>>>>> >>>>>>> stevens(a)anl.gov >>>>>>> stevens(a)ci.uchicago.edu >>>>>>> >>>>>>> (v) 630-252-3378 >>>>>>> (f) 630-252-6333 >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >> -- >> Hunter Matthews Unix Administrator >> Office: Bldg 221 Room B240 Argonne National Labs, MCS >> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >> Never take candy from strangers. Especially on the internet. >> >> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > Rick Stevens > Associate Laboratory Director > Computing, Environment and Life Science > Argonne National Laboratory > > Professor of Computer Science > Senior Fellow Computation Institute > Senior Fellow Institute for Genomics and Systems Biology > The University of Chicago > > stevens(a)anl.gov > stevens(a)ci.uchicago.edu > > (v) 630-252-3378 > (f) 630-252-6333 > > -- Hunter Matthews Unix Administrator Office: Bldg 221 Room B240 Argonne National Labs, MCS Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 Never take candy from strangers. Especially on the internet.

1 0

Re: [Kbase-hw] kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

I think that part of the plan is to use volume storage instead of bigger VMs where possible (since volume storage is and should be faster). This is all TBD subject to our experiences when we get there though. -nld On Sep 20, 2011, at 1:43 PM, Robert Olson wrote: > Hunter's picture shows a bunch of 1GB images as hosting services. > > On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > >> That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. >> >> There will also be some security things to work out as well. (was reminded by Gene stopping by my office) >> >> What do you mean 1G images? >> -nld >> >> On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: >> >>> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >>> >>> In any event, we cannot run the production services on a bunch of 1G images. >>> >>> --bob >>> >>> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >>> >>>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>>> -nld >>>> >>>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>>> >>>>> oh, it has to be remade first? >>>>> >>>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>>> >>>>>> That is the eventual plan, once we remake magellan. >>>>>> >>>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>>> >>>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>>> >>>>>>> --bob >>>>>>> >>>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>>> >>>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>>> <kbase-hw-rollout.pdf> >>>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>>> >>>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>>> >>>>>>>> -- >>>>>>>> Hunter Matthews Unix Administrator >>>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Kbase-hw mailing list >>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> Rick Stevens >>>>>> Associate Laboratory Director >>>>>> Computing, Environment and Life Science >>>>>> Argonne National Laboratory >>>>>> >>>>>> Professor of Computer Science >>>>>> Senior Fellow Computation Institute >>>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>>> The University of Chicago >>>>>> >>>>>> stevens(a)anl.gov >>>>>> stevens(a)ci.uchicago.edu >>>>>> >>>>>> (v) 630-252-3378 >>>>>> (f) 630-252-6333 >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>> >> >

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

lets edit it so we don't have an angry mob on our hands :-) On Sep 20, 2011, at 1:52 PM, Hunter Matthews wrote: > I put that on the slide just to have SOME kind of config listed for the VM's. I'm starting to regret that. > > > On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > >> That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. >> >> There will also be some security things to work out as well. (was reminded by Gene stopping by my office) >> >> What do you mean 1G images? >> -nld >> >> On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: >> >>> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >>> >>> In any event, we cannot run the production services on a bunch of 1G images. >>> >>> --bob >>> >>> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >>> >>>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>>> -nld >>>> >>>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>>> >>>>> oh, it has to be remade first? >>>>> >>>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>>> >>>>>> That is the eventual plan, once we remake magellan. >>>>>> >>>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>>> >>>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>>> >>>>>>> --bob >>>>>>> >>>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>>> >>>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>>> <kbase-hw-rollout.pdf> >>>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>>> >>>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>>> >>>>>>>> -- >>>>>>>> Hunter Matthews Unix Administrator >>>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Kbase-hw mailing list >>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> Rick Stevens >>>>>> Associate Laboratory Director >>>>>> Computing, Environment and Life Science >>>>>> Argonne National Laboratory >>>>>> >>>>>> Professor of Computer Science >>>>>> Senior Fellow Computation Institute >>>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>>> The University of Chicago >>>>>> >>>>>> stevens(a)anl.gov >>>>>> stevens(a)ci.uchicago.edu >>>>>> >>>>>> (v) 630-252-3378 >>>>>> (f) 630-252-6333 >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > -- > Hunter Matthews Unix Administrator > Office: Bldg 221 Room B240 Argonne National Labs, MCS > Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 > Never take candy from strangers. Especially on the internet. > > > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

okay.. good.. On Sep 20, 2011, at 1:50 PM, Narayan Desai wrote: > Our mails crossed. The plan is to do it in parts. I think that it is going to take about a month to get things sorted out. We'll keep as much as possible running in the old configuration until we need to change things around. After it is up and running, there will be a several month period of iterative refinements that will be needed as well. > > Our goal is to get new infrastructure and roll compute nodes into it. That is pretty easy to do non-invasively. The storage part is harder, due to the way that openstack works. (and also, the precise details of how the current storage is configured). > -nld > > On Sep 20, 2011, at 1:34 PM, Rick Stevens wrote: > >> Narayan, >> >> how fast can we flip parts of magellan into the new configuration? Can we do it in parts? >> >> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >> >>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>> -nld >>> >>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>> >>>> oh, it has to be remade first? >>>> >>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>> >>>>> That is the eventual plan, once we remake magellan. >>>>> >>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>> >>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>> >>>>>> --bob >>>>>> >>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>> >>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>> <kbase-hw-rollout.pdf> >>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>> >>>>>>>> >>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>> >>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>> >>>>>>> -- >>>>>>> Hunter Matthews Unix Administrator >>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> Rick Stevens >>>>> Associate Laboratory Director >>>>> Computing, Environment and Life Science >>>>> Argonne National Laboratory >>>>> >>>>> Professor of Computer Science >>>>> Senior Fellow Computation Institute >>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>> The University of Chicago >>>>> >>>>> stevens(a)anl.gov >>>>> stevens(a)ci.uchicago.edu >>>>> >>>>> (v) 630-252-3378 >>>>> (f) 630-252-6333 >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >> >> Rick Stevens >> Associate Laboratory Director >> Computing, Environment and Life Science >> Argonne National Laboratory >> >> Professor of Computer Science >> Senior Fellow Computation Institute >> Senior Fellow Institute for Genomics and Systems Biology >> The University of Chicago >> >> stevens(a)anl.gov >> stevens(a)ci.uchicago.edu >> >> (v) 630-252-3378 >> (f) 630-252-6333 >> >> > Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] kb store and hw deployment
by Hunter Matthews 20 Sep '11

20 Sep '11

I put that on the slide just to have SOME kind of config listed for the VM's. I'm starting to regret that. On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. > > There will also be some security things to work out as well. (was reminded by Gene stopping by my office) > > What do you mean 1G images? > -nld > > On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > >> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >> >> In any event, we cannot run the production services on a bunch of 1G images. >> >> --bob >> >> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >> >>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>> -nld >>> >>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>> >>>> oh, it has to be remade first? >>>> >>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>> >>>>> That is the eventual plan, once we remake magellan. >>>>> >>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>> >>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>> >>>>>> --bob >>>>>> >>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>> >>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>> <kbase-hw-rollout.pdf> >>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>> >>>>>>>> >>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>> >>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>> >>>>>>> -- >>>>>>> Hunter Matthews Unix Administrator >>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> Rick Stevens >>>>> Associate Laboratory Director >>>>> Computing, Environment and Life Science >>>>> Argonne National Laboratory >>>>> >>>>> Professor of Computer Science >>>>> Senior Fellow Computation Institute >>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>> The University of Chicago >>>>> >>>>> stevens(a)anl.gov >>>>> stevens(a)ci.uchicago.edu >>>>> >>>>> (v) 630-252-3378 >>>>> (f) 630-252-6333 >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >> > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw -- Hunter Matthews Unix Administrator Office: Bldg 221 Room B240 Argonne National Labs, MCS Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 Never take candy from strangers. Especially on the internet.

1 0

Re: [Kbase-hw] kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

Our mails crossed. The plan is to do it in parts. I think that it is going to take about a month to get things sorted out. We'll keep as much as possible running in the old configuration until we need to change things around. After it is up and running, there will be a several month period of iterative refinements that will be needed as well. Our goal is to get new infrastructure and roll compute nodes into it. That is pretty easy to do non-invasively. The storage part is harder, due to the way that openstack works. (and also, the precise details of how the current storage is configured). -nld On Sep 20, 2011, at 1:34 PM, Rick Stevens wrote: > Narayan, > > how fast can we flip parts of magellan into the new configuration? Can we do it in parts? > > On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > >> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >> -nld >> >> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >> >>> oh, it has to be remade first? >>> >>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>> >>>> That is the eventual plan, once we remake magellan. >>>> >>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>> >>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>> >>>>> --bob >>>>> >>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>> >>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>> <kbase-hw-rollout.pdf> >>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>> >>>>>>> >>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>> >>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>> >>>>>> -- >>>>>> Hunter Matthews Unix Administrator >>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>> Never take candy from strangers. Especially on the internet. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> Rick Stevens >>>> Associate Laboratory Director >>>> Computing, Environment and Life Science >>>> Argonne National Laboratory >>>> >>>> Professor of Computer Science >>>> Senior Fellow Computation Institute >>>> Senior Fellow Institute for Genomics and Systems Biology >>>> The University of Chicago >>>> >>>> stevens(a)anl.gov >>>> stevens(a)ci.uchicago.edu >>>> >>>> (v) 630-252-3378 >>>> (f) 630-252-6333 >>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> > > Rick Stevens > Associate Laboratory Director > Computing, Environment and Life Science > Argonne National Laboratory > > Professor of Computer Science > Senior Fellow Computation Institute > Senior Fellow Institute for Genomics and Systems Biology > The University of Chicago > > stevens(a)anl.gov > stevens(a)ci.uchicago.edu > > (v) 630-252-3378 > (f) 630-252-6333 > >

1 0

Re: [Kbase-hw] kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

Hunter's picture shows a bunch of 1GB images as hosting services. On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. > > There will also be some security things to work out as well. (was reminded by Gene stopping by my office) > > What do you mean 1G images? > -nld > > On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > >> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >> >> In any event, we cannot run the production services on a bunch of 1G images. >> >> --bob >> >> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >> >>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>> -nld >>> >>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>> >>>> oh, it has to be remade first? >>>> >>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>> >>>>> That is the eventual plan, once we remake magellan. >>>>> >>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>> >>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>> >>>>>> --bob >>>>>> >>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>> >>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>> <kbase-hw-rollout.pdf> >>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>> >>>>>>>> >>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>> >>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>> >>>>>>> -- >>>>>>> Hunter Matthews Unix Administrator >>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> Rick Stevens >>>>> Associate Laboratory Director >>>>> Computing, Environment and Life Science >>>>> Argonne National Laboratory >>>>> >>>>> Professor of Computer Science >>>>> Senior Fellow Computation Institute >>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>> The University of Chicago >>>>> >>>>> stevens(a)anl.gov >>>>> stevens(a)ci.uchicago.edu >>>>> >>>>> (v) 630-252-3378 >>>>> (f) 630-252-6333 >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >> >

1 0

Re: [Kbase-hw] kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. There will also be some security things to work out as well. (was reminded by Gene stopping by my office) What do you mean 1G images? -nld On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. > > In any event, we cannot run the production services on a bunch of 1G images. > > --bob > > On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > >> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >> -nld >> >> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >> >>> oh, it has to be remade first? >>> >>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>> >>>> That is the eventual plan, once we remake magellan. >>>> >>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>> >>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>> >>>>> --bob >>>>> >>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>> >>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>> <kbase-hw-rollout.pdf> >>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>> >>>>>>> >>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>> >>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>> >>>>>> -- >>>>>> Hunter Matthews Unix Administrator >>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>> Never take candy from strangers. Especially on the internet. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> Rick Stevens >>>> Associate Laboratory Director >>>> Computing, Environment and Life Science >>>> Argonne National Laboratory >>>> >>>> Professor of Computer Science >>>> Senior Fellow Computation Institute >>>> Senior Fellow Institute for Genomics and Systems Biology >>>> The University of Chicago >>>> >>>> stevens(a)anl.gov >>>> stevens(a)ci.uchicago.edu >>>> >>>> (v) 630-252-3378 >>>> (f) 630-252-6333 >>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >

1 0