- Kbase-hw - mailman3.cels.anl.gov

Re: [Kbase-hw] kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. There will also be some security things to work out as well. (was reminded by Gene stopping by my office) What do you mean 1G images? -nld On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. > > In any event, we cannot run the production services on a bunch of 1G images. > > --bob > > On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > >> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >> -nld >> >> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >> >>> oh, it has to be remade first? >>> >>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>> >>>> That is the eventual plan, once we remake magellan. >>>> >>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>> >>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>> >>>>> --bob >>>>> >>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>> >>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>> <kbase-hw-rollout.pdf> >>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>> >>>>>>> >>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>> >>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>> >>>>>> -- >>>>>> Hunter Matthews Unix Administrator >>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>> Never take candy from strangers. Especially on the internet. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> Rick Stevens >>>> Associate Laboratory Director >>>> Computing, Environment and Life Science >>>> Argonne National Laboratory >>>> >>>> Professor of Computer Science >>>> Senior Fellow Computation Institute >>>> Senior Fellow Institute for Genomics and Systems Biology >>>> The University of Chicago >>>> >>>> stevens(a)anl.gov >>>> stevens(a)ci.uchicago.edu >>>> >>>> (v) 630-252-3378 >>>> (f) 630-252-6333 >>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

Narayan, how fast can we flip parts of magellan into the new configuration? Can we do it in parts? On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. > -nld > > On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: > >> oh, it has to be remade first? >> >> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >> >>> That is the eventual plan, once we remake magellan. >>> >>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>> >>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>> >>>> --bob >>>> >>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>> >>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>> <kbase-hw-rollout.pdf> >>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>> >>>>>> >>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>> >>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>> >>>>> -- >>>>> Hunter Matthews Unix Administrator >>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>> Never take candy from strangers. Especially on the internet. >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >>> Rick Stevens >>> Associate Laboratory Director >>> Computing, Environment and Life Science >>> Argonne National Laboratory >>> >>> Professor of Computer Science >>> Senior Fellow Computation Institute >>> Senior Fellow Institute for Genomics and Systems Biology >>> The University of Chicago >>> >>> stevens(a)anl.gov >>> stevens(a)ci.uchicago.edu >>> >>> (v) 630-252-3378 >>> (f) 630-252-6333 >>> >>> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

Yes.. I think that the real plan needs to be more of a a rolling upgrade so that we don't lose capability in the mean time. We need to think of it as a production resource. I haven't thought this through, but perhaps we can split into two parts so that we upgrade 1/2 while the other keep going etc. I agree 1G images are pointless. 100G is about the minimum to do anything useful. The timetable in the slides is probably too strung out.. On thursday and friday we need to collect feedback on the strawman plan and look for how to accelerate things.. and make the plan match what we need for KBase. On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. > > In any event, we cannot run the production services on a bunch of 1G images. > > --bob > > On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > >> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >> -nld >> >> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >> >>> oh, it has to be remade first? >>> >>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>> >>>> That is the eventual plan, once we remake magellan. >>>> >>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>> >>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>> >>>>> --bob >>>>> >>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>> >>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>> <kbase-hw-rollout.pdf> >>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>> >>>>>>> >>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>> >>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>> >>>>>> -- >>>>>> Hunter Matthews Unix Administrator >>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>> Never take candy from strangers. Especially on the internet. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> Rick Stevens >>>> Associate Laboratory Director >>>> Computing, Environment and Life Science >>>> Argonne National Laboratory >>>> >>>> Professor of Computer Science >>>> Senior Fellow Computation Institute >>>> Senior Fellow Institute for Genomics and Systems Biology >>>> The University of Chicago >>>> >>>> stevens(a)anl.gov >>>> stevens(a)ci.uchicago.edu >>>> >>>> (v) 630-252-3378 >>>> (f) 630-252-6333 >>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> > Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. In any event, we cannot run the production services on a bunch of 1G images. --bob On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. > -nld > > On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: > >> oh, it has to be remade first? >> >> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >> >>> That is the eventual plan, once we remake magellan. >>> >>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>> >>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>> >>>> --bob >>>> >>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>> >>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>> <kbase-hw-rollout.pdf> >>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>> >>>>>> >>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>> >>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>> >>>>> -- >>>>> Hunter Matthews Unix Administrator >>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>> Never take candy from strangers. Especially on the internet. >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >>> Rick Stevens >>> Associate Laboratory Director >>> Computing, Environment and Life Science >>> Argonne National Laboratory >>> >>> Professor of Computer Science >>> Senior Fellow Computation Institute >>> Senior Fellow Institute for Genomics and Systems Biology >>> The University of Chicago >>> >>> stevens(a)anl.gov >>> stevens(a)ci.uchicago.edu >>> >>> (v) 630-252-3378 >>> (f) 630-252-6333 >>> >>> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw >

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. -nld On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: > oh, it has to be remade first? > > On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: > >> That is the eventual plan, once we remake magellan. >> >> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >> >>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>> >>> --bob >>> >>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>> >>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>> <kbase-hw-rollout.pdf> >>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>> >>>>> >>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>> >>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>> >>>> -- >>>> Hunter Matthews Unix Administrator >>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>> Never take candy from strangers. Especially on the internet. >>>> >>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >> Rick Stevens >> Associate Laboratory Director >> Computing, Environment and Life Science >> Argonne National Laboratory >> >> Professor of Computer Science >> Senior Fellow Computation Institute >> Senior Fellow Institute for Genomics and Systems Biology >> The University of Chicago >> >> stevens(a)anl.gov >> stevens(a)ci.uchicago.edu >> >> (v) 630-252-3378 >> (f) 630-252-6333 >> >> > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

oh, it has to be remade first? On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: > That is the eventual plan, once we remake magellan. > > On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: > >> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >> >> --bob >> >> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >> >>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>> <kbase-hw-rollout.pdf> >>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>> >>>> >>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>> >>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>> >>> -- >>> Hunter Matthews Unix Administrator >>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>> Never take candy from strangers. Especially on the internet. >>> >>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > Rick Stevens > Associate Laboratory Director > Computing, Environment and Life Science > Argonne National Laboratory > > Professor of Computer Science > Senior Fellow Computation Institute > Senior Fellow Institute for Genomics and Systems Biology > The University of Chicago > > stevens(a)anl.gov > stevens(a)ci.uchicago.edu > > (v) 630-252-3378 > (f) 630-252-6333 > >

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

That is the eventual plan, once we remake magellan. On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: > How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. > > --bob > > On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: > >> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >> <kbase-hw-rollout.pdf> >> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >> >>> >>> There are two things on the agenda for Thursday that I'm on the hook for. >>> >>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >> >> -- >> Hunter Matthews Unix Administrator >> Office: Bldg 221 Room B240 Argonne National Labs, MCS >> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >> Never take candy from strangers. Especially on the internet. >> >> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. --bob On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: > Attached is a draft of my deployment drawing in electronic form (omnigraffle) > <kbase-hw-rollout.pdf> > On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: > >> >> There are two things on the agenda for Thursday that I'm on the hook for. >> >> 1) hardware deployment strategy (Hunter and Tom) (20mins) >> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) > > -- > Hunter Matthews Unix Administrator > Office: Bldg 221 Room B240 Argonne National Labs, MCS > Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 > Never take candy from strangers. Especially on the internet. > > > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Brettin, Thomas S. 20 Sep '11

20 Sep '11

Nice! Looks much prettier than the ppt. -----Original Message----- From: Hunter Matthews [mailto:[email protected]] Sent: Tuesday, September 20, 2011 11:38 AM To: Brettin, Thomas S. Cc: kbase-hw(a)lists.kbase.us Subject: Re: [Kbase-hw] FW: kb store and hw deployment Attached is a draft of my deployment drawing in electronic form (omnigraffle)

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Hunter Matthews 20 Sep '11

20 Sep '11

Attached is a draft of my deployment drawing in electronic form (omnigraffle) On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: > > There are two things on the agenda for Thursday that I'm on the hook for. > > 1) hardware deployment strategy (Hunter and Tom) (20mins) > 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) -- Hunter Matthews Unix Administrator Office: Bldg 221 Room B240 Argonne National Labs, MCS Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 Never take candy from strangers. Especially on the internet.

1 0