September 2011 - Kbase-hw - mailman3.cels.anl.gov

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

Narayan, how fast can we flip parts of magellan into the new configuration? Can we do it in parts? On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. > -nld > > On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: > >> oh, it has to be remade first? >> >> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >> >>> That is the eventual plan, once we remake magellan. >>> >>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>> >>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>> >>>> --bob >>>> >>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>> >>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>> <kbase-hw-rollout.pdf> >>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>> >>>>>> >>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>> >>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>> >>>>> -- >>>>> Hunter Matthews Unix Administrator >>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>> Never take candy from strangers. Especially on the internet. >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >>> Rick Stevens >>> Associate Laboratory Director >>> Computing, Environment and Life Science >>> Argonne National Laboratory >>> >>> Professor of Computer Science >>> Senior Fellow Computation Institute >>> Senior Fellow Institute for Genomics and Systems Biology >>> The University of Chicago >>> >>> stevens(a)anl.gov >>> stevens(a)ci.uchicago.edu >>> >>> (v) 630-252-3378 >>> (f) 630-252-6333 >>> >>> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

Yes.. I think that the real plan needs to be more of a a rolling upgrade so that we don't lose capability in the mean time. We need to think of it as a production resource. I haven't thought this through, but perhaps we can split into two parts so that we upgrade 1/2 while the other keep going etc. I agree 1G images are pointless. 100G is about the minimum to do anything useful. The timetable in the slides is probably too strung out.. On thursday and friday we need to collect feedback on the strawman plan and look for how to accelerate things.. and make the plan match what we need for KBase. On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. > > In any event, we cannot run the production services on a bunch of 1G images. > > --bob > > On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > >> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >> -nld >> >> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >> >>> oh, it has to be remade first? >>> >>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>> >>>> That is the eventual plan, once we remake magellan. >>>> >>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>> >>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>> >>>>> --bob >>>>> >>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>> >>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>> <kbase-hw-rollout.pdf> >>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>> >>>>>>> >>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>> >>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>> >>>>>> -- >>>>>> Hunter Matthews Unix Administrator >>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>> Never take candy from strangers. Especially on the internet. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> Rick Stevens >>>> Associate Laboratory Director >>>> Computing, Environment and Life Science >>>> Argonne National Laboratory >>>> >>>> Professor of Computer Science >>>> Senior Fellow Computation Institute >>>> Senior Fellow Institute for Genomics and Systems Biology >>>> The University of Chicago >>>> >>>> stevens(a)anl.gov >>>> stevens(a)ci.uchicago.edu >>>> >>>> (v) 630-252-3378 >>>> (f) 630-252-6333 >>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> > Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. In any event, we cannot run the production services on a bunch of 1G images. --bob On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. > -nld > > On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: > >> oh, it has to be remade first? >> >> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >> >>> That is the eventual plan, once we remake magellan. >>> >>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>> >>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>> >>>> --bob >>>> >>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>> >>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>> <kbase-hw-rollout.pdf> >>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>> >>>>>> >>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>> >>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>> >>>>> -- >>>>> Hunter Matthews Unix Administrator >>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>> Never take candy from strangers. Especially on the internet. >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >>> Rick Stevens >>> Associate Laboratory Director >>> Computing, Environment and Life Science >>> Argonne National Laboratory >>> >>> Professor of Computer Science >>> Senior Fellow Computation Institute >>> Senior Fellow Institute for Genomics and Systems Biology >>> The University of Chicago >>> >>> stevens(a)anl.gov >>> stevens(a)ci.uchicago.edu >>> >>> (v) 630-252-3378 >>> (f) 630-252-6333 >>> >>> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw >

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. -nld On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: > oh, it has to be remade first? > > On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: > >> That is the eventual plan, once we remake magellan. >> >> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >> >>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>> >>> --bob >>> >>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>> >>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>> <kbase-hw-rollout.pdf> >>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>> >>>>> >>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>> >>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>> >>>> -- >>>> Hunter Matthews Unix Administrator >>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>> Never take candy from strangers. Especially on the internet. >>>> >>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >> Rick Stevens >> Associate Laboratory Director >> Computing, Environment and Life Science >> Argonne National Laboratory >> >> Professor of Computer Science >> Senior Fellow Computation Institute >> Senior Fellow Institute for Genomics and Systems Biology >> The University of Chicago >> >> stevens(a)anl.gov >> stevens(a)ci.uchicago.edu >> >> (v) 630-252-3378 >> (f) 630-252-6333 >> >> > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

oh, it has to be remade first? On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: > That is the eventual plan, once we remake magellan. > > On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: > >> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >> >> --bob >> >> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >> >>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>> <kbase-hw-rollout.pdf> >>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>> >>>> >>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>> >>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>> >>> -- >>> Hunter Matthews Unix Administrator >>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>> Never take candy from strangers. Especially on the internet. >>> >>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > Rick Stevens > Associate Laboratory Director > Computing, Environment and Life Science > Argonne National Laboratory > > Professor of Computer Science > Senior Fellow Computation Institute > Senior Fellow Institute for Genomics and Systems Biology > The University of Chicago > > stevens(a)anl.gov > stevens(a)ci.uchicago.edu > > (v) 630-252-3378 > (f) 630-252-6333 > >

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

That is the eventual plan, once we remake magellan. On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: > How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. > > --bob > > On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: > >> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >> <kbase-hw-rollout.pdf> >> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >> >>> >>> There are two things on the agenda for Thursday that I'm on the hook for. >>> >>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >> >> -- >> Hunter Matthews Unix Administrator >> Office: Bldg 221 Room B240 Argonne National Labs, MCS >> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >> Never take candy from strangers. Especially on the internet. >> >> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. --bob On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: > Attached is a draft of my deployment drawing in electronic form (omnigraffle) > <kbase-hw-rollout.pdf> > On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: > >> >> There are two things on the agenda for Thursday that I'm on the hook for. >> >> 1) hardware deployment strategy (Hunter and Tom) (20mins) >> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) > > -- > Hunter Matthews Unix Administrator > Office: Bldg 221 Room B240 Argonne National Labs, MCS > Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 > Never take candy from strangers. Especially on the internet. > > > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Brettin, Thomas S. 20 Sep '11

20 Sep '11

Nice! Looks much prettier than the ppt. -----Original Message----- From: Hunter Matthews [mailto:[email protected]] Sent: Tuesday, September 20, 2011 11:38 AM To: Brettin, Thomas S. Cc: kbase-hw(a)lists.kbase.us Subject: Re: [Kbase-hw] FW: kb store and hw deployment Attached is a draft of my deployment drawing in electronic form (omnigraffle)

1 0

Re: [Kbase-hw] FW: kb store and hw deployment
by Hunter Matthews 20 Sep '11

20 Sep '11

Attached is a draft of my deployment drawing in electronic form (omnigraffle) On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: > > There are two things on the agenda for Thursday that I'm on the hook for. > > 1) hardware deployment strategy (Hunter and Tom) (20mins) > 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) -- Hunter Matthews Unix Administrator Office: Bldg 221 Room B240 Argonne National Labs, MCS Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 Never take candy from strangers. Especially on the internet.

1 0

FW: kb store and hw deployment
by Brettin, Thomas S. 20 Sep '11

20 Sep '11

There are two things on the agenda for Thursday that I'm on the hook for. 1) hardware deployment strategy (Hunter and Tom) (20mins) 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) Attached is a ppt rendition of what Hunter and I discussed last week on the hardware deployment. I plan to add a slide of the pic from the proposal and some pics (or translations) of the whiteboard from the Aug HW meeting. Hunter, notice that I accelerated the timeline for the DTNs. I imagine the 20 minutes going something like: 1) what was discussed in the proposal 2) what the state of hw was when the project started 3) what the deployment strategy 4) questions to identify gaps or changes in the schedule With the majority of time being spent on num 3 followed by 4. For the kbstore, both Bob and I would like to see requirements discussions begin, although we understand that the requirements will not be well understood until the demos are more refined. An entry to the requirements would be valuable now, but if time does not allow, then we can delay the discussion to another day. Here is what Bob and I discussed for the kbstore: > 1) articulate the requirements that we know of and get validation of those. > 2) get new/refined requirements from the group at-large. > 3) avoid discussions of implementation details. > 4) could tip-toe into discussion of public/private access, but I prefer not to as this discussion always consumes the stage. How does this sound to all? Tom -----Original Message----- From: Robert Olson [mailto:[email protected]] Sent: Monday, September 19, 2011 4:27 PM To: Brettin, Thomas S. Subject: Re: kb store That all sounds right. I think we can completely sidestep the public/private by deferring it to the group that is dealing with authentication issues (in some sense we have to, since they define the detailed requirements for any component of the architecture that uses the authentication methods) Avoiding implementation detail discussion is indeed key, as that's a tarpit. I don't think it's too soon to discuss requirements. We've been driving ours based on our initial ideas regarding the rough workflow ideas and on the requirements driven by the microbes demo. --bob On Sep 19, 2011, at 8:50 AM, Brettin, Thomas S. wrote: > Hi Bob, > > Just wanted to sync up with you on the 4-5pm Thurs. slot on the agenda > that we share. I was thinking marginally > > 1) articulate the requirements that we know of and get validation of those. > 2) get new/refined requirements from the group at-large. > 3) avoid discussions of implementation details. > 4) could tip-toe into discussion of public/private access, but I prefer not to as this discussion always consumes the stage. > > Thoughts? > > One big question, is it too soon to start easing into discussion kbstore requirements? > > t

1 0