- Kbase-hw - mailman3.cels.anl.gov

Fwd: [I2-NEWS] Internet2, ESnet Complete First Transcontinental 100G Network Deployment
by Rick Stevens 13 Oct '11

13 Oct '11

FYI Begin forwarded message: > From: Todd Sedmak <todd(a)internet2.edu> > Subject: [I2-NEWS] Internet2, ESnet Complete First Transcontinental 100G Network Deployment > Date: October 11, 2011 9:46:15 AM CDT > To: i2-news(a)internet2.edu > > > Internet2, ESnet Complete First Transcontinental 100G Network Deployment > > New Massive Capacity Networks to Benefit U.S. Scientists, Researchers, and Educators > > Ann Arbor, Mich.—Oct. 11, 2011—Two of the nation’s leading research networks – the U.S. Department of Energy’s (DOE) Energy Sciences Network (ESnet) and Internet2 –today announced that they have completed the world’s first transcontinental deployment of 100 Gigabit per second (Gbps) using coherent technology. Built on Ciena’s 6500 Packet-Optical Platform, the new 8.8 Terabit per second network is equipped with 100 Gbps optical backbone connections. Those connections are now operational between New York, Washington D.C., Cleveland, Chicago, Kansas City, Denver, Salt Lake City, and Sunnyvale spanning a distance nearly 4000 miles. > > “This new coast-to-coast capacity represents the first major milestone in completing the nation’s most advanced platform for network-based innovation,” said Rob Vietzke, Executive Director of Network Services for Internet2. “Prior innovations from the research and education community have given us the Internet itself, the world-wide web and social networking. We can only imagine what the major new capabilities of this new network might enable in a classroom, research lab or health clinic.” > > Both ESnet and Internet2 are upgrading their respective networks to new 100 Gbps technology on a nationwide scale to ensure they keep pace with the exponential growth in scientific research traffic being driven by the nation’s research labs and universities. Internet2’s network will also extend to support the country’s community anchor institutions including libraries, hospitals, K-12 schools, community colleges and public safety organizations as part of its United States Unified Community Anchor Network (U.S. UCAN) project. > > Internet2 provides a national high-performance network that connects America’s colleges and universities to collaborators worldwide. ESnet – managed by Lawrence Berkeley National Laboratory (Berkeley Lab) – is a national network that connects thousands of DOE Office of Science researchers at more than 40 different U.S. laboratories and supercomputing facilities and links them to research partners around the world. > > “The global science community’s needs for managing data are exploding in scope and complexity requiring a fundamental shift in the way we provide networking. By 2015, we anticipate that ESnet will carry 100 petabytes of traffic per year – and this volume will continue to grow driven by research fields like high energy physics, climate research and genomics,” said Steve Cotter, ESnet department head. “The DOE’s Advanced Networking Initiative (ANI) was created to re-establish America’s global leadership in ultra-high capacity networking and to build the most sophisticated platform for accelerating U.S. science discovery in this age of data intensive research. Today’s announcement marks a major milestone in ensuring this vision is realized.” The Advanced Networking Initiative is supported by DOE’s Office of Science. > > Earlier this year, Berkeley Lab announced an agreement with Internet2 for ESnet to share capacity on the Ciena optical platform for its new 100 Gbps network being built as part of ANI. The network will first be built as a prototype to connect DOE’s three unclassified supercomputing centers as well as the Manhattan Landing International Exchange Point (MAN LAN) in New York. By the end of 2012, ESnet will transition the network to production deploying 100 Gbps connections linking DOE Office of Science sites. Through the agreement, Internet2 is also providing dark fiber to ESnet for a nationwide experimental network test-bed. > > This first milestone deployment has been completed in partnership with Ciena. Ciena’s 6500 Packet-Optical Platform equipped with WaveLogic™ coherent optical processors provide high network capacity that helps to reduce overall operational expenses through its automated wavelength provisioning and restoration. > > “We have historically enjoyed a very strategic partnership with both Internet2 and ESnet. We are excited about this latest opportunity to continue supporting their next-generation network build around Ciena’s coherent solutions,” said Mike Aquino, General Manager, Global Government Solutions, Ciena. “This deployment is a testament to our technology leadership, as well as our commitment to strong collaboration with global leaders in the research and education segment.” > > Both Internet2 and ESnet plan to showcase these new 100G capabilities at the upcoming SC11 conference being held from November 12-18, 2011 in Seattle, Washington. > > About Internet2 > Internet2, owned by U.S. research universities, is the world’s most advanced networking consortium for global researchers and scientists who develop breakthrough Internet technologies and applications and spark tomorrow’s essential innovations. Internet2 consists of more than 350 U.S. universities; corporations; government agencies; laboratories; higher learning; and other major national, regional and state research and education networks; and organizations representing more than 50 countries. Internet2 is a registered trademark. For more information, see www.internet2.edu > > About ESnet > ESnet is a high-speed national network serving thousands of Department of Energy scientists and collaborators worldwide. A 25-year pioneer in providing high-bandwidth, reliable connections, ESnet enables researchers at national laboratories, universities and other institutions to communicate with each other using the collaborative capabilities needed to address some of the world's most important scientific challenges. Funded principally by DOE's Office of Science, ESnet services allow scientists to make effective use of unique DOE research facilities and computing resources, independent of time and geographic location. ESnet is managed by the Lawrence Berkeley National Laboratory. For more information: www.es.net and www.lbl.gov. > > About Ciena > Ciena is the network specialist. We collaborate with customers worldwide to unlock the strategic potential of their networks and fundamentally change the way they perform and compete. With focused innovation, Ciena brings together the reliability and capacity of optical networking with the flexibility and economics of Ethernet, unified by a software suite that delivers the industry’s leading network automation. We routinely post recent news, financial results and other important announcements and information about Ciena on our website. For more information, visit www.ciena.com. > > Media Contacts: > > Todd Sedmak, > Internet2 > 202-331-5373 > Todd(a)Internet2.edu > > Jon Bashor > Lawrence Berkeley National Laboratory > (510) 486-5849 > jbashor(a)lbl.gov > > Jamie Moody > Ciena > jmoody(a)ciena.com > 214-995-8035 > > To UNsubscribe, send an e-mail to pubsympa(a)internet2.edu **from the address you > subscribed with** and use the following message in the subject: unsubscribe i2-news > > ### > > > > > > > > > To UNsubscribe, send an e-mail to pubsympa(a)internet2.edu **from the address you subscribed with** with the following message in the subject: unsubscribe i2-news > > >

1 0

FW: Presentation and notes from microbes session and datatypes
by Brettin, Thomas S. 23 Sep '11

23 Sep '11

Thomas Brettin Oak Ridge National Laboratory 865-603-7760 (mobile) 865-574-0455 (office) ________________________________________ From: Christopher Henry [chrisshenry(a)gmail.com] Sent: Thursday, September 22, 2011 11:08 PM To: Brettin, Thomas S. Cc: Rick Stevens Subject: Presentation and notes from microbes session and datatypes Hi Tom, As I recall, we're supposed to send you the documents for distribution to the meeting attendees. They're attached. The presentation isn't an exact replica since it's missing 2 slides (accidentally lost them). The microbes notes includes the complete datatypes list we made on slide 2. Let me know if you have questions or need anything else. Chris

1 0

apparmor
by Hunter Matthews 22 Sep '11

22 Sep '11

I've moved the mysql storage area from /var/lib/mysql to /sandbox/kbase/projects/prototype/mysql. I did not know that ubuntu had apparmor. I've modified the apparmor definition to allow mysql equivalent access to this area. Resstarted mysql. My intent is this afternoon to do the same for postgres.

1 0

Re: [Kbase-hw] kb store and hw deployment
by Hunter Matthews 20 Sep '11

20 Sep '11

New version sent to Tom. On Sep 20, 2011, at 1:53 PM, Rick Stevens wrote: > lets edit it so we don't have an angry mob on our hands :-) > > > On Sep 20, 2011, at 1:52 PM, Hunter Matthews wrote: > >> I put that on the slide just to have SOME kind of config listed for the VM's. I'm starting to regret that. >> >> >> On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: >> >>> That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. >>> >>> There will also be some security things to work out as well. (was reminded by Gene stopping by my office) >>> >>> What do you mean 1G images? >>> -nld >>> >>> On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: >>> >>>> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >>>> >>>> In any event, we cannot run the production services on a bunch of 1G images. >>>> >>>> --bob >>>> >>>> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >>>> >>>>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>>>> -nld >>>>> >>>>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>>>> >>>>>> oh, it has to be remade first? >>>>>> >>>>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>>>> >>>>>>> That is the eventual plan, once we remake magellan. >>>>>>> >>>>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>>>> >>>>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>>>> >>>>>>>> --bob >>>>>>>> >>>>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>>>> >>>>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>>>> <kbase-hw-rollout.pdf> >>>>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>>>> >>>>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Hunter Matthews Unix Administrator >>>>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Kbase-hw mailing list >>>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Kbase-hw mailing list >>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>> >>>>>>> Rick Stevens >>>>>>> Associate Laboratory Director >>>>>>> Computing, Environment and Life Science >>>>>>> Argonne National Laboratory >>>>>>> >>>>>>> Professor of Computer Science >>>>>>> Senior Fellow Computation Institute >>>>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>>>> The University of Chicago >>>>>>> >>>>>>> stevens(a)anl.gov >>>>>>> stevens(a)ci.uchicago.edu >>>>>>> >>>>>>> (v) 630-252-3378 >>>>>>> (f) 630-252-6333 >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> >> -- >> Hunter Matthews Unix Administrator >> Office: Bldg 221 Room B240 Argonne National Labs, MCS >> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >> Never take candy from strangers. Especially on the internet. >> >> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > Rick Stevens > Associate Laboratory Director > Computing, Environment and Life Science > Argonne National Laboratory > > Professor of Computer Science > Senior Fellow Computation Institute > Senior Fellow Institute for Genomics and Systems Biology > The University of Chicago > > stevens(a)anl.gov > stevens(a)ci.uchicago.edu > > (v) 630-252-3378 > (f) 630-252-6333 > > -- Hunter Matthews Unix Administrator Office: Bldg 221 Room B240 Argonne National Labs, MCS Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 Never take candy from strangers. Especially on the internet.

1 0

Re: [Kbase-hw] kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

I think that part of the plan is to use volume storage instead of bigger VMs where possible (since volume storage is and should be faster). This is all TBD subject to our experiences when we get there though. -nld On Sep 20, 2011, at 1:43 PM, Robert Olson wrote: > Hunter's picture shows a bunch of 1GB images as hosting services. > > On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > >> That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. >> >> There will also be some security things to work out as well. (was reminded by Gene stopping by my office) >> >> What do you mean 1G images? >> -nld >> >> On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: >> >>> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >>> >>> In any event, we cannot run the production services on a bunch of 1G images. >>> >>> --bob >>> >>> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >>> >>>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>>> -nld >>>> >>>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>>> >>>>> oh, it has to be remade first? >>>>> >>>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>>> >>>>>> That is the eventual plan, once we remake magellan. >>>>>> >>>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>>> >>>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>>> >>>>>>> --bob >>>>>>> >>>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>>> >>>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>>> <kbase-hw-rollout.pdf> >>>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>>> >>>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>>> >>>>>>>> -- >>>>>>>> Hunter Matthews Unix Administrator >>>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Kbase-hw mailing list >>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> Rick Stevens >>>>>> Associate Laboratory Director >>>>>> Computing, Environment and Life Science >>>>>> Argonne National Laboratory >>>>>> >>>>>> Professor of Computer Science >>>>>> Senior Fellow Computation Institute >>>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>>> The University of Chicago >>>>>> >>>>>> stevens(a)anl.gov >>>>>> stevens(a)ci.uchicago.edu >>>>>> >>>>>> (v) 630-252-3378 >>>>>> (f) 630-252-6333 >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>> >> >

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

lets edit it so we don't have an angry mob on our hands :-) On Sep 20, 2011, at 1:52 PM, Hunter Matthews wrote: > I put that on the slide just to have SOME kind of config listed for the VM's. I'm starting to regret that. > > > On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > >> That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. >> >> There will also be some security things to work out as well. (was reminded by Gene stopping by my office) >> >> What do you mean 1G images? >> -nld >> >> On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: >> >>> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >>> >>> In any event, we cannot run the production services on a bunch of 1G images. >>> >>> --bob >>> >>> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >>> >>>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>>> -nld >>>> >>>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>>> >>>>> oh, it has to be remade first? >>>>> >>>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>>> >>>>>> That is the eventual plan, once we remake magellan. >>>>>> >>>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>>> >>>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>>> >>>>>>> --bob >>>>>>> >>>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>>> >>>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>>> <kbase-hw-rollout.pdf> >>>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>>> >>>>>>>>> >>>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>>> >>>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>>> >>>>>>>> -- >>>>>>>> Hunter Matthews Unix Administrator >>>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Kbase-hw mailing list >>>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> Rick Stevens >>>>>> Associate Laboratory Director >>>>>> Computing, Environment and Life Science >>>>>> Argonne National Laboratory >>>>>> >>>>>> Professor of Computer Science >>>>>> Senior Fellow Computation Institute >>>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>>> The University of Chicago >>>>>> >>>>>> stevens(a)anl.gov >>>>>> stevens(a)ci.uchicago.edu >>>>>> >>>>>> (v) 630-252-3378 >>>>>> (f) 630-252-6333 >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>> >> >> _______________________________________________ >> Kbase-hw mailing list >> Kbase-hw(a)lists.kbase.us >> https://lists.kbase.us/mailman/listinfo/kbase-hw > > -- > Hunter Matthews Unix Administrator > Office: Bldg 221 Room B240 Argonne National Labs, MCS > Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 > Never take candy from strangers. Especially on the internet. > > > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] kb store and hw deployment
by Rick Stevens 20 Sep '11

20 Sep '11

okay.. good.. On Sep 20, 2011, at 1:50 PM, Narayan Desai wrote: > Our mails crossed. The plan is to do it in parts. I think that it is going to take about a month to get things sorted out. We'll keep as much as possible running in the old configuration until we need to change things around. After it is up and running, there will be a several month period of iterative refinements that will be needed as well. > > Our goal is to get new infrastructure and roll compute nodes into it. That is pretty easy to do non-invasively. The storage part is harder, due to the way that openstack works. (and also, the precise details of how the current storage is configured). > -nld > > On Sep 20, 2011, at 1:34 PM, Rick Stevens wrote: > >> Narayan, >> >> how fast can we flip parts of magellan into the new configuration? Can we do it in parts? >> >> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >> >>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>> -nld >>> >>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>> >>>> oh, it has to be remade first? >>>> >>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>> >>>>> That is the eventual plan, once we remake magellan. >>>>> >>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>> >>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>> >>>>>> --bob >>>>>> >>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>> >>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>> <kbase-hw-rollout.pdf> >>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>> >>>>>>>> >>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>> >>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>> >>>>>>> -- >>>>>>> Hunter Matthews Unix Administrator >>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> Rick Stevens >>>>> Associate Laboratory Director >>>>> Computing, Environment and Life Science >>>>> Argonne National Laboratory >>>>> >>>>> Professor of Computer Science >>>>> Senior Fellow Computation Institute >>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>> The University of Chicago >>>>> >>>>> stevens(a)anl.gov >>>>> stevens(a)ci.uchicago.edu >>>>> >>>>> (v) 630-252-3378 >>>>> (f) 630-252-6333 >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >> >> Rick Stevens >> Associate Laboratory Director >> Computing, Environment and Life Science >> Argonne National Laboratory >> >> Professor of Computer Science >> Senior Fellow Computation Institute >> Senior Fellow Institute for Genomics and Systems Biology >> The University of Chicago >> >> stevens(a)anl.gov >> stevens(a)ci.uchicago.edu >> >> (v) 630-252-3378 >> (f) 630-252-6333 >> >> > Rick Stevens Associate Laboratory Director Computing, Environment and Life Science Argonne National Laboratory Professor of Computer Science Senior Fellow Computation Institute Senior Fellow Institute for Genomics and Systems Biology The University of Chicago stevens(a)anl.gov stevens(a)ci.uchicago.edu (v) 630-252-3378 (f) 630-252-6333

1 0

Re: [Kbase-hw] kb store and hw deployment
by Hunter Matthews 20 Sep '11

20 Sep '11

I put that on the slide just to have SOME kind of config listed for the VM's. I'm starting to regret that. On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. > > There will also be some security things to work out as well. (was reminded by Gene stopping by my office) > > What do you mean 1G images? > -nld > > On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > >> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >> >> In any event, we cannot run the production services on a bunch of 1G images. >> >> --bob >> >> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >> >>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>> -nld >>> >>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>> >>>> oh, it has to be remade first? >>>> >>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>> >>>>> That is the eventual plan, once we remake magellan. >>>>> >>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>> >>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>> >>>>>> --bob >>>>>> >>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>> >>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>> <kbase-hw-rollout.pdf> >>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>> >>>>>>>> >>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>> >>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>> >>>>>>> -- >>>>>>> Hunter Matthews Unix Administrator >>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> Rick Stevens >>>>> Associate Laboratory Director >>>>> Computing, Environment and Life Science >>>>> Argonne National Laboratory >>>>> >>>>> Professor of Computer Science >>>>> Senior Fellow Computation Institute >>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>> The University of Chicago >>>>> >>>>> stevens(a)anl.gov >>>>> stevens(a)ci.uchicago.edu >>>>> >>>>> (v) 630-252-3378 >>>>> (f) 630-252-6333 >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >> > > _______________________________________________ > Kbase-hw mailing list > Kbase-hw(a)lists.kbase.us > https://lists.kbase.us/mailman/listinfo/kbase-hw -- Hunter Matthews Unix Administrator Office: Bldg 221 Room B240 Argonne National Labs, MCS Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 Never take candy from strangers. Especially on the internet.

1 0

Re: [Kbase-hw] kb store and hw deployment
by Narayan Desai 20 Sep '11

20 Sep '11

Our mails crossed. The plan is to do it in parts. I think that it is going to take about a month to get things sorted out. We'll keep as much as possible running in the old configuration until we need to change things around. After it is up and running, there will be a several month period of iterative refinements that will be needed as well. Our goal is to get new infrastructure and roll compute nodes into it. That is pretty easy to do non-invasively. The storage part is harder, due to the way that openstack works. (and also, the precise details of how the current storage is configured). -nld On Sep 20, 2011, at 1:34 PM, Rick Stevens wrote: > Narayan, > > how fast can we flip parts of magellan into the new configuration? Can we do it in parts? > > On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: > >> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >> -nld >> >> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >> >>> oh, it has to be remade first? >>> >>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>> >>>> That is the eventual plan, once we remake magellan. >>>> >>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>> >>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>> >>>>> --bob >>>>> >>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>> >>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>> <kbase-hw-rollout.pdf> >>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>> >>>>>>> >>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>> >>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>> >>>>>> -- >>>>>> Hunter Matthews Unix Administrator >>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>> Never take candy from strangers. Especially on the internet. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> _______________________________________________ >>>>> Kbase-hw mailing list >>>>> Kbase-hw(a)lists.kbase.us >>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>> >>>> Rick Stevens >>>> Associate Laboratory Director >>>> Computing, Environment and Life Science >>>> Argonne National Laboratory >>>> >>>> Professor of Computer Science >>>> Senior Fellow Computation Institute >>>> Senior Fellow Institute for Genomics and Systems Biology >>>> The University of Chicago >>>> >>>> stevens(a)anl.gov >>>> stevens(a)ci.uchicago.edu >>>> >>>> (v) 630-252-3378 >>>> (f) 630-252-6333 >>>> >>>> >>> >>> _______________________________________________ >>> Kbase-hw mailing list >>> Kbase-hw(a)lists.kbase.us >>> https://lists.kbase.us/mailman/listinfo/kbase-hw >> > > Rick Stevens > Associate Laboratory Director > Computing, Environment and Life Science > Argonne National Laboratory > > Professor of Computer Science > Senior Fellow Computation Institute > Senior Fellow Institute for Genomics and Systems Biology > The University of Chicago > > stevens(a)anl.gov > stevens(a)ci.uchicago.edu > > (v) 630-252-3378 > (f) 630-252-6333 > >

1 0

Re: [Kbase-hw] kb store and hw deployment
by Robert Olson 20 Sep '11

20 Sep '11

Hunter's picture shows a bunch of 1GB images as hosting services. On Sep 20, 2011, at 1:42 PM, Narayan Desai wrote: > That is exactly what we are planning out right now. The main issue is that the existing system will be without an operations team come 10/1. We aren't going to turn off the current stuff, but we can't guarantee that it will be reliable either. There will definitely be a flag day in terms of data and so forth due to the way that the infrastructure is laid out behind the scenes. > > There will also be some security things to work out as well. (was reminded by Gene stopping by my office) > > What do you mean 1G images? > -nld > > On Sep 20, 2011, at 1:00 PM, Robert Olson wrote: > >> Having all that hardware unavailable for many months seems nonoptimal however; can't the machine be split and part upgraded/rebuilt and the rest left running, then upgraded after the first portion is rebuilt? Magellan in its current state works very well. >> >> In any event, we cannot run the production services on a bunch of 1G images. >> >> --bob >> >> On Sep 20, 2011, at 12:52 PM, Narayan Desai wrote: >> >>> Yeah, we learned a lot from the initial deployment of openstack on Magellan. There are a bunch of new software features that we should be able to use with newer versions of openstack as well. >>> -nld >>> >>> On Sep 20, 2011, at 12:11 PM, Robert Olson wrote: >>> >>>> oh, it has to be remade first? >>>> >>>> On Sep 20, 2011, at 12:07 PM, Rick Stevens wrote: >>>> >>>>> That is the eventual plan, once we remake magellan. >>>>> >>>>> On Sep 20, 2011, at 11:55 AM, Robert Olson wrote: >>>>> >>>>>> How does ANL magellan fit into this? Seems it would be natural to host the VMs there and have much more resources available than just 1G/100G images. >>>>>> >>>>>> --bob >>>>>> >>>>>> On Sep 20, 2011, at 10:37 AM, Hunter Matthews wrote: >>>>>> >>>>>>> Attached is a draft of my deployment drawing in electronic form (omnigraffle) >>>>>>> <kbase-hw-rollout.pdf> >>>>>>> On Sep 20, 2011, at 10:10 AM, Brettin, Thomas S. wrote: >>>>>>> >>>>>>>> >>>>>>>> There are two things on the agenda for Thursday that I'm on the hook for. >>>>>>>> >>>>>>>> 1) hardware deployment strategy (Hunter and Tom) (20mins) >>>>>>>> 2) KB store (Bob and Tom) (30mins 4:30pm-5pm) >>>>>>> >>>>>>> -- >>>>>>> Hunter Matthews Unix Administrator >>>>>>> Office: Bldg 221 Room B240 Argonne National Labs, MCS >>>>>>> Key: F0F88438 / FFB5 34C0 B350 99A4 BB02 9779 A5DB 8B09 F0F8 8438 >>>>>>> Never take candy from strangers. Especially on the internet. >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Kbase-hw mailing list >>>>>>> Kbase-hw(a)lists.kbase.us >>>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>>> >>>>>> _______________________________________________ >>>>>> Kbase-hw mailing list >>>>>> Kbase-hw(a)lists.kbase.us >>>>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>>>> >>>>> Rick Stevens >>>>> Associate Laboratory Director >>>>> Computing, Environment and Life Science >>>>> Argonne National Laboratory >>>>> >>>>> Professor of Computer Science >>>>> Senior Fellow Computation Institute >>>>> Senior Fellow Institute for Genomics and Systems Biology >>>>> The University of Chicago >>>>> >>>>> stevens(a)anl.gov >>>>> stevens(a)ci.uchicago.edu >>>>> >>>>> (v) 630-252-3378 >>>>> (f) 630-252-6333 >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Kbase-hw mailing list >>>> Kbase-hw(a)lists.kbase.us >>>> https://lists.kbase.us/mailman/listinfo/kbase-hw >>> >> >

1 0