tag:blogger.com,1999:blog-8825992.post134409467734847333..comments2019-02-13T20:54:50.768-08:00Comments on Electric Duncan: CERN, OpenStack Keep Resonance Cascades at BayUnknownnoreply@blogger.comBlogger6125tag:blogger.com,1999:blog-8825992.post-43413318778193554342012-07-19T11:29:53.418-07:002012-07-19T11:29:53.418-07:00We're investigating both Compute and Storage c...We're investigating both Compute and Storage cloud technologies. The compute side is covered in http://cern.ch/go/FwG7.<br /><br />Data is MUCH more complicated (as if 300K VMs is 'easy'). CERN's role is to record the 25PB or so each year for 20 years along with supplying the 200 remote sites which want to analyse the LHC results. We are looking at Swift, S3 appliances and storage federations based on xrootd technologies.<br /><br />Changing direction in compute is relatively easy (since you just start the new work elsewhere). Moving data around, especially with networking costs, is much more difficult (and so more investigations are required).<br /><br />BTW, Duncan's portrayal of me contains some fact and some fiction....<br /><br />Tim Bell<br />CERNAnonymoushttps://www.blogger.com/profile/01315333079658597119noreply@blogger.comtag:blogger.com,1999:blog-8825992.post-73312997113287504782012-07-19T10:08:20.810-07:002012-07-19T10:08:20.810-07:00Trey, I don't know... but you could email Gor^...Trey, I don't know... but you could email Gor^H^H^H Tim Bell and ask! I'll point him at this comment, and see if has some insights to share ...<br /><br />Thanks!Duncan McGreggorhttps://www.blogger.com/profile/17155270977759488515noreply@blogger.comtag:blogger.com,1999:blog-8825992.post-85500086908436024042012-07-19T09:07:08.437-07:002012-07-19T09:07:08.437-07:00Nice post - to think that OpenStack might lead to ...Nice post - to think that OpenStack might lead to the invention of a Gravity Gun.<br /><br />Duncan, did you learn about how CERN is using Swift? I'm very interested in knowing how scientific and research organizations are using Object Storage, and was curious, if CERN does use it extensively, are they using things like metatagging to assist with their data analysis?Anonymoushttps://www.blogger.com/profile/17733676371821478119noreply@blogger.comtag:blogger.com,1999:blog-8825992.post-11359147553816046452012-05-15T19:21:38.969-07:002012-05-15T19:21:38.969-07:00@GregP Heheh :-) In deed I have not! Brent Scotten...@GregP Heheh :-) In deed I have not! Brent Scotten (from DreamHost) and I were talking about it last night and then again today. He's just finished playing BioShock, and really enjoyed it. We chatted briefly about the greats: System Shock 2, Deus Ex, HL & HL2 :-)Duncan McGreggorhttps://www.blogger.com/profile/17155270977759488515noreply@blogger.comtag:blogger.com,1999:blog-8825992.post-7068310927924422112012-05-15T11:22:37.528-07:002012-05-15T11:22:37.528-07:00Ahhhh yes. Heartily comforting to see that my old...Ahhhh yes. Heartily comforting to see that my old friend hasn't yet forgotten his gaming days. :)GregPhttps://www.blogger.com/profile/07167498662843416864noreply@blogger.comtag:blogger.com,1999:blog-8825992.post-74934559233588150112012-05-15T06:13:57.801-07:002012-05-15T06:13:57.801-07:00Fact and fiction are pretty tightly woven in that ...Fact and fiction are pretty tightly woven in that post, so I thought I'd help folks out here:<br /><br />1) Simon really did say that ;-) and<br /><br />2) Tim's summary to me of CERN's plans around DevOps/OpenStack was as follows:<br /><br />The CERN Agile Infrastructure project aims to develop CERN's computing resources and processes to support the expanding needs of LHC physicists and the CERN organisation. This requires actions to<br /><br />- modernise the data centre configuration tools and automating operations procedures<br />- exploit wide scale use of virtualisation, improving flexibility and efficiency<br />- enhance monitoring such that the usage of the infrastructure can be fully understood and tuned to maximise the resources available<br /><br />From the current mode of operations based on local tools developed over the past 10 years towards data driven automated operations based on tools developed elsewhere and following modern installation and deployment<br />techniques.<br /><br />The current toolchains are based around<br /><br />- OpenStack as a single Infrastructure-as-a-Service providing physics experiment services, developer boxes, applications servers as well as the large batch farm<br />- Puppet for configuration management<br />- Scientific Linux CERN as the dominant operating system with sizeable chunk of Windows<br /><br />The target for a pre-production service this year and moving towards 300,000 virtual machines on 15,000 hosts spread across two data centres by 2015.Duncan McGreggorhttps://www.blogger.com/profile/17155270977759488515noreply@blogger.com