From fryers at ucc.gu.uwa.edu.au Thu Dec 8 08:07:18 2005 From: fryers at ucc.gu.uwa.edu.au (Simon Fryer) Date: Thu, 8 Dec 2005 08:07:18 +0800 Subject: [tech] manbo In-Reply-To: References: Message-ID: <20051208000718.GE25023@rcpt.to> All, A bit behind on my email. > A while ago David Adam tapped: [...] > Anyone who has brilliant ideas about how to reduce the temperature in the > machine room should contact their nearest wheel member (although we have > already considered the liquid nitrogen plan). I have liquid nitrogen at work! I also have chilled water plants (4 degrees Celsius) and refrigeration systems capable of pulling below -60 Celsius! Pretty cool huh! I could suggest co-lo in the UK - had to scrape the inside of my windscreen this morning... The condensation solidified overnight! Also, if the windscreen is below 0 Celsius, the condensation from your breath solidifies making it difficult to see where you are driving. > UCC (Almost made a crack about Wheel Group being tyred of the heat > problems, but it was all a bit exhausting) That was pretty flat. Revolutionary, but flat. Simon -- ------------------------------------------------------------------------ "Well, an engineer is not concerned with the truth; that is left to philosophers and theologians: the prime concern of an engineer is the utility of the final product." Lectures on the Electrical Properties of Materials, L.Solymar, D.Walsh From trs80 at ucc.gu.uwa.edu.au Fri Dec 16 00:33:44 2005 From: trs80 at ucc.gu.uwa.edu.au (James Andrewartha) Date: Fri, 16 Dec 2005 00:33:44 +0800 (WST) Subject: [tech] manbo upgrades Message-ID: manbo has been upgraded to Solaris Express b24, in preparation for OpenSolaris and ZFS. It's currently only got 4 cpus and 2GB of ram due to some odd errors with dynamic reconfiguration that were occuring. I'll probably be poking it again on Saturday or Sunday. Thanks to Matt and Davyd for helping. -- # TRS-80 trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \ # UCC Wheel Member http://trs80.ucc.asn.au/ #| what squirrels do best | [ "There's nobody getting rich writing ]| -- Collect and hide your | [ software that I know of" -- Bill Gates, 1980 ]\ nuts." -- Acid Reflux #231 / From trs80 at ucc.gu.uwa.edu.au Fri Dec 16 01:05:10 2005 From: trs80 at ucc.gu.uwa.edu.au (James Andrewartha) Date: Fri, 16 Dec 2005 01:05:10 +0800 (WST) Subject: [tech] manbo upgrades In-Reply-To: References: Message-ID: oh, and /services seems to be read only for reasons I cannot fathom, it being 1am. -- # TRS-80 trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \ # UCC Wheel Member http://trs80.ucc.asn.au/ #| what squirrels do best | [ "There's nobody getting rich writing ]| -- Collect and hide your | [ software that I know of" -- Bill Gates, 1980 ]\ nuts." -- Acid Reflux #231 / From trs80 at ucc.gu.uwa.edu.au Fri Dec 16 01:20:50 2005 From: trs80 at ucc.gu.uwa.edu.au (James Andrewartha) Date: Fri, 16 Dec 2005 01:20:50 +0800 (WST) Subject: [tech] manbo upgrades In-Reply-To: References: Message-ID: On Fri, 16 Dec 2005, James Andrewartha wrote: > oh, and /services seems to be read only for reasons I cannot fathom, it being > 1am. Ah, it wants full hostnames in /etc/dfs/dfstab. fun. Also, Solaris' SVC SMF shit can't handle the root group being called wheel. -- # TRS-80 trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \ # UCC Wheel Member http://trs80.ucc.asn.au/ #| what squirrels do best | [ "There's nobody getting rich writing ]| -- Collect and hide your | [ software that I know of" -- Bill Gates, 1980 ]\ nuts." -- Acid Reflux #231 / From nick at ucc.gu.uwa.edu.au Sat Dec 17 20:07:05 2005 From: nick at ucc.gu.uwa.edu.au (Nick Bannon) Date: Sat, 17 Dec 2005 20:07:05 +0800 Subject: [tech] manbo, gibson In-Reply-To: <20051208000718.GE25023@rcpt.to> References: <20051208000718.GE25023@rcpt.to> Message-ID: <20051217120705.GL26208@ucc.gu.uwa.edu.au> On Thu, Dec 08, 2005 at 08:07:18AM +0800, Simon Fryer wrote: > > A while ago David Adam tapped: [...] > I could suggest co-lo in the UK - had to scrape the inside of my windscreen > this morning... The condensation solidified overnight! Also, if the > windscreen is below 0 Celsius, the condensation from your breath solidifies > making it difficult to see where you are driving. Feel like picking a 24GiB E10K up? 102 pounds so far, but it hasn't hit its reserve price yet. http://cgi.ebay.co.uk/ws/eBayISAPI.dll?ViewItem&item=5840355574 More manbo upgrading tonight, for anyone wanting to drop by! > > UCC (Almost made a crack about Wheel Group being tyred of the heat > > problems, but it was all a bit exhausting) > > That was pretty flat. Revolutionary, but flat. We got 'round to an improvement today, [TRS] and I took a spin to "The Good Guys" and rolled out with a new air conditioner. $320 for Gibson, our new Celsius brand window-box unit, much the same as poor old Gobi, which it has replaced. Specified for 0.96kW energy input for 2.50kW of cooling - that seems pretty accurate, it's sucking 3.8-3.9A, the same as Atacama. They're both plugged into a 15A socket in the machine room, which is therefore only at about half capacity. http://search.energyrating.gov.au/air_srch.asp?sort=%5BNew+SRI+Cool%5D+DESC%2C%5BNew+SRI+Heat%5D+DESC&list=basic&Elec=&CUses=&HUses=&Years=&type=Cooling+Only&Inst2=Window+Wall&Inst=all&Out=0203&brand=CELSIUS&B1=SEARCH It has bonus bling - a LED temperature display and an IR remote (don't lose it!). [DAA] tested it working through the machine room door... It's helping a bit... http://www.ucc.asn.au/stats/temp.html Nick. -- Nick Bannon | "I made this letter longer than usual because nick-sig at rcpt.to | I lack the time to make it shorter." - Pascal From trs80 at ucc.gu.uwa.edu.au Sun Dec 18 23:02:11 2005 From: trs80 at ucc.gu.uwa.edu.au (James Andrewartha) Date: Sun, 18 Dec 2005 23:02:11 +0800 (WST) Subject: [tech] manbo, gibson In-Reply-To: <20051217120705.GL26208@ucc.gu.uwa.edu.au> References: <20051208000718.GE25023@rcpt.to> <20051217120705.GL26208@ucc.gu.uwa.edu.au> Message-ID: On Sat, 17 Dec 2005, Nick Bannon wrote: > More manbo upgrading tonight, for anyone wanting to drop by! Well, we finally upgraded to Solaris Nevada b28, after waiting overnight to put in the next cdrom. Nick and I played around with manbo some more today, and all boards are in. Noteable points: - all boards have 2GB except for board 11, which has 256MB - board 11 does not like hot-swapping, possibly due to bad connections. - the ram in board 11 was swapped from the other board that didn't boot, and it turns out one set might not be matched. - the tape library is connected to a HVD sbus card - the gigaplane runs at 80MHz - putting the same cards into manduba would allow running at 100MHz, although we couldn't fit in the PCI board or the gige fibre card. - IPv6 is the devil - it was causing hangs that made ZFS unusable until it was disabled. - I'm currenting moving the old space to the new, ZFS /space. - /space will be two 6x18gb disk raid-zs and a 2x36gb mirror. - ZFS natively exports NFS, so some fun will be needed to control the permissions. Oh, and NFSv4 is bad (well, at least confusing). - Nick has some current readings in various configs. I've left it with an extra PSU in there, prtdiag reports the power status as redudant. -- # TRS-80 trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \ # UCC Wheel Member http://trs80.ucc.asn.au/ #| what squirrels do best | [ "There's nobody getting rich writing ]| -- Collect and hide your | [ software that I know of" -- Bill Gates, 1980 ]\ nuts." -- Acid Reflux #231 / From davyd at madeley.id.au Sun Dec 18 23:10:50 2005 From: davyd at madeley.id.au (Davyd Madeley) Date: Sun, 18 Dec 2005 23:10:50 +0800 Subject: [tech] manbo, gibson In-Reply-To: References: <20051208000718.GE25023@rcpt.to> <20051217120705.GL26208@ucc.gu.uwa.edu.au> Message-ID: <20051218151050.GA22746@bridgewayconsulting.com.au> On Sun, Dec 18, 2005 at 11:02:11PM +0800, James Andrewartha wrote: > - the gigaplane runs at 80MHz - putting the same cards into manduba would > allow running at 100MHz, although we couldn't fit in the PCI board or > the gige fibre card. Did we know this in advance? Is there something we have done wrong here? Otherwise (and correct me if I'm wrong) we could have used the old boards and old clockboard and simply installed faster CPUs, yes? --d -- Davyd Madeley http://www.davyd.id.au/ 08B0 341A 0B9B 08BB 2118 C060 2EDD BB4F 5191 6CDA From trs80 at ucc.gu.uwa.edu.au Sun Dec 18 23:26:38 2005 From: trs80 at ucc.gu.uwa.edu.au (James Andrewartha) Date: Sun, 18 Dec 2005 23:26:38 +0800 (WST) Subject: [tech] manbo, gibson In-Reply-To: <20051218151050.GA22746@bridgewayconsulting.com.au> References: <20051208000718.GE25023@rcpt.to> <20051217120705.GL26208@ucc.gu.uwa.edu.au> <20051218151050.GA22746@bridgewayconsulting.com.au> Message-ID: On Sun, 18 Dec 2005, Davyd Madeley wrote: > On Sun, Dec 18, 2005 at 11:02:11PM +0800, James Andrewartha wrote: > >> - the gigaplane runs at 80MHz - putting the same cards into manduba would >> allow running at 100MHz, although we couldn't fit in the PCI board or >> the gige fibre card. > > Did we know this in advance? Is there something we have done wrong > here? Otherwise (and correct me if I'm wrong) we could have used the > old boards and old clockboard and simply installed faster CPUs, yes? With the older boards we would have only got 2MB of cache, not 8MB. We would still have needed a new clockboard. http://xrl.us/i9d6 has details. -- # TRS-80 trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \ # UCC Wheel Member http://trs80.ucc.asn.au/ #| what squirrels do best | [ "There's nobody getting rich writing ]| -- Collect and hide your | [ software that I know of" -- Bill Gates, 1980 ]\ nuts." -- Acid Reflux #231 / From trs80 at ucc.gu.uwa.edu.au Mon Dec 19 00:04:16 2005 From: trs80 at ucc.gu.uwa.edu.au (James Andrewartha) Date: Mon, 19 Dec 2005 00:04:16 +0800 (WST) Subject: [tech] manbo, gibson In-Reply-To: References: <20051208000718.GE25023@rcpt.to> <20051217120705.GL26208@ucc.gu.uwa.edu.au> Message-ID: On Sun, 18 Dec 2005, James Andrewartha wrote: > - the tape library is connected to a HVD sbus card Amanda isn't set up yet (bacula broke, and it sucks, so I blew it away), so we have no backups. Half the tapes are in the old library, so they need to be extracted. All the tapes need to be forced to 35GB capacity in the new library (which has two drives). I won't have time to set this up before I go (going to SA 20th Dec-6th Jan), so if anyone is really concerned about having backups, set it up yourself. > - ZFS natively exports NFS, so some fun will be needed to control the > permissions. Oh, and NFSv4 is bad (well, at least confusing). It can also use the existing dfstab, dunno if I'll just use that. -- # TRS-80 trs80(a)ucc.gu.uwa.edu.au #/ "Otherwise Bub here will do \ # UCC Wheel Member http://trs80.ucc.asn.au/ #| what squirrels do best | [ "There's nobody getting rich writing ]| -- Collect and hide your | [ software that I know of" -- Bill Gates, 1980 ]\ nuts." -- Acid Reflux #231 / From nick at ucc.gu.uwa.edu.au Tue Dec 20 17:59:29 2005 From: nick at ucc.gu.uwa.edu.au (Nick Bannon) Date: Tue, 20 Dec 2005 17:59:29 +0800 Subject: [tech] manbo power In-Reply-To: References: <20051208000718.GE25023@rcpt.to> <20051217120705.GL26208@ucc.gu.uwa.edu.au> Message-ID: <20051220095929.GO26208@ucc.gu.uwa.edu.au> On Sun, Dec 18, 2005 at 11:02:11PM +0800, James Andrewartha wrote: > - all boards have 2GB except for board 11, which has 256MB > - board 11 does not like hot-swapping, possibly due to bad connections. [...] ...for a total of 14 x 400MHz CPUs, 12.25GiB RAM, 20 x 10000rpm discs. Power consumption is 6.52A. - 0.56A for each D1000 disc tray with 10 discs - 0.50A for the TL891 tape library with dual DLT7000's - 0.46A for each populated CPU/memory board During boot it can vary between 6A and 7A, but adding tinderbox load doesn't seem to raise consumption above 6.8A. Broadly speaking, manbo has the cumulative CPU grunt of martello's dual Opteron 242's, but with about five times the RAM, disc IO's/second, CPU L2 cache, power consumption and rack space usage... Nick. -- Nick Bannon | "I made this letter longer than usual because nick-sig at rcpt.to | I lack the time to make it shorter." - Pascal