From owner-sage-members@usenix.org Thu Jun 3 11:40:24 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53IeMnJ027023 for ; Thu, 3 Jun 2004 11:40:24 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53IdU6F000601 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 11:39:31 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53IdTAi000599; Thu, 3 Jun 2004 11:39:29 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 11:38:19 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53IcH6F000285 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 11:38:18 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53IcHsu000284 for sage-members-outgoing; Thu, 3 Jun 2004 11:38:17 -0700 (PDT) Received: from mail.halligan.org (mail.halligan.org [64.127.99.10]) by usenix.org (8.12.10/8.12.10) with SMTP id i53IcG6E000266 for ; Thu, 3 Jun 2004 11:38:16 -0700 (PDT) Received: (qmail 31629 invoked by uid 502); 3 Jun 2004 18:40:20 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 3 Jun 2004 18:40:20 -0000 Date: Thu, 3 Jun 2004 11:40:20 -0700 (PDT) From: "Michael T. Halligan" To: sage-members@sage.org Subject: [SAGE] Datacenter tools? Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 3027 Lines: 72 My ops director has a good-sized chunk of cash in our budget marked aside for "Datacenter tools". I was wondering what people like to keep on their datacenter for such things. So far, we have : - Plantronics Industrial noise-canceling phono dual-ear headset, with connectors for the 3 different types of cell phones our ops people use, and one portable phone we keep in a cabinet. - Power convertors for the 3 different types of cell phones - anti-static straps in each cabinet - assorted sizes Velcro cable ties, as well as nylon zip ties - 1 APC Environmental Monitoring Unit in each cabinet - 1 Laptop in each cabinet with serial connections and adapters for 3 different types of serial connections - Ethereal & Minicom installed, as well as a web browser - Patch panel for laptop with 3 network connections (one for each subnet) - Assorted tools (punchdown, cable cutters, screwdrivers, wrenches (for adjusting cabinets), several paper-clips (APCs have very tiny reset buttons if they trip) - Roll of quarters for vending machine - One cold-spare for every classification of server, including load balancers, switches, firewalls - 4U chatsworth locking drawers in every cabinet to keep spare parts and - Cold spares for anything that we could imagine will break (CPU, memory, different sizes of hot-swap drives, raid cards, PDUs (very helpful, just had a PDU fail on us yesterday), GBICs, we've even got a spare 1U USR tray of fans in case one of ours fails. - Paper & pens - 2 Label makers, with extra tape - Post-its - Multimeter - Extra cables of all types (serial, scsi, cat5, cat5 crossover) - Power tester - Ethernet link checker - Floor panel lifters - Foldup nylon chair - 2 Keyboards & Mice (less important since our datacenter provides rolling carts) It sounds a bit cluttered, but we have 2 cabinets dedicated for testing environment and management tools, and production in other cabinets, eventually we'll have 2 cabinets solely for testing, and one for management). We've tried to make everything as remotely manageable a possible. Everything sits on a remote serial console, as well as a remote reboot switch. Our datacenter has a staffed 24x7 NOC that will change tapes, sit down at a terminal to read errors and type commands, as well as reboot boxes. We've also made everything redundant as possible, having everything that's not using our clustering utilities have a hot-spare (vrrp for network gear, LVS for servers). We've also setup automatic rebuild scripts for all of our servers, so we can kickstart or systemimage through a serial console. My goal is to eliminate trips to the dc as much as possible, but making sure we have every tool we need in case of any unforseen failure. Some of the proposed new tools have been : - 1 AXIS network camera per cabinet (the kind that pan, so we can potentially look at blinkys, as well as who's accessing) - Fluke network debuggers Does anybody else have any other good ideas for tools to keep in the datacenter? From owner-sage-members@usenix.org Thu Jun 3 11:49:40 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53Ind04022531 for ; Thu, 3 Jun 2004 11:49:39 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53Imt6F002150 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 11:48:55 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53Imsb3002147; Thu, 3 Jun 2004 11:48:54 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 11:48:02 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53Im16F001954 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 11:48:01 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53Im1XN001952 for sage-members-outgoing; Thu, 3 Jun 2004 11:48:01 -0700 (PDT) Received: from etsuex1.etsu.edu (etsuex1.etsu.edu [151.141.8.103]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53Ilx6E001932 for ; Thu, 3 Jun 2004 11:47:59 -0700 (PDT) X-MimeOLE: Produced By Microsoft Exchange V6.0.6487.1 Content-Class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Subject: RE: [SAGE] Datacenter tools? Date: Thu, 3 Jun 2004 14:47:53 -0400 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: [SAGE] Datacenter tools? Thread-Index: AcRJmpy2CKKAYIoNQWSEIcmQyzv/hAAAD7Xw From: "Jenkins, Steven" To: "Michael T. Halligan" , Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by usenix.org id i53Im06E001948 Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 3606 Lines: 94 I'd suggest adding radios to that list (for the times when the cell phones aren't usable). Also, I suggest you read chapter 17 (Data Centers) of Limoncelli and Hogan's excellent book, The Practice of System and Network Administration. In that chapter, they discuss many useful tools and devices that a good data center would have. Steven -----Original Message----- From: owner-sage-members@usenix.org [mailto:owner-sage-members@usenix.org] On Behalf Of Michael T. Halligan Sent: Thursday, June 03, 2004 2:40 PM To: sage-members@sage.org Subject: [SAGE] Datacenter tools? My ops director has a good-sized chunk of cash in our budget marked aside for "Datacenter tools". I was wondering what people like to keep on their datacenter for such things. So far, we have : - Plantronics Industrial noise-canceling phono dual-ear headset, with connectors for the 3 different types of cell phones our ops people use, and one portable phone we keep in a cabinet. - Power convertors for the 3 different types of cell phones - anti-static straps in each cabinet - assorted sizes Velcro cable ties, as well as nylon zip ties - 1 APC Environmental Monitoring Unit in each cabinet - 1 Laptop in each cabinet with serial connections and adapters for 3 different types of serial connections - Ethereal & Minicom installed, as well as a web browser - Patch panel for laptop with 3 network connections (one for each subnet) - Assorted tools (punchdown, cable cutters, screwdrivers, wrenches (for adjusting cabinets), several paper-clips (APCs have very tiny reset buttons if they trip) - Roll of quarters for vending machine - One cold-spare for every classification of server, including load balancers, switches, firewalls - 4U chatsworth locking drawers in every cabinet to keep spare parts and - Cold spares for anything that we could imagine will break (CPU, memory, different sizes of hot-swap drives, raid cards, PDUs (very helpful, just had a PDU fail on us yesterday), GBICs, we've even got a spare 1U USR tray of fans in case one of ours fails. - Paper & pens - 2 Label makers, with extra tape - Post-its - Multimeter - Extra cables of all types (serial, scsi, cat5, cat5 crossover) - Power tester - Ethernet link checker - Floor panel lifters - Foldup nylon chair - 2 Keyboards & Mice (less important since our datacenter provides rolling carts) It sounds a bit cluttered, but we have 2 cabinets dedicated for testing environment and management tools, and production in other cabinets, eventually we'll have 2 cabinets solely for testing, and one for management). We've tried to make everything as remotely manageable a possible. Everything sits on a remote serial console, as well as a remote reboot switch. Our datacenter has a staffed 24x7 NOC that will change tapes, sit down at a terminal to read errors and type commands, as well as reboot boxes. We've also made everything redundant as possible, having everything that's not using our clustering utilities have a hot-spare (vrrp for network gear, LVS for servers). We've also setup automatic rebuild scripts for all of our servers, so we can kickstart or systemimage through a serial console. My goal is to eliminate trips to the dc as much as possible, but making sure we have every tool we need in case of any unforseen failure. Some of the proposed new tools have been : - 1 AXIS network camera per cabinet (the kind that pan, so we can potentially look at blinkys, as well as who's accessing) - Fluke network debuggers Does anybody else have any other good ideas for tools to keep in the datacenter? From owner-sage-members@usenix.org Thu Jun 3 11:52:57 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53IquYI021455 for ; Thu, 3 Jun 2004 11:52:56 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53IqG6F002630 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 11:52:16 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53IqFRw002629; Thu, 3 Jun 2004 11:52:15 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 11:51:20 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53IpJ6F002347 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 11:51:19 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53IpJgk002346 for sage-members-outgoing; Thu, 3 Jun 2004 11:51:19 -0700 (PDT) Received: from mail.halligan.org (mail.halligan.org [64.127.99.10]) by usenix.org (8.12.10/8.12.10) with SMTP id i53IpI6E002339 for ; Thu, 3 Jun 2004 11:51:18 -0700 (PDT) Received: (qmail 31701 invoked by uid 502); 3 Jun 2004 18:53:32 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 3 Jun 2004 18:53:32 -0000 Date: Thu, 3 Jun 2004 11:53:32 -0700 (PDT) From: "Michael T. Halligan" To: "Jenkins, Steven" cc: sage-members@sage.org Subject: RE: [SAGE] Datacenter tools? In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 657 Lines: 24 > > I'd suggest adding radios to that list (for the times when the cell > phones aren't usable). Good call. > > Also, I suggest you read chapter 17 (Data Centers) of Limoncelli and > Hogan's excellent book, The Practice of System and Network > Administration. In that chapter, they discuss many useful tools and > devices that a good data center would have. If people would quit stealing this book from me at dinner parties, I might do that :) I've lost 3 of them now! -- ------------------- Michael T. Halligan Chief Geek Halligan Infrastructure Designs. http://www.halligan.org/ 3158 Mission St. #3 San Francisco, CA 94110 (415) 724.7998 - Mobile From owner-sage-members@usenix.org Thu Jun 3 13:30:10 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53KU9cc000577 for ; Thu, 3 Jun 2004 13:30:10 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53KSt6F026063 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 13:28:55 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53KSst5026052; Thu, 3 Jun 2004 13:28:54 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 13:26:16 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53KQC6F025141 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 13:26:14 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53KQCQB025138 for sage-members-outgoing; Thu, 3 Jun 2004 13:26:12 -0700 (PDT) Received: from mail.indeterminate.net (olivia.indeterminate.net [207.173.200.107]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53KQ96E025097 for ; Thu, 3 Jun 2004 13:26:10 -0700 (PDT) Received: from indeterminate.net (localhost.localdomain [127.0.0.1]) by mail.indeterminate.net (8.11.6/8.11.6) with SMTP id i53KPxk10467 for ; Thu, 3 Jun 2004 13:25:59 -0700 From: John Costello Received: from 149.117.16.12 (SquirrelMail authenticated user cos) by www.indeterminate.net with HTTP; Thu, 3 Jun 2004 13:25:59 -0700 (PDT) Message-ID: <57238.149.117.16.12.1086294359.squirrel@www.indeterminate.net> Date: Thu, 3 Jun 2004 13:25:59 -0700 (PDT) Subject: RE: [SAGE] Datacenter tools? To: In-Reply-To: References: X-Priority: 3 Importance: Normal X-Mailer: SquirrelMail (version 1.2.10) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Virus-Scanned: ClamAV version 'clamd / ClamAV version 0.65', clamav-milter version '0.60p' Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 786 Lines: 29 >> >> I'd suggest adding radios to that list (for the times when the cell >> phones aren't usable). > > Good call. > >> >> Also, I suggest you read chapter 17 (Data Centers) of Limoncelli and >> Hogan's excellent book, The Practice of System and Network >> Administration. In that chapter, they discuss many useful tools and >> devices that a good data center would have. > > If people would quit stealing this book from me at dinner parties, I > might do that :) I've lost 3 of them now! Perhaps you should include a copy of the book in your DC, and chain it to a large object? ;^) > ------------------- > Michael T. Halligan > Chief Geek > Halligan Infrastructure Designs. > http://www.halligan.org/ > 3158 Mission St. #3 > San Francisco, CA 94110 > (415) 724.7998 - Mobile John From owner-sage-members@usenix.org Sat Jun 5 21:46:43 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i564kf7X015700 for ; Sat, 5 Jun 2004 21:46:42 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i564g06F016044 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 5 Jun 2004 21:42:00 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i564fwtC016040; Sat, 5 Jun 2004 21:41:58 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Sat, 5 Jun 2004 21:39:42 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i564de6F015704 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Sat, 5 Jun 2004 21:39:40 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i564deav015702 for sage-members-outgoing; Sat, 5 Jun 2004 21:39:40 -0700 (PDT) Received: from vanilla.cyber.com.au (vanilla.cyber.com.au [203.7.155.28]) by usenix.org (8.12.10/8.12.10) with ESMTP id i564dZ6E015680 for ; Sat, 5 Jun 2004 21:39:37 -0700 (PDT) Received: by vanilla.cyber.com.au (Postfix, from userid 1103) id 09BE857BADF; Sun, 6 Jun 2004 14:39:20 +1000 (EST) Date: Sun, 6 Jun 2004 14:39:20 +1000 From: Paul Armstrong To: sage-members@sage.org Subject: Re: [SAGE] Datacenter tools? Message-ID: <20040606043920.GQ13012@vanilla.office.cyber.com.au> References: <57238.149.117.16.12.1086294359.squirrel@www.indeterminate.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <57238.149.117.16.12.1086294359.squirrel@www.indeterminate.net> User-Agent: Mutt/1.4i Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 688 Lines: 16 On Thu, Jun 03, 2004 at 01:25:59PM -0700, John Costello wrote: > >> Also, I suggest you read chapter 17 (Data Centers) of Limoncelli and > >> Hogan's excellent book, The Practice of System and Network > >> Administration. In that chapter, they discuss many useful tools and > >> devices that a good data center would have. > > > > If people would quit stealing this book from me at dinner parties, I > > might do that :) I've lost 3 of them now! > > Perhaps you should include a copy of the book in your DC, and chain it to > a large object? ;^) The way my current employer fixes this is to give all new Sysadmins a copy when they start. Plenty of copies hanging around work :-) Paul From owner-sage-members@usenix.org Fri Jun 25 06:38:13 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i5PDcBf9018199 for ; Fri, 25 Jun 2004 06:38:12 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i5PDbEu8014441 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 25 Jun 2004 06:37:15 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i5PDbDjL014440; Fri, 25 Jun 2004 06:37:14 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Fri, 25 Jun 2004 06:35:19 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i5PDZHu8014159 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 25 Jun 2004 06:35:18 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i5PDZHim014158 for sage-members-outgoing; Fri, 25 Jun 2004 06:35:17 -0700 (PDT) Received: from whatexit.org (whatexit.org [64.32.179.55]) by usenix.org (8.12.10/8.12.10) with ESMTP id i5PDZFu7014153 for ; Fri, 25 Jun 2004 06:35:15 -0700 (PDT) Received: from localhost (unknown [127.0.0.1]) by whatexit.org (Postfix) with ESMTP id D7CE96626; Fri, 25 Jun 2004 13:35:12 +0000 (US/Eastern) Received: from whatexit.org ([127.0.0.1]) by localhost (joisey [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 23430-01-83; Fri, 25 Jun 2004 09:35:05 -0400 (EDT) Received: from [10.10.10.41] (pcp09147873pcs.union01.nj.comcast.net [69.142.214.144]) by whatexit.org (Postfix) with ESMTP id 29CFA65DB; Fri, 25 Jun 2004 09:35:00 -0400 (EDT) In-Reply-To: <20040606043920.GQ13012@vanilla.office.cyber.com.au> References: <57238.149.117.16.12.1086294359.squirrel@www.indeterminate.net> <20040606043920.GQ13012@vanilla.office.cyber.com.au> Mime-Version: 1.0 (Apple Message framework v618) Content-Type: text/plain; charset=US-ASCII; format=flowed Message-Id: Content-Transfer-Encoding: 7bit Cc: sage-members@sage.org, Christine Hogan From: Tom Limoncelli Subject: Re: [SAGE] Datacenter tools? Date: Thu, 24 Jun 2004 22:59:33 +0100 To: Paul Armstrong X-Mailer: Apple Mail (2.618) X-Virus-Scanned: by amavisd-new at whatexit.org Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 1159 Lines: 30 On Jun 6, 2004, at 5:39 AM, Paul Armstrong wrote: > On Thu, Jun 03, 2004 at 01:25:59PM -0700, John Costello wrote: >>>> Also, I suggest you read chapter 17 (Data Centers) of Limoncelli and >>>> Hogan's excellent book, The Practice of System and Network >>>> Administration. In that chapter, they discuss many useful tools and >>>> devices that a good data center would have. >>> >>> If people would quit stealing this book from me at dinner parties, I >>> might do that :) I've lost 3 of them now! >> >> Perhaps you should include a copy of the book in your DC, and chain >> it to >> a large object? ;^) > > The way my current employer fixes this is to give all new Sysadmins a > copy when > they start. Plenty of copies hanging around work :-) > > Paul Thanks, Paul. Christine and I are constantly humbled by such posts. We couldn't have written it without the help of all the people we learned from, most of whom are Usenix/SAGE/LISA people. That reminds me... I have to mail this months cheques to our minions that go around stealing copies so that people like John have to keep buying new copies. :-) Tom Limoncelli www.EverythingSysadmin.com From owner-sage-members@usenix.org Thu Jun 3 14:10:57 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53LAq3K023549 for ; Thu, 3 Jun 2004 14:10:52 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53LA06F003738 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 14:10:01 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53LA00n003732; Thu, 3 Jun 2004 14:10:00 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 14:08:42 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53L8f6F003469 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 14:08:41 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53L8fof003465 for sage-members-outgoing; Thu, 3 Jun 2004 14:08:41 -0700 (PDT) Received: from heidi.servers.uwrf.edu (heidi.servers.uwrf.edu [139.225.32.18]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53L8c6F003460 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=NO) for ; Thu, 3 Jun 2004 14:08:39 -0700 (PDT) Received: from uwrf.edu (hansos.ns.its.uwrf.edu [139.225.72.130]) by heidi.servers.uwrf.edu (8.12.11/8.12.11) with ESMTP id i53L8UUo013072; Thu, 3 Jun 2004 16:08:30 -0500 Message-ID: <40BF934E.6070502@uwrf.edu> Date: Thu, 03 Jun 2004 16:08:30 -0500 From: Steve Hanson User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.3) Gecko/20030314 X-Accept-Language: en-us, en MIME-Version: 1.0 To: "Michael T. Halligan" CC: "Jenkins, Steven" , sage-members@sage.org Subject: Re: [SAGE] Datacenter tools? References: In-Reply-To: Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.27 (www . roaringpenguin . com / mimedefang) Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 307 Lines: 10 > > If people would quit stealing this book from me at dinner parties, I might > do that :) I've lost 3 of them now! > Wow - you must have different kinds of dinner parties than I do - I can never even explain to people what a System Administrator IS - no fear of their stealing a BOOK about it :-). From owner-sage-members@usenix.org Thu Jun 3 11:56:49 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53Iumjv016092 for ; Thu, 3 Jun 2004 11:56:48 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53Iu56F003224 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 11:56:06 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53Iu5BV003222; Thu, 3 Jun 2004 11:56:05 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 11:55:16 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53ItB6F002985 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 11:55:12 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53ItBOs002982 for sage-members-outgoing; Thu, 3 Jun 2004 11:55:11 -0700 (PDT) Received: from Eng.Auburn.EDU (dns.eng.auburn.edu [131.204.10.13]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53It86E002964 for ; Thu, 3 Jun 2004 11:55:08 -0700 (PDT) Received: from goodall.eng.auburn.edu (goodall.eng.auburn.edu [131.204.12.5]) by Eng.Auburn.EDU (8.12.10/8.12.10) with ESMTP id i53It2SL027906; Thu, 3 Jun 2004 13:55:02 -0500 (CDT) Received: from localhost (doug@localhost) by goodall.eng.auburn.edu (8.9.3+Sun/8.6.4) with ESMTP id NAA13330; Thu, 3 Jun 2004 13:55:00 -0500 (CDT) X-Authentication-Warning: goodall.eng.auburn.edu: doug owned process doing -bs Date: Thu, 3 Jun 2004 13:54:59 -0500 (CDT) From: Doug Hughes To: "Michael T. Halligan" cc: sage-members@sage.org Subject: Re: [SAGE] Datacenter tools? In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Spam-Status: No, hits=-27.1 required=5.1 tests=EMAIL_ATTRIBUTION,IN_REP_TO,QUOTED_EMAIL_TEXT, QUOTE_TWICE_1,REPLY_WITH_QUOTES,USER_AGENT_PINE, X_AUTH_WARNING version=2.52 X-Spam-Checker-Version: SpamAssassin 2.52 (1.174.2.8-2003-03-24-exp) Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 4155 Lines: 96 On Thu, 3 Jun 2004, Michael T. Halligan wrote: > My ops director has a good-sized chunk of cash in our budget > marked aside for "Datacenter tools". I was wondering what people like > to keep on their datacenter for such things. > > So far, we have : > > - Plantronics Industrial noise-canceling phono dual-ear headset, > with connectors for the 3 different types of cell phones our ops > people use, and one portable phone we keep in a cabinet. > - Power convertors for the 3 different types of cell phones > - anti-static straps in each cabinet > - assorted sizes Velcro cable ties, as well as nylon zip ties > - 1 APC Environmental Monitoring Unit in each cabinet > - 1 Laptop in each cabinet with serial connections and adapters for > 3 different types of serial connections > - Ethereal & Minicom installed, as well as a web browser > - Patch panel for laptop with 3 network connections (one for each > subnet) > - Assorted tools (punchdown, cable cutters, screwdrivers, wrenches (for > adjusting cabinets), several paper-clips (APCs have very tiny reset > buttons if they trip) > - Roll of quarters for vending machine > - One cold-spare for every classification of server, including load > balancers, switches, firewalls > - 4U chatsworth locking drawers in every cabinet to keep spare parts and > - Cold spares for anything that we could imagine will break (CPU, > memory, different sizes of hot-swap drives, raid cards, PDUs (very > helpful, just had a PDU fail on us yesterday), GBICs, we've even got a spare > 1U USR tray of fans in case one of ours fails. > - Paper & pens > - 2 Label makers, with extra tape > - Post-its > - Multimeter > - Extra cables of all types (serial, scsi, cat5, cat5 crossover) > - Power tester You want a kill-a-watt. (or two) to measure actual RMS vs Watts and powerfactor of all your equipment. It's excellent. > - Ethernet link checker Why not get something nice like a wavelan or fluke lanmeter? You can tell the quality of the cable (vs what it's rated), and even roughly tell where any break may be. It's a lot better than a simple link checker and doubles as a cable checker, length checker, cross-over checker, protocol analyzer, and everything else. (more expensive, but very useful) > - Floor panel lifters > - Foldup nylon chair > - 2 Keyboards & Mice (less important since our datacenter provides > rolling carts) > > It sounds a bit cluttered, but we have 2 cabinets dedicated for testing > environment and management tools, and production in other cabinets, > eventually we'll have 2 cabinets solely for testing, and one for > management). > > We've tried to make everything as remotely manageable a possible. > Everything sits on a remote serial console, as well as a remote > reboot switch. Our datacenter has a staffed 24x7 NOC that will change > tapes, sit down at a terminal to read errors and type commands, as well > as reboot boxes. If you have remote serial console, then why have a laptop in every cabinet? Wouldn't one or two suffice? > > We've also made everything redundant as possible, having everything > that's not using our clustering utilities have a hot-spare (vrrp for > network gear, LVS for servers). We've also setup automatic rebuild > scripts for all of our servers, so we can kickstart or systemimage > through a serial console. > > My goal is to eliminate trips to the dc as much as possible, but making > sure we have every tool we need in case of any unforseen failure. > > Some of the proposed new tools have been : > > - 1 AXIS network camera per cabinet (the kind that pan, so we can > potentially look at blinkys, as well as who's accessing) > - Fluke network debuggers There you go. now you don't need a separate cable tester either. :) > at least 2 ratcheting crimpers are good to have. I have a recommendation on a vendor - www.pi-mfg.com. As far as environmental monitoring goes, a Westronic Metago WS3500 or equivalent is very nice and capable and expandable with all kinds of accessories. You can access it with typical TL-1 telco-type network probes or with SNMP. (AC, flood, humidity, battery, generator, intrusion, etc) From owner-sage-members@usenix.org Thu Jun 3 12:05:10 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53J59rv011688 for ; Thu, 3 Jun 2004 12:05:09 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53J3u6F004444 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 12:03:56 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53J3urf004437; Thu, 3 Jun 2004 12:03:56 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 12:02:58 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53J2u6F004181 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 12:02:56 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53J2uRE004179 for sage-members-outgoing; Thu, 3 Jun 2004 12:02:56 -0700 (PDT) Received: from mail.halligan.org (mail.halligan.org [64.127.99.10]) by usenix.org (8.12.10/8.12.10) with SMTP id i53J2p6E004163 for ; Thu, 3 Jun 2004 12:02:55 -0700 (PDT) Received: (qmail 31825 invoked by uid 502); 3 Jun 2004 19:05:05 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 3 Jun 2004 19:05:05 -0000 Date: Thu, 3 Jun 2004 12:05:05 -0700 (PDT) From: "Michael T. Halligan" To: sage-members@sage.org Subject: Re: [SAGE] Datacenter tools? In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 3113 Lines: 79 > > - Post-its > > - Multimeter > > - Extra cables of all types (serial, scsi, cat5, cat5 crossover) > > - Power tester > You want a kill-a-watt. (or two) to measure actual RMS vs Watts and > powerfactor of all your equipment. It's excellent. Ahh, good call on that! We do have metered/switching PDUs, but it's pretty limited in the fact that all it really shows is the current amperage being used. > > - Ethernet link checker > Why not get something nice like a wavelan or fluke lanmeter? You can > tell the quality of the cable (vs what it's rated), and even roughly > tell where any break may be. It's a lot better than a simple link > checker and doubles as a cable checker, length checker, cross-over > checker, protocol analyzer, and everything else. > (more expensive, but very useful) Look below, but we're definately considering something like this, once we've figured out which one meets our needs. > > It sounds a bit cluttered, but we have 2 cabinets dedicated for testing > > environment and management tools, and production in other cabinets, > > eventually we'll have 2 cabinets solely for testing, and one for > > management). > > > > We've tried to make everything as remotely manageable a possible. > > Everything sits on a remote serial console, as well as a remote > > reboot switch. Our datacenter has a staffed 24x7 NOC that will change > > tapes, sit down at a terminal to read errors and type commands, as well > > as reboot boxes. > If you have remote serial console, then why have a laptop in every > cabinet? Wouldn't one or two suffice? Well, it'll probably just be a laptop in every management cabinet at this point, with one spare.. As we're building our our infrastructure, we've got a "change test" list we have to go through, which currently has about 60 tests, and requires one person to be available at home, one person at the office, and one person physically at the datacenter.. Lots of cable pulls and stuff. Having the extra screen real estate makes the monitoring process while doing those tests a lot easier. > > - 1 AXIS network camera per cabinet (the kind that pan, so we can > > potentially look at blinkys, as well as who's accessing) > > - Fluke network debuggers > > There you go. now you don't need a separate cable tester either. :) > > > at least 2 ratcheting crimpers are good to have. > > I have a recommendation on a vendor - www.pi-mfg.com. > Ahh, forgot that. We have 2 ratcheting crimpers from Ideal. I'll check out pi-mfg though, for my own hosting company's datacenter.. > As far as environmental monitoring goes, a Westronic Metago WS3500 or equivalent > is very nice and capable and expandable with all kinds of accessories. > You can access it with typical TL-1 telco-type network probes or with > SNMP. > > (AC, flood, humidity, battery, generator, intrusion, etc) Thanks, I'll check it out. I've been less than impressed with the APC so far. -- ------------------- Michael T. Halligan Chief Geek Halligan Infrastructure Designs. http://www.halligan.org/ 3158 Mission St. #3 San Francisco, CA 94110 (415) 724.7998 - Mobile From owner-sage-members@usenix.org Fri Jun 4 13:13:50 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i54KDmig002497 for ; Fri, 4 Jun 2004 13:13:49 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i54KCm6F021098 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 4 Jun 2004 13:12:48 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i54KCiUt021087; Fri, 4 Jun 2004 13:12:44 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Fri, 4 Jun 2004 13:07:00 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i54K6x6F020564 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 4 Jun 2004 13:06:59 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i54K6xnF020563 for sage-members-outgoing; Fri, 4 Jun 2004 13:06:59 -0700 (PDT) Received: from crusoe.degler.net (crusoe.degler.net [66.114.64.229]) by usenix.org (8.12.10/8.12.10) with ESMTP id i54K6t6F020558 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL) for ; Fri, 4 Jun 2004 13:06:57 -0700 (PDT) Received: from crusoe.degler.net (localhost [127.0.0.1]) by crusoe.degler.net (8.12.11/8.12.9) with ESMTP id i54K6q3X022447; Fri, 4 Jun 2004 16:06:52 -0400 (EDT) Received: (from chuck@localhost) by crusoe.degler.net (8.12.11/8.12.9) id i54K6paf014654; Fri, 4 Jun 2004 16:06:51 -0400 (EDT) Date: Fri, 4 Jun 2004 16:06:51 -0400 From: Chuck Yerkes To: sage-members@sage.org Subject: Re: [SAGE] Datacenter tools? Message-ID: <20040604200651.GA16925@2004.snew.com> Reply-To: sage-members@usenix.org References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.1i X-Spam-Status: No, hits=-4.4 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on crusoe.degler.net Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 1997 Lines: 46 Quoting Doug Hughes (doug@eng.auburn.edu): > On Thu, 3 Jun 2004, Michael T. Halligan wrote: Baylisa deja vu ellided... > > - Power tester > You want a kill-a-watt. (or two) to measure actual RMS vs Watts and > powerfactor of all your equipment. It's excellent. I have a WattsUp at home (same thing, I think). But for pro use, you likely want an ammeter and a breakout thing (this thing that separates the wires so you can use the clampon ammeter). The watts up won't work with 220 or > ~12amps. My data center cabinets MOSTLY run 220 (a 20 amp run powers twice as much that way and 95% of machines don't care 220/110). My cabinets pull more than 12A. Even just the big RAID units will pull 15Amps. > > - Foldup nylon chair > > - 2 Keyboards & Mice (less important since our datacenter provides > > rolling carts) > As far as environmental monitoring goes, a Westronic Metago WS3500 or equivalent > is very nice and capable and expandable with all kinds of accessories. > You can access it with typical TL-1 telco-type network probes or with > SNMP. > > (AC, flood, humidity, battery, generator, intrusion, etc) FLOOD! Yes. This has come up on my New York admin group list too. I've done homemade (any plastic container with holes on the ground with two wires and a little salt will conduct when there's water. A game port (A/D) can catch that). There's pro stuff galore (look for home water cutoff sensors - smarthouse.com has "watercop" sensors. I've also been using ibutton/1wire sensors a bunch. Cheap; I put them in a phone block with 2 RJ11s (in/out) and chain them together. I can do temp, humidity, SWITCHES (with a simple burglar alarm switch you can see if cabinet got opened), barometer, etc. Another DC I worked with had under-floor pressure sensors which would set of a trap if more than 3 tiles got pulled. We'd have guys pull up 20 tiles, and take lunch. This sort of affected the air conditioning hitting the racks. SGIs and Crays don't like warm air for long. From owner-sage-members@usenix.org Thu Jun 3 13:38:35 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53KcYcg002718 for ; Thu, 3 Jun 2004 13:38:34 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53Kbg6F028883 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 13:37:43 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53KbfcB028875; Thu, 3 Jun 2004 13:37:41 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 13:36:27 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53KaQ6F028311 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 13:36:26 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53KaPBx028308 for sage-members-outgoing; Thu, 3 Jun 2004 13:36:25 -0700 (PDT) Received: from etsuex1.etsu.edu (etsuex1.etsu.edu [151.141.8.103]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53KaN6E028298 for ; Thu, 3 Jun 2004 13:36:24 -0700 (PDT) X-MimeOLE: Produced By Microsoft Exchange V6.0.6487.1 Content-Class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Subject: RE: [SAGE] Datacenter tools? Date: Thu, 3 Jun 2004 16:36:18 -0400 Message-ID: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: [SAGE] Datacenter tools? Thread-Index: AcRJqiqm7Xh71V+DRSGRmaZwhv0YQQAADFUg From: "Jenkins, Steven" To: "John Costello" , Content-Transfer-Encoding: 8bit X-MIME-Autoconverted: from quoted-printable to 8bit by usenix.org id i53KaO6E028304 Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 519 Lines: 27 Only a sysadmin would have dinner parties in a data center... Steven -----Original Message----- ... > > If people would quit stealing this book from me at dinner parties, I > might do that :) I've lost 3 of them now! Perhaps you should include a copy of the book in your DC, and chain it to a large object? ;^) > ------------------- > Michael T. Halligan > Chief Geek > Halligan Infrastructure Designs. > http://www.halligan.org/ > 3158 Mission St. #3 > San Francisco, CA 94110 > (415) 724.7998 - Mobile John From owner-sage-members@usenix.org Thu Jun 3 15:02:28 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i53M2SBJ029114 for ; Thu, 3 Jun 2004 15:02:28 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53M1j6F014641 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 15:01:45 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i53M1i9n014640; Thu, 3 Jun 2004 15:01:44 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 15:00:39 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i53M0b6F014366 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 15:00:38 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i53M0bPR014362 for sage-members-outgoing; Thu, 3 Jun 2004 15:00:37 -0700 (PDT) Received: from mail.halligan.org (mail.halligan.org [64.127.99.10]) by usenix.org (8.12.10/8.12.10) with SMTP id i53M0a6E014357 for ; Thu, 3 Jun 2004 15:00:36 -0700 (PDT) Received: (qmail 32422 invoked by uid 502); 3 Jun 2004 22:02:51 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 3 Jun 2004 22:02:51 -0000 Date: Thu, 3 Jun 2004 15:02:51 -0700 (PDT) From: "Michael T. Halligan" To: John Costello , Subject: RE: [SAGE] Datacenter tools? In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 967 Lines: 45 Not in my datacenter, at my house.. Though, only a sysadmin would have dinner parties where people would consider asking to borrow a copy of limoncelli's book. On Thu, 3 Jun 2004, Jenkins, Steven wrote: > > > Only a sysadmin would have dinner parties in a data center... > > Steven > > -----Original Message----- > ... > > > > If people would quit stealing this book from me at dinner parties, I > > might do that :) I've lost 3 of them now! > > Perhaps you should include a copy of the book in your DC, and chain it > to a large object? ;^) > > > ------------------- > > Michael T. Halligan > > Chief Geek > > Halligan Infrastructure Designs. > > http://www.halligan.org/ > > 3158 Mission St. #3 > > San Francisco, CA 94110 > > (415) 724.7998 - Mobile > > John > > > > -- ------------------- Michael T. Halligan Chief Geek Halligan Infrastructure Designs. http://www.halligan.org/ 3158 Mission St. #3 San Francisco, CA 94110 (415) 724.7998 - Mobile From owner-sage-members@usenix.org Thu Jun 3 20:59:58 2004 Received: from usenix.org (voyager.usenix.org [131.106.3.1]) by eldwist.darkuncle.net (8.12.11/8.12.9) with ESMTP id i543xvep023078 for ; Thu, 3 Jun 2004 20:59:58 -0700 (PDT) Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i543wh6F013301 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Jun 2004 20:58:44 -0700 (PDT) Received: from localhost (majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) with SMTP id i543wgwp013290; Thu, 3 Jun 2004 20:58:42 -0700 (PDT) Received: by voyager.usenix.org (bulk_mailer v1.13); Thu, 3 Jun 2004 20:54:36 -0700 Received: from voyager.usenix.org (localhost [127.0.0.1]) by usenix.org (8.12.10/8.12.10) with ESMTP id i543sZ6F012888 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 3 Jun 2004 20:54:35 -0700 (PDT) Received: (from majordomo@localhost) by voyager.usenix.org (8.12.10/8.12.10/Submit) id i543sZsa012887 for sage-members-outgoing; Thu, 3 Jun 2004 20:54:35 -0700 (PDT) Received: from mail.indeterminate.net (olivia.indeterminate.net [207.173.200.107]) by usenix.org (8.12.10/8.12.10) with ESMTP id i543sX6E012882 for ; Thu, 3 Jun 2004 20:54:33 -0700 (PDT) Received: from indeterminate.net (localhost.localdomain [127.0.0.1]) by mail.indeterminate.net (8.11.6/8.11.6) with SMTP id i543sSk19395; Thu, 3 Jun 2004 20:54:28 -0700 From: John Costello Received: from 198.182.56.5 (SquirrelMail authenticated user cos) by www.indeterminate.net with HTTP; Thu, 3 Jun 2004 20:54:28 -0700 (PDT) Message-ID: <24587.198.182.56.5.1086321268.squirrel@www.indeterminate.net> Date: Thu, 3 Jun 2004 20:54:28 -0700 (PDT) Subject: RE: [SAGE] Datacenter tools? To: In-Reply-To: References: X-Priority: 3 Importance: Normal Cc: , X-Mailer: SquirrelMail (version 1.2.10) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Virus-Scanned: ClamAV version 'clamd / ClamAV version 0.65', clamav-milter version '0.60p' Sender: owner-sage-members@usenix.org Precedence: bulk Status: RO Content-Length: 646 Lines: 32 > > > Only a sysadmin would have dinner parties in a data center... Well, of course--that way you don't have to worry about the drinks or snacks keeping cool. > Steven John > -----Original Message----- > ... >> >> If people would quit stealing this book from me at dinner parties, I >> might do that :) I've lost 3 of them now! > > Perhaps you should include a copy of the book in your DC, and chain it > to a large object? ;^) > >> ------------------- >> Michael T. Halligan >> Chief Geek >> Halligan Infrastructure Designs. >> http://www.halligan.org/ >> 3158 Mission St. #3 >> San Francisco, CA 94110 >> (415) 724.7998 - Mobile > > John