At least it wasn’t 92
Monday morning through Sunday night I worked 91.5 hours, which was my heaviest work week ever. The team I am on was in a big sprint to get Sun’s DSEE software rolled out on a huge scale across multiple data centers and it all came together. The software installation and configuration itself was easy to manage across dozens of hosts thanks to the fantastic CLI. The x4600 servers performed very well. Our biggest challenges were coordinating a group of people in multiple locations with differing levels of familiarity of the machines and software stack. There were a few cases where tired fingers made a typo and wiped out some data, but using zfs rollback (and smart use of snapshots) made the recovery time in under a minute once the problem was detected.
The funniest moment of the crazy weekend was when my wife saw me working in my office at 8am Sunday morning and asked what time I went to bed. I answered “about 6:30″. The look of horror on her face as she realized that mean less than 1.5 hours of sleep was awesome.
I hope I don’t have craziness like the last week often, but I did feel a great sense of accomplishment when we were done.
Tip of the day:
If you get a coredump on Solaris, run
echo ‘$C’ | mdb $name_of_corefile
to get the stacktrace that actually caused the core.