Anthropomorphizing alcohol while pondering backups and hoping I don't have to give a friend bad news
I've been working hard on some projects, and deadlines and milestones can really take it out of your sleep schedule. I'm kind of known for pushing my sleep schedule beyond normal limits, sometimes through artificial means, and used to be quite proud of it.
As I've gotten older though, I've started to try to introduce some sanity into my schedule. While that plan gets derailed from time to time because of a project, it's a lot better than it used to be... and it did seem to be catching up with me.
In the past when I'd pushed the sleep issue back for days, I'd just get tired and slow down. I'd tell my body what was expected of it, and it'd do its best, just slower. I've been reading some lit on the formations of unions lately, and disturbingly I think my body itself may have been listening. Perhaps it's the mid-20s just catching up with one, but I'm not used to falling asleep unless I give the A-OK.
Maybe while driving, when you're sort of being lulled, but even then it bothered me. Trying to wean myself from four strong pots of coffee a day down to two, while simultaneously backing off of the nicotine probably isn't helping the situation.
Nothing freaks me out like waking up with the realiziation that you hadn't known you'd gone to sleep... and hitting snooze 40 times on the alarm isn't the same as waking up late and not realizing that the alarm somehow got turned off, or that it's been going off for an hour and you just didn't hear it.
Last night I got home late, and knew I had to get some work done for today. It'd been a long day, and the continued stream of hate mail had my throat pining for something cold and alcoholic, but the fridge was bare. Some people just don't respect the 'last beer' rule, which means if you take a cold one, you replace it with a warm one.
I threw it in the freezer to chill to optimimum temperature while I spread out on the couch and watched some Charlie Rose (I love Charlie Rose's interviews) and within a few minutes I was out, only to be awoken by a loud popping noise and the scittering of bits of glass.
To my shame, that popping noise was the end result of the beer freezing while I dozed. I'm unamused by the feelings of loss and guilt it caused.
When you come to identify something as a thing of beauty, to have some connection to it, seeing it wasted or not being used in its intended fashion can really rankle. There is also the notion that something is created for a purpose, and when that potential is not being fulfilled, you're letting that thing down.
This is why you'll often see uber geeks pause on the street with heads bowed and hats clutched to their chest when they see a computer left out for trash, and why while a car on a showroom floor can make you swoon, some intrinsic part of you knows that cars are made to be driven.
I decided to put the feelings of guilt and loss aside to deal with later and poured a glass of Grand Marnier to sip while I finished Charlie Rose, and promptly fell asleep again. Unamusing.
Then a friend called at 4am, frantic because their iBook was dead and they needed the files on it for that day. Hot coffee was promised, and possibly breakfast, so off I trundled through the cold blowing wind laced with snow.
Besides, she's pre-law, and it never hurts to get in on the ground floor with a lawyer. I'm a big fan of pulling thorns from a lion's paw whenever the possibility presents itself.
This poor girl hasn't had the best time with their dual-USB iBook; it's been sent back for repairs at least three times, and it's pretty flaky, although things have improved somewhat.
It's more partial to kernel panic'ing on waking from sleep than I'd like, and swapping out the RAM and other usual tricks didn't help. There are other issues, but I'd say she's not really happy with it. One thing Mac people don't talk about when they pull in new users is how many are leaving at the same time.
If you have a bad experience with a piece of hardware on Windows, you just switch brands... if your Mac experience kinda sucks, you switch platforms. And you generally don't come back.
Anyways, apparently there had been a kernel panic yesterday and she'd run Disk Warrior, which I recc'd she purchase, and last night she couldn't print, so she ran repair permissions and then Disk Warrior again. It was still going when she hit the sack, and was still going when she got up, which was where the worry came in.
It had been running for eight to nine hours, so I figured something must be up and rebooted. Her iBook was reporting 15 terabytes were free, which wasn't good. For some reason it refused to boot off of her Firewire Neptune HD, which I also wasn't amused by.
She needed a specific email with directions on where she was supposed to be in a few hours, as well as some stuff for that evening... and of course she hadn't done a backup in two weeks (She finds it too annoying. Why OS's don't come with integrated and easy to use backup solutions at this point is beyond me), and of course she'd just gotten the directions yesterday.
Opening up Mail, things got spookier. There was no mail. Blank. She commented on how fast it opened (that was quick! it always bounces a bunch of times for me) and I didn't have the heart to tell her that that probably wasn't a good thing. It did have her account information in Mail's preference pane, but nothing else. So, off to check Mail's files.
This wasn't good. To the finder, the 'Application Support' directory, where Mail stores its files (except for one of its preferences) was now considered to be a file. It did still say it was a directory, and kept the icon, but when clicked on it was being treated as a file of 4k. Basically, pretty much a blank file, as HFS+ only allows you to go down to 4k.
Ok, so launch the terminal and see what ls might see better than the Finder application, but Hmmmm, the Terminal.app doesn't want to launch. The console log was taunting me with its emptiness.
Figuring maybe something small was tripping up Disk Warrior I ran the standard Disk Utility, which said it was repaired... but while scrolling up I saw a whole bunch of 'extent allocation' errors, which is just nasty business.
Really nasty business. Disk Warrior is about the only thing that can repair these, and without a bunch of jargon they're caused by something going wrong and files getting overlapped... sorta. I know what it is, however I've never really heard what exactly causes it to start to happen systemically.
And while I love Disk Warrior (this affair really started with 10.1, which had a nasty bug that would cause firewire drives to get corrupted when you tried to transfer large files), ideally it's the kind of thing that just shouldn't be occurring at all... and if it's going to because of some innate cause of the product, at the very least Apple needs to buy Disk Warrior or include the same functionality.
This doesn't appear to be the kind of problem that just accrued over time, considering she'd just run everything the day before... something caused it, but what? Like most users, she couldn't remember what exact application she'd had up when it awoke from sleep and kernel panic'ed so there weren't a lot of clues there.
(as a side note, I don't hold users to the fire for that - I'm generally intimately aware of what my computer is doing, but if I am ever pulled into an investigation ala a TV crime show I am just screwed, as I can never remember where I was at a given time, let alone last Tuesday at 7:30pm when someone went missing)
Her application usage is pretty tame: iTunes, Microsoft Office, Mail, web browsing, and now a bit of iMovie (which was the impetus for the Firewire drive). Her drive was only half full.
A quick call to Alsoft (who were responsive) basically said that yeah, if it's stuck on "Step 6: optimizing..." it could be going for awhile, and yes, even though it seems to be stuck and the UI doesn't update, it's still working.
How long could it possibly go? He basically said "Who knows, a long damn time. Maybe the day, maybe the night too. And if Disk Warrior can't fix it, you'll have to send it to Drive Savers...". This meant my friend was basically screwed for that evening as far as her data was concerned, so I just left it to run and we'd see what would happen.
The big thing she was worried about was that someone or other had just sent a big iTunes gift certificate to her email ($100 - she likes her iTunes Store). You can get these a variety of ways, but one of the most popular (and last minute) ways it to have them sent as an email.
Give Apple your credit card number at the store (or via PayPal), plug in the persons email, and they get a nice little HTML-formatted email with the information they need to enter to get the moola. If you don't already have an account, you create one, otherwise you can redeem it and have the amount sitting in your account as a credit.
Her main question was... if I don't have that email, how do I get it? What I've found so far hasn't been encouraging. Apple's site says:
Can I receive a replacement gift certificate or prepaid card? We cannot issue a replacement gift certificate or prepaid card. Please treat prepaid cards and paper gift certificates like cash. If ordered an email gift certificate and you can't find the email from us, check in your email application's junk mail folder. Or, verify your email address with the person who purchased your gift certificate.
Yeah, that isn't sounding good. Kinda lame, to be honest. An email is, well, an email. It could not get to someone for a whole variety of reasons, including spam filters. Surely the necessary information would be somewhere on the invoice itself... but it's not.
I don't really use the iTunes Store, but I have a friend who is a huge fan, and I sent them one a week or so ago, and checking the receipt I saved... nada. After googling around for 15 minutes, I found that there's no phone support, but you can send an email and after a week you can get a reply.
They can't/won't reissue them, but they will cancel them and the person can be asked to get a new one. That, at least, is a little bit of good news... sort of. The word around the web doesn't seem to be good on this one... Apple's site says you'll get a response in 24 hours, but the word on the web you're looking at at least a week, with at least a few blogs saying it's been 2+ weeks and they've gotten no response.
At the very least, hopefully someone won't be out $100, but with Christmas in twelve days and things being very busy over there because of it, I'm honestly not looking forward to having that chat with her.
Why, if you have all of the information you needed to buy it, there isn't a way for someone to cancel and reissue it themselves in an electronic way isn't something I get. It's an awful lot of hassle to go through if you happened to misspell someone's email.
Going back to the hard drive situation, it's now 11 PM, and when I talked to her a half an hour ago Drive Warrior was still chugging away. She thinks at least. It's honestly hard to tell since the screen never updates. Perhaps the whole iTunes deal will be moot, as well as her angst over her lost files, if Disk Warrior completes its marathon and is able to recover her files.
I really hope it does... the closest I'll ever come to feeling like a doctor is having to tell someone their treasured data was slag. Since I don't work in tech support, these are usually friends, so it usually sucks.
While I'll report back on whether she is able to recover her holiday cheer, her situation did leave me pondering a couple of questions:
- How, if at all, has the process of backing up one's computer really changed over the last 5 years till now? From the last 10 years? The medium you might be backing it up onto may have changed, but has the process really been made easier and/or improved? If not, why?
- What could have caused her file system to spontaneously combust in the span of a day in the first place? I've pounded Linux filesystems (usually ext3) ten times harder than I ever have an HFS+ drive, yet I've never experienced half the problems HFS+ seems to bring to the table. An engineer who used to work on it told me once that you're just asking for corruption if you push an HFS+ past 80% capacity. Are my experiences an abberation, or is HFS+ just kinda sucky?
- There's a fairly rudimentary Windows Backup utility that's included on the WindowsXP and Windows2000 CDs, although it requires a separate install. Mac OS X includes... nothing. Apple has a new 'Backup' program, which you can get if you pay $99/year for .Mac. Is this really such an exotic feature request that users should be forced to buy a separate solution?
I'm going to go out on a limb and say the majority of users are going to want to backup their data, just as the majority of users are going to want to have access to a web browser or TCP/IP stack.
It isn't as common an operation as it should be, but its still one the majority of users out there should have access to without paying a bunch extra. I'd think the capability would not only be ripe for rolling it into the OS, but that some of the technologies available now (Rendezvous or whatever it's called now, Wireless, etc.) could really improve things.
In my personal opinion, this feature passed ripe a generation ago and is now rotting on vine... and I find the whole situation perplexing.
Comments (22)
Posted by: Carl at December 15, 2004 02:16 AM
My understanding is that Tiger will let you iSync a directory, allowing you to auto-update your data onto your iPod, but I'm not 100% sure about this, since I'm not a beta tester.
Anyhow, if that feature ships, it will be helpful, especially consider that important folders like Library and Documents rarely come to more than a gig or two…
Posted by: eco2geek at December 15, 2004 02:24 AM
IMHO, the problem used to be affordable storage media with sufficient capacity. I'm a packrat, and I still have a floppy disk backup from a full 160MB Mac LCIII sitting here...73 diskettes. Now that hard drives commonly sold with computers are in the 80 to 200GB range, what are you going to back up to? CDs? DVDs? Yeah, there's a pleasant way to spend an entire weekend. I'll get a round tuit.
Fortunately, hard drives have become so inexpensive (Why? Clearing out the shelves for SATA?) that anyone can afford an extra partition or two for backup purposes.
Perhaps computers should come with hard drives partitioned for the purpose of using one for a backup, and a backup utility that runs out of the box on a set schedule, instead of leaving it up to the user to buy a separate utility and backup media. (This would be easier for Apple, since they control both the software and the hardware.)
And perhaps if it had been that way from the start -- a feature of the computer, rather than a decision left up to the user -- we'd all be doing it more often.
Posted by: Carl at December 15, 2004 05:25 AM
What eco2 just described is RAID-- a file system that writes everything down multiple times, just in case.
Anyhow, keeping your backup copy within the same physical machine, to say nothing of on the same physical disk, is asking for trouble. What makes more sense is to buy an external FireWire drive, so at least when your notebook is stolen you have some backups left. (Incidentally, this happened to my brother.)
Now, my LaCie came with some software for backing up stuff, but I'll be damned if I ever used it. Maybe this will bite me in the ass later, but for now, I'm OK.
Hmm, all this reminds me that I should probably backup my powerbook before my flight next week…
Posted by: SirG3 at December 15, 2004 06:58 AM
Wow that sucks. I've never really had my Mac screw up too bad (and when it did, I was absolutely responsible ;-)). I've kernel panicked maybe.. twice on 10.3. If I had problems like what you've described, I wouldn't go Mac again. I like OS X, but I like my data more.
There's about 5 computers in the house (6 once I build my new one for Christmas :-D) and the only ones that have had hardware failures are my mom's. Her laptop hard drive went once (ticking hard drive sounds of doom...) and she's had two 250GB (or was it 100GB, I dunno, they're big :-P) hard drives corrupt too. I've never had much problems with my hardware or software. Perhaps I'm just very careful... or lucky.
-- SirG3
Posted by: Fred B. at December 15, 2004 07:51 AM
Maybe I didn't understand well, but I'd recommend to repair the drive from another mac, thru Taget Disk Mode.
To the finder, the 'Application Support' directory, where Mail stores its files (except for one of its preferences) was now considered to be a file.
Mail doesn't put its files in Application Support, but in ~/Library/Mail.
Posted by: Diggory Laycock at December 15, 2004 01:02 PM
Beat me to it on ~/Library/Mail Fred. :)
I think backup is freeware (the non-online part works without .mac (I think)).
http://www.apple.com/downloads/macosx/apple/backup.html
Posted by: drunkenbatman at December 15, 2004 01:13 PM
Thanks for the heads up on the Mail directory, don't know why I was thinking it was there. Disk Warrior is still running, but I'll check that out.
Posted by: cjp at December 15, 2004 02:13 PM
I try to reccomend to people who insist on filling up their 100G+ disks with important data (at least to them anyway) and who aren't able to have RAID in their system, to at least get a FireWire or USB 2.0 cradle and stick in an inexpensive second drive. One day they WILL wake up and their hard disk will have died, maybe tomorrow -maybe in a few years. But the long-term reliability of today's cheap drives really hasn't been tested yet.
And a very similar thing to what your describing happened to my workmate on his eMac a few months ago. I think his hard drive was pretty full too.
He backs everything up now.
Posted by: Wes at December 15, 2004 02:16 PM
You say she uses her book lightly, but has it been dropped any? I've had similar experiences twice now with my powerbook. The first time it started with disk images not mounting, then KPs, and various other file system weirdness. I checked ram, the hardware test CD, single-user boot with fsck, everything, and couldn't figure it out. Made it through 3 levels of AppleCare with the issue, the final guy I talked to was emailing product engineers :)
Turns out the drive cable was loose. I use my powerbook heavily and I don't treat it very nicely (it gets banged around frequently) and so the second time it happened I immediately had it pegged. I sent it in to AppleCare again, would have done it myself, but I'd hate to void my extended warranty. Plus AC has been good to me.
Check her drive cable. Or have AC do it. It amazed me how the loose cable manifested itself as file corruption, bad memory (KPs) and just about everything else under the sun.
Posted by: Cap'n Hector at December 15, 2004 04:13 PM
DB, I know the pain with telling people they've lost data, and I hope your friend is able to recover.
I work in support, and those calls are the ones that I am the most pained by and least sympathetic to,
Even with a complete stranger it's hard to give them the news that the data is toast and then tell them how they should've backed up…
Good luck with Disk Warrior, and I agree…it's ~/Library/Mail
Did you check her mail servers? IMAP/Pop server storage?
Posted by: at December 15, 2004 04:45 PM
Is that a Jamaican Red Stripe? Good lager.
Posted by: Adrian Sampson at December 15, 2004 07:43 PM
I spent a long time looking for an adequate backup solution after my TiBook was stolen along with years of work, and I have to plug the open-source, command-line rsyncbackup. It just hit 1.0 and now supports Growl notifications (local and remote), remote backups, incremental backups, and all sorts of geeky things. I keep a couple of scripts in my Script Menu and back up without pain every day. Perhaps, however, it is not for your average (ie. casual) user.
Best of luck.
Posted by: Adrian Sampson at December 15, 2004 07:44 PM
I spent a long time looking for an adequate backup solution after my TiBook was stolen along with years of work, and I have to plug the open-source, command-line rsyncbackup. It just hit 1.0 and now supports Growl notifications (local and remote), remote backups, incremental backups, and all sorts of geeky things. I keep a couple of scripts in my Script Menu and back up without pain every day. Perhaps, however, it is not for your average (i.e. casual) user.
Best of luck.
Posted by: Linden at December 16, 2004 02:33 PM
You know, after reading this and comments, and some own personal experience, I wonder if there's something that not computer savvy people do (maybe a way they treat files/saving/their computer/etc) that computer savvy people just don't do. I've heard a couple horror stories about hard drives, but they're almost always someone's friend/relative that doesn't know much about computers. I work part time in computer labs for my college helping people, and sometimes I see the strangest ways of doing normal stuff. Maybe there's some kind of abuse people put their hard drives through because they don't understand how things are working. Just a thought.
Anyways, sorry to hear about that, it sounds super messy.
Wes - great info on the loose hard drive cable. I'll have to scare my abusive-on-his-laptop friend with that.
Posted by: drunkenbatman at December 17, 2004 03:46 AM
Yes, it's a Red Stripe, to my eternal burning shame. It deserved better.
Wes - good idea about the cable. She's pretty light with it, hasn't dropped it or anything that will be admitted to... at least the outside is in perfect shape. It does travel a bit, but in a car inside a bag.
The big problem with kernel panics are almost always on wake from sleep... just been a nightmare. I'll look into seeing what it takes to check out the HD cable in those, I have a feeling if its anything like the Powerbooks, getting to the HD could be a nightmare.
Oh, and regarding the iPod... yes, one is used, but there haven't been any real issues with it. They're pretty honest about screwing up, so I think they would have said if they'd accidently unplugged it or something, but they say they've always been very careful to dismount it, wait for the OK on the screen, then disconnect. (original 5gig version)
For the record, I checked it earlier, and Disk Warrior was still going... so it's been like three days. I'm going to pull the plug tomorrow...
Posted by: Paul Mison at December 17, 2004 09:11 AM
Diggory: Apple's Backup application (great name, there, guys; just like Mail, it's difficult to tell if you mean the app or the concept; sigh) does not work without .Mac access. It's possible for the sort of person who can configure DNS and Webdav to fool it fairly easily into working, but this (arguably- and drunkenbatman argues the case pretty well) essential piece of software is not part of the OS, but part of a $100 - per year - addon.
Me? I'm kind of savvy enough to run CCC, but damn, I wish that every time my machine was at home and idle for 30 minutes something would just start and take an incremental backup to a home server. Maybe rsyncbackup could be scripted to do that. I should look at it.
Posted by: poswald at December 17, 2004 11:53 AM
All this talk about laptop disassembly... A good resource to check before you jump in: http://www.pbfixit.com/Guide/
Posted by: uv at December 18, 2004 04:37 AM
I think Apple's not getting around to creating it becuase:
a. It's hard to do it in a way that "just works" (think restores).
b. It will soon be obselete, like running spell-checkers when nowadays you have that red thingy under misspelled words. Let me tell you why.
I'm guessing that in the next year or two one or both things could happen:
1. iPod sync will backup *all* your data, at least everything but movies (documents, mail, calendar, prefrences, etc.). They're doing photos now, and there's no reason not to do it with 80GB iPods coming...
2. People who really worry about their data will probably have two computers - probably a portable and a desktop. That's where iSync comes in again and syncs between them (I think they mentioned iSync being upgraded in Tiger). If this works, you have a system-wide redundency, not just data redudency (think what happens when your iMac's integrated screen goes out).
In any case although these forms of backup are actually just 'disaster recovery' and not the 'give me last week's version' type of backup, they should be adequate to home users.
Posted by: John Evans at December 19, 2004 12:16 PM
UV your kinda off track with your comments.
iPod drives are not made to be used in such a heavy fashion. I cant recall the figures but if one was to use it in such a heavy way the life of the drive would be cut short by quite an incredible ammount.
Also iSync. Do you think apple will really go away from the .Mac thing and allow one to use iSync to do data syncing between machines?
For example, the backup utlitly is pretty much what your describing. It requires .Mac just to launch!!! I would bet if Apple puts in these features they will need .Mac. Might be wrong but I doubt it.
Also apps like Super Duper do a good job of backups that 'justwork'. At least in the incremental backup sense. Create a fullbackup once then just add incremental changes which makes the first backup a long one but the rest real fast.
There is also rsync which is pretty decent if not too geeky. But does allow one to backup accross a network. Not quite the apple way.
Also there is the ability to create backups via disk utility. Its there just hidden.
Posted by: Scaryllama at December 20, 2004 08:15 AM
I seem to remember that mac OS had built in support for raid. Not sure what level of raid or if you can raid partition to partition on the same drive. Obviously not as good as a real backup, but at least it'd get some stuff done. Personally I have a chron job set to copy specific files to my removable HD on a nightly basis.
If you REALLY need it, I believe that many of the companies that release firewire external drives also put out software for backing up to them. I seem to recall ignoring the installation of such software with my Maxtor, but I do know it was OSX compatiable.
Posted by: drunkenbatman at December 21, 2004 07:07 AM
Just to wrap it up... Disk Warrior ran for something like three days, with no change in status, and at that point she was desperate and it was time to wipe and reinstall after salvaging what we could. She was unamused.
While going through her backup, I did go through the older crash logs, and most of them seemed to involve data access of one form or another... googling gave me nothing, but even though Apple said the RAM and everything was fine (we aren't going to go into her experiences with Apple support, it's been that bad) it's probably worth looking into again. I didn't have a small screwdriver on me, but will go back soon and remove the top stick and see if that helps.
The HD cable idea is again an interesting one, but the problems seem to creep up over 2-3 weeks until things go FUBAR, not regularly like every other day... except for the wake-on-sleep crap.
And thanks for the disassembly note for the iBooks- that was a real help, mostly in letting me know I didn't want to do it without the promise of beer or food. :) Changing a HD in a recent Powerbook was a horrid enough experience it shouldn't be done without a solid reward.









I'd comment but I feel the urge to open CCC and back up my hard drive...