This is the archive site for the pioneering blog CamWorld.com, which is no longer maintained.
Cameron Barrett's personal site can now be found at cameron.barrett.org and his professional site can be found at cameronbarrett.com.

September 08, 2003

Got Those Hard Drive Blues

On Sunday morning the hard drive in my new 12" Powerbook G4 decided to take a permanent vacation. I spent the entire day coaxing data off it, resulting in getting everything crucial except for my massive 1 GB Entourage email database. Luckily, I have a Retrospect backup of my hard drive that was run on August 20, however when I extract the Entourage db it has all of my mail up to July 27, which was the first date I ran the backup process. Somehow my Retrospect backup process missed the Main Identity folder containing my email databases. Bah.

Anyway, I was fortunate enough to procrastinate on selling my old ComboDrive Powerbook G4 which I replaced with an identical SuperDrive PBG4 (the one that is now at an Apple Repair Center getting a brand new hard drive), so I'm now using my old ComboDrive PBG4 in the interim. The short of it is that I'm now missing about 6 weeks of email archives that I'm not sure if I'll ever get back - everything since July 27, 2003.

Interestingly enough, the Powerbook with the bad hard drive now only boots into the Darwin console, but still have full Interent access. Since I had no easy way of getting my data off this drive I enabled FTP on my old Powerbook and started FTPing gzip'ed folders over my WiFi LAN. It worked surprisingly well until I started getting FTP errors when it hit bad blocks on the hard drive. Unfortunately, this only happened when I tried to FTP my 1 GB of archived email. Bah.

I also learned that Mac OS X's default for Gzip is to replace the file you are compressing with the compressed version of it. This is bad because it leaves you with no backup. If you don't know that this is the default, and you Gzip 1 GB of data without backing it up first you run the risk of writing the compressed version to a bad part of the hard drive, effectively making it impossible to retrieve via FTP and also impossible to Gunzip. Bah.

All of this I learned in a 12-hour marathon session yesterday of trying to save my data. It has reinforced my belief that backups are good and regular daily backups are even better. It has also convinced me to abandon Entourage for a better mail client that stores its mail in the more normal mbox format which I can then regularly synchronize to my server if I don't migrate to IMAP.

The question is: Is Mailsmith a decent mail client? I've checked out GNUmail, which looks pretty good. And I'm hearing things about Eudora 6 that make me want to try that as well.

Update: It could be worse. At least I didn't run over my PBG4 with an SUV.

Posted by Cameron Barrett at September 8, 2003 12:34 PM
Comments

Why not use Mail.app? I moved from Entourage to Mail some time ago and have been quite happy with the transition. I don't know if it does mbox, but it does work nicely with IMAP servers.

-Chris


Posted by: Chris at September 8, 2003 12:45 PM

So where is the 'apple rant' ?


Posted by: Diederik at September 8, 2003 12:51 PM

It's not just OS X that has gzip default to replacing the file; that's the default for gzip on any platform.

Coincidentally, it's also the default method for the old UNIX compress and bzip2.


Posted by: Jeff Seifert at September 8, 2003 01:00 PM

I use Mailsmith as my professional email client, and Mail.app for personal mail. I'll likely be switching back to Mail.app when Panther is released, since it looks like they've resolved the speed issue, and threaded email looks insanely cool.


Posted by: Dan Budiac at September 8, 2003 01:55 PM

I use Mail.app and Thunderbird. I've yet to lose email due to anything either of them has done. (My own carelessness is another issue.)


Posted by: pete at September 8, 2003 01:57 PM

I am an unabashed Eudora partisan, although I'm using v5.2, not 6. I've been using Eudora for 10 years and have yet to lose a piece of mail.


Posted by: TheBrad at September 8, 2003 02:58 PM

Using Mail.app myself. Mailsmith doesn't do IMAP nor HTML mail, am I right? Those are two big strikes with me (and I'm a BareBones fan).


Posted by: ~bc at September 8, 2003 06:26 PM

My vote for Mail.app too! :-) Ok, it is a bit sluggish but the tight spam filter integration alone is a big plus IMHO; personally I recieve around 900 spam mails a month at this time (and that probably isn't much for a lot other people).

I like Entourage, but I'd have to get an external spam filter which would be, I'm afraid, not a point-and-click setup with my dial-up modem connection (and I'd not be willing to buy a commercial tool). Well, and now we all know the proprietary db file as "single point of failure" can really become a problem, too. Mail.app at least uses MBOX -- although I've read, it IMAP support isn't worth a dime.

Thunderbird is great -- for Linux and Windows; I use it on my accursed XP box in the university and I'm very fond of it (spam filter even a little bit better that Mail.app's, far better IMAP support (AFAIK!)). But IMHO it's integration with OS X leaves much to be desired -- and probably will continue to do so for quite a while. (But that, of course, is a matter of taste...! ;-) Also I never ever liked Netscape's/Mozilla's/Thunderbird's approach to the whole on-/offline business; this litte connection icon in the lower right corner IMHO doesn't even come close to Mail.app's or Entourage's handling of the problem! (Then again a lot of people do not have my "dial-up problem" these days...)

I have to try Eudora 6 yet, but Eudora failed to sweep of my feet the last few times I took a look at it; I can't say much either for or against it, though. I've read good things about PowerMail (shareware) but never tried it myself. GNU Mail gave me too much the impression of a constructions site last time I looked. GyazMail looks promising but despite the fact that usefulmac.com *still* lists it a freeware, it too is a shareware program. And Mailsmith (like everything from BareBones!) is way too expensive IMHO.


Posted by: Chris at September 8, 2003 07:05 PM

we feel for you dude....


Posted by: Jim at September 9, 2003 05:39 AM

Mail.app is slow, and even if Panther fixes that up it's search capabilities are a joke.

I love Mailsmith, but it's not for everyone. If you can embrace the idea that "No, it can't do that by default, but with this little apple script ..." you'll probably love it too :)

Mailsmith actually *coverts* HTML email to plain text for you (the they haven't included a plain text version in the mailing), and you always have a small browser button available to view the original file in Camino, Safari, et. all.

Where mailsmith shines is it's apple script support, text editing/manipulation and a powerful search feature.

One thing to keep in mind though, Mailsmith's mailbox format is *not* mbox. It's proprietary, although it is some kind of ASCII with binary metadata, so if push came to crash you would be able to recover all your information. (it also has the ability to export as mbox, so you're not forced to stick with it if you find something better.

If your biggest concern is mail box stability and transparency, go with Eudora. I've been using it on the PC for 8 years now with nary a problem. I'd probably be using it on the mac, but I could never get used to the different keyboard shortcuts, and the text editing features kind of blew.


Posted by: alan at September 9, 2003 08:51 AM

The IMAP Gods have frowned on you! I personally use IMAP with SquirrelMail/Mail.app. I, of course, have SpamAssassin and ClamAV built into my mail server's queue along with Qmail-Scanner (which blocks certain attachments, etc.).

Mail.app works fine for everything I need it for and when I'm on the road without a laptop (it happens) I access my mail through SquirrelMail.

Every month or two I back up all of my email with a python utility called archivemail, pipe it through hypermail, spider it with htdig and throw it into a password protected/firewalled server for my browsing enjoyment. As far as I know I have at least three copies (HTML, mbox and gzip) of all of my email going back to about 1999 or so.

--Joe


Posted by: joestump at September 9, 2003 11:52 AM

Are you sure the G4 drive is bad? How can it be if you can still get some files off of it and still use Darwin? How did you determine there were bad blocks? Has your brother looked at it yet? If so, what was his diagnosis? Are you sure it's not simple directory corruption?


Posted by: Grant Barrett at September 9, 2003 12:45 PM

I used Mail.app for a long time, but I got really, really tired of having notes from my Visor being forced to sync to Palm Desktop, while everything else synced to Address Book and iCal. Plus, Address Book with only the one address field. So, I'm back to Entourage.

(Glad to hear you got all your mail back! (: )


Posted by: .sara at September 10, 2003 05:59 PM

I used Entourage until I hit the mythical 2GB limit and lost it all. I used splitter and some other tool to recover most of it, but I spent a good two weeks on the project.

I now use Mail.app, address book, and iCal. My only complaint is speed. So I am also looking forward to the Panther releases.

I have not used mailsmith, so I cannot comment on that particular app, but I will say that I've been thrilled with BBEdit (also by BareBones)...

And my good friend sara forgets that you can add more than one address field in Address book. GOts to use that [+] icon ;)


Posted by: john athayde at September 10, 2003 06:06 PM

Wow - I'm going through something similar with my G4 Cube at work, except Mail.app is all hosed for me. Whenever I run it it shuts back down. I haven't yet figured out how it has gotten itself in such a bad state.

Now this comments thread has me worried about Entourage. Perhaps I should retreat back to Eudora. Too bad - I loved Mail.app's spam filter! (I use POPFile on my PC).


Posted by: JP at September 17, 2003 02:41 AM

Here's a tip for Entourage users. If you drag an Entourage folder (BTW, the Inbox is a folder) to the desktop. It will be converted to an mbox file. Very handy for non-proprietary format email backups.


Posted by: ira cary blanco at September 18, 2003 10:47 PM