But that doesn't make me feel any less horrible when I discover something that I love is gone and I can never get it back.

I've definitely had that experience too. These days, I compulsively save things to my hard drive, but there's always a gem or two that falls through the cracks.