2/26/08

Database Clean-Up (with some collateral damage)

Guys,

I'm sorry to report that any ratings / reviews / and lists posted yesterday are gone. We had to revert back to our backup db that was updated through Monday at 1AM.

Here's what happened:

A long time ago, we set up our system so that non registered users could rate and review things. These reviews would not post live on the site until the person registered, but we had to save user information about EVERYBODY - registered or not.

Well we quickly realized that people found this system confusing, so we scrapped it. However, we did not scrap the process that "remembered" anonymous users. So every day, we were accumulating thousands of these "anon" users in our database, that were just taking up space.

So as of yesterday, we were up to MILLIONS of lines in our database of worthless anon info. We kept putting it off, and putting it off, because a clean up of this magnitude is a big exercise.

RateItAll's CTO last night made the call that it was time to clean this stuff up. In the process of removing all of these anon listings, there was a problem with the db. We were forced to go back to Monday morning's backup (this is why we do backups every single day).

The good news is that all of those ANON listings are out. The bad news is that we lost a day's worth of data.

We're making a concerted effort to get our technology in order, to make the site faster and better. This was a very unfortunate side effect, of an initiative that in the long term will improve site experience.

5 comments:

  1. That's OK Lawrence. A little frustrating but when weighed against the problems in the world the loss of a few posts is not a major crisis.

    Donovan

    ReplyDelete
  2. Damn that had to be the lamest attempt at taking the high road yet.

    The fact one would even put comment loss on a website in the same sentence as "problems in the world" is mystifying in its stupidity.

    That comment is a GREAT example of how fake that "I am a good little christian and love everyone attitude" persona is.

    ReplyDelete
  3. I must admit, I'm curious if there might be an evaluation of my persona out there now...

    ReplyDelete
  4. And how do you define your "persona" pbeavr??? Kind? Honest? Caring? Christian? Hateful?

    Donovan

    ReplyDelete
  5. I still want to see him define my persona, Donovan. It's a case study of epic proportions, so I'm told...

    ReplyDelete

Apture