Guys, we are doing some scheduled maintenance late this evening that will required a DB reboot, bringing the site down for a 15-30 minutes.
Automatt, will you comment with the exact time?
Showing posts with label downtime. Show all posts
Showing posts with label downtime. Show all posts
6/11/08
3/24/08
Site Maintenance is Beginning Now...
by
lawrence
at
Monday, March 24, 2008
.... we are estimating 30 minutes.
Scheduled Maintenance Tonight: 1:30AM EST
by
lawrence
at
Monday, March 24, 2008
Guys, we're dropping some more memory into our new database server late tonight. This shouldn't take more than 30 minutes. Really.
3/21/08
Back Up!
by
lawrence
at
Friday, March 21, 2008
OK, we're back up.
At about 7:30AM this morning we tried to replace a damaged drive on the database and the system would not detect the new drive. When we went back to the damaged drive, it wouldn't detect that one either.
So we had to replace the whole database server. What was supposed to be a 15 minute exercise turned into an all day affair as we scrambled for and configured new hardware. Data was restored up until about 27 hours from the time the site went down - anything that was posted after around 2AM EST yesterday has been lost.
We will also be running the db on 2GB of memory for the weekend (it was 4GB), but will be ramping up to 8GB on Monday or Tuesday. The site might be a little sluggish until then.
We're taking steps to ensure that this doesn't happen again, including refining our db backup process.
At about 7:30AM this morning we tried to replace a damaged drive on the database and the system would not detect the new drive. When we went back to the damaged drive, it wouldn't detect that one either.
So we had to replace the whole database server. What was supposed to be a 15 minute exercise turned into an all day affair as we scrambled for and configured new hardware. Data was restored up until about 27 hours from the time the site went down - anything that was posted after around 2AM EST yesterday has been lost.
We will also be running the db on 2GB of memory for the weekend (it was 4GB), but will be ramping up to 8GB on Monday or Tuesday. The site might be a little sluggish until then.
We're taking steps to ensure that this doesn't happen again, including refining our db backup process.
Update
by
lawrence
at
Friday, March 21, 2008
What was supposed to be fifteen minutes of downtime has turned into a larger exercise. We're still working on swapping out the failed drive on our database. It might be a while.
10/31/07
Back up to 4 DB Processors
by
lawrence
at
Wednesday, October 31, 2007
OK, our fan fix went smoothly. We're back up and running, and things should be humming again.
Downtime at 11AM PST
by
lawrence
at
Wednesday, October 31, 2007
We're dropping in the new DB fans at 11AM California time. We should be back up no later than 11:30.
2/16/07
Cutting Over to the New Server Soon
by
lawrence
at
Friday, February 16, 2007
We may have up to 30 minutes of downtime starting very soon.
2/15/07
Scheduled Downtime - New Server Going In
by
lawrence
at
Thursday, February 15, 2007
Guys, it looks like there's going to be some scheduled downtime today when we put the new quad core online. I'll let you know when I have a definitive time.
Subscribe to:
Posts (Atom)
