Server Downtime and Data Loss

Archival storage for Announcements. Peruse old Announcements here!

Moderator: Community Team

Forum rules
Please read the Community Guidelines before posting.
Locked
User avatar
bigWham
Webmaster
Webmaster
Posts: 2914
Joined: Mon Aug 26, 2013 12:08 pm

Server Downtime and Data Loss

Post by bigWham »

In the late evening of Oct 3 (CC Time) one of our core system data tables suffered data loss and could not be recovered.

The only efficient solution was to roll back our entire database to the most recent backup, which happened to be approximately 24 hours before.

Unfortunately all data from the period between the backup and the event has been lost, including moves made, games started, chat, private messages and forum posts.

Everything is back and running now and 24 hours have been added to all game timers.

We apologize for the inconvenience and will be crediting Premium Members with a 2 days of extension to their Membership, and Freemiums with 4 free speed games in recognition.

Sincerely,
A weary Admin crew.
wi1bert
Posts: 76
Joined: Wed Oct 19, 2011 4:19 pm

Re: Server Downtime and Data Loss

Post by wi1bert »

Sounds like a horrible 24 hours for you guys. Well done and thank you.
User avatar
timrs2001
Posts: 38
Joined: Fri Sep 12, 2008 2:17 pm
Gender: Male

Re: Server Downtime and Data Loss

Post by timrs2001 »

Well that's a drag but it's certainly better than the alternative. Thanks for the quick work.
"If you choose not to decide, you still have made a choice." - Rush, Freewill
User avatar
EminenceGrise
Posts: 44
Joined: Wed Jun 23, 2010 10:25 pm
Gender: Male
Location: Canberra, Australia

Re: Server Downtime and Data Loss

Post by EminenceGrise »

Well done team, those of us in the backup and restore of data salute you.
User avatar
Dustin45
Posts: 6
Joined: Wed Nov 29, 2006 10:17 pm
Location: Hell
Contact:

Re: Server Downtime and Data Loss

Post by Dustin45 »

A simple sorry would be better then offering something that doesnt help with the problem that 24 hours of data loss created. I understand that things happen . So good job that it wasnt worse than 24 hours. CAuse im sure if it was more than 24 hours of lost data there would not be many people that would have faith and continue playing on a site than cant do a back up.
Last edited by Dustin45 on Sat Oct 05, 2013 9:28 am, edited 1 time in total.
User avatar
hyposquasher
Posts: 297
Joined: Thu Aug 16, 2007 1:19 pm
Gender: Male
Location: Pennsylvania, USA

Re: Server Downtime and Data Loss

Post by hyposquasher »

Thanks much for your efforts in the restore. The IT/Infrastructure side of things is exactly what I do for a living. These kind of high-tension outages suck. At least you had backups. Nicely done.
This image cannot be clicked.
Image

High Score: 4112 - 11-30-2014
New High Score: 4164 - 4/9/20
New High Score: 4315 - 4/5/21
curiousone1
Posts: 30
Joined: Wed Sep 07, 2011 11:15 am

Re: Server Downtime and Data Loss

Post by curiousone1 »

These things happen. Pleased all is back up and appr :D eciate the membership extension
[/BigImg]
User avatar
Artimis
Posts: 810
Joined: Sat Oct 11, 2008 9:09 am
Gender: Male
Location: Right behind ya!!! >:D

Re: Server Downtime and Data Loss

Post by Artimis »

That explains why all my games vanished. :D
==================================================
This post was sponsored by Far-Q Industries.

Far-Q Industries: Telling you where to go since 2008.
User avatar
L M S
SoC Training Adviser
Posts: 2103
Joined: Fri Dec 01, 2006 5:00 pm
Gender: Male
Location: Denver, Colorado USA

Re: Server Downtime and Data Loss

Post by L M S »

Dang. Sounds like a mess.
Glad I picked yesterday to work on the bot medal, about 50 times :(
“One of God's own prototypes.....never even considered for mass production.
Too weird to live, and too rare to die.”
sarphinius
Posts: 14
Joined: Sun Aug 07, 2011 8:39 pm

Re: Server Downtime and Data Loss

Post by sarphinius »

Nice works, folks. Get some sleep, you earned it!
betiko
Posts: 10941
Joined: Fri Feb 25, 2011 3:05 pm
Gender: Male
Location: location, location

Re: Server Downtime and Data Loss

Post by betiko »

had some turns that really went well and that went bad for the opponent.. I guess dice don't keep this kind of stuff into consideration? lol..
Image
User avatar
hyposquasher
Posts: 297
Joined: Thu Aug 16, 2007 1:19 pm
Gender: Male
Location: Pennsylvania, USA

Re: Server Downtime and Data Loss

Post by hyposquasher »

Are forums rolled back as well, or is that a different database?
This image cannot be clicked.
Image

High Score: 4112 - 11-30-2014
New High Score: 4164 - 4/9/20
New High Score: 4315 - 4/5/21
benga
Posts: 6925
Joined: Tue Nov 17, 2009 4:15 pm

Re: Server Downtime and Data Loss

Post by benga »

Can you slow down a bit in your updates and new things, there have been a lot of setbacks lately.
generalmighty
Posts: 30
Joined: Wed Jul 14, 2010 10:27 am

Re: Server Downtime and Data Loss

Post by generalmighty »

That is great news. I lost a 20 v 4 roll yesterday afternoon.
tarareinhart
Posts: 1
Joined: Wed Dec 26, 2007 10:25 pm

Re: Server Downtime and Data Loss

Post by tarareinhart »

Terrible
robchask
Posts: 12
Joined: Mon Aug 03, 2009 11:58 am

Re: Server Downtime and Data Loss

Post by robchask »

These things happen no problem :)
ausprime
Posts: 1
Joined: Tue Nov 02, 2010 9:20 am

Re: Server Downtime and Data Loss

Post by ausprime »

It's Ok. I'm fine with taking my turn again xD
User avatar
iAmCaffeine
Posts: 11699
Joined: Mon Apr 01, 2013 5:38 pm

Re: Server Downtime and Data Loss

Post by iAmCaffeine »

We've experienced this in work before and it's a real pain. Still, this is incredibly frustrating for our current clan war as moves that had already been played, whether as we wanted or not, now have to be re-made and have so far all gone terribly.

benga wrote:Can you slow down a bit in your updates and new things, there have been a lot of setbacks lately.

+1
Image
lutherxyz
Posts: 6
Joined: Wed Sep 08, 2010 7:54 am
Gender: Male
Location: st louis missouri

Re: Server Downtime and Data Loss

Post by lutherxyz »

just one the Best game ever played here!!! 12 player and went to capt.. now i wont win unless i get lucky and repeats.. dont think that will happen!! Go Cardinals!!!!!
User avatar
Evil Semp
Multi Hunter
Multi Hunter
Posts: 8456
Joined: Sun Jul 02, 2006 8:50 pm
Gender: Male

Re: Server Downtime and Data Loss

Post by Evil Semp »

betiko wrote:had some turns that really went well and that went bad for the opponent.. I guess dice don't keep this kind of stuff into consideration? lol..


I had some turns that went bad for me a good for the other guy.
Image
User avatar
Metalmarsh89
Posts: 21
Joined: Wed Sep 18, 2013 10:06 am

Re: Server Downtime and Data Loss

Post by Metalmarsh89 »

Ah, that's why my games are missing. Thanks for the message, and sorry to hear that. :(
User avatar
timrs2001
Posts: 38
Joined: Fri Sep 12, 2008 2:17 pm
Gender: Male

Re: Server Downtime and Data Loss

Post by timrs2001 »

Dustin45 wrote:well the four freemium games doesnt help when i have 7 games going already. Makes me happy I dont pay for this anymore

How do you have 7 games going when you don't pay to be on here? I can only get 4.
"If you choose not to decide, you still have made a choice." - Rush, Freewill
blakebowling
Posts: 5093
Joined: Wed Jan 23, 2008 12:09 pm
Gender: Male
Location: 127.0.0.1

Re: Server Downtime and Data Loss

Post by blakebowling »

benga wrote:Can you slow down a bit in your updates and new things, there have been a lot of setbacks lately.

Just to note: This wasn't caused by an update. Database corruption is something that happens occasionally. (To put it in perspective, the last time CC had data loss like this was in 2010).
User avatar
Armandolas
Posts: 1761
Joined: Fri Jun 06, 2008 6:32 am
Gender: Male
Location: Lisbon

Re: Server Downtime and Data Loss

Post by Armandolas »

Well, it happens.
1 day reverted is not so bad, and i can easily forget the annoyance of repeating some turns again(some in benefit, some not so much)
User avatar
fishydance
Clan Director
Clan Director
Posts: 979
Joined: Wed Aug 15, 2007 8:28 am
Gender: Female
Location: Mini-soda (basically southern Canada)

Re: Server Downtime and Data Loss

Post by fishydance »

For some reason this morning I have this weird sense of déjà vu, like maybe I repeated the past day or something..... :lol:
Locked

Return to “Announcement Archives”