Saturday 8 June 2013
Downtime Tonight
As many of you probably figured out, we had some server troubles this evening. The reason why it took so long for us to get back up was as follows:
The server guys get notified as soon as the server goes down, so they always know before anyone else. They did a quick check and two of the hard-drives seemed to have failed (computers eh? can't trust 'em.) They got them physically checked and the techies confirmed this. It turns out they both failed simultaneously so the RAID couldn't even protect it from failure.
The techies then replaced the two failed hard-drives with brand spanking new ones. And the server guys re-installed the OS and loaded the latest backup onto them.
I invest heavily into this sort of protection and with the backups in the rare event things like this happen. A lot of sites/games don't. It may have taken some time, but when it involves having to physically replace drives, it can take a while. There might be up to an hour of loss (as the backups are done pretty much hourly.)
Remember to keep an eye on our Facebook Page for updates when the site is down.
I have given everybody a free VIP and VIP+ day. Also a little promo code for everyone to use to make up for the loss and mess ups it would create in regards to the dailies and the slight time jump: junedowntime
Sorry again, and thanks for your patience.
Ash
Posted by
DarkAsh
at
02:19:00
Popular Posts
-
Double coven exp ended I see this was a great success! A lot of death occurred as everyone scrambled for those precious kill. I will do t...
-
Happy Decemeber people :) Firstly, the server upgrade is due to be installed this Saturday, which should speed the site up by quite a bit. P...
-
Had a talk with my new accountant and seems that I have to start charging sales tax for all vip/plasma packs. Which is a huge pain in the as...
-
Hey everyone, My apologies for appearing a bit AWOL lately, I've had some weird dizziness & bug and not been feeling great. On ...
-
Good afternoon vampires! I've spent my time today going through the suggestion forum and started implementing some features that you ...
-
The weapon system needs to change... but of course i want your feedback before i do anything drastic and annoy everyone, of course. http://r...
-
New In-Game Layout! Reign Of Blood started in 2006 with a layout theme which is now called 'RoB-Lite' (A fan fav...
-
Hey guys! Running a quick Facebook thing... basically I just posted a status on the Facebook fan page, and if it gets 100 likes I will i...
-
A big thanks to Dark August night for setiing up the merch store! It is now open for business! You can view the store by clicking here . A...
-
Well this is it guys, i'm off home for the xmas week. This week i've added a "question of the day", which can be set by a ...
10 comments:
Thanks for the VIP bonuses, and promo! 289510
Thanks Ash for doing what other games don't, and for getting things taken care of so quickly. Even a technologically handicapped person such as myself knows this was bad. :o Thanks also for the awesome reward! WooT!!!
We all owe Ash a giant THANK YOU for having the foresight and awesomeness to invest in backups. It's events like these that justify all the time spent protecting your technology (plus keep us buying into protection to keep not getting screwed over by failed tech). THANKS Ash, for being awesome.
Thank You Ash
First, thank you for the bonuses.
Second, thank you for the explanation as to what went south... I know you've made sincere efforts at upgrading.
Third, I think that it's possible that more than an hour or data was lost... I know I lost BL's and comments made more than an hour before the site went down completely... can't be helped - it is what it is - just sayin', I think the site may have lost a bit more data than you suspect.
Finally, and I'm sure you've already considered this concept, but I'll say it here just in case, have you considered using/paying for a mirror site in addition to the servers that you currently use? The mirror site would keep the same data as your servers, but would kick in the moment your server connections go down for any reason, without loss of data... I'm no network architect, but I know that companies that believe their websites to be mission critical use mirror sites (sometimes multiples) as a means to achieve minimum downtime for the least cost...
That explains why some news that I deleted yesterday has returned and the rant thread that I posted has disappeared! Thanks for the update on the situation Ash.
I was asleep. This affects me negatively in no way. Yay for free stuff.
Thanks for update and explanation and bonuses to improvise, very grateful.
We do use mirroring techniques :)
Mirroring drives is good. Mirroring sites (offsite mirroring to an alternate host, in case your entire facility burns to the ground in a worst case scenario) is better. You absolutely use the techniques now - and you do an excellent job with what you have to work with! But data loss and time loss equal potential income loss for you (not to mention all the endless whining!! ;) jk)...
All that said, kudos for all that you do. My suggestion was simply that... food for thought, hopefully something constructive...
Post a Comment
Comment this update.