Server Recovery

   (102)
      
日本語/Japanese
Tue 2007/09/11 13:00
The last time I felt like this was when I collapsed when working at Amazon - was in the hospital for a few days living off a drip.

Even though this was one of the worst ordeals I have been through, I live by my belief that ordeals dished up by fate are actually gifts. Getting through an ordeal leaves us wiser and stronger which makes it easier to deal with future obstacles - I'll be better prepared next time ^^;

Apart from learning a ton of unix and other tech stuff through this ordeal, I guess I temporarily hit my mid 2008 goal of getting into the worlds top 5000 websites. This is a snapshot of my alexa rank which shows what the traffic was like when I got dugg. It will drop back down to the 15,000 level though.

So whats been lost?
  • All comment data and puchi blurbs since last wednesday.
  • About 30 otaku news items + comments.
  • Thumbnails for the RSS Fusion aggregator.
  • Some thumbnails for videos which have been removed from YouTube.
  • Data for anybody who registered after last Wednesday - I know its a bother to register again and I'm truly sorry. Will try to tempt you with the next batch of pictures which need the Mirai Mark removed ^^;
  • Some avatars - if you login and see your avatar broken, just go to edit your profile again to restore it.


  • I only had a snapshot of the MYSQL database from last Wednesday but managed to salvage the other posts from Googles cache! The only post I totally lost was the "eroge to anime" post - will post that again.

    If you spot anything thats broke on the site, do let me know and I will get on to it. There are a few bugs with the Ranking Charts, RSS Fusion and maybe the piecharts too but will work on em as soon as I can.

    Apologies to Featured Feed members - the site being down means that your site may have broke due to the missing feed.

    As you know, I moved this site to a new server very recently and postponed setting up a RAID (a disk mirroring thingy) until after all the otaku events which recently finished - looks like I was too late ^^;

    I would like to thank you all for your patience and also thanks for visiting and leaving comments on the server status blog - your comments really helped pick me up during the past 48 hours (sheds tear.)

    Want to say a big thanks to the guys at Webtenet who helped me fix that darn darn ImageMagick problem that was preventing the site from going live. If you need to outsource some dev work then they are the ones you need.
    Join Danny Choo
    You may have noticed a new feature that I rolled out yesterday tentatively called "Ne...(more)
    Wed 09/05 01:22 comments (27)
    "There are ideas that change the way many people think, spend, and live. Some people ri...(more)
    Wed 08/29 05:12 comments (30)
    Just wanted to run through a few new features recently added to the site and talk about ...(more)
    Mon 08/27 00:08 comments (32)
    This has to be the worlds most expensive blog template - make your blog look like a Japa...(more)
    Mon 07/30 23:27 comments (23)
    Polls
    Phenie in Aichi (Registered on 2007/01/08 16:14)
    Catgirl Trainer.
    Well, I'm glad you're back, I need my daily dose of dannychoo. =D
    (ID #56516) Posted on 2007/09/11 13:07
    Tiny Red Man in Shingapooru.. (Registered on 2007/04/11 17:39)
    Great to see you back. we miss you..
    
    and ya, going through ordeals makes you stronger and wiser. But a few ordeals are enough....
    
    and a big GOOD JOB to you...rest well..
    (ID #56517) Posted on 2007/09/11 13:12
    Uradox in Nagoya / Perth (Registered on 2007/05/12 16:15)
    Procurement officer / Teacher
    Good to have the site back :) though it seems a bit slow to me at the moment. Everyones hammering it maybe to get their dose of danny that has been dearly missed the past few days
    (ID #56518) Posted on 2007/09/11 13:16
    xenohawk in Tokyo, Japan (Registered on 2007/07/16 14:47)
    Programmer, Web Developer / Web Designer
    Welcome back! That was fast ^^
    I understand collapsing in japanese workplace. They push it so far to finish their work, which have me following as well.
    
    So on weekends I usually hibernate to recover LOL.
    
    (ID #56519) Posted on 2007/09/11 13:20
    pp in Singapore (Registered on 2007/07/10 21:10)
    宅男军人/otaku soldier
    xD welcome back and glad that ordeal was over. 
    (ID #56520) Posted on 2007/09/11 13:28
    foxgear in Otaku Star, Malaysia (Registered on 2006/12/30 10:38)
    Otakurian Shen
    Hooray ! Finally the Site is back Alive !!!
    (ID #56521) Posted on 2007/09/11 13:32
    Dalai in Córdoba, Spain (Registered on 2007/05/12 00:55)
    Chemistry Student
    o(^.^)o Dannychoo is online again!!
    (ID #56522) Posted on 2007/09/11 13:32
    Otaku Surf in Maryland (Registered on 2007/06/04 09:20)
    Producer
    Great to see you up and running again!
    (ID #56523) Posted on 2007/09/11 13:34
    Gundamjehutykai in Foundation II: Stellvia
    Damn, that had to hurt!!!
    
    Luckily, I never have to worry about server outages! Otherwise, I'd probably collapse faster than a house of cards!
    (ID #56524) Posted on 2007/09/11 13:42
    Mars in Chicago, America (Registered on 2007/08/24 04:36)
    College Kid
    Welcome back Danny, I'm glad you hit ground running
    (ID #56525) Posted on 2007/09/11 13:44
    Demacrez in Evansville, Indiana, US (Registered on 2006/12/25 14:19)
    Link Cosplayer, Video Gamer, Amatuer Programmer, and Artist
    Woohoo!  Yatta!!!
    
    The site is back online and I can have my fix again! XD
    
    Great job Danny!  I was surprised to see the site back up and running again today, I was sure I'd see it running again tonight but you proved me wrong.
    
    Anyway, you better get some well earned and deeply deserved rest.  After all that hassle, you surely need a 12 hour power nap. XD
    (ID #56526) Posted on 2007/09/11 13:45
    notfair in Malaysia (Registered on 2007/08/14 17:22)
    Student, ACG Fans
    oh yeah, its back online ! ^^, that was fast ~ Hope you will be ok since the server so fast recover, mean you take alot of time doing/repair it ^^.
    (ID #56527) Posted on 2007/09/11 13:51
    chraen in Singapore (Registered on 2007/08/23 22:24)
    Student
    Welcome back ^^
    
    You can finally go to sleep now XD
    (ID #56528) Posted on 2007/09/11 14:10
    Alafista OTAKU in Singapore (Registered on 2006/12/25 12:22)
    Policy & Research Officer
    Glad to see that you are back in action. Well as they say "what doesn't kill you makes you stronger" =P
    (ID #56530) Posted on 2007/09/11 14:16
    10116222 in QC, Manila, Philippines (Registered on 2007/01/28 22:25)
    Not sure anymore
    Super glad to see us up and running again :D I've checked more than 3 times today since I do need the daily dose.
    
    Congratulations in overcoming this ordeal, and thank you very much; I missed the site too!
    (ID #56532) Posted on 2007/09/11 14:30
    Hayden in London, UK (Registered on 2007/01/06 06:41)
    Custom Pc Builder, Muppet, Pyromaniac, Demolitions Expert
    Not so much a server crash but one of my main hard drives went down & I pretty much lost everything - all my pics, 20-30gb worth of music, & my game data (yes haveing to install 10 odd games & configure them all over again takes a long time)
    
    I manage to salvage some of my data but not all of it. the hard drive kept getting Delyed Write errors then XP would B.S.O.D time n time again when i tried to salave from a 'bad sector' i suppose. I was a little pissed of as this pc was a new custom build & the Hard drive was less then 2 weeks old fresh from the shop without the anti static packing ripped off until i got home.
    
    after this hardware fault & a few XP corruptions I finally nabbed myself a huge External Hard Drive where I archive all my important files/folders - so yeah I feel your pain. I lost part of a website that Id spent designing since when i was in college as a little hobby. something i spent loads of sleepless nights during the summer holidays mulling over why my codes wouldnt work.
    
    Ive managed to recover or expand my music collection since the hard drive went down
    (ID #56533) Posted on 2007/09/11 14:30
    Hayden in London, UK (Registered on 2007/01/06 06:41)
    Custom Pc Builder, Muppet, Pyromaniac, Demolitions Expert
    Oh yeah, I forgot to say...WELCOME BACK!!! I will have some scotch in your honor.
    (ID #56534) Posted on 2007/09/11 14:31
    lu-k in Bayonne, France (Registered on 2007/01/07 22:43)
    Software Developer
    Glad to see dannychoo.com back :D
    Good job! That must have been exhausting ^^
    (ID #56535) Posted on 2007/09/11 14:33
    Henry in /usr/bin/ (Registered on 2006/12/25 20:05)
    anime/cosplay events organizer
    Okairi Nasai~
    
    Welcome Back Danny!
    
    now that the nightmare is over, you can now sleep soundly ^^
    (ID #56536) Posted on 2007/09/11 14:40
    Subaruhess in Portsmouth, UK (Registered on 2006/12/24 23:25)
    Nothing can stop dannychoo.com ^^
    (ID #56537) Posted on 2007/09/11 14:47
    Akiraman in RIDGE RACER City (Registered on 2007/01/12 00:40)
    Designer & Animator
    Hmm... I Think I better backup my data frequently for my website... 
    
    I know what its like to reinstall stuff, having just touch briefly on apache and unix at school it is no easy task. 
    
    Glad to see the site back and Mirai as aswell ^^
    
    Take a good rest
    (ID #56539) Posted on 2007/09/11 15:04
    CMWilly in Los Angeles, CA (Registered on 2007/04/19 11:47)
    Animation
    good to have you back!
    (ID #56540) Posted on 2007/09/11 15:12
    xjaymanx in Vegas, baby! (Registered on 2006/12/29 11:49)
    Technical Writer/Editor, Designer, Collector, Artist, Nice Guy
    Nice recovery! I'm glad the ordeal didn't occur during your visit to LA this week. Might've been an even BIGGER learning experience, lol. Continued good luck and better fortune!
    
    
    (ID #56541) Posted on 2007/09/11 15:14
    ふぇんりる in 日本の関東 (Registered on 2007/09/04 01:27)
    引きこもり
    お疲れ様でしたー復帰おめでとう御座います。
    
    余談ですけど、自分のHDDもいい加減バックアップを
    取らないと危険な感じなんですが、HDDだけ買って
    ほったらかしです。今週末にはバックアップを取らないと(=_=;
    
    
    (ID #56542) Posted on 2007/09/11 15:17
    IdolFan in Earth (Registered on 2007/01/09 13:26)
    Good to have you back!
    (ID #56543) Posted on 2007/09/11 15:19
    krapou in tervuren, belgium (Registered on 2006/12/27 00:46)
    daydreaming and planning to take over the world
    Hey, good to see you back...my surfing has a meaning again.
    Domo arigato gozaimasu.
    (ID #56544) Posted on 2007/09/11 15:25
    thefrikking in Spain (Registered on 2007/08/18 07:18)
    Imperial Guard
    Uff, I`m glad to see you again. Hope all the past troubles don`t repeat again.
    (ID #56545) Posted on 2007/09/11 15:31
    Ohjay in Sweden (Registered on 2007/08/29 23:13)
    Supervisor
    Good to see you back again.
    What doesn't kill you makes you stronger ;)
    (ID #56546) Posted on 2007/09/11 15:40
    Nerthoul in Russia (Registered on 2007/02/23 08:13)
    I am glad that you have coped with the problem :)
    
    (ID #56547) Posted on 2007/09/11 15:47
    BeLe in Davao, Philippines (Registered on 2007/01/03 17:24)
    .NET/Web Developer
    Great to see the site back up again.  I know how it feels when your HDD gives up on you.  Such a pain in the neck.  
    
    Might as well take your well-deserved rest after getting through such an ordeal. :D
    (ID #56548) Posted on 2007/09/11 15:47
    kca in Hanoi (Registered on 2007/02/10 16:01)
    Bouty hunter
    I just made a back up of my site ^^ the first one, i ever made ;)
    Nevertheless don t forget the post for tomorrow morning (^_^)
    (ID #56549) Posted on 2007/09/11 15:50
    D_Blade in Montreal (Registered on 2006/12/31 23:36)
    Non-profit org. volunteering work addict
    Welcome back Danny. It's great having you around again.
    
    I just hope things like that will never happen again.
    (ID #56550) Posted on 2007/09/11 15:53
    Phamolous in Germany (Registered on 2007/05/26 07:32)
    Good to have you back. 
    
    I once suffered a data loss through a HDD crash and lost date worth 80gb, including precious memories =/ I feel you.
    (ID #56551) Posted on 2007/09/11 15:53
    shinsengumi in New York (Registered on 2007/01/07 06:13)
    Grad Student
    おかえりなさい ^^
    (ID #56552) Posted on 2007/09/11 15:55
    Hachiko in Toronto, Ontario, Canada (Registered on 2006/12/26 12:01)
    Student
    Nice to see it back, I gotta back up my site too now I think about it xD! Anyways, can't wait for more news to come ^^
    (ID #56553) Posted on 2007/09/11 16:05
    DRAGUN in Arizona, USA (Registered on 2007/08/23 05:32)
    Design Consultant
    Yay Danny! Great to see your site up and running. Now go lay down and sleep for three days.. or look at your new figures, whichever helps relax you more.
    (ID #56554) Posted on 2007/09/11 16:22
    Tsubaki in Singapore (Registered on 2007/01/07 06:09)
    Film Student
    Ah welcome back Danny. I'm glad the damage wasn't that bad. 
    (ID #56555) Posted on 2007/09/11 16:27
    DuckFOO in USA (Registered on 2007/09/11 02:47)
    Ero-Manga Fiend
    I don't have a blog but I sometimes think that if I did, I would refuse incoming connections when Digg or Slashdot is the referrer.
    (ID #56559) Posted on 2007/09/11 16:49
    Pippo in Italy (Registered on 2007/07/03 19:54)
    Universitary Student
    without this site i don't know how most of my time on internet, welcome back danny!!! Bentornato!!! ^^
    (ID #56560) Posted on 2007/09/11 16:56
    Ryuuichi in Sydney, Australia (Registered on 2008/06/21 18:22)
    Student
    Good to see you again Danny! Got it back up I see ^^d How I miss going to this site~
    (ID #56561) Posted on 2007/09/11 17:01
    nirodha35 in Netherlands (Registered on 2007/05/13 20:46)
    Welcome back Danny!!! 
    (ID #56562) Posted on 2007/09/11 17:07
    J.L in カナダ (Registered on 2007/04/19 01:18)
    大学生
    finally Danny is back. it was like in a typhoon - nothing to do, just waiting is pass - nothing to do on web, just waiting the site come back.
    
    otaku forever Yea!
    (ID #56563) Posted on 2007/09/11 17:13
    Doc in Kansas (Registered on 2007/01/05 14:20)
    Student
    strange.... i seem to remember seeing this site on digg a year or two back, why didnt it crash then?
    
    either way, im glad your finally back danny, life has been boring without your little site.
    
    heres to the hope that dannychoo.com will grow to have the digg-like level of visitors it deserves... and live to tell about it!
    (ID #56565) Posted on 2007/09/11 17:47
    AndyH in Birmingham, UK (Registered on 2006/12/25 10:56)
    3D artist
    Nice to see you getting up and running again. Was getting worried for a minute then. Poor danny - hid server destroyed by his own popularity!
    (ID #56566) Posted on 2007/09/11 17:47
    The_WOZ in Trelew (Chubut) Argentina (Registered on 2006/12/25 04:56)
    Woodcrafter/3D Modeler
    Welcome back Danny!
    Nice to see your site back online. ;)
    
    (ID #56567) Posted on 2007/09/11 17:51
    Timoshi Huang in Portland, Oregon
    Whew! T_____________t*!
    (ID #56569) Posted on 2007/09/11 18:04
    bazhang in singapore (Registered on 2007/11/02 03:56)
    Pilot for Singapore Aerophile
    hey dude, hope u are still well coming back from the hospital, don't overwork too much, ya? :)
    (ID #56571) Posted on 2007/09/11 18:40
    syrix in U.S. (Registered on 2007/03/21 10:18)
    student
    You deserve a good rest after that kind of ordeal, glad to hear that you gained something from the experience though that might help you in the future.  
    (ID #56574) Posted on 2007/09/11 19:13
    gusgus in cyberspace (Registered on 2007/09/11 05:16)
    web head
    good to see you back. That's funny, ( i had signed up in the past week ) even though it showed me as logged in, it said my account didn't exist.  Just made a new one. 
    (ID #56575) Posted on 2007/09/11 19:18
    Neurorelay in California, USA (Registered on 2007/08/29 13:09)
    Sophist
    I remember the first time I lost all my important data; ever since then I back up to two different locations almost too much. :)  Good luck with the raid setup which I imagine will be your next priority. ^^
    (ID #56576) Posted on 2007/09/11 19:32
    cedrico in Australia (Registered on 2007/03/18 07:57)
    Bus Operator, Part time Zaku Pilot
    Great to see you back up again, my machines do die too but not as bad as yours, but on Sunday night, my trusty almost 5 years old ibook's HD went to see its makers... leaving me stuck using my pc to do things :(
    (ID #56577) Posted on 2007/09/11 19:36
    Shin222 in Germany (Registered on 2006/12/31 21:50)
    Student
    Welcome back! ^^
    (ID #56578) Posted on 2007/09/11 19:53
    D_Blade in Montreal (Registered on 2006/12/31 23:36)
    Non-profit org. volunteering work addict
    cedrico, don't you feel that technological items today are not that reliable compared with what we had in the past?
    Whether it is HDDs, CPUs, DVD players, game consoles, etc., I don't trust companies anymore (especially Sony). 
    Or is it because of hackers?
    
    Save/backup often, don't take things for granted, avoid dangerous sites/programs and have the adequate protection...
    Such a necessary but annoying chore! 
    (ID #56579) Posted on 2007/09/11 20:02
    kousaka in US (Registered on 2007/09/02 01:39)
    student
    Ah, its good to see the site up and running again.  Server crashes are a bother aren't they?
    (ID #56580) Posted on 2007/09/11 20:59
    kousaka in US (Registered on 2007/09/02 01:39)
    student
    Oh! Welcome back, Danny!  I hope that never happens again.
    (ID #56581) Posted on 2007/09/11 21:03
    NGEunit01 in Cali (Registered on 2007/05/14 10:25)
    College Student
    YAY! Danny's back and running again!
    (ID #56582) Posted on 2007/09/11 21:06
    XSportSeeker in Brazil (Registered on 2007/08/22 06:18)
    Dropping computers, starting all over again at Journalism
    I was wondering why there were no dannychoo entries on my RSS reader this weekend... now I get it!
    Welcome back! I understand what you've been through.
    
    I had a discussion forum not long ago, had to learn lots of php and mysql stuff before going online, and when I finally did, I had to do updates which forced me to mess with the code almost twice a month.
    
    After a while, hackers discovered a security issue, invaded my forum, and erased the whole database. I had like... 300+ posts written by me, plus tons others written by friends.
    
    Backup was from some months ago. And I had had problems before that. I finally gave up on that and am now trying to start my own personal blog, with a reliable system and a new host. Hope it works this time...
    (ID #56583) Posted on 2007/09/11 21:07
    silent1134 in California (Registered on 2007/08/22 15:21)
    Student
    Glad you're back up and running Danny...Thank goodness...
    (ID #56586) Posted on 2007/09/11 21:30
    cloudduel_13 in San Antonio, Texas (Registered on 2007/10/11 10:39)
    Worker
    just glad the site is up and running again
    (ID #56588) Posted on 2007/09/11 21:42
    jonhohx in adelaide (Registered on 2007/05/14 20:19)
    filmaker
    welcome bck
    (ID #56589) Posted on 2007/09/11 21:51
    soonkiong in Malaysia (Registered on 2007/08/22 13:38)
    1st year Civil Engineering Student
    Okaerinasai!!! X3
    (ID #56590) Posted on 2007/09/11 22:07
    FEARtactics in Canada (Registered on 2007/06/18 13:05)
    Student
    Good to see you back Danny, I guess you should get a long rest.
    (ID #56591) Posted on 2007/09/11 22:36
    Kira in USA Atlanta, Georgia (Registered on 2007/02/10 16:01)
    College Student
    For a min I thought Dannychoo was no more glad to see that this site is back up man!!!!
    (ID #56592) Posted on 2007/09/11 22:37
    skankywonders in California (Registered on 2007/08/09 06:24)
    Student
    Thank the lord you're back ;__;
    (ID #56593) Posted on 2007/09/11 22:43
    kintaro in Pineville North Carolina (Registered on 2007/04/24 21:07)
    Student
    Now all you need is a cup of mocha and relaxation :D Thanks for working hard to bring the site back.
    (ID #56595) Posted on 2007/09/11 22:56
    dans in Tokyo, Japan (Registered on 2007/08/05 22:52)
    ERP Consultant
    yay ! welcome back, danny ! :D
    (ID #56596) Posted on 2007/09/11 23:20
    Barsona in California USA (Registered on 2007/08/03 09:24)
    NEET (no, student...)
    your site is back!
    hope you are taking a break while you are doing this
    (ID #56597) Posted on 2007/09/11 23:22
    Sotb in Malaysia (Registered on 2007/08/22 13:17)
    Manufacturing
    Really miss your site! Feels like lacking something when i surf web without your site!
    (ID #56598) Posted on 2007/09/11 23:26
    iMM in Kaohsiung, Taiwan (Registered on 2007/07/08 15:20)
    Publisher
    Hi Danny, Good to see your site back up. Hope you can take a break now to recover. I had a hard drive crash last week and lost most of my information, had backed up my work but not things like game saves...that was a painful lesson.
    
    (ID #56599) Posted on 2007/09/11 23:46
    Timerswing in Mexico (Registered on 2007/08/25 11:25)
    Student
    Danny congrats for getting the site back on, speaking of wich my last drive crash was about 2 months ago.....Its frustrating to just see al your hard work getting awa T_T.....hope the server will work even better than the last one
    (ID #56600) Posted on 2007/09/11 23:57
    Gundam_ZZ in Toronto, Ontario (Registered on 2007/08/23 08:07)
    good to see everything back up and running ^^ 
    (ID #56601) Posted on 2007/09/12 00:05
    toxicmind in SF, USA (Registered on 2007/02/06 22:41)
    cg artist
    Oh my goodness.  I can't imagine what kinda hell you went through, but I m glad u came back to this world!
    (ID #56602) Posted on 2007/09/12 00:57
    Edward in SE Michigan/Osaka (Registered on 2006/12/24 12:50)
    Troubleshooter, Universal Exports
    Danny it's great to see your site back!  It will take more than Digg to keep Dannychoo.com down!
    
    Please take care Danny, we don't want you in the hospital.  I know you personally get a lot in return from this site, but we really appreciate your hard work for our enjoyment as well.
    
    Domo Arigatoo, Danny!
    
    I'm back to my Web Development and Nihongo homework...
    
    (ID #56603) Posted on 2007/09/12 01:05
    Leo in San Francisco (Registered on 2006/12/24 17:30)
    Email & Network Support/Administration
    Glad to see you're back up and alive.
    (ID #56604) Posted on 2007/09/12 01:14
    animes in cephiro (Registered on 2007/01/23 15:18)
    mahou kishi
    The videos page is not working fine, or maybe is just me?
    (ID #56605) Posted on 2007/09/12 01:17
    Aya Kyunik in Melbourne, Australia (Registered on 2007/05/22 17:26)
    Hobby Store clerk guy thing...
    Yay, it's back up!
    Grats on the hard work :3
    (ID #56607) Posted on 2007/09/12 01:54
    myu in Finland (Registered on 2007/07/03 21:40)
    Student
    Welcome back, Danny! ^^
    (ID #56610) Posted on 2007/09/12 02:02
    Uradox in Nagoya / Perth (Registered on 2007/05/12 16:15)
    Procurement officer / Teacher
    [f]