an explanation of current downtime

Update (Sat 12 Jun, 7am GMT): Things have been back for the last 6 hours or so, and feed processing has now largely caught up. We can only apologize for this lengthy downtime, and as we mention below, we are taking active steps to make such long outages a thing of the past. Thanks for your support and encouraging comments and tweets while we were working through the problems!

This is a brief update on the current downtime:

Over night, a number of disks on our primary database server failed. The hosting provider has since replaced the disks, but was unable to restore the latest data. Now, we do of course have a fully up-to-date backup/slave database, but as we are in the middle of moving to a new hosting provider, we can’t (yet) just switch to the backup database server without delay. We are working as fast as we can on getting the service back up, but due to the enormous size of the database and the complexities of the hosting setup this may still take a few more hours.

We’d like to say how sorry we are for the problems this causes you, and at the same time want to reassure you that the move to the new hosting facility/provider will  - once completed – make these lengthy outages a thing of the past, as we’ll have full redundancy there, so will be able to hot-swap database  and other servers in the event of similar hardware failures. It’s incredibly unfortunate and frustrating to us that this current disk issue happened while we still haven’t fully completed the migration to the new hosting facility.

Advertisement

43 Responses to an explanation of current downtime

  1. twitterfeed

    when can we have the services back ?

  2. Like mentioned above, any idea when things are back to normal?

  3. My condolences, I’ve had a similar thing happen to me in the middle of a migration as well. Best of luck, and hang tight!

  4. Thanks for all your efforts at restoring this excellent – and free – service.

  5. Why not bring up current server – and migrate at your leisure AFTER your service is restored – the length of this downtime is causing us and many to rethink our twitterfeed usage – is this now 2 days? if you have slave/backup – bring that online – this seems like BP oil spill – more PR than facts..

  6. Thanks for the updates and for the service – as everyone has said, my condolences on the problem.

  7. My feeds do not publish to ping.fm anymore. It gives me ping.fm api error. I changed my api key but the same. It seems that publishing via api does not work anymore with ping.fm, although they allow email publishing. Would you switch to email publishing with ping.fm? Otherwise this option is worthless.

    Regards,
    Gianmarco Leone

  8. Oooooh, unlucky there with several disks going at once, especially during a migration. Hope it gets sorted without too much stress.

  9. Here is my thoughts… How about charging for your service. This will allow you to buy the best equipment and hire the right people to make it work correctly. You have a huge base of users. I am willing to pay and have asked for months to pay for support.

    I would also suggest leasing the servers verses hosting them somewhere else. By leasing you will get a nice tax break and actually have the servers in your location or in the best colo and not have to wait on some hosting company which is cutting every corner possible to make money. Just a thought…

    If you guys are hiring let me know:) info@stupidDOPE.com

  10. Thank you for the notice. Hey, things happen…I look forward to the service being restorted. And to all of you crying about the loss of this FREE service…chillax.

  11. Pingback: Major Hardware Outage at TwitterFeed « WindowsObserver.com

  12. It happens. Thanks for the update, and best of luck!

  13. TwitterFeed is an awesome service and more than worth the price and the wait! As someone who hosts sites, I understand you feel the pressure. Don’t worry…there’s nothing we can do but wait and know that you are doing your best, so we aren’t looking at you with virtual daggers in our eyes!

    Thanks for the service and the notice. No need for more notices as far as I’m concerned. When it’s fixed, it’s fixed.

    Cheers!

  14. good work boys! we’re waiting for you! ;-)

  15. Good work boys!!! We’re waiting good news from you ;-)

  16. Thanks for working so hard. Sounds like things will be even beter when the crisis is over. o it is “good news/bad news.”

  17. Hey, you guys have been so reliable over such along time that the current down-ness is disquieting! This is not a complaint, but a compliment.

    Hope your fix is coming along well.

  18. Great service, especially when it’s free. Don’t listen to the jerks on here. Thanks for working so hard to get it up and running.

  19. You are appreciated! Life happens. :)

  20. Sorry to hear of the problems – know how it feels! Thanks for all your hard work in getting things restored.

  21. Clearly, I’ve tuned in late. Am I to understand that you will resuming feeding all the blogs using your services soon? If you have already, how long before my dashboard catches up with reality? Will any post I make in the future be fed in a timely manner? You seem to have generated more questions….

  22. I posted a blog about 2 hours ago and still no feed / link has been posted to Twitter or Facebook.

  23. thanks for your great service, and this explanation.

  24. My feed still will not update since the outage. What can I do to fix???

  25. My feeds are not updating as often as they should. Any updates?

  26. get this: i have two twitter accounts, both with digg.com feeds thru twitterfeed, but only one works!

  27. Our twitterfeed.com service is no longer working. Our RSS feed has not been updated on your site since June 7th and is still not working.

  28. A great alternative to Twitterfeed is dlvr.it.

  29. My twitter feed from Ezines has stopped working weeks ago and yet everything appears active when I check twitter feed.

    Please advise and fix…thanks

  30. Well no problem, twitterfeed is a free service so we don’t have to complain too much ;)

  31. Wow, glad to see things are working again. Now if only Twitter could fix itself too.

  32. Great Service so far, keep up this job!

  33. I can realize with all the feeds you have to manage that you’re going to have downtime…it’s just a fact of life…but thanks for always working hard to make the service better! :)

  34. Team , I can wait for you :-) I appreciate your hard work……. we known the moon wave …..let see

    Thanks
    -SP

  35. Thanks for your great service, and this explanation.

  36. A few months ago my account use to post old posts every 30 minutes to twitter when I was not updating with new ones. This small feature was very useful for our site. Can we pay to have this back. Please email me and let me know. Our account email is stupidDOPE1@gmail.com and the feed is stupidDOPE. Thank you!

  37. Thanks for working so hard. Sounds like things will be even beter when the crisis is over. o it is “good news/bad news.”

  38. blogwalking ..!

    interesting articles, I waited behind her visit.,
    and hope you want to exchange links with me, thanks

  39. it’s very helpful that website.
    i use in 2 links and working fine.

  40. Can you guys design a app to facebook?