Articles / Hardware outage at freshmeat
Hardware outage at freshmeat
As you may or may not have noticed, freshmeat has suffered from some major downtime from 11am EST to 5pm EST. Both database servers crashed hard and refused to boot with various kernel revisions and mylex driver modules. OSDN's netop staff worked hard to get a replacement machine up and running which neither cooperated nicely at first. The site is up in semi-stable state right now and searches are still disabled while we're working on getting the search database server back up and running. Please bear with us and sorry for the inconvenience.
Reason?
Hi,
it would bei nice to hear something about the
reasons for the crash, as soon as they're detected...
regards, chris
Re: Reason?
Yes, let us know what happened, il will be very interesting!
Thank you for the good work!!!
Re: Reason?
hope u get everything back to normal real soon, i also had a major crash on 2 of our servers last weekend...
cheers,
-joerg
> Hi,
>
> it would bei nice to hear something
> about the
> reasons for the crash, as soon as
> they're detected...
>
> regards, chris
>
It's okay...
With as many times as your site has helped me out. I don't mind it being down a couple hours so that you guys can do hardware/software upgrades or replacements. Not at all... Keep up the *great* work guys!!
Whew
I was scared! I visit your site about 10 times a day, if not more. Glad your back!
Freshmeat
Hey, check it out, a generic thread where we can express out appreciation of all freshmeat has done for us software junkies.
THANKS GUYS. YOU KICK ASS.
:)
God bless you
i also visit it more than 5 times a day for various reasons
god be with you guys and keep the great work
Thanks for this wonderfull tool !
I would like to join the concert of thanks. With a disponibility of 24/24 hours on 365/365 days, how could we blame you ? :)
Thanks again, yann.
Thanks
all the quick help/solutions your software database has brought me could never be repaid. although I was nervous at first, i assumed if the site isn't up, it must be a serious problem and will be taken care of as quickly as possible.
THANKS for all the good work (and keeping the users informed about what happened)
I was worried....
Good work getting it back up... I wasn't sure if it was at our end, your end, or somewhere in-between. Next time something happens, how about posting a notice over at at OSDN main page? Otherwise, people sit around like worried parents waiting for the overdue teenager to come home :-)
Great Work :)
This is why OSDN rocks! As soon as a problem is encountered, a notice is sent to members and other affiliated sites. Great job, guys! :)
Re: I was worried....
> Good work getting it back up... I wasn't
> sure if it was at our end, your end, or
> somewhere in-between. Next time
> something happens, how about posting a
> notice over at at OSDN main page?
> Otherwise, people sit around like
> worried parents waiting for the overdue
> teenager to come home :-)
Humm... I'll bring that up at the next meeting we have. Just need a easy way to do it. Like a small side box on the site that people could see if there are any outages or planned maintance happening....
Re: Reason?
> Hi,
>
> it would bei nice to hear something
> about the
> reasons for the crash, as soon as
> they're detected...
>
> regards, chris
>
Well to put it simply have you ever planned an upgrade to a new kernel then find out it won't work? Hardware that is supported just won't work. One of thoses lovely little things you can't really plan for.
You might ask why the kernel upgrade? The answer would be the machine was not being very stable under the other kernel. The DB was just not getting along with the setup and if given time would lock up the machine.
Thats the basic facts without going into great detail of the hair pulling and long irc chats. For the moment there are still unsolved issues but we are working on real solutions to keep everything working.
Belive it or not Freshmeat has some of the best uptime records of OSDN machines.
Oh by the way Scoop rocks!
Notice
Hi,
Next time you could place a dumb web server with a simple note: "We've got troubles, try again in X hours."
Peter
Re: I was worried....
> Humm... I'll bring that up at the next
> meeting we have. Just need a easy way to
> do it. Like a small side box on the site
> that people could see if there are any
> outages or planned maintance
> happening....
Just pull a box from somebody's desk. If all you're doing is serving a single static page, it's not gonna need massive disk I/O or anything -- just apache (/tux) and an ethernet card that won't melt down under the pressure.
Lol...
How about calling the national disaster dudes and have them broadcast a warning across the nation! nah, too much...
Perhaps put a notice opn all opf the OSDN websites? that way everyone who visits an OSDN website will know. Don't make it too large though, too big would be an eye sore.
OK, keep hunting
Patiently yours.....