Archive for December, 2006

httpd Offline Due to Flood

Thursday, December 21st, 2006

Howdy, all; I’ve taken HTTP offline temporarily while I determine who is hammering the holy heck out of the server. If I bring HTTP back online, 200 processes spawn off in under ten seconds. [Normal load at any one time is 30-50 processes.]

1821 CST: Well, the NOC is involved with me on this one. Having issues running things down …

1910 CST: The NOC has put us under a guard at their network firewall to detect such incoming attacks and limit them before they touch the server. This has brought us to resolution. I’m going to take some time over the break to sift through the logs, domain-by-domain, and see if I can find what was being hammered.

1948 CSR: The user who owns the account responsible reported what he think that he might have done to cause the problem. In digging to his domlog, I quickly determined that he was correct. 20-30 requests a second … yep, that’ll slag this little box. :) I won’t out him, but he’s welcome to come and apologize if he wants.

MySQL Offline Due to /var/ Being Full

Thursday, December 14th, 2006

Hey all … got a problem with MySQL and I’m working to solve it.

1703 CST: Fixed it!

Localized Network Instability

Monday, December 11th, 2006

Hey all: I’m getting horrible network throughput to the server [ping times alone of 670ms], so I figured that I’m not the only one. Best as I can tell, the disconnect is between alter.net and theplanet.com. I’m filing a support ticket, but chances are that it’s not something that the NOC can fix right away.

Update, 1245 CST [1845 GMT]: Indeed, this is a known issue between alter.net and ThePlanet. They’re working it!

Update, 1315 CST [1845 GMT]: Looks like we’re back to normal.