|
|
|
When Wikipedia goes down |
|
|
anthony |
|
Postmaster
Group: Regulars
Posts: 2,034
Joined:
Member No.: 2,132
|
Take a look at the server admin log (personally I'm subscribed to the RSS feed). QUOTE 18:00 brion: things seem at least semi-working.
1. everything hung 2. suda had some kind of kernel crash 3. after reboot, it was found to have a couple flaky disks 4. brion hacked up MW config files to skip the NFS logging 5. mark set up an alternate /home NFS server
QUOTE 15:00 mark: Site down completely. Post-mortem:
1. Rob is untangling power cables in rack B2, and both asw-b2-pmtpa and asw3-pmtpa (in B4) lose power 2. Two racks unreachable, PyBal sees too many hosts down and won't depool more 3. Rob brings power to asw-b2-pmtpa back up, but connectivity loss to B4 is not noticed 4. Mark investigates why LVS isn't working, adjusts PyBal parameters, until PyBal pools not a single server 5. Apaches are unhappy about completely missing ES clusters 6. Connectivity loss to B4 discovered, restored 7. Site back online
There is an oversighted edit though, that read: QUOTE 14:45 godwin/gardner: Prepare downtime donation message and take a hammer to a few hard drives.
Just kidding.
|
|
|
|
lolwut |
|
Photobucket staff are Marxists.
Group: Regulars
Posts: 571
Joined:
Member No.: 6,235
|
QUOTE(GlassBeadGame @ Fri 20th February 2009, 5:21pm) Reminds of the Woody Allen joke of the two old ladies at the restaurant. First lady says "The food here is so bad." Her friend replies "Yes and the portions are so small."
Were you referring to my post there? I do get the joke and understand the analogy, but I actually kinda have more of a love/hate relationship with WP rather than just outright hate. QUOTE(Eva Destruction @ Fri 20th February 2009, 6:06pm) To be boring for a minute – usually when you get this message it means someone's doing an action that's locked the system (either the devs updating the software, or something which puts a major strain on the server). Renaming an account with a lot of edits will do it, as will deletion/restoration of pages with thousands of revisions – when Nawlinwiki was at his fearless-grawp-hunter peak, you'd get this all the time as he deleted and selective-restored what felt like every single page.
He's stopped doing that now, probably for good. But he was going for massive overkill. It was pretty funny to watch while it lasted.
|
|
|
|
|
|
3 User(s) are reading this topic (3 Guests and 0 Anonymous Users)
0 Members:
| |