In a recent numa meeting that Scott called, Jeff suggested a small
patch to the pageout daemon.
It's rather dramatic the difference it makes for me. If I arrange to
thrash the crap out of memory, without this patch the kernel is so
borked with all the processes in disk wait that I can't kill them,
I can't reboot, my only option is to power off.
With the patch there is still some borkage, the kernel is randomly
killing processes because of out of mem, it should kill one of my
processes that is causing the problem but it doesn't, it killed
random stuff like dhclient, getty (logged me out), etc.
But the system is responsive.
What the patch does is say "if we have more than one core, don't sleep
in pageout, just keep running until we freed enough mem".