[ILUG] Ever seen so many OOM's

[Conor Wynne]

Had this today. This is only page 1 of the grep :-)

Turned out to be a corrupted swap - and incorrect tunings to be fair.

var/log/messages:Nov 19 15:48:41 kernel: hald invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages:Nov 19 15:48:41 kernel: date invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages:Nov 19 15:48:41 kernel: date invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages:Nov 19 15:48:42 kernel: date invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages:Nov 19 15:48:42 kernel: klogd invoked oom-killer:
gfp_mask=0x4d0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:19:56 kernel: irqbalance invoked
oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:20:03 kernel: httpd invoked oom-killer:
gfp_mask=0x200d0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:20:09 kernel: klogd invoked oom-killer:
gfp_mask=0x4d0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:20:13 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:20:19 kernel: date invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:20:23 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: httpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: httpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: irqbalance invoked
oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: date invoked oom-killer:
gfp_mask=0x84d0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: irqbalance invoked
oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: irqbalance invoked
oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: snmpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: httpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: irqbalance invoked
oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:21:34 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:22:32 kernel: date invoked oom-killer:
gfp_mask=0x84d0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:42:25 kernel: pcscd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:42:45 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:42:45 kernel: httpd invoked oom-killer:
gfp_mask=0x84d0, order=0, oomkilladj=0
/var/log/messages.2:Nov  4 13:42:45 kernel: master invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.2:Nov  5 10:10:26 kernel: date invoked oom-killer:
gfp_mask=0x84d0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:16:15 kernel: snmpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:16:27 kernel: pcscd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: irqbalance invoked
oom-killer: gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: ps invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: date invoked oom-killer:
gfp_mask=0x84d0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: httpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: httpd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: httpd invoked oom-killer:
gfp_mask=0x84d0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: pcscd invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: crond invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: crond invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0
/var/log/messages.4:Oct 22 10:17:25 kernel: date invoked oom-killer:
gfp_mask=0xd0, order=0, oomkilladj=0