I'm using monit for all system processes on all the servers I run, it
works wonderfully, dutifully notifying me that it has prevented the sky
from falling.
It has occured to me that it would be VERY VERY nice to have monit also
collect performance data and write RRD databases, since it is constantly
running and checking processes. The most interesting performance data for
me is system load an HTTP response times on localhost (I want to know if
it is taking 10 seconds for apache to respond), however I'm sure it would
be trivial to collect other data as well. Even better if that information
was exposed in the monit HTTP interface. I would be happy to donate an
interface design for that, btw.
Self monitoring and self healing machines = sexy ;)