Could you do like you did with the Debug of IRC and have each plugin show a log file of the output it creates in the terminal? I.e. AutoDJ output in 1 file, Trivia in another. IMHO this would save a LOT of time trying to dig through ircbot.log for the important stuff and let us know it was the executable itself that crashed and not the use of a plugin. I'm not talking about a debug log, but a straight log of what's being thrown to the terminal by each plugin.

This is done for ircbot v5. It's actually pretty, if I look at the IRCBot-only log it reminds me of the old days before plugins existed and the console wasn't so overwhelming with text.