I completely support the idea, if you aren't talking in chat, and you're in spec for 7 minutes or so, give them the boot. Save tea time for when you can legitimately take a break from Toribash.

I can't tell you how many times I can't host a Tournament because too many servers exist and there's 4 servers with 2 people, one-two people in spec not talking.