Players who's ELO are reset to 1600 will remain on the top of the leaderboard for a small period of time, but yes that is remedied, no worries.

And much like Fish said: simply having ELO decay in an appropriate manner would address what you're talking about. It also in a way promotes being active which of course is nice... because we want to give thumbs up to people who play Toribash.