It doesn't show how many people downvoted the post, it shows "points" the post has. Current system is always 1 point per vote, old system could be 100 points per vote depending on user.