If I remember correctly, you must defeat players who are higher in rank to you to actually keep going up. Just defeating random people who are lower or don't even have a rank doesn't change your rank, and you'll eventually go even lower in ranks.