Ranking system is BROKEN

So I was scrolling on OGS games one day and saw a 9D player who apparently is 8 years old! And then, I scrolled down to the games list, and saw this! 1300+ of playing against the worst AI with 9 handicap! OGS ranking system has been exploited! I thought in the previous updates, OGS ranked games are only allowed if the 2 players have a difference in ranks less than 9?



3 Likes

Please post the link to the user profile

Sorry, but I would rather not publicly single out someone.

4 Likes

The profile is public. There is nothing wrong about. You are reporting a bug. Not an action of a person.

You have already provide enough information to search the user. High gain of rank for short period is enough to find the user. Please do not waste time to do search next time.

I do not see any illegal actions from the user. They can’t beat ordinary kyu players.

I think you are right about strange behavior of rating system.

This is the player, I am sorry if this makes someone feels ashamed.

1 Like

Why are you repeating after me? :wink:

Appologies, your message didn’t load until I sent mine.

2 Likes

Please don’t worry. It was a joke.

1 Like

Really? You can do that? How?

Everybody can do it. Just check the history of every user. It is tedious but not impossible.

Like you mean you could find every 9Ds in the game?

Or you can just check ranked 9x9 game history for the bot Amaranthus on Aug. 07.

2 Likes

Ohh! Smart!

Nah, I found another AI issue. If you play against AI Bouvardia in 19x19 and give it 9 handicaps, it just straight up passes. 9x9 doesn’t have the issue though.

It does seem like a bug that you can challenge a bot to a ranked game outside the +/- 9 rank difference :face_with_monocle:

However, that aside, exploiting bot weaknesses to gain rank is simply “disallowed behaviour” and should be reported.

6 Likes

I agree that it is “disallowed behaviour”.

But I disagree about bug “reason”.

Rank should not grow fast for playing with weaker opponents.

What about ranked tournaments?

I know what you’re saying - a 5d defeating a 25k should gain essentially no rank.

BUT the game itself is “out of bounds”. (On face value) it appears to be in a space that the ranking system isn’t even designed to handle: a game where the players are more than 9 ranks apart.

I can speculate that it’s treated as if they were 9 ranks apart AND 9 handicap … which results in an “even match” from a ranking perspective.

So arguably if the existence of the game itself were fixed then the ranking system would not be exposed to this “out of bounds case”.

That being said, I’m not an expert of the ranking system, maybe there’s a reason why this game is allowed, in which case the rank calculation is clearly wrong.

Let’s @anoek at this point :slight_smile:

5 Likes

I think it was the opposite, after a previous update this restriction was removed.

I think we’re a good bit on from that proposal now (allowing players to choose their entry level, and removing rank restrictions) that it could be interesting to see if there has been any positive or negative effects generally of those proposals.

1 Like

It was an intentional change after a long thread of discussions. If that was the simple summary, surely it wouldn’t have went ahead.

So it could just be an implementation bug?

^^ relevant GitHub issues, and within the second one

in case it’s useful for debugging.

1 Like

There are at least two other users who exploited the same weakness. See LES BRETONS