2021 Rating and rank adjustments

image

image

image

image

image

rank colour = name colour

Oh now I see what you mean ā€¦ I was looking at the rank table. So ā€¦ mine are like yours and Kobaā€™s is indeed a mystery!

So many mysteries :slight_smile:

Ah i have the ranks&ratings hidden as default, so they always appear white when i click ā€œshow ratingsā€ on somebodys profile.

3 Likes

ooooooooooooh haha thanks that makes sense

2 Likes

Ah so clicking the ā€œshow ratingsā€ makes them 6kyus instead questionmarks?

1 Like

Yes, can confirm when you turn on ā€œhide ranks and ratingsā€ and then click ā€œshowā€ on profile page I can reproduce this bug

2 Likes

Soā€¦ If you hide ranks, your opponentā€™s humble ranks become bragging ranks - at the top of the uncertainty rather than the bottom? Does hiding ranks reverse polarity somehow?

Also - is there a link to What happened to tournaments.players.ranking? - #25 by Lys

2 Likes

Nah, just back to the middle like a normal rank. It must be bypassing humble somehowā€¦ Top of uncertainty would be about 1k

1 Like

Yes, I have read anoekā€™s posting about three times since it was first posted. I waited quite a while before I put in my opinion, since opinions can change. Mine has not.

The part about making 1 dan a correct rating relative to other systems is fine. However, assigning all the other corrections according to a fixed criterion seems incorrect to me, and I would have believed it if he or she showed evidence that a 25 kyu rating under the new OGS system truly corresponds to 25 kyu in AGA. I think it strange that all the postings in response to mine ignore my very sensible suggestion to make several comparisons across the Kyu range.

Iā€™m sure it it true that players from other environments found OGSā€™s ratings wrong. Iā€™m sure that an adjustment was needed. But an adjustment that pays attention only to the Dan levels and mostly ignores us Kyu players doesnā€™t make sense to me. OGS should be a welcoming and fair environment even for lowly beginners. This is the price OGS should pay for being such an easy to use site compared to some (all?) of the others. And yes, all of this is my opinion, not fact. That doesnā€™t mean it is right or wrong. Testing (evidence) is needed.

See my reply at 2021 Rating and rank adjustments - #451 by BHydden.

See 2021 Rating and rank adjustments - #451 by BHydden for my reply.

Seems like my ā€œas brief as possibleā€ explanation is not cutting it, so hereā€™s a longer reply.

Iā€™m not sure you have really read either anoek or my reply if you say this: OGS 25k is not based on AGA 25k, itā€™s based on the principle that a 25k playing a 20k with 5 handicap stones has an equal chance to win, and a 20k with 3 handicap stones has an equal chance to win gainst a 17k, and so on.

The AGA ranks are not suitable for this: handcap stones are worth too much compared to AGA ranks. That is, an AGA 25k getting 5 handicap stones against an AGA 20k does not have an equal chance to win, but a higher chance to win, i.e. 5 handicap stones is too much.


If you had truly read and understood anoekā€™s post, you would not think that kyu players are ignored. All ranks are adjusted based on testing, since they are based on previously played handicap games on OGS. With this, the relative distance between player A and player B is based on how much handicap stones they need to play a game with fair win chance for both. This number of handicap stones is then the difference in their rank.

Then, once these distances between ranks have been established, the next thing to do is to decide what to call the ranks. Is player A 10k, player B 5k? Or is player A 1d, player B 6d? Or is player A 20k, player B 15k? To make this rather arbitrary choice, anoek has opted for putting players around the 1d rank as close as possible to AGA and EGF ranks, which mostly solves the problem that OGS dan ranks were very tough to reach.


I believe I saw somewhere that either the EGF or the AGA are also working on an improved ranking system that distributes kyu ranks more fairly based on the handicap system, since handicap is now too strong to really align with the difference in ranks.

8 Likes

I do understand the principle that a handicap stone should be equal to the difference in the playerā€™s rank. But Iā€™m seeing the players who used to be 14k now being 9k, which is a very large change, particularly for 9x9, where each stone played has a far greater effect on the game than with 19x19 (surely OGS gives separate rankings for each major size of board?).

I guess Iā€™m just not understanding why only the 1d point was chosen to be equal to rankings from other sources. If this makes 25k totally different from the other sources, and 9d different from the other sources, then logically the other source (such as AGA) must be quite incorrect. I find it hard to believe this can be true.

I guess Iā€™m missing some important basic point. If OGS rankings donā€™t work, perhaps the problem goes back to deriving the ranking from an underlying point system (which I donā€™t understand).

Iā€™m willing to let these issues go if everyone else is so sure Iā€™m wrong, which they are. Iā€™ll just shut up and hope that I really can claim Iā€™m 9k when I play outside of OGS, although Iā€™m absolutely certain I will be far worse than that when I play my next 19x19 game, either inside or outside of OGS just due to the fact that I have played only (ā€œonlyā€ is an excellent approximation) 9x9 games for many, many years.

Today I compared rankings on feb 1st with todayā€™s rankings for 2233 players participating in ā€œThrough the years, long correspndenceā€ tournament.

Old data are retrieved via V1 API while new data come from termination-api.
Iā€™m sorry I didnā€™t gather rating instead of ranking. Ranking seemed to be more straightforward for my purposes (avoiding one calculation) but, as it seems, thereā€™s a glitch involving some users who are wrongly ranked 30 (1d).
Anyway, if you ignore that weird thread of dots on value 30, here you can see New rankings compared to Old rankings.

It looks like there are two distinct diagonal stripes, doesnā€™t it?
I coloured them based on difference ā€œnew - oldā€ so that increases are blue and decreases are orange.

Dot size is the number of players in that dot. Range is from 1 to 9.

9 Likes

For 9x9, a rank difference does not correspond directly with 1 stone handicap. But this is an entirely different problem. The difference in ranks currently is based on handicap stones on 19x19, but our handicap system should give an automatic handicap that is fair for 9x9 as well, using (reverse) komi.

Because choosing two points does not make any sense: the relative distance between ranks is fixed by data based on handicap games, and the absolute value of ranks is based on having 1d be close to the AGA / EGF. If we would fix the 1d ranks and the 25k ranks, for example, then this would no longer be compatible with the relative distance based on the handicap games.

Itā€™s not totally uncorrelated: weaker players are still weaker players here. Itā€™s just that we squished the ranks a bit compared to AGA / EGF, so that handicap games are more fair, based on data from actual handicap games. It might not be intuitive at first, but it should be fairer with the overall idea that 1 rank difference equals 1 handicap stone in 19x19 (which is commonly used in tournaments everywhere)

6 Likes

Also, short note about this: there is no problem claiming youā€™re 9k on OGS. Claiming that youā€™re 9k in the AGA, or in Japan, or on Tygem, or on WBaduk, they all mean different things.

9 Likes

Ya better believe it son! (Or perform some analysis on the AGA data set that shows it is more ā€œcorrectā€ than OGS)

You do understand that your request is like making 0ā° freezing and 100ā° boiling while using Fahrenheit sized degreesā€¦

11 Likes

Thanks, thatā€™s the analogy I was searching for!

6 Likes

perfect comparison!!!
[also, just to piss of Fahrenheit-iansā€¦ who would choose such a scale?! :joy:]

2 Likes

Oh but they are! Or rather, all ranking systems are somehow both correct and incorrect in their own way ^___^

Like gennan posted earlier this thread, EGF is in the process of updating its ranking system too. According the graph in post 59, it seems like EGF and OGS ranks should align really well in kyu-ranges after their update, so maybe itā€™s the AGA which should be updated next xD

7 Likes