A friend of mine that’s 4d on KGS has tried playing some on this site, but he’s run into issues with the inconsistency of the ranks here. It would probably help if players whose rating the site was pretty unsure of were marked as provisional. As it stand, the question mark next to a player’s rating seems to go away pretty quickly, even in cases where the player’s rating might still be wildly inaccurate.
If we used a glicko-esque system , we could show a user’s rating as provisional up until the point their Rating Deviation (RD) went below some threshold. If a player claims to be 2d, but is actually 25k, their RD will still be quite high after they’ve played and lost several games (and thus, their rank would still show up as provisional). In this circumstance, they also won’t affect other players’ ranks much until their RD settles. If people wildly over- or under- estimate their rank initially, they won’t tend to pull other players’ ranks around as much. Additionally, their ratings will show up as provisional for longer. As I understand it, if someone self-assigns an accurate rank at the start, and plays at that level, their RD will drop quicker. (If we wanted, we could even vary the number of question marks after a player’s rank with the amount of uncertainty about their rating. e.g., 3d??? --> 1k?? -> 8k? -> 9k.)
I’d like this feature, because while you’re learning, it’s nice to know if you’re improving or not. If you’re constantly being beaten (or beating) players with inaccurate ranks, it obscures your sense of progress. And knowledge of your progress (or lack thereof) is important – if you’re not improving, perhaps it’s time to have a stronger player check your play, etc.
The behavior of ratings systems is complicated, so please take my analysis about the consequences of using glicko with several grains of salt.