BadukPop provides both a “rank” in kyu,dan, and an “automatch rating” which is a four-digit number. The rank is more an achievement thing that reflects the user’s activity on the app, including live games, correspondence games, life and death problems and yose problems. This “rank” is a bit bullshit and can be very, very far from the go player’s usual rank in both directions (ie I could easily be OGS 3dan and BadukPop 15kyu, or OGS 3dan and BadukPop 8dan, depending on how active I’ve been on BadukPop). The “automatch rating” is probably a much better descriptor of the user’s “go rank”, but it’s not in your survey.
GoQuest is a pretty popular go server which is not in your survey (GoQuest also has separate “rank” and “rating”, with rating probably being more accurate)
I suggest to also plot histogram like that: Unofficial OGS rank histogram (and graphs) 2022 - #26 by stone.defender (but by using result of survey only)
don’t only compare rank between servers. Information of which rank got the most users on each server may be useful for understanding size of collected data and for comparing servers.
Thanks for the feedback. I’ve added both rank and rating for BadukPop and GoQuest (and rank for DGS, @fuseki3), but most likely there won’t be many entries for those this round since they were added so late, so I’ll probably not include results for them when I do the analysis. I’ll copy this format for future surveys so they’ll be included then (looking to do it every 6-12 months).
To compare two servers/associations you can do the following:
Click “Hide fields” then at the bottom click “Hide all”. Enable just the two fields you care about.
Click “Filter” → “Add condition” and filter to only include filled results for both fields (e.g. Where “OGS rank” is not empty and “Fox rank” is not empty)
Click “Sort by” and select the first field included in the comparison
OGS was the most popular server with 105 entries, next was Fox at 69 (totals per server can be seen at the bottom of the raw data view columns)
I’ve included histograms for each of the servers/associations (excluding those with low number of entries). I wanted to run a regression analysis to generate a comparison table similar to the survey ran in 2018, but I couldn’t get scipy working on my machine. If someone has the know-how to do this sort of analysis it would be much appreciated (I think the python notebook from the previous survey analysis should work with only minor changes).
If anyone has any other data visualizations they’d like to make and share I’d be happy to add them to the graphs link.
IIRC when OGS implemented the glicko2 rating system few years ago, there was some data on AGA ranks being roughly 1.5 ranks higher than EGF ranks at 1d level, and ogs sytem was designed to sit about half-way between the two. So based on this survey, it looks like we’re still pretty close to that goal ^___^
What about training NNs on games by specific ranks on specific servers, optimizing not for winning, but for guessing the next move of that level on that server, and then play them against eachother to derive relative ranks on the servers?
it would be easier to just use Kata https://forums.online-go.com/t/server-comparison-ranks/50428/7
with more data, like 100 games from each OGS rank it would be possible to properly measure angle of border between ranks in (number of mistakes)X(size of mistakes) space
then we could plot perpendicular line to that border
make projection of these dots on this perpendicular line
average coordinates of these dots to compress them into 1 dot each
Then we would get unique dot for EACH ogs rank, they wouldn’t be too close to each other
Then we could do all this again for each rank of each other server and paint resulted dots on lines that are parallel to OGS line
Then we would get picture that perfectly compares all servers
