Statistics from a 27M game sample

I am still curious about the tengen frequency and occurrence throughout the game,

I am also curious about the relationship between shapes and move sequence, like what this post implied

Is it really true that players at lower level don’t actually play common shape move like tiger’s mouth, etc. I know from teaching some young kids, that they tend to like “straight” answer, like continuous extension, or hane hane a lot, but at some point they will start to learn to jump, knight’s move, large knight, two space jumps even later, not to mention bamboo joint and table shape. I kind of wonder if this is actually the case as players advance in rank?

3 Likes

A bit about lenght of games.

Here are all completed games from years 2018-2021 (start date) divided by days of duration.
The big orange dot represent all the games that ended within 24 hours.
Every other dot is for other integer values (2 days, 3 days and so on…).

As a correspondence player I feel quite diminished. :smiley:

There’s one game that lasted 10 … negative days! :smiley:

Here is the longest game: 2060 days!

I have issues finding the shortest games, since there are plenty of games that lasted… zero seconds!
I’m talking about completed, scored games. I fear there must be some kind of bug somewhere.
Here are few examples:

6 Likes

Since you’re having fun, you might as well give a complete answer to this one.


That one isn’t random sample, it’s pretty complete. There were some games I couldn’t get my grabby hands onto but the next iteration will be even better.

4 Likes

Aha, that’s pretty cool, and probably makes it even cooler. I kind of expected it to be a lot of work to try and grab all the accounts, so some sampling might have been done, but I stand corrected!

Game lengths from 2 632 713 non-handicap 19x19 games that had a score result:

image

The average is 253.5 moves.

Games longer than 500 moves were ignored and not included in the average.

For this one I decided to calculate game length as (length of movelist) - 2, to remove the final two passes.

I failed to take into account that under AGA rules, white must pass last - I believe this is the reason for the spikes on even game lengths.

If I ran the analysis again, this time removing all trailing passes, we would get a smoother histogram and a sliiiightly lower average.

6 Likes

Did you consider filtering out unranked games?

Like we see your examples there may be much more outlier (longer or shorter) unranked games.

To remind, the original question is

27M games should get enough of non-standard boards but needs filtering. So it’s annoying.

1 Like

That would maybe be a good idea (although there would still be some “garbage” in ranked games too).

Ah, right! I was mostly interested in this question for high-level (or at least “reasonable”) games. I wonder what would be the best way to explore this with just the OGS dataset.

One could calculate game length divided by area for each game and make a histogram like above. I guess this would give a normal-ish distribution but it wouldn’t really verify or falsify the hypothesis. So better would be to plot average length against area - but we have so much more data on 9x9, 13x13 and 19x19 than the other sizes, so different datapoints would have very different confidence. But I think this plot could be interesting, I’ll probably try that at some point.

1 Like

I got curious after the last post how many games use AGA rules. Not that many, it turns out:

6 Likes

Wow, does literally no one use Ing? The distinction is probably not so relevant, since I guess OGS must not actually implement the Ing ko rules, since I doubt that anyone can implement the Ing ko rules.

This is only necessary when using territory counting with AGA rules, and it does need to be implemented as an actual additional pass, but just one additional pass stone handed over (and done only once, after all resumptions and life/death disputes have been resolved).

I’m not sure OGS AGA rules actual does it that way, and I think it just uses area counting for AGA rules to get the equivalent score without having to account for pass stones.

1 Like

This was the data I plotted:

image

Seems like Google Sheets just left Ing out from the pie chart since the slice would be < 0.1% :stuck_out_tongue:

Before pasting into Sheets, I filtered out even smaller entries to get rid of some garbage from uploaded SGF:s, here is what the full output looked like:

{'aga': 180273, 'japanese': 19531122, 'nz': 37072, 'chinese': 7120701, 'korean': 201751, 'ogs': 266, 'finn': 1, 'ing': 14192, 'aga (area)': 194, 'simple': 69, '1': 46, 'ing rules': 1, 'old chinese': 1, 'jp': 427, 'jpn': 11, 'relay game': 2, 'uchikomi': 96, 'w wins jigo': 34, 'w gives komi': 7, 'white gives ': 1, 'taiwanese (a': 1, 'free placeme': 1, 'free handica': 1, 'aga (territo': 28, '日本': 9, 'aga (fläche': 1, 'японск': 1, 'подсче': 2, 'ja': 1, '': 16, 'aga (地)': 2, '地を数え': 22, 'tang (japane': 1, 'japanische r': 4, 'china': 1, 'stone': 7, 'american': 1, 'kosimplescor': 5, 'japonesas': 2, 'japenese': 1, 'zh': 45, 'mine': 1, 'cn': 8, "ikeda's area": 1, 'egf': 1}

I also think so, but there is a “white_must_pass_last” property in the json which seems to be true whenever the rules are AGA. So maybe an extra pass is just automatically added to the end of the move list in those cases?

I don’t really care enough to dive in and figure out the details, I’ll leave that to someone else :stuck_out_tongue:

3 Likes

I wonder what % Japanese rules would have if it wasn’t set as default on OGS.

UPDATE: much better version: Statistics from a 27M game sample - #29 by stone_defender


top 10 moves: Statistics from a 27M game sample - #94 by stone_defender


repainted your diagram
odd number moves are black after all
and replaced the least popular moves with board background

first 20 moves:

14 Likes

At least as far as I can see on the website, games with AGA rules do not show white necessarily passing last or any pass stones. Example:

At least it seems to get the handicap adjustment right!

1 Like

I love this.

I love how it clearly shows the stages of the game

  1. 0-10: corner moves
  2. 10 - 30: side moves
  3. 30: 150: central moves
  4. 150: endgame

It also points out that you don’t play on the first line for the first ~150 moves of the game, which is nice for beginners to know.

2 Likes

OGS neither implents pass stones nor white pass last. The games are scored using the area method, so the outcome isn’t affected.

4 Likes

again based on images from @le_4TC :

placed the most popular black moves from move 1
placed the most popular white moves from move 2 from coordinates that were not already placed

new style moves 1-24

11 Likes

It!s all really interesting but why not use stones after the come back of the board (and a grid btw)?

I’m not so crazy lover of this QR code style.

1 Like

I wonder what will be differences between different ranks (I would assume earlier moving toward the center for stronger players), or differences in different years (3-3 earlier and more corners after the AI era?).

3 Likes