Statistics from a 27M game sample

[teapoweredrobot]

That’s amazing!
I was thinking about what the most popular time settings are and if there is a clear favourite or maybe a couple of front runners for each time setting. And if the favourites for byo-yomi and fischer were equivalent in terms of game duration/pacing.

So I suppose something that shows the distributions of main time and increment/period duration for each of blitz, live and correspondence and each of byo-yomi and fischer. Initially I feel the number of periods of byo-yomi could be ignored, which might cause issues but I suppose it will generally be 3 or 5 and maybe that’s something to explore later.

So does it make sense to have a series of graphs with time across the bottom against number of occurrences of that time on the Y axis?

I suppose there will be peaks for each automatch timing, plus others for say ladder games and site tournaments or particularly popular tournaments. But does anything else rise above background noise?

I guess games which finished by cancellation or before a few moves were played should be excluded as I’m only interested in what’s popular and actually played not what’s popular to put out there but which hardly ever really happens in practice (I’m thinking about 1s blitz maybe seeming more popular than it should be otherwise!)

(Separately, what is the actual ratio of blitz/live/correspondence? I always think of OGS as a correspondence server but I guess a lot of live games can be played while only one correspondence one is finished! Or in other words, is Lys’s observation that 25m/27m games lasted less than 24 an indication of the dominance of live over correspondence or that most correspondence games don’t get going properly?)

[Lys]

@teapoweredrobot

I always think of OGS as a correspondence server

I shared something about that before:

@Lys

As a correspondence player I feel quite diminished.

I’m happy that Anton showed this:

@antonTobi

"speed": "live"

I didn’t recall that bit.
Unfortunately I discarded it together with the rest of that section.
I wonder if I could extract that piece and merge it back into my subset of data.

[bugcat]

Why don’t we zoom in on some joseki?

eg. when’s the first time a flying knife setup appeared?

Seems like a lot of interesting questions can be asked.

[Feijoa]

Graphs of joseki popularity over time would be great.

[antonTobi]

Here’s the easy part:

(only counting 19x19 games)

I also collected the frequency for each specific setting of byoyomi and fischer, but not sure at the moment what graphs exactly I want to make, so I’ll just dump some data here for now and come back to it later.

Messy data

system {'simple': 324926, 'canadian': 226218, 'fischer': 3329337, 'none': 77509, 'byoyomi': 8669798, 'absolute': 163652}
byoyomiMain {0: 346808, 60: 357222, 1200: 1919257, 604800: 54146, 1140: 315, 345600: 2349, 1800: 446537, 172800: 5352, 300: 855617, 600: 2300254, 900: 742994, 240: 57313, 259200: 14835, 1814400: 513, 
1209600: 1425, 86400: 11087, 1296000: 170, 43200: 58, 1152: 60, 120: 191618, 1500: 157040, 310: 4, 7200: 49488, 432000: 5413, 3000: 18365, 3600: 141520, 2592000: 309, 1175: 1, 4800: 4628, 1172: 1, 170: 29, 3900: 75, 1080: 1070, 2100: 32640, 780: 371, 2400: 48305, 480: 88991, 720: 15697, 83: 2, 1020: 777, 3300: 7645, 210: 10531, 30000: 3, 12: 1935, 180: 188561, 80: 2233, 864000: 1826, 15600: 6, 25: 879, 3: 1565, 75: 6, 960: 780, 5400: 10280, 4200: 5271, 950400: 47, 777600: 167, 157: 100, 90: 27874, 1: 895, 6300: 30, 10800: 9852, 2700: 52798, 1320: 395, 30: 172653, 73200: 7, 6000000: 3, 36000: 52, 194: 1, 40: 11051, 356400: 4, 10: 31409, 18000: 78, 867: 1, 50: 3517, 171: 27, 840: 933, 360: 52832, 65: 60, 420: 75623, 45: 4511, 2: 513, 35: 4389, 1525: 1, 5: 3030, 150: 25148, 2520: 22, 6120: 1, 1380: 2, 28800: 32, 320: 7, 497: 1, 21600: 14, 108000: 11, 6000: 880, 305: 1, 540: 16543, 74700: 1, 9000: 1050, 160: 15, 14400: 14426, 24600: 1, 660: 833, 2419200: 5528, 37200: 31, 11400: 1, 1728000: 45, 12000: 73, 20: 6065, 15: 4009, 5990: 4, 2270: 2, 126000: 1, 25200: 9, 691200: 936, 591: 1, 4500: 58, 1530: 2, 140: 33, 176: 5, 175200: 1, 3540: 18, 518400: 757, 720000: 1, 8400: 25, 37800: 3, 5960: 1, 22800: 1, 3600000: 1, 270: 14892, 215: 4, 1800000: 1, 167: 21, 165: 6, 450: 99, 4080: 1, 2160000: 440, 3596480: 1, 137: 4, 162000: 4, 610: 10, 910: 5, 6900: 5, 130: 36, 177: 73, 15999600: 1, 110: 53, 5940: 15, 1036800: 483, 79200: 1, 14670: 2, 765: 2, 35820: 5, 5700: 3, 25920000: 1, 180000: 5, 12600: 949, 90060: 1, 590: 5, 362439: 5, 330: 2, 12000000000: 1, 70: 4941, 930: 4, 68400: 1, 33000: 2, 3720: 3, 1865: 1, 605: 3, 110400: 1, 1641600: 2, 5100: 42, 1980: 16, 2401: 12, 4320: 3, 950: 1, 
360000: 1, 23400: 1, 8542: 7, 84000: 3, 6600: 1721, 260400: 2, 1920: 4, 85: 22, 60000: 4, 359999: 1, 3599: 24, 8100: 336, 3607: 1, 4271: 1, 20100: 1, 181200: 3, 2246400: 4, 16200: 6, 1220: 58, 1207: 1, 1225: 1, 1230: 67, 91500: 1, 19200: 1, 1440: 11, 35997600: 2, 8: 423, 1201: 1, 1281: 11, 2073600: 
2, 3606055: 3, 3600006055: 1, 300000000: 3, 1620: 7, 36960: 4, 158: 27, 3606000000: 1, 1382400: 2, 600000000: 1, 864000000: 1, 55: 1846, 6: 669, 18: 3, 72000: 24, 1680: 107, 603: 1, 7: 1759, 216000: 11, 2820: 3, 100: 20, 24300: 1, 1950: 3, 173400: 1, 325200: 10, 666660: 1, 72060: 4, 359700: 1, 12300: 33, 18420: 1, 1803: 1, 1551: 1, 625: 1, 190: 1, 750: 2, 285: 1, 306: 1, 109800: 4, 54000: 13, 17: 
9, 8631: 1, 600000: 3, 1810: 1, 4: 99, 219600: 2, 87300: 4, 1260: 1, 2332800: 1, 3665: 2, 72120: 1, 
359997600: 1, 1055: 18, 97: 1, 1560: 6, 9: 620, 18001: 1, 357600: 2, 1737: 10, 7203: 1, 31536000: 8, 937: 13, 5999940: 8, 32400: 4, 33: 1, 2440: 1, 1204: 1, 640: 7, 280: 2, 180000000: 1, 630: 1, 90000: 4, 19: 2, 11: 4, 570: 1, 27000: 1, 175680: 10, 1900800: 4, 14: 24, 2402: 1, 1870: 1, 87600: 1, 907: 2, 1555200: 3, 307: 3, 39600: 1, 1023: 9, 142: 2, 71: 6, 1205: 3, 7800: 34, 1740: 124, 219300: 2, 
620: 102, 426: 1, 743: 3, 150000: 1, 213600: 2, 108240: 1, 35999964000: 1, 59940: 1, 143: 1, 990: 1, 1708: 9, 510: 2, 129600: 1196, 64800: 8, 208: 1, 318480: 3, 1242: 6, 102480: 3, 66480: 8, 1860: 4, 
144240: 2, 360014: 2, 301: 2, 185: 28, 740: 1, 742: 1, 68: 7, 362340: 1, 2013: 7, 81600: 1, 105: 3695, 181800: 16, 9900: 407, 671: 3, 3610: 9, 1123200: 84, 70500: 3, 200: 1, 1890: 1, 6450: 1, 4680: 1, 14370: 2, 14070: 1, 14130: 1, 4590: 1, 2550: 1, 7350: 1}
byoyomiPeriods {5: 6402811, 2: 264079, 1: 382130, 3: 1226283, 15: 5607, 10: 107113, 12: 3634, 6: 42560, 383: 1, None: 132, 1000: 2, 0: 170, 140: 20, 7: 26108, 200: 505, 4: 128951, 20: 19186, 9: 8039, 
42: 22, 50: 3066, 8: 15559, 599: 1, 100: 2146, 60: 381, 30: 5111, 25: 1211, 480: 66, 500: 94, 11: 2976, 30000: 1, 90: 86, 600: 120, 19: 500, 18: 216, 10000: 1, 444: 1, 400: 2, 64: 2, 123: 6, 99: 237, 
320: 1, 88: 18, 75: 33, 474: 1, 240: 14, 40: 556, 14: 1167, 495: 6, 21: 155, 31: 28, 49: 5, 16: 382, 361: 878, 33: 75, 250: 10, 22: 83, 80: 52, 29: 27, 300: 13512, 430: 1, 339: 2, 51: 155, 61: 1, 41: 
3, 55: 46, 56: 14, 23: 51, 28: 157, 48: 29, 45: 70, 222: 7, 17: 136, 39: 16, 35: 175, 32: 290, 24: 135, 588: 13, 71: 129, 69: 38, 36: 29, 97: 1, 27: 115, 13: 1137, 68: 1, 180: 30, 81: 4, 120: 47, 555: 1, 70: 53, 202: 7, 58: 4, 357: 1, 59: 6, 160: 8, 174: 3, 52: 10, 72: 4, 66: 29, 118: 2, 53: 31, 150: 290, 101: 12, 234: 20, 314: 2, 77: 5, 47: 5, 122: 1, 360: 4, 168: 1, 256: 1, 34: 14, 110: 4, 175: 
3, 65: 27, 98: 4, 257: 1, 261: 2, 138: 2, 103: 2, 111: 3, 76: 2, 136: 2, 183: 5, 62: 6, 134: 2, 209: 2, 208: 2, 46: 1, 38: 11, 54: 40, 63: 3, 255: 9, 125: 3, 189: 1, 199: 7, 130: 4, 299: 5, 93: 36, 79: 16, 290: 17, 108: 8, 149: 1, 85: 1, 115: 2, 133: 1, 109: 1, 170: 10, 239: 1, 83: 2, 37: 7, 26: 1, 
249: 2, 298: 1, 84: 1, 43: 3, 280: 5, 67: 5, 287: 6, 278: 1, 289: 9, 237: 3, 117: 1, 142: 1, 270: 1, 295: 10, 181: 1, 273: 1, 152: 5}
byoyomiPeriodLength {10: 935552, 30: 5620270, 5: 58522, 86400: 89056, 43200: 76, 90: 19392, 604800: 
2172, 345600: 479, 32: 60, 15: 306184, 20: 577959, 40: 96318, 25: 105133, 17: 491, 60: 424922, 38: 1, 172800: 5347, 259200: 7790, 1: 930, 18: 261, 13: 401, 2: 676, 1830: 10, 120: 47561, 45: 104718, 1200: 1990, 50: 27134, 2592000: 176, 600: 7344, 12: 42557, 240: 1481, 35: 31970, 75: 32, 900: 1416, 301: 1, 300: 18806, 41: 15, 2100: 101, 1800: 2081, 8: 11251, 3001: 4, 760: 1, 180: 9266, 16: 190, 22: 
68, 150: 2390, 3600: 3888, 36: 4, 7200: 75, 27: 1, 11: 303, 1810: 1, 65: 171, 42: 40, 59: 8, 70: 5567, 7: 17703, 310: 17, 85: 6, 1801: 6, 100: 50, 36001: 1, 1500: 350, 108000: 2, 18000: 10, 432000: 823, 28800: 5, 5430: 1, 1230: 3, 361: 1, 14: 495, 61: 21, 6: 7382, 32400: 10, 0: 1176, 140: 69, 130: 79, 110: 44, 37: 1, 2505600: 8, 43350: 1, 360000: 1, 630: 14, 330: 15, 21630: 1, 121: 2, 720: 37, 3600000: 1, 3: 15612, 14430: 1, 3300: 776, 55: 10543, 3630: 5, 210: 2300, 360: 554, 3596465: 1, 420: 317, 62: 1, 19800: 7, 2400: 235, 5940: 3, 518400: 77, 31: 85, 3000: 893, 19: 79, 315: 1, 356410: 1, 1080: 6, 21600: 34, 24: 24, 30060: 2, 780: 2, 8160: 1, 270: 2399, 9: 9801, 1296000: 1, 480: 221, 80: 7150, 1123200: 14, 4: 7470, 302: 4, 170: 2, 182: 16, 105: 1110, 36040: 1, 21: 5, 10800: 6, 1201: 1, 864000: 503, 7230: 5, 356460: 1, 14400: 2, 36000: 145, 6600: 1, 1140: 2, 738044: 4, 36030: 4, 840: 10, 600000000: 1, 366100: 1, 660: 2, 2700: 227, 3060: 1, 540: 113, 160: 71, 666660: 1, 1468800: 1, 23: 36, 5400: 2, 143: 2, 4200: 5, 33: 9, 59400: 1, 108065: 5, 960: 1, 4235: 1, 3030: 1, 4800: 3, 362439: 2, 29: 2, 54000: 1, 6000: 5, 5700: 4, 86460: 4, 3665: 2, 559: 1, 26: 1, 1290: 10, 356430: 1, 1860: 10, 4890: 3, 21900: 7, 3540: 1, 46: 13, 59999940: 8, 180000000: 1, 87120: 10, 305: 9, 304: 1, 1728000: 3, 53: 6, 1440: 1, 216030: 2, 610: 2, 1209600: 113, 51: 3, 90000: 1, 359998200: 1, 200: 1, 101280: 7, 65280: 7, 64800: 4, 72030: 7, 64: 2, 691200: 65, 324040: 3, 2419200: 3104, 129600: 3619, 1814400: 61, 777600: 782, 122: 3, 1036800: 25, 95: 1, 365: 1, 260: 2, 460: 1, 950400: 4, 570: 1}
fischerInitial {259200: 1016018, 518400: 5535, 129600: 6095, 120: 712598, 604800: 194303, 150: 7882, 210: 5349, 300: 159323, 86400: 72857, 600: 109528, 240: 18713, 2592000: 749, 28800: 36, 36000: 46, 
172800: 36279, 900: 33303, 691200: 2430, 432000: 24515, 1036800: 320, 60: 228142, 30: 241017, 345600: 12637, 1296000: 277, 1209600: 6106, 40: 5333, 864000: 5964, 1728000: 451, 540: 1527, 7200: 26, 43200: 504, 3120: 4, 50: 2228, 3000: 2183, 180: 67275, 75: 3, 20: 57329, 2700: 4733, 1800: 42896, 45: 3698, 90: 14839, 55: 925, 160: 6, 1814400: 967, 420: 13643, 172920: 10, 0: 10, 480: 6142, 2520: 1, 39600: 35, 3600: 57735, 1500: 5843, 80: 4523, 35: 1345, 6048000: 1, 14400: 2, 2505600: 12, 777600: 536, 10800: 18, 21600: 31, 950400: 235, 720: 845, 1200: 51890, 1123200: 183, 18000: 21, 2419200: 24124, 780: 8, 360: 5774, 3900: 1, 5400: 4, 2246400: 4, 55200: 1, 2160000: 5, 1320: 3, 10: 14960, 6600: 14, 25: 943, 86820: 1, 18: 2, 14: 1, 1382400: 8, 72000: 3, 15: 7325, 3720: 1, 115200: 1, 25200: 1, 108120: 1, 16200: 1, 6900: 1, 270: 2361, 31536000: 7, 1987200: 1, 5184000: 9, 130: 2, 777600000: 1, 86313600: 1, 6000: 5, 1468800: 4, 86450: 2, 32400: 82, 863913600: 13, 4800: 1, 8553600: 2, 77: 2, 75600: 25, 100: 1, 7776000: 2, 2678400: 4, 64800: 2, 8640000: 4, 3369600: 1, 3456000: 1, 86530: 21, 201600: 8, 12: 7442, 17: 57, 9000: 6, 108000: 1, 25920000: 10, 2400: 4679, 2100: 2516, 1900800: 9, 105: 1335, 70: 3107, 3300: 2002, 840: 3, 5: 1586, 9: 985, 6: 43, 7: 840, 8: 957}
fischerIncrement {86400: 1241748, 172800: 13305, 43200: 29567, 20: 103230, 15: 60254, 30: 1018064, 10800: 328, 12: 12891, 24: 7, 259200: 10606, 60: 100383, 28800: 21651, 432000: 872, 10: 445967, 21600: 8136, 36000: 2972, 18000: 7260, 8: 9933, 129600: 4727, 64800: 179, 345600: 704, 2678400: 1, 691200: 15, 864000: 68, 1209600: 27, 1987200: 4, 2160000: 9, 1555200: 1, 518400: 216, 604800: 26064, 14400: 34443, 2592000: 282, 2: 1108, 5: 24903, 4: 3031, 6: 4541, 0: 28, 3030: 4, 3: 5297, 7: 15183, 55: 3065, 7200: 407, 900: 542, 3000: 2, 45: 6287, 1140: 4, 50: 3269, 75: 1, 1: 1860, 170: 1, 25: 8114, 17: 10, 18: 28, 3630: 16, 9000: 15, 3628800: 1, 172830: 7, 432030: 107, 40: 9358, 300: 7812, 777600: 3, 3600: 103, 18000000: 1, 61: 2, 1800: 8035, 1036800: 10, 1296000: 7, 120: 41215, 1382400: 2, 35: 3553, 90: 3028, 12600: 6, 259230: 1, 180: 2557, 19: 9, 600: 3116, 150: 762, 6300: 1, 5400: 24, 1200: 432, 32400: 24, 46800: 4, 86401: 7, 2073600: 1, 54000: 1, 390: 45, 9: 2989, 1123200: 1, 57600: 3608, 
9600: 2, 2400: 12, 4500: 2, 110: 17, 420: 397, 31536000: 5, 16200: 591, 6600: 28, 11: 9, 86313600: 1, 630: 1, 3300: 14, 950400: 3, 480: 121, 1728000: 1, 1814400: 1, 71: 2, 125: 1, 135: 1, 70: 1766, 86430: 1, 50400: 9, 16: 43, 360: 78, 3369600: 1, 8640000: 1, 43230: 11, 720: 26, 25200: 593, 210: 449, 39600: 46, 33: 1, 1440: 1, 72000: 1768, 19800: 336, 1500: 417, 80: 1810, 108000: 645, 270: 187, 105: 880, 240: 466, 540: 131}
fischerMax {518400: 5919, 1036800: 1266, 259200: 352608, 120: 122980, 1209600: 11943, 604800: 823795, 432000: 70914, 150: 10587, 210: 6797, 240: 22473, 300: 748900, 1140: 4, None: 3, 600: 136320, 2592000: 5981, 43200: 9, 1800: 72296, 345600: 15339, 864000: 14828, 900: 48111, 3600: 93639, 691200: 3797, 2073600: 20, 86400: 28382, 180: 85933, 480: 12762, 90: 18456, 1200: 57100, 172800: 28096, 6300: 2, 14400: 7, 30: 95222, 3000: 4422, 60: 248199, 7200: 41, 40: 5247, 1296000: 484, 1728000: 921, 1814400: 2976, 777600: 1342, 70: 2816, 1500: 9191, 5400: 12, 21120: 4, 1987200: 28, 360: 12013, 950400: 537, 50: 1925, 75: 32, 35: 4782, 45: 6188, 2700: 6259, 130: 4, 1123200: 300, 1468800: 14, 5: 914, 960: 4, 420: 20231, 1382400: 23, 6048000: 1, 2505600: 9, 2678400: 5, 2246400: 8, 36000: 42, 270: 1510, 8553600: 20, 720: 1739, 3300: 2934, 10800: 11, 2419200: 38047, 780: 1, 840: 2, 2160000: 22, 18000: 3, 1000: 7, 3900: 6, 2100: 3555, 3456000: 2, 5700: 1, 6000: 70, 1320: 6, 540: 3171, 15: 6744, 1820: 1, 10: 4508, 1900800: 13, 72000: 1, 3720: 1, 3110400: 1, 129600: 4046, 450: 1, 25: 436, 2400: 8911, 108120: 1, 1555200: 15, 31190400: 3, 31536000: 15, 5184000: 9, 777600000: 1, 86313600: 1, 3540: 4, 87030: 1, 180480: 1, 170: 9, 259250: 2, 55: 158, 44400: 1, 863913600: 13, 4800: 1, 4320000: 2, 1641600: 9, 4200: 
1, 7776000: 2, 7219: 4, 180019: 1, 65: 2, 8640000: 5, 87120: 1, 3369600: 1, 28800: 1, 3888000: 1, 259330: 11, 12: 9049, 17: 41, 20: 8444, 1020: 1, 21600: 1, 356400: 1, 122: 2, 6600: 1, 216000: 2, 25920000: 10, 1080: 3, 80: 7638, 105: 3260, 4: 3, 16200: 2, 6: 23, 9: 150, 7: 317, 8: 861, 1: 1, 360000: 18}

[shinuito]

I was thinking one could plot main time against byo-yomi or increment in a 2d plot, like the way @Lys had been doing.

Statistics from a 27M game sample

Trying to dig into teaching games. There’s no flag about that, so I tried to filter on game name. I looked for the string “teach” which could possibly appear in various combinations. I’m keeping only 9x9 and 19x19 boards and considering both handicap and komi. Here’s a summary: Ranked Board False True Total 9x9 1980 1841 3821 19x19 9713 2340 12053 Total 11693 4181 15874 About 9k games have actually a title such as “Teaching game” or similar. Many are like “Please teach …

Although sometimes it can be tricky to see where the centre of each circle is I suppose.

[teapoweredrobot]

Amazing!
Confirmation that people only care about byo-yomi and fischer at least!

Looking forward to understanding the messy data! I feel it might have the answer if only I could see it. In that if I were to ignore things with an occurrence of say 3 or less, a lot of the numbers go away if I’ve understood. And I think I’d only be interested in what’s left. I’ll have to try and look at it not on a phone!