Statistics from a 27M game sample

Internet Go OGS
107

That’s amazing!
I was thinking about what the most popular time settings are and if there is a clear favourite or maybe a couple of front runners for each time setting. And if the favourites for byo-yomi and fischer were equivalent in terms of game duration/pacing.

So I suppose something that shows the distributions of main time and increment/period duration for each of blitz, live and correspondence and each of byo-yomi and fischer. Initially I feel the number of periods of byo-yomi could be ignored, which might cause issues but I suppose it will generally be 3 or 5 and maybe that’s something to explore later.

So does it make sense to have a series of graphs with time across the bottom against number of occurrences of that time on the Y axis?

I suppose there will be peaks for each automatch timing, plus others for say ladder games and site tournaments or particularly popular tournaments. But does anything else rise above background noise?

I guess games which finished by cancellation or before a few moves were played should be excluded as I’m only interested in what’s popular and actually played not what’s popular to put out there but which hardly ever really happens in practice (I’m thinking about 1s blitz maybe seeming more popular than it should be otherwise!)

(Separately, what is the actual ratio of blitz/live/correspondence? I always think of OGS as a correspondence server but I guess a lot of live games can be played while only one correspondence one is finished! Or in other words, is Lys’s observation that 25m/27m games lasted less than 24 an indication of the dominance of live over correspondence or that most correspondence games don’t get going properly?)

108

I shared something about that before:

I’m happy that Anton showed this:

I didn’t recall that bit.
Unfortunately I discarded it together with the rest of that section.
I wonder if I could extract that piece and merge it back into my subset of data.

2 Likes
109

Why don’t we zoom in on some joseki?

eg. when’s the first time a flying knife setup appeared?

image

Seems like a lot of interesting questions can be asked.

1 Like
110

Graphs of joseki popularity over time would be great.

2 Likes
111

Here’s the easy part:
image
(only counting 19x19 games)

I also collected the frequency for each specific setting of byoyomi and fischer, but not sure at the moment what graphs exactly I want to make, so I’ll just dump some data here for now and come back to it later.

Messy data 
system {'simple': 324926, 'canadian': 226218, 'fischer': 3329337, 'none': 77509, 'byoyomi': 8669798, 'absolute': 163652}
byoyomiMain {0: 346808, 60: 357222, 1200: 1919257, 604800: 54146, 1140: 315, 345600: 2349, 1800: 446537, 172800: 5352, 300: 855617, 600: 2300254, 900: 742994, 240: 57313, 259200: 14835, 1814400: 513, 
1209600: 1425, 86400: 11087, 1296000: 170, 43200: 58, 1152: 60, 120: 191618, 1500: 157040, 310: 4, 7200: 49488, 432000: 5413, 3000: 18365, 3600: 141520, 2592000: 309, 1175: 1, 4800: 4628, 1172: 1, 170: 29, 3900: 75, 1080: 1070, 2100: 32640, 780: 371, 2400: 48305, 480: 88991, 720: 15697, 83: 2, 1020: 777, 3300: 7645, 210: 10531, 30000: 3, 12: 1935, 180: 188561, 80: 2233, 864000: 1826, 15600: 6, 25: 879, 3: 1565, 75: 6, 960: 780, 5400: 10280, 4200: 5271, 950400: 47, 777600: 167, 157: 100, 90: 27874, 1: 895, 6300: 30, 10800: 9852, 2700: 52798, 1320: 395, 30: 172653, 73200: 7, 6000000: 3, 36000: 52, 194: 1, 40: 11051, 356400: 4, 10: 31409, 18000: 78, 867: 1, 50: 3517, 171: 27, 840: 933, 360: 52832, 65: 60, 420: 75623, 45: 4511, 2: 513, 35: 4389, 1525: 1, 5: 3030, 150: 25148, 2520: 22, 6120: 1, 1380: 2, 28800: 32, 320: 7, 497: 1, 21600: 14, 108000: 11, 6000: 880, 305: 1, 540: 16543, 74700: 1, 9000: 1050, 160: 15, 14400: 14426, 24600: 1, 660: 833, 2419200: 5528, 37200: 31, 11400: 1, 1728000: 45, 12000: 73, 20: 6065, 15: 4009, 5990: 4, 2270: 2, 126000: 1, 25200: 9, 691200: 936, 591: 1, 4500: 58, 1530: 2, 140: 33, 176: 5, 175200: 1, 3540: 18, 518400: 757, 720000: 1, 8400: 25, 37800: 3, 5960: 1, 22800: 1, 3600000: 1, 270: 14892, 215: 4, 1800000: 1, 167: 21, 165: 6, 450: 99, 4080: 1, 2160000: 440, 3596480: 1, 137: 4, 162000: 4, 610: 10, 910: 5, 6900: 5, 130: 36, 177: 73, 15999600: 1, 110: 53, 5940: 15, 1036800: 483, 79200: 1, 14670: 2, 765: 2, 35820: 5, 5700: 3, 25920000: 1, 180000: 5, 12600: 949, 90060: 1, 590: 5, 362439: 5, 330: 2, 12000000000: 1, 70: 4941, 930: 4, 68400: 1, 33000: 2, 3720: 3, 1865: 1, 605: 3, 110400: 1, 1641600: 2, 5100: 42, 1980: 16, 2401: 12, 4320: 3, 950: 1, 
360000: 1, 23400: 1, 8542: 7, 84000: 3, 6600: 1721, 260400: 2, 1920: 4, 85: 22, 60000: 4, 359999: 1, 3599: 24, 8100: 336, 3607: 1, 4271: 1, 20100: 1, 181200: 3, 2246400: 4, 16200: 6, 1220: 58, 1207: 1, 1225: 1, 1230: 67, 91500: 1, 19200: 1, 1440: 11, 35997600: 2, 8: 423, 1201: 1, 1281: 11, 2073600: 
2, 3606055: 3, 3600006055: 1, 300000000: 3, 1620: 7, 36960: 4, 158: 27, 3606000000: 1, 1382400: 2, 600000000: 1, 864000000: 1, 55: 1846, 6: 669, 18: 3, 72000: 24, 1680: 107, 603: 1, 7: 1759, 216000: 11, 2820: 3, 100: 20, 24300: 1, 1950: 3, 173400: 1, 325200: 10, 666660: 1, 72060: 4, 359700: 1, 12300: 33, 18420: 1, 1803: 1, 1551: 1, 625: 1, 190: 1, 750: 2, 285: 1, 306: 1, 109800: 4, 54000: 13, 17: 
9, 8631: 1, 600000: 3, 1810: 1, 4: 99, 219600: 2, 87300: 4, 1260: 1, 2332800: 1, 3665: 2, 72120: 1, 
359997600: 1, 1055: 18, 97: 1, 1560: 6, 9: 620, 18001: 1, 357600: 2, 1737: 10, 7203: 1, 31536000: 8, 937: 13, 5999940: 8, 32400: 4, 33: 1, 2440: 1, 1204: 1, 640: 7, 280: 2, 180000000: 1, 630: 1, 90000: 4, 19: 2, 11: 4, 570: 1, 27000: 1, 175680: 10, 1900800: 4, 14: 24, 2402: 1, 1870: 1, 87600: 1, 907: 2, 1555200: 3, 307: 3, 39600: 1, 1023: 9, 142: 2, 71: 6, 1205: 3, 7800: 34, 1740: 124, 219300: 2, 
620: 102, 426: 1, 743: 3, 150000: 1, 213600: 2, 108240: 1, 35999964000: 1, 59940: 1, 143: 1, 990: 1, 1708: 9, 510: 2, 129600: 1196, 64800: 8, 208: 1, 318480: 3, 1242: 6, 102480: 3, 66480: 8, 1860: 4, 
144240: 2, 360014: 2, 301: 2, 185: 28, 740: 1, 742: 1, 68: 7, 362340: 1, 2013: 7, 81600: 1, 105: 3695, 181800: 16, 9900: 407, 671: 3, 3610: 9, 1123200: 84, 70500: 3, 200: 1, 1890: 1, 6450: 1, 4680: 1, 14370: 2, 14070: 1, 14130: 1, 4590: 1, 2550: 1, 7350: 1}
byoyomiPeriods {5: 6402811, 2: 264079, 1: 382130, 3: 1226283, 15: 5607, 10: 107113, 12: 3634, 6: 42560, 383: 1, None: 132, 1000: 2, 0: 170, 140: 20, 7: 26108, 200: 505, 4: 128951, 20: 19186, 9: 8039, 
42: 22, 50: 3066, 8: 15559, 599: 1, 100: 2146, 60: 381, 30: 5111, 25: 1211, 480: 66, 500: 94, 11: 2976, 30000: 1, 90: 86, 600: 120, 19: 500, 18: 216, 10000: 1, 444: 1, 400: 2, 64: 2, 123: 6, 99: 237, 
320: 1, 88: 18, 75: 33, 474: 1, 240: 14, 40: 556, 14: 1167, 495: 6, 21: 155, 31: 28, 49: 5, 16: 382, 361: 878, 33: 75, 250: 10, 22: 83, 80: 52, 29: 27, 300: 13512, 430: 1, 339: 2, 51: 155, 61: 1, 41: 
3, 55: 46, 56: 14, 23: 51, 28: 157, 48: 29, 45: 70, 222: 7, 17: 136, 39: 16, 35: 175, 32: 290, 24: 135, 588: 13, 71: 129, 69: 38, 36: 29, 97: 1, 27: 115, 13: 1137, 68: 1, 180: 30, 81: 4, 120: 47, 555: 1, 70: 53, 202: 7, 58: 4, 357: 1, 59: 6, 160: 8, 174: 3, 52: 10, 72: 4, 66: 29, 118: 2, 53: 31, 150: 290, 101: 12, 234: 20, 314: 2, 77: 5, 47: 5, 122: 1, 360: 4, 168: 1, 256: 1, 34: 14, 110: 4, 175: 
3, 65: 27, 98: 4, 257: 1, 261: 2, 138: 2, 103: 2, 111: 3, 76: 2, 136: 2, 183: 5, 62: 6, 134: 2, 209: 2, 208: 2, 46: 1, 38: 11, 54: 40, 63: 3, 255: 9, 125: 3, 189: 1, 199: 7, 130: 4, 299: 5, 93: 36, 79: 16, 290: 17, 108: 8, 149: 1, 85: 1, 115: 2, 133: 1, 109: 1, 170: 10, 239: 1, 83: 2, 37: 7, 26: 1, 
249: 2, 298: 1, 84: 1, 43: 3, 280: 5, 67: 5, 287: 6, 278: 1, 289: 9, 237: 3, 117: 1, 142: 1, 270: 1, 295: 10, 181: 1, 273: 1, 152: 5}
byoyomiPeriodLength {10: 935552, 30: 5620270, 5: 58522, 86400: 89056, 43200: 76, 90: 19392, 604800: 
2172, 345600: 479, 32: 60, 15: 306184, 20: 577959, 40: 96318, 25: 105133, 17: 491, 60: 424922, 38: 1, 172800: 5347, 259200: 7790, 1: 930, 18: 261, 13: 401, 2: 676, 1830: 10, 120: 47561, 45: 104718, 1200: 1990, 50: 27134, 2592000: 176, 600: 7344, 12: 42557, 240: 1481, 35: 31970, 75: 32, 900: 1416, 301: 1, 300: 18806, 41: 15, 2100: 101, 1800: 2081, 8: 11251, 3001: 4, 760: 1, 180: 9266, 16: 190, 22: 
68, 150: 2390, 3600: 3888, 36: 4, 7200: 75, 27: 1, 11: 303, 1810: 1, 65: 171, 42: 40, 59: 8, 70: 5567, 7: 17703, 310: 17, 85: 6, 1801: 6, 100: 50, 36001: 1, 1500: 350, 108000: 2, 18000: 10, 432000: 823, 28800: 5, 5430: 1, 1230: 3, 361: 1, 14: 495, 61: 21, 6: 7382, 32400: 10, 0: 1176, 140: 69, 130: 79, 110: 44, 37: 1, 2505600: 8, 43350: 1, 360000: 1, 630: 14, 330: 15, 21630: 1, 121: 2, 720: 37, 3600000: 1, 3: 15612, 14430: 1, 3300: 776, 55: 10543, 3630: 5, 210: 2300, 360: 554, 3596465: 1, 420: 317, 62: 1, 19800: 7, 2400: 235, 5940: 3, 518400: 77, 31: 85, 3000: 893, 19: 79, 315: 1, 356410: 1, 1080: 6, 21600: 34, 24: 24, 30060: 2, 780: 2, 8160: 1, 270: 2399, 9: 9801, 1296000: 1, 480: 221, 80: 7150, 1123200: 14, 4: 7470, 302: 4, 170: 2, 182: 16, 105: 1110, 36040: 1, 21: 5, 10800: 6, 1201: 1, 864000: 503, 7230: 5, 356460: 1, 14400: 2, 36000: 145, 6600: 1, 1140: 2, 738044: 4, 36030: 4, 840: 10, 600000000: 1, 366100: 1, 660: 2, 2700: 227, 3060: 1, 540: 113, 160: 71, 666660: 1, 1468800: 1, 23: 36, 5400: 2, 143: 2, 4200: 5, 33: 9, 59400: 1, 108065: 5, 960: 1, 4235: 1, 3030: 1, 4800: 3, 362439: 2, 29: 2, 54000: 1, 6000: 5, 5700: 4, 86460: 4, 3665: 2, 559: 1, 26: 1, 1290: 10, 356430: 1, 1860: 10, 4890: 3, 21900: 7, 3540: 1, 46: 13, 59999940: 8, 180000000: 1, 87120: 10, 305: 9, 304: 1, 1728000: 3, 53: 6, 1440: 1, 216030: 2, 610: 2, 1209600: 113, 51: 3, 90000: 1, 359998200: 1, 200: 1, 101280: 7, 65280: 7, 64800: 4, 72030: 7, 64: 2, 691200: 65, 324040: 3, 2419200: 3104, 129600: 3619, 1814400: 61, 777600: 782, 122: 3, 1036800: 25, 95: 1, 365: 1, 260: 2, 460: 1, 950400: 4, 570: 1}
fischerInitial {259200: 1016018, 518400: 5535, 129600: 6095, 120: 712598, 604800: 194303, 150: 7882, 210: 5349, 300: 159323, 86400: 72857, 600: 109528, 240: 18713, 2592000: 749, 28800: 36, 36000: 46, 
172800: 36279, 900: 33303, 691200: 2430, 432000: 24515, 1036800: 320, 60: 228142, 30: 241017, 345600: 12637, 1296000: 277, 1209600: 6106, 40: 5333, 864000: 5964, 1728000: 451, 540: 1527, 7200: 26, 43200: 504, 3120: 4, 50: 2228, 3000: 2183, 180: 67275, 75: 3, 20: 57329, 2700: 4733, 1800: 42896, 45: 3698, 90: 14839, 55: 925, 160: 6, 1814400: 967, 420: 13643, 172920: 10, 0: 10, 480: 6142, 2520: 1, 39600: 35, 3600: 57735, 1500: 5843, 80: 4523, 35: 1345, 6048000: 1, 14400: 2, 2505600: 12, 777600: 536, 10800: 18, 21600: 31, 950400: 235, 720: 845, 1200: 51890, 1123200: 183, 18000: 21, 2419200: 24124, 780: 8, 360: 5774, 3900: 1, 5400: 4, 2246400: 4, 55200: 1, 2160000: 5, 1320: 3, 10: 14960, 6600: 14, 25: 943, 86820: 1, 18: 2, 14: 1, 1382400: 8, 72000: 3, 15: 7325, 3720: 1, 115200: 1, 25200: 1, 108120: 1, 16200: 1, 6900: 1, 270: 2361, 31536000: 7, 1987200: 1, 5184000: 9, 130: 2, 777600000: 1, 86313600: 1, 6000: 5, 1468800: 4, 86450: 2, 32400: 82, 863913600: 13, 4800: 1, 8553600: 2, 77: 2, 75600: 25, 100: 1, 7776000: 2, 2678400: 4, 64800: 2, 8640000: 4, 3369600: 1, 3456000: 1, 86530: 21, 201600: 8, 12: 7442, 17: 57, 9000: 6, 108000: 1, 25920000: 10, 2400: 4679, 2100: 2516, 1900800: 9, 105: 1335, 70: 3107, 3300: 2002, 840: 3, 5: 1586, 9: 985, 6: 43, 7: 840, 8: 957}
fischerIncrement {86400: 1241748, 172800: 13305, 43200: 29567, 20: 103230, 15: 60254, 30: 1018064, 10800: 328, 12: 12891, 24: 7, 259200: 10606, 60: 100383, 28800: 21651, 432000: 872, 10: 445967, 21600: 8136, 36000: 2972, 18000: 7260, 8: 9933, 129600: 4727, 64800: 179, 345600: 704, 2678400: 1, 691200: 15, 864000: 68, 1209600: 27, 1987200: 4, 2160000: 9, 1555200: 1, 518400: 216, 604800: 26064, 14400: 34443, 2592000: 282, 2: 1108, 5: 24903, 4: 3031, 6: 4541, 0: 28, 3030: 4, 3: 5297, 7: 15183, 55: 3065, 7200: 407, 900: 542, 3000: 2, 45: 6287, 1140: 4, 50: 3269, 75: 1, 1: 1860, 170: 1, 25: 8114, 17: 10, 18: 28, 3630: 16, 9000: 15, 3628800: 1, 172830: 7, 432030: 107, 40: 9358, 300: 7812, 777600: 3, 3600: 103, 18000000: 1, 61: 2, 1800: 8035, 1036800: 10, 1296000: 7, 120: 41215, 1382400: 2, 35: 3553, 90: 3028, 12600: 6, 259230: 1, 180: 2557, 19: 9, 600: 3116, 150: 762, 6300: 1, 5400: 24, 1200: 432, 32400: 24, 46800: 4, 86401: 7, 2073600: 1, 54000: 1, 390: 45, 9: 2989, 1123200: 1, 57600: 3608, 
9600: 2, 2400: 12, 4500: 2, 110: 17, 420: 397, 31536000: 5, 16200: 591, 6600: 28, 11: 9, 86313600: 1, 630: 1, 3300: 14, 950400: 3, 480: 121, 1728000: 1, 1814400: 1, 71: 2, 125: 1, 135: 1, 70: 1766, 86430: 1, 50400: 9, 16: 43, 360: 78, 3369600: 1, 8640000: 1, 43230: 11, 720: 26, 25200: 593, 210: 449, 39600: 46, 33: 1, 1440: 1, 72000: 1768, 19800: 336, 1500: 417, 80: 1810, 108000: 645, 270: 187, 105: 880, 240: 466, 540: 131}
fischerMax {518400: 5919, 1036800: 1266, 259200: 352608, 120: 122980, 1209600: 11943, 604800: 823795, 432000: 70914, 150: 10587, 210: 6797, 240: 22473, 300: 748900, 1140: 4, None: 3, 600: 136320, 2592000: 5981, 43200: 9, 1800: 72296, 345600: 15339, 864000: 14828, 900: 48111, 3600: 93639, 691200: 3797, 2073600: 20, 86400: 28382, 180: 85933, 480: 12762, 90: 18456, 1200: 57100, 172800: 28096, 6300: 2, 14400: 7, 30: 95222, 3000: 4422, 60: 248199, 7200: 41, 40: 5247, 1296000: 484, 1728000: 921, 1814400: 2976, 777600: 1342, 70: 2816, 1500: 9191, 5400: 12, 21120: 4, 1987200: 28, 360: 12013, 950400: 537, 50: 1925, 75: 32, 35: 4782, 45: 6188, 2700: 6259, 130: 4, 1123200: 300, 1468800: 14, 5: 914, 960: 4, 420: 20231, 1382400: 23, 6048000: 1, 2505600: 9, 2678400: 5, 2246400: 8, 36000: 42, 270: 1510, 8553600: 20, 720: 1739, 3300: 2934, 10800: 11, 2419200: 38047, 780: 1, 840: 2, 2160000: 22, 18000: 3, 1000: 7, 3900: 6, 2100: 3555, 3456000: 2, 5700: 1, 6000: 70, 1320: 6, 540: 3171, 15: 6744, 1820: 1, 10: 4508, 1900800: 13, 72000: 1, 3720: 1, 3110400: 1, 129600: 4046, 450: 1, 25: 436, 2400: 8911, 108120: 1, 1555200: 15, 31190400: 3, 31536000: 15, 5184000: 9, 777600000: 1, 86313600: 1, 3540: 4, 87030: 1, 180480: 1, 170: 9, 259250: 2, 55: 158, 44400: 1, 863913600: 13, 4800: 1, 4320000: 2, 1641600: 9, 4200: 
1, 7776000: 2, 7219: 4, 180019: 1, 65: 2, 8640000: 5, 87120: 1, 3369600: 1, 28800: 1, 3888000: 1, 259330: 11, 12: 9049, 17: 41, 20: 8444, 1020: 1, 21600: 1, 356400: 1, 122: 2, 6600: 1, 216000: 2, 25920000: 10, 1080: 3, 80: 7638, 105: 3260, 4: 3, 16200: 2, 6: 23, 9: 150, 7: 317, 8: 861, 1: 1, 360000: 18}
6 Likes
112

I was thinking one could plot main time against byo-yomi or increment in a 2d plot, like the way @Lys had been doing.

Although sometimes it can be tricky to see where the centre of each circle is I suppose.

1 Like
113

Amazing!
Confirmation that people only care about byo-yomi and fischer at least!

Looking forward to understanding the messy data! I feel it might have the answer if only I could see it. In that if I were to ignore things with an occurrence of say 3 or less, a lot of the numbers go away if I’ve understood. And I think I’d only be interested in what’s left. I’ll have to try and look at it not on a phone!