Bug in KataGo 9x9

Hey,

when using the new feature of AI analysis for 9x9 games, passing apparently screws up the winning probability graph. It shows something like 100% for the player whose turn it is after a player passed. Also, there are no moves printed on the board. Take a look yourself at this example: https://online-go.com/game/view/20952322

1 Like

@anoek I think it’s not just 9x9 - the passes in other games I’ve looked at cause this as well.

eg: https://online-go.com/game/20534247

1 Like

Thanks I’ll be working on that. Pretty sure those values are just what the engine is giving me, if so I can’t really fix that pesay, but I can fix the issue where that causes it to be a “key move”

6 Likes

Maybe terminate the analysis at the first pass…

That wouldn’t work when there is resumed play after passing though

@BHydden you beat me :wink:

Hm, then if one player passes out of ‘inexperience’ and the other still plays a move, the analysis is incomplete. I think this must be a bug in KataGo that handles passing incorrectly.

If player A passes, and B would win this way, KataGo should output passing as best possible move for B, shouldn’t it? Maybe it does this already? As of now there is no UI to indicate this, is there?

1 Like

Clearly that’s the case - the question is whether it’s an OK price to pay.

I guess another approach on the same thing is to simply not show the last two moves … unless the game ended in resign.

Nothing is simple :smiley:

It’s not exactly a bug. Like other “zero” bots, KataGo basically uses Tromp-Taylor rules (https://senseis.xmp.net/?TrompTaylorRules), which are the simplest possible form of rules to implement. Under these rules, you get only score for the space you surround that has no opponent stones in it. So if there are “dead” stones, you have to actually prove them dead by capturing them.

If you end the game without doing so, then technically under Tromp-Taylor, that area is not your territory yet, and passing would indeed be a fatal mistake (much like it might be a mistake under human rules to pass when your territory has an unfinished border, regardless of whether you would be winning if the border was finished). So it’s a little less of a “bug” and more like “mismatch between computer rules vs human rules, computer is analyzing correctly under one particular ruleset but that ruleset is the wrong one for human analysis”.

@anoek For now, you can fix this just by skipping analysis on any move that follows an opponent’s pass. You can resume analysis on any moves after that pass if they are not pass moves, because on any moves that are not immediately following a pass, there should be no danger of the game ending.

I’ll add a hack in the next release of KataGo where you can configure it to assume that passes cannot end the game for the purpose of analysis, which should address the rules mismatch here.

2 Likes

I’m not aware of any rule that closes territory borders in scoring phase. Humans have the tendency to not take the rules to the word, but handle them rather loosely.