AutoScoring Question

How reliable is the Auto Scoring? The first estimate of what dead stones are in the stone removal phase. It feels pretty accurate to me which makes me wonder if we can have a toggle that forces players to accept the auto scoring. I think this would be very helpful for new players who don’t understand what the stone removal phase is or what a dead group is. But maybe I’m being too optimistic.

I recall coming across a number of threads about auto-score “failures” - so whether it’s as reliable as one might hope may be an open question.

when game is unfinished or includes weakness that players missed, AI often has different opinion from humans

1 Like

This is the current one: Current autoscore failures (2025)

FWIW, the vibe I get is that the “failures” are often “did the algorithm give away too much information to the players?” not “the algorithm failed some life and death problem”. Forced autoscore might actually be an improvement in those scenarios :person_shrugging:

2 Likes

So my issue, I want to always accept the auto scoring. When it’s wrong, I want to report the game. BUT if the opponent isn’t forced to accept it, then they can click on stones to change their status. But since I’m trying to skip the stone removal phase for beginners on Tsumego Dragon it would auto accept the changes.

I think in most cases players would likely accept or fix an honest ai mistake in counting, but they are those who score cheat.

Also, what if another beginner has no idea about the stone removal phase and clicks all the stones on the board? I totally did this when I first started Go.

Basically what I am asking for, is a true/false toggle in challenge creation that will force players to accept the auto scoring when set to true. Then only those who ‘want’ it can turn it on.

1 Like

The first essential question that needs to be decided is this: How good is good enough? A 5% fail rate? One percent? What?

When you say a “toggle,” what does that mean? A choice in the game-creation specifications, whereby players agree to abide by the autoscore? That certainly has appeal in terms of thwarting score cheating. The question then becomes this: Is the score cheating rate larger or smaller than the autoscore fail rate?

Edit: I didn’t see your latest post when I wrote this. I see the toggle is conceived as a game-speicification choice. My subsequent question remains however.

I suspect it’s probably > 99%, though I haven’t measured. Are your players going to be playing against other players on Tsumego Dragon only or against the wider OGS pool of players? I think it’s an easy enough flag to add technically speaking, the real question revolves around expectations and yet-another-thing-to-twiddle for a flag when creating a game on OGS.

1 Like

They would be creating custom games and accepting challenges of other players. I cannot do anything about other player’s challenges, but for the custom ones that I send I would like to trust the auto score as I think it is probably more reliable than a beginner.

As for expectations, I can only share my opinions in why I would use it.

Edit: This is the current look.

2 Likes

I mainly mean expectations of the players. Like, if you send all challenges with that flag, but also allow them to accept other challenges, they’re going to have the experience that at the end of a game sometimes it just automatically does the thing, and sometimes it doesn’t, it’d be weird. I’m with you in spirit though, I’d love for the end game to be completely magic all the time.

2 Likes

I think its better to allow users to choose what they wish if both opponents agree.
if they not agree, and select something different from each other, then force AI score.

2 Likes