I think that’s a very valid concern, and it was brought up when I suggested to Use KataGo for Scoring.
However, I think that ultimately, we need to strike a balance between user convenience vs competition “purity”. It’s not ideal for what you described to happen, but at least it requires both players to make the mistake of passing too early, rather than being a tool available during the entire game.