Ko ban goes away if you can't agree on which stones are dead?

yeah seems like not filling it is an implicit, if not explicit offer to your opponent to take it back