Is rating volatility a bug or a feature? [Forked]

Maybe Brier score - Wikipedia does the trick.