If memory serves, the “Ranked” checkbox available when setting up a game is sticky - i.e., if you uncheck it (for unranked games) it will stay that way until you re-check it. Personally, I prefer it behave this way rather than have it change on its own.
This same issue came up earlier today: