I think at some point it was supposed to be the case that timing out of a game removed you from the ladder
From an older thread
Is that still what happens?