Just go

Remove yourself from the game.
Stand up, say "Nah" and leave.
In the next 24 hours you dont have to play against the current opponent again.