Everything balances itself here. If my favourite team loses the match and I make money from the bet, it is a great consolation for me not to feel disappointed.
Again, on the other hand, if I lose the bet and my favourite team wins, I will still console myself with the win.
The only thing that can help me or any other gambler have a neutral feeling towards such a situation is if they bet with what they can afford to lose.