I've had that happen to me before, I've built up enough karma over my time here to stop caring as much, and sometimes it comes back, other times not so much. It usually depends, but even though the karma system may have it's flaws it at least keeps us from turning into the abyss that other communities have turned into.