Giving karma to anyone is a great privilege as it was a word of thanks or punishment. But it is also possible that it was given through accidentally clicked the link whether punish or thanks karma. That's the problem of karma.
If you gave someone a positive or negative karma by mistake, you can still remove it. Just click the opposite.
Gave "thank" by mistake, click "punish"
Gave "punish by mistake, click "thank"