hold against
phrasal verbhold something against somebody
- to allow something that somebody has done to make you have a lower opinion of them
- I admit I made a mistake—but don't hold it against me.
Definition of hold against phrasal verb from the Oxford Advanced Learner's Dictionary