count against

US /kaʊnt əˈɡenst/
UK /kaʊnt əˈɡenst/
"count against" picture
1.

to be a disadvantage to someone or something

:
His lack of experience might count against him in the interview.
Don't let one mistake count against your overall performance.