lose (one's) patience (with someone)
To become or start becoming annoyed, exasperated, or angered (by someone), especially to the point of snapping at them verbally. I'm sorry for losing my patience with you earlier—I didn't get much sleep last night. I know he's being infuriating, but try not to lose your patience.
lose patience (with someone or something)
to stop being patient with someone or something; to become impatient with someone or something. Please try to be more cooperative. I'm losing patience with you.