Difficult, exhausting, or problematic. The phrase originates from the collar on a horse's harness, which tightens on the horse's neck when it travels uphill. Primarily heard in UK. I was doing fine in the marathon, but it was a bit against the collar for the last couple miles. I don't think I have time to meet you today. Work has been a bit against the collar recently.