guard
lower (or drop or let down) your guard
1 relax your defensive posture, leaving yourself vulnerable to attack.
2 reduce your level of vigilance or caution.
☞ This is an expression connected in its literal sense with boxing, as is its opposite raise your guard meaning 'adopt a defensive posture'.