I am surprised or annoyed by this.

For goodness' sake, Harry, what are you doing at this time of night?

Well, for goodness sakes, why didn't you tell me that earlier so I could have changed my plans?

Usage notes: used for emphasis and often used instead of the more offensive idioms for God's sake and for Christ's sake

Related vocabulary: for crying out loud

• beat swords into ploughshares
• be at the bottom of
• be at the bottom of something
• beat the bushes
• beat the daylights out of
• beat the daylights out of someone
• beat the drum
• be at the end of tether
• be at the end of your tether
• beat the hell out of
• beat the hell out of someone
• beat the hell out of something
• beat the living daylights out of
• beat the living daylights out of someone
• be at the mercy of
• be at the mercy of someone
• be at the mercy of something
• beat the pants off
• beat the rap
• be at the receiving end
• beat the socks off
• beat the system
• beat the tar out of
• beat the tar out of someone
• be at the wheel