your, his, etc. heart is in the right place

(one's) heart is in the right place

(One) means well or is good at heart, even if they don't always do the right thing; (one) is well intentioned. His speech at the wedding was horribly embarrassing, but his heart was definitely in the right place. I know your heart is in the right place, but you're actually being very unhelpful at the moment.
See also: heart, place, right
Farlex Dictionary of Idioms.

your, his, etc. heart is in the right ˈplace

used to say that somebody’s intentions are kind and sincere even though they sometimes do the wrong thing: I know she gets angry sometimes, but basically her heart is in the right place.
See also: heart, place, right
Farlex Partner Idioms Dictionary
See also:
  • (one's) heart is in the right place
  • one's heart is in the right place
  • your heart is in the right place
  • wouldn't be caught dead (doing something)
  • somebody wouldn't be seen/caught dead...
  • caught dead, wouldn't be
  • paint (one) black
  • paint black
  • wash (one's) dirty linen in public
  • wash one's dirty linen in public