An expression of surprise or pleasure. The phrase most likely arose as an alternative to something stronger, such as “Good lord!” which would have been acceptable to those people who objected to taking the deity's name in vain.