"Why believe in a god? Just be good for goodness' sake,"

How does that upset anyone that believes in a god? You need god to be good?