There are many reasons, but mostly it comes down to how strongly they feel about your brand, what sort of feedback you are asking, when and how you send the survey to them.
By making sure you ask relevant, meaningful and simple questions, at the right moment of the customer journey, and via a user-friendly format, the customers’ willingness to respond will improve greatly.