When you answer every question of “Do you want to do X?” with “I don’t know,” your questioner will eventually assume that you mean “I don’t care.”

And that’s fine if you don’t care.  But if you do care, and Steve I’m looking at you, don’t do that!