To generalize the point a little bit, I'd say that "no" can sometimes mean "maybe, but you'll need to increase my confidence first". This seems to apply to OP's original dilemma too.