Why is it so wrong to say no?

Nearly every significant action in my life has been in deference to someone else's wishes or opinion. Now you want me to do it yet again on a permanent basis.  Why is it so wrong to say no?