You go girl! Standing up for yourself is your absolute right. Let no one get in the way of what you believe is right for you. Your personal relationship(s) is(are) your business and the one(s) you have the relationship with and no one else's.
Now, people have a right to their opinions and may even have the right to express it, they do not, however, have the right to tell you what you can and can't do.
"...
Human beings owe to each other help to distinguish the better from the worse, and encouragement to choose the former and avoid the latter. They should be forever stimulating each other to increased exercise of their higher faculties, and increased direction of their feelings and aims towards wise instead of foolish, elevating instead of degrading, objects and contemplations. But neither one person, nor any number of persons, is warranted in saying to another human creature of ripe years, that he shall not do with his life for his own benefit what he chooses to do with it. He is the person most interested in his own well-being, the interest which any other person, except in cases of strong personal attachment, can have in it, is trifling, compared with that which he himself has; the interest which society has in him individually (except as to his conduct to others) is fractional, and altogether indirect: while, with respect to his own feelings and circumstances, the most ordinary man or woman has means of knowledge immeasurably surpassing those that can be possessed by any one else. The interference of society to overrule his judgment and purposes in what only regards himself, must be grounded on general presumptions; which may be altogether wrong, and even if right, are as likely as not to be misapplied to individual cases, by persons no better acquainted with the circumstances of such cases than those are who look at them merely from without. In this department, therefore, of human affairs, Individuality has its proper field of action. In the conduct of human beings towards one another, it is necessary that general rules should for the most part be observed, in order that people may know what they have to expect; but in each person's own concerns, his individual spontaneity is entitled to free exercise. Considerations to aid his judgment, exhortations to strengthen his will, may be offered to him, even obtruded on him, by others; but he, himself, is the final judge. All errors which he is likely to commit against advice and warning, are far outweighed by the evil of allowing others to constrain him to what they deem his good..."
-John Stuart Mill
(1859)