I'm going to just throw in my 0.02 here.
As a woman who trains in the iron sports (my deadlift is over 300 lbs and my bench is around 160lbs etc etc.) 5 times a week, I've noticed a lot of peoples perceptions of what a woman's body would look like after that sort of training. Women who are the feared "big and bulky/masculine" are training to look that way, and generally are taking steroids to achieve that aesthetic as well. Also, the women who look like that, don't give a good damn what anyone thinks about them, and are liked by the men in that community. The ol' "beauty is in the eye of the beholder" saying fits well in this scenario.
Most women who crossfit etc will never look like that. I'm strong, and I've noticed changes in my shape, but I'm not cut and I've still got curves. For as much as I train, I wish it was more visible.. (although my diet isn't stellar). It's in fact good for women to strength train, as we are prone to osteoporosis and weight training helps build up bone density.
I'd rather have fewer people think I'm attractive because of how I choose to train, but have a tight body than be a jogger or whatever cardio exercise people are used to women doing, that are typically characterised as being "skinny fat". To each their own.
Perhaps they're just intimidating you