Really funny how that double standard works......You do what is best for your family, it's a partnership, not a stereotype to be filled. (imo)
And congrats on staying calm! I would have said something really snarky and regretted it.
I know that I've come across similar situations a few times, and it's made me pause. I know when I, or my family do anything unusual, I expect people to take a second to process it. But to say anything, or insinuate anything is rude and ignorant. You don't have to respond to them at all, but a raised eyebrow and an "amused" smile have worked well for me.