I don't necessarily agree that this points to a logical flaw...what it does point to is that most people (I'm not an exception) don't thoroughly think their beliefs through.
Read this -- by far one of the most brilliant lectures on Gender and Culture I have ever heard and read. Lots of 'insight'.