It also may also have something to do with men and frequent OCD - audio, cars, boats, guns, fishing, stuff in general. At least I know I certainly resemble that remark for a few of them.
Some really knowledgeable women do come to mind - Eva Manley, Kathy Gornak(?) - used to be at Thiel, Colleen Cardas, Karen Sumner - Transparent Audio, Jim Weil's spouse (forgot her name) of Sound Application, all of whom are part of the biz.
One thing I've found, even though they may be seemingly disinterested, they are very sensitive to differences in sound that we might ignore or agonize over whether we heard a difference. They can pick it right out, typically from another room, not glued to the listening position at all.