But couldnt it be that other women are the ones who would judge them and not so much the men?The topic reminded me of this Salon article, which is probably somewhat relevant. I can't cite any evidence but I have a feeling that the cultural stigma around drug use acts more strongly against women than against men. Considering women are already faced with unfair social/career hurdles, there's less incentive to add another to the mix.

