It probably has to do with Jora long ago rejecting Jormag's offer of power. Now they think all women are unworthy of their dragon's greatness. They can stuff that greatness up their loincloths.