A party is attended by single women and married couples only. If the probability of selecting a married woman when choosing randomly from all women at the party is $\frac{1}{3}$, what fraction of the total people present are men?