One morning each member of a family drank a $9$-ounce mixture of coffee with milk. The amounts of coffee and milk varied from cup to cup, but were never zero. One member drank a third of the total amount of milk and a fifth of the total amount of coffee. How many people are in the family?