Carl decided to fence in his rectangular garden. He bought $20$ fence posts, placed one on each of the four corners, and spaced out the rest evenly along the edges of the garden, leaving exactly $6$ yards between neighboring posts. The longer side of his garden, including the corners, has $2$ more posts than the shorter side, including the corners. What is the area, in square yards, of Carl’s garden?