A collector sells $25\%$ of his coin collection each month. If he had $180$ coins left at the end of the second month, how many coins did he have at the beginning of the first month?