A library removed $20\%$ of its books. If $4,000$ books remained, how many books were in the library originally?