A bag contains only red and blue marbles. The number of red marbles is $5$ times the number of blue marbles. If there are $24$ more red marbles than blue marbles, how many blue marbles are in the bag?