A single bench section at a community hall can accommodate either $5$ adults or $9$ children. If $N$ such bench sections are arranged end to end, and an equal number of adults and children are seated, completely filling all the space, what is the smallest possible positive integer value of $N$?