At the beginning of a project, Town X's elevation is $N$ feet lower than Town Y's elevation. During the project, Town X's elevation increases by $15$ feet while Town Y's elevation decreases by $8$ feet. After these changes, the elevations of the two towns differ by $4$ feet. What is the product of all possible values of $N$?