One dimension of a cube is increased by $2$, another is decreased by $2$, and the third is left unchanged. The volume of the new rectangular solid is $36$ less than that of the cube. What was the volume of the cube?