The positive integers $x$ and $y$ are the two smallest positive integers for which the product of $1080$ and $x$ is a square and the product of $1080$ and $y$ is a cube. What is the sum of $x$ and $y$?