When counting from $5$ to $180$, $40$ is the $36^{\text{th}}$ number counted. When counting backwards from $180$ to $5$, $40$ is the $n^{\text{th}}$ number counted. What is $n$?