The graph of a linear function passes through the points $(-1,5)$ and $(3,-3)$. What is the $y$-intercept of this function?