The function $f$ is defined by $f(x)=a\sqrt{x+b}$, where $a$ and $b$ are constants. In the $xy$-plane, the graph of $y=f(x)$ passes through the point $(-1,0)$, and $f(3)=-4$. What is the value of $a$?