Function $f$ is defined by $f(x)=b-a^x$, where $a$ and $b$ are constants. In the $xy$-plane, the graph of $y=f(x)-7$ has a $y$-intercept at $(0,-3)$. The product of $a$ and $b$ is $20$. What is the value of $b$?