The function $f$ is defined by $f(x)=a^x+b$, where $a$ and $b$ are positive constants. The graph of $y=f(x)$ in the $xy$-plane passes through the points $(0,6)$ and $(-1,\frac{16}{3})$. What is the value of $a+b$?