Last year Ben took $7$ math tests and received $7$ different scores, each an integer between $91$ and $100$, inclusive. After each test he noticed that the average of his test scores was an integer. His score on the seventh test was $96$. What was his score on the sixth test?