A $10\times 10$ grid is filled with the numbers $1$ through $100$ in some order. The product of the numbers in each row and column is calculated. What is the minimum number of rows and columns whose product is divisible by $3$?