Two similar polygons have areas of $48$ square units and $108$ square units. If the perimeter of the smaller polygon is $32$ units, what is the perimeter, in units, of the larger polygon?