If you stretch it across the mouth of your port, it increases resistance in the port and lowers tuning freq.
Try and put grills approx. 1/2 the port diameter away from the mouth and you should have port noise. (if possible)
The only other problem I've encountered when Ive used it over ports is; over time the cloth will stretch and need to be re-pulled taught.