I actually did something similar to this once, and it didn't sound that bad honestly. But then I built a new box, single chamber, with the proper port and air space, and the SQ blew me away! Not to mention I was a full 2 db louder on the TermLab. So yeah, you can do it, and it may work, but it's not ideal.
I was hoping to hear someome opinion who had done it or close to. Thanks man!