Ok so I took the advice of sound deadening and bracing. I added just a tad more bracing to the port volume than I did to the cabinet volume which I think will be accounted for in the decrease volume due to the sound deadening. Ok so here's what I ended up with....
Port to back wall bracing..... I only went with two braces which puts panel size right at 4.5"

Sound deadening added.... After working with the VCT in this way I can see how it would help with resonances

Full frontal through driver hole.....

Remember only half the port assembly has been installed. So all thats left is installing the rest of the port which is already cut and pre-assembled and cut and install the bottom/Side. I'll also have a little work cutting the holes for amp controller wires and driver lead and cutting in the amp/controller cutouts.