I have been playing around with OB for a couple of years now, and in my experience, keeping the bass helper drivers OFF the main baffle is a good thing.
Wish I took my own advice when I built my latest ones - oh, wait, that is how I now KNOW to give this advice!
You can look into magnet mounting the woofers behind the main baffle, and allowing them to fire through the main baffle, that is my next approach.
You can also build a separate baffle for the bass, that is what many others have done.
Have fun!