To close the loop, I tried this with and without the felt. I liked the sound without the felt just a little better. Seemed a little cleaner, brighter, more airy sound. The difference was small but noticeable.
That said, I discovered a non-functioning bass unit in one of the speakers shortly after this test, so it may not be a fair test given that issues. I posted another thread about repairing the bass unit.