I had a simular, but not as obvious a buzzing coming from one of my OB1's.
The buzz only happened at certain frequences, and I also thought it was a bad driver.
Then as I am packing the speakers up to take them into Bryston I notice a rattle type sound coming from inside the same speaker, hmm.
When I got to Bryston the technician ( Cam, great guy and very helpfull ), opens up the back panel where the terminal posts are and we have a look at the x-over.
As it turned out, one of the coils had come loose and was hanging just by it's wire and was resinating against the cabinet. Cam re-secured the coil, replace a
couple of the caps that got dinged up by the coil and the OB1's sound perfect agian.
I don't know if this your problem, but it might be worth looking into.