Also note that if you're driving your woofers to this extreme they are low quality drivers or you are playing your music way, way too loud. Back in the day we used to bang the voice coils against their stops regularly, with a loud click or pop, but they were much more compliant suspensions then and the quality of parts generally much lower than today. I haven't bumped a voice coil against its stop with anything made since the late 80's.
More to the OP's question, even medium quality drivers with butyl rubber or neoprene surrounds should last decades in normal use, foam of course deteriorates rapidly. I'd have to believe the larger driver manufacturers have done destructive testing on their products, but are unlikely to publish this data. Therefore you'll likely need to replace the capacitors in the crossover long before the woofer driver.