Brian,
A relay is fine, but it should have very low resistance contacts, which means, of course, precious metals.
There is no danger to the speaker from the infrasonic turn on/off surges. DC dissipation is well below the rating of the voice coil, though excursion is a little surprising (but not dangerous or damaging).
Cheers,
Hugh