In 99.9999999% of cases: Nah you're good.
You're likely to encounter driver's distorting or burning out long before that point.
I would only be worried if you had large bass drivers with an in-line resistor in the signal path that can't handle the power load given to it.
Most times, that's handled by larger resisitors, or multiple smaller ones that will spread the heat load across them.
With the XSLS, that's unlikely to ever be an issue, so long as everything is properly assembled.