The differences between amps on various speakers I have played with were significant, sometimes so obvious that within a few seconds of the same recording you would notice completely different presentation.
Speakers I played with more or less extensively and tried with different amps were WA WP 7, Sasha, Sophia II, B&W I do not know how many models, PMC GB1, FB1, FB1+, OB1, PB1i, EB1, EB1i, IB2S, IB2i, MB2S, ATC ACM50 and 100, Magico V3, Q5, Q3, Gershman, Avalon, to name a few, and yes, Harbeth for a short period of time.
Amps I tried were a range of amps from Bryston, McIntosh, Hovland, Simaudio, Linar, Krell, ML, PassLab, McCormack, to name a few.
I have never heard a pair of speakers where significantly different amps (i.e. power difference), yet all build very competently, did not exhibit clearly different presentation.
Even within Bryston line-up, for example 4B SST vs. 7B SST on the same pair of speakers, quite a difference. I vividly remember the day I tried 4B SST on WA Sophia II, it was so clear that 4B had no power to drive those so called “tube friendly” speakers, the load was too much for it. But hook them up to any 700+ Watts amps and they start to perform much better.
Or the difference between 4B SST and McCormack DNA 225 on PMC IB2S, it was the biggest difference between any two amps in approximately the same category I have ever heard, DNA was so colored that you would sometimes think you were not listening to the same recording.
Out of that entire bunch what stands out till this day is Bryston, PMC and ATC in corresponding brackets.
It is not possible to make passive cross-over that will at the same time be “easy load” without impedance and phase issues and provide decent dynamic capabilities, good power response, etc. Not in a thousand years. With passive crossover you have to make huge compromises and find a balance between problems.
If there are claims that amps do not sound different on some speakers, the only explanation for it is that speakers are masking those differences with their own heavy handed colorations.