I used to own an AKSA 55 years ago.
55 years ago? I didn't know AKSA was around back in 1951. You and Hugh must be much older than I thought.

I recall having the same problem. When I disconnected the GND from the power cord to the amp, this solved the problem. They make "cheater plugs" that do this as well.
NOTE: The GND is for safety (in case the chassis were to ever become 'live' by a live 120Vac wire), so you need to be aware of this
Yes, it is for safety and defeating it isn't the best thing to do in my opinion.
One solution would be to insulate any RCA jacks and such from the chassis and tie the amplifier's signal ground to the chassis through a 50 ohm resistor in series with a 0.01uF capacitor. This provides a high impedance between the signal ground and safety ground at audio frequencies, but allows for a low impedance connection with the chassis so it can better provide RF shielding.
A better solution in my opinion would be to add a pair of input transformers to the amplifier and/or a pair of output transformers to the SqueezeBox.
se