I have not experienced this noise in my system nor when i had my squeezebox in a system with higher effeciency (~92db) speakers. My SB is modded and i've never heard a stock SB, so that may make a difference (though i would expect the noise floor to be higher in the modded unit).
Now, what you should be worried about is the "white noise" bug (search white noise or white noise of death on the slimdevices' forums). I've experienced this one first hand, and it's not pretty (sudden maximum output white noise). Thankfully, the SB output will not clip my amp and my speakers can handle the power.