Every system has limits, and one should be aware of them. It ultimately comes down to the recorded level of the source material and the listener's volume preference. In your case, based on your observations, I feel you are grossly underpowered and should consider high efficiency speakers.