I find that I listen to music with the volume control at about 9 o'clock. I doubt that produces even 5 watts RMS per channel, probably averaging around 1.5-2 watts with my 88db/m/w speakers. I run AVA stuff in my chain as well. I do have concerns for folks that really run their systems hard. I have many friends that have developed tinnitus, or just plain HF loss from their own listening habits. It takes its toll thru the years.
The loudness rule: if listening at 1 watt and you want it twice as loud, one needs 10 watts, twice again as loud, 100 watts, twice as loud again, 1000 watts. I believe that almost all amp and speaker combos can reach the third level of loudness and the rest of the amps power goes into the category of "head room". I'm sure many will disagree, but that's fine.