The notion of measured performance being, to a significant degree, independent of subjective sound quality is on its face a very reasonable one that will be consistent with experiences that each of us have had. From this we can conclude that either lab testing is irrelevant or we have ignored at least one significant variable. In actual fact, it's the second one.
When I studied this at Carlton U fifty years ago, it was already old news. We experience the world with our brain, using input from our eyes, ears and sensory nerves. We hear primarily with our brain and thus, professional violinists when comparing a Stradivarius with several other violins will absolutely love it, unless they are not told which instrument is which. In that case, they don't like it, preferring good modern instruments made with the knowledge of what makes the Strad great. People comparing good to not so good audio gear will hear very big differences in SQ between the two systems that are quite reasonable and consistent with what one might expect, except that the reactions track with what they are told is playing rather than the equipment they are actually listening to.
When you consider that we are listening to recordings and then presuming we know what those should sound like with little or no knowledge of how the recordings were made, that additional large variable in my mind makes subjective evaluations of equipment of very limited value. I don't say none.
I looked at ASR years ago and gave up because they were too subjective at that time, or made some assumptions about sound without requiring any real proof for those beliefs. I don't now recall specifics but one belief I believe to be wrong is the idea that noise and distortion can be below a threshold and further improvements will be inaudible. Bryston has shown that as of a few years ago, we had not reached any such level.
I want to be clear that I had to make the journey from believing The Absolute Sound as a subscriber from its inception, to what I espouse today, so I have no sense of superiority to anyone who thinks that listening tests are the most meaningful way to evaluate audio gear. If you're happy to disagree, that's good and if you're motivated to investigate the issues I've raised, I think that's even better.
