Perhaps a bit late to this thread, but jeez, if a technically poor recording contains music I really love, I can enjoy it on my highest end system, or my car system, or on my el cheapo computer speakers.
Believe me, I'm not trying to sound "holier than thou" as at one time (when I was much younger) I shared OP's frustrations (back in my vinyl days I remember telling a friend that one of the greatest burdens to bear in my life was inner-groove distortion! He had a good laugh).
But as I mellowed out in life, I learned when to care about the sound and when not to care about it. And if caring too much about sound quality would keep me from listening to music I love, then I know exactly what choice to make. There's some awfully wonderful music on those mono reissues of stuff recorded back in the 40's.
For some, as has been suggested, the best solution may be to avoid listening to poor recordings on your good system, but instead listen to them on a low resolution, limited bandwidth system. For me, I have no trouble listening to them on a good system.
But admittedly, having a great recording of great music playing on a great high-end system is still mesmerizing and thrilling.