I agree completely!  No one can afford to own every recording.  You have to choose how you want to spend your money.  For me, I begin with the performance and how the conductor organizes his orchestra.  I rely on reviews, especially over at HRAudio.Net.  I tag all my music files with extra information.  First, the venue.  For instance, the Barbican in London is notorious for poor acoustics.  Next, I look at the Sound Engineering team.  Soundmirror from Boston does most of Reference Recordings engineering.  They are superb!  Finally, I listen to the music several times and assign a star rating (5 stars is best).  Most on line vendors, like Native DSD, allow me to sample tracks.
I recently signed up for Amazon HD music.  It's a bit tricky to set it up for full HiRez sound (24/192).  But, it can be done.  Most all albums I am interested in, especially jazz & blues, I can find and play.
Can't wait to find out how well the X3s play my library of music.
Marcus