As for me (and it's always about me isn't it?), you can't beat digging through the dreck at Goodwill. Both vinyl and CD's. If you leave with a couple or three choices you're only out $6 bucks max.
Looking quickly, here's some of the "cream" I've pulled from Goodwill in the last few years.....all on vinyl and VERY clean...
Miles - Milestones orig mono $1
Louis Armstrong plays WC Handy orig mono $1
Freddie Hubbard - Red Clay $1
The Best of Blue Note box set $6
James Cotton - 100% Cotton $1
And the list goes on with Zepplin, The Who, Joe Cocker, The Rascals, War, Paul Simon, Average White Band, CSNY, Grand Funk, Etta James, Robben Ford, Eddie "Cleanhead" Vinson, and etc, etc...including a couple of Riverside mono's, a few Nautilus, Crystal Clear, Shaded dogs and a Dinah Washington Mercury to die for.
If you want "new music" it's $10 - $20 bucks a CD. If you like the old stuff it's almost free at your local Goodwill. YMMV, but my mileage in this regard rocks!
Listen, share and enjoy.
OTL