I went to the Tampa, Fl area to drop off a subwoofer sold on eBay and stopped at the Bananas record warehouse in St. Pete--http://www.musicfinder.com
The most vinyl I've ever seen in one place: for instance, I wanted a clean copy of David Crosby's "If Only I Could remember My Name" and found maybe 15 copies. I stumbled onto a mint copy with a somewhat "slick" cover (compared to the domestic covers I've seen before) that turns out to be an import. I bought it for $12 (you can see these are collector prices, not thrift stores bargains--though I did get a few LP's like Joan Armatrading for $3 ea.
But there's so much there it's overwhelming. I actually felt more comfortable at my "usual" store--less total LP's but easier to look through.
I ended up finding more in the store that had less.