Hey!
Welcome to Audio Circle. Which part of NYC are you at? I'm in Queens here.
Vinyl rabbit hole? Talk about vinyl, during the lock down stuck in my apartment don't know when I'd return to work or ever, I bought a few LPs through internet of course... it was the only luxury thing I spent whatever money I could spare on and that I have to say that kept me sane during the lock down. Anyway, there are quite a few places that vinyl records in NYC. I was just at the Barnes & Noble in Union Sq yesterday and surprisingly they have a pretty good selection of new releases there also.
Buddy