Welcome from Michigan!
There's never been a better time to find good sound at affordable prices. Just check out the Cheap and Cheerful circle for ideas. Vinyl is the more hobbyist approach but digital streaming is the more convenient and less expensive route. For $20/month or less you can have access to millions of albums anywhere in the world that's within internet range. I'm a fan of active speakers (low voltage input, crossover feeds one channel of amplification per driver for superior performance). With actives and streaming, you just need to add a DAC/preamp and your system can be complete.
Am also a fan of sorting out the listening room. Pick a room that's not tiny or squarish, hopefully well insulated and dedicated to listening. Suggest reading Floyd Toole's "Sound Reproduction" 3rd edition as the consummate audiophile guide for how speakers behave in-room.