If you want to get into Classical music, there are plenty of classical recordings on youtube. With a decent set of headphones, it's accessible. Browse conductors and compositions. If you don't like it, move on to another one.
Also check with an Orchestra near you and see what their schedule is.
Here, on dress rehearsals, if the guest artist is okay with it, we allow visitors to come in and listen for 5 bucks a head. You can wear anything. Now, since it's a dress rehearsal, we might stop and go back and work on something. Usually, we run the concert set straight through and revisit some critical sections at the end. Rehearsals here are 2 and a half hours long.
Most orchestra's will play works written in the past 300 - 350 years or so. Beethoven's middle period was from around 1803 to 1814. I generally don't listen to anything earlier than that. His 5th and 6th Symphonies are 2 of my favorites.
Check the website of an Orchestra that's located close to you and you might get lucky on seat discounts or special access during rehearsals. You should also be able to find out what the Program is for those concerts and you can preview those works on youtube if you don't want to spend the money for hard copies of the works. Most Orchestra's have support organizations that help raise money. That's another good way to support the arts.
One of the engineers I work with has gotten to his early 50's and is now interested in Classical music, so I've been sending him youtube links of a bunch of different kinds of musical works to figure out where he resides on the Classical music landscape.
As always, trust your ears and listen to what moves you
HsvHeelFan