Hello!

I know absolutely nothing about vinyl or turntables... Could you help me in finding my first record player, and in answering a number of newbie-type questions I've got?
Thanks! I knew I could count on you, internetstrangersfromwhomItakewhilegivi
ngnothinginreturn.

I'd like to get into the "bottom-end of the sweet spot", with my first turntable purchase. Nothing that's more than a few hundred US dollars, if possible - but that's still ever-so-slightly more-than-good-enough to show me what the magic of vinyl is all about. Can you make some recommendations? Are there any good sources for refurbished models? Is the stylus the most important part of the turntable? Are all stylus compatible with all tonearms/turntables? Should I upgrade my stylus right away - how much difference does it make?
Once I've got one, what do I need to integrate into my system? Ideally, I'd like to be able to just plug it straight into my headphone amp (my headphone amp has RCA inputs). Is this possible? I looked at my father's turntable and on its RCA outputs it has an additional wire - the "GROUND" wire. What is this about? Does this mean I can't use the turntable with my headphone amp?
I also listened to my father's turntable. I chose a record that looked perfectly clean, free of dust or particles - yet when I played it, there were still pops and clicks. Is this normal? Was this because he has a particularly old/cheap turntable?
Finally, what are some good ways to build my record collection? I love avant-garde, classical, and experimental/historical Eastern European (Eisler, Weil, Shostakovich, etc.), but also plenty of more mainstream stuff like soundtracks to films (of the whole 20th century, from early to late). I searched for a few titles I was interested in, and was dismayed to see that they are rare/expensive...I feel like I'm in a race against deterioration/collectors to get the music I want before it's all gone! How should I go about collecting the titles I want before they disappear? What are good sources from which to buy, besides the obvious eBay?
Thank you so much for your help!!!!