Between all the components that make up a stereo system, the Speakers and amplification are the first place you should start. Not all amps and speaker combos work well together.
After you have an amp and speakers you like, source components won't change the synergy between the amplification and the speakers.
Listen to a few different types of speakers, and setups. If you like Magnapans, you will need a hefty amp to drive them, they like power to sound right. If you audition and like tubes and want to go that route, you might explore more efficient speakers that require less watts to sound good.
Your listening habits, what kind of music you play and how loud you like to play it, how big of a room you have and your budget will all be deciding factors.
That book will help you to determine where to put the dollars.
Good luck in your quest.
tb
The Complete Guide to High-End Audio
This does look like a really good book! 
The link also has sample pages that shows the contents inside.
I would always pick the speakers I like first because knowing their characteristics first would make it easier to pick upstream gear.
I would think this could leave you endlessly trying to match components to make your speakers sound good .
