Although loudspeakers are the most important component, the room must be kept in mind first and foremost. Pick (or better yet design) and room that is neither small or squarish and is well insulated. Having a dedicated room is another big plus.
Recommend reading Floyd Toole's "Sound Reproduction" (either edition). Toole is a very well respected acoustician.