For music that was engineered for multi-channel playback, the recording engineers would have monitored the music using a traditional 5.1 speaker setup. The multi-channel recording will only sound "correct" when your speakers are in the traditional positions.
You can move the speakers around as much as you want and if it produces a sound that you like, go for it. However, it will never sound "as intended" unless the speakers are in relatively the same position as the recording engineers intended.
Enjoy,
TIC