The origin of the noise is the original recording, or the subsequent manipulation thereof by the mastering engineer. This is the pitfall of getting a high resolution system. The question is, are you getting increased enjoyment of the music(getting closer to the emotion and intent of the musician(s))? If not, then maybe a high resolution system is not the best match for your taste. It has been my experience that the higher the resolution of the system, the more satisfaction I derive from the music despite the limitations of the source recording.