Aha! You bring up a good point. The headphone output is NOT isolated. That's fine for headphones, but not if you use it as an analog feed into your system. In such a case, the computer and audio ground get connected. That is not always bad, just sometimes.
jh