Hi Jad,
When you are playing music, there is definitely voltage (a signal) on the output and your voltmeter set to measure DC volts is going to see it, but what you are reading is NOT dc offset.
What happens when you pause the music but keep your iPod ON? Use the millivolt setting....it should be very, very close to 0mV.
With coupling caps on the output of your iPod, dc offset will be blocked so I wouldn't worry about it...
Best regards,