I've had this problem as well, but I'm using a TADAC.
I've tried several different airport expresses, all exhibit this problem. From what I can tell, it seems to be very sensitive to signal quality from my time capsule to the express. I've tried several different configurations from within the airport utility with little changes. If everybody is home and we have several wireless connections, the problem is worse. Right now I'm the only person here, and have been listening for over 3 hours with no dropouts.