I used a few DVD players from thrift stores that didn't last too long. Then an old ADCOM that was definitely better. (I put in a few better caps n stuff that helped too, but it was always better). CD players are better for CD playback until you get something like a Cambridge Audio player or something.
Here's the bonus to the situation. I was using a Peter Daniel's DAC (premium, there are few considered better at any price). That with power conditioning still made the music superb in quality of sound, while lacking resolution. It was very enjoyable to listen too, but a better transport would have added a lot information. My point being that for enjoyment I recommend a DAC you prefer, even more than a transport. If they are one in the same that's great. Upgrading transport is always good, but listen-ability is the big key.