I am a bit biased on this topic, but I do feel that an aftermarket, linear power supply will help out a great deal.
The switching power supply that comes with the DUET system does inject high frequency noise into both the AC line and the DC line feeding the Receiver. This high frequency noise will ride on the DC and carry through on the voltage supplying the digital output section.
To my ears and on my system, changing to a linear power supply reduces the hash or harshness from the digital output. There are some comments about this in my circle here on AC.
Duet ModsDusty's power supply (Channel Islands Audio VDC 9.0) is very good sounding for the money. Tyson now has the one Dusty sent me for evaluation. He will be comparing it to a much more expensive one that I built him. You may want to keep an eye on this thread
Initial thoughts on the modded Duet for his and other comments on mods and power supplies.
I do agree with you 100% about the remote.

I just love it. Now that Rhapsody is streaming at 192 kbs, I am finding LOTs of music and it sounds pretty darn good. Check out the Crazy for Covers channel.