I bought a Foxcon barebones R10-D4 Atom computer on Amazon. It was $120 plus $30 for 2 GB memory and I used an existing hard drive. In my case, I'm running Vortexbox software (Linux based which includes a player) but you could certainly install MS Windows if you wish. It has plenty of USB outputs and an open PCI slot if you want to go the soundcard route.
In short, very flexible. It runs 24/7 without a hiccup. It does have a fan, but it's very quiet (and I don't keep the PC in the listening room anyway) and it's very low-energy use. The case is quite small and goes either horizontal or vertical.
I'd suggest taking a look.
(PS, I've had a Touch for over 2 years and never had a problem. I also have a SB3 and had a SliMP3 prior to that, going back about 10 years, and never had a problem with their stuff. I follow the slimdevices forum closely and the only consistent problems I've heard of involved those who insisted on using the Touch as a stand-alone device with its internal server, directly using an external USB drive. Sorry you had issues.)