Tony,
Ah, that's the problem? Perhaps you have too much gain!
Try this:
Signal source to 33K resistor, then to top of pot.
Wiper of pot now goes to ground.
Signal is taken from the join of the 33K resistor and the top of the pot.
Wire both gangs of the pot up for both channels; one gang per channel.
You may have to establish which is the 'top' of the pot empirically, so that turning up the wick in the usual way increases rather than decreases the volume.
This is a shunt volume control. At max setting the attenuation will be down to (50/33+50) or around 60% of input signal, and input impedance will vary from around 75K down to around 25K (which is no bad thing if you preamp/source has an output impedance below about 3K) but it will reduce the loudness handily and pay dividends in clarity.
Cheers,
Hugh