Both the AES/EBU and the Coax digital outputs can handle up to 192/24 files. The choice depends on the DAC you're using. Coax input on a DAC is more common than AES/EBU, and which one sounds the best (if either has an advantage) is DAC dependent.
In my experience, the BNC Coax output will sound better than the RCA Coax output, but that's probably not universally true.
The cables do make a difference, even if one would like to believe that they don't.