So if one were to take one of these pretty little boxes and plug it after an Ultravalve, you would be able to use the Ultravalve as a headphone amp. Nice.
Now, again, what was it that was wrong about swapping speaker connections with the amps live...

Ok, one thing, for sure, the sudden rush of voltage in a jiggly fashion as you manipulate the live wires in there.
Ok, for another thing, if your grip on the wires slips, it can be pretty bad for your amps, or even your own body. These amps are pretty powerful little boxes, and they're plugged right into the wall socket.
But that thing about the headphone amp is the pearl inside the pretty oyster. It is yet another excuse to buy some excellent conventional headphones.