This is all amp and tube dependent. I wait at least 10-15 seconds before I swap tubes, but some tubes really need to be in the upright position all the time, i.e. Svetlana 300B, which has filaments that tend to warp under heat and cause shorts.
Some dictate that tubes need to be cooled down before swapping, but heck, we're trying to do A-B comparisons here.