The AVR must have pre-outs. Plug the Front Left and Right AVR pre-outs into a pair of line inputs on the two channel preamp. You can set the AVR's Front Left and Right levels to 0 in the AVR setup. Then find the position of the preamp's volume control where the fronts are level matched to the center and rears, either with internal test tones or a setup disk. Mark that position on the preamp's volume control for reference. If the preamp has a digital volume readout, then you will use that number.
When you want to listen to the HT, select that input on the preamp and return the volume control to that calibrated level. The disadvantage of not having an HT Bypass input is that the signal will be going through an extra volume control and other preamp circuitry, so it won't be as pure as it could be, and of course you have to set the preamp volume control each time.
Steve