For amp building, you are mostly going to be checking DC voltages and continuity, so what you have is fine. Bias currents are typically measured through a sense resistor, and kit may only be listing the voltages at those test points anyway.
If you are using it to debug or test the output of an amplifier (e.g. checking the gain of the amplifier), you will be testing an AC signal. This is possible with a multimeter, but you just need to make sure your test signal is a low frequency sine wave, like 60 Hz.