No, you should not use both inputs at the same time. Most amps wire these two inputs together internally, so if you connect two sources, you will be shorting two outputs together. This will probably not damage the output drivers, but will likely affect the sound quality. If the drivers are both low-impedance, such as 10 ohms, then damage could result.
