I am concerned that there may be some confusion over the term "bypass" as used in this thread. I use the term (in this context) to refer to multiple capacitors wired in parallel
in the same physical location, or nearly so. The purpose of this (at least within the realm of high-end audio) is to create a single, conjugate capacitor that outperforms ("sounds better than") any single cap in the same application. The mix of caps is usually arrived at through a series of listening evaluations, so the process is mainly subjective.
On the other hand, stable circuit design often demands the use of "decoupling" caps located as close as possible to the circuit elements they are helping to stabilize. These caps are often referred to as "local bypass" caps, and they are electrically in parallel with the main power supply caps. While these may be considered "bypass" caps, they do not really fall into the category being discussed in this thread. Of course, these local bypass caps may themselves be bypassed, but I digress....

I design fairly wideband preamps and amps, and they are stable without the need for zobel loading networks. I could remove all of the bypass caps in any of my designs and they would continue to operate perfectly. I would not, however, consider removing the local decoupling caps.
Steve McCormack
designer, SMc Audio, McCormack Audio
www.SMcAudio.com