You can always find good and bad examples of each. Suggest you read up on why recording professionals go active. The professionals have no tolerance for "entertaining" colorations that audiophiles seem to crave, they work to find the truth. Frankly I'm amazed that active speakers like JBL 305's sound as good as they do based on size and cost.
Getting back to efficiency versus size of amp. I've found that low efficiency means poor dynamics, lots of distortion, ultimate sound pressure levels and high efficiency translates into all sorts of sonic anomalies. In my experience 90 - 95 dB/w/m at 8 ohms is the ideal compromise at realistic pricing (assuming those are honest real world values).
The grip an amp has on the speakers is more than just numbers on paper. It's a matter of control. Resolution of detail improves if you move from barely adequate to plenty of power and control can improve. Thankfully we live in the age of class D where power is extremely cheap.
Again, this is overstating the effects of active speakers. Whilst I agree they provide some advantages, they are not the nirvana some people hold them out to be. I'll stand by the assertion that many of the best sounding speakers available are passive, and one needs to provide them with proper amplification to drive them.
Case in point: Anyone who has listened to a higher powered Devialet system using the mono configuration driving a quality large floor standing set of speakers will attest that it is among the best sound available at any price point. Further enhancement can be achieved if the speaker is supported by the Speaker Active Matching (SAM) application.
Class D does provide good value for watts vs dollar. Having said that, many of them just don't quite get the treble as well sounding as more traditional amps. This is due to the inherent design issues with Class D. Granted, they have come a long way, and will likely continue to get better.