Nothing in audio is cut and dry. There is great equipment on the market or diy built with feedback that sounds simply amazing, and equipment without feedback that doesn't. It's like everything else, how it's implemented, how speakers react to the load, etc.
If you only use amplifiers without feedback (generally low power and with high output impedance), you will also have to use a very limited variety of speakers that will play nice with them, and that's fine. This is one of the places where audio moves into a philosophical discussion about following a particular path to audio Nirvana. Like all discussions about finding Nirvana, there's many directions people are traveling from to arrive there.