Blind Test: mp3 vs. 24bit

0 Members and 1 Guest are viewing this topic. Read 1733 times.

jonson3459

  • Jr. Member
  • Posts: 3
Blind Test: mp3 vs. 24bit
« on: 5 Oct 2021, 01:54 am »
Hello Audio Circle Members~
What a pleasure to meet you all! I am an avid music lover and an audio enthusiast. I also write for a audio/music magazine called PMA. PMA magazine is conducting a study to see if we can hear which is better between an mp3 and a 24/96 file in a side-by-side comparison. So far, the results are surprising. Right now the sample size is still small so, if we all participate, we’ll know the truth. It’s also a fun test. Please go to the page below to participate:

https://www.pmamedia.org/en/home/can-you-hear-the-difference


DannyBadorine

  • Full Member
  • Posts: 376
Re: Blind Test: mp3 vs. 24bit
« Reply #1 on: 7 Oct 2021, 05:37 pm »
I have submitted my results.  I'm confident with the Vivaldi and Patrician Barber tracks but the Sabbath song was more difficult to tell than I expected.

Norman Tracy

Re: Blind Test: mp3 vs. 24bit
« Reply #2 on: 7 Oct 2021, 06:10 pm »
Sees post title including "Blind Test..." from new member with 3 posts.

Immediate reaction "oh no not again, flame war incoming, prepare for AudioCircle signal to noise ratio reduction".  :duh:

mcmusicman

Re: Blind Test: mp3 vs. 24bit
« Reply #3 on: 7 Oct 2021, 06:19 pm »
File too large for AV scan with Kaspersky.

DannyBadorine

  • Full Member
  • Posts: 376
Re: Blind Test: mp3 vs. 24bit
« Reply #4 on: 7 Oct 2021, 06:33 pm »
Sees post title including "Blind Test..." from new member with 3 posts.

Immediate reaction "oh no not again, flame war incoming, prepare for AudioCircle signal to noise ratio reduction".  :duh:

Hahahahaha!! C'mon Norm.  Take the test!! It was much more difficult than I thought it would be and I still don't know the actual results.

Rusty Jefferson

  • Full Member
  • Posts: 873
Re: Blind Test: mp3 vs. 24bit
« Reply #5 on: 7 Oct 2021, 07:03 pm »
Red Herring. It doesn't say where the 24/96 tracks originated. Upsampling 16/44 to 24/96 is not Hi-Res. If they started with 24/96 original files recorded digitally and made an mp3 copy of that file, it's quite easy for even untrained listeners to hear the difference. 

I.Greyhound Fan

Re: Blind Test: mp3 vs. 24bit
« Reply #6 on: 7 Oct 2021, 11:09 pm »
No point in me taking the test.  In my stereo I can easily hear the difference between an MP3 recording and the same recording that was recorded in Hi-Rez.  MP3 is flat, dull and lifeless although some MP3 recordings are better than others.

DannyBadorine

  • Full Member
  • Posts: 376
Re: Blind Test: mp3 vs. 24bit
« Reply #7 on: 7 Oct 2021, 11:27 pm »
Red Herring. It doesn't say where the 24/96 tracks originated. Upsampling 16/44 to 24/96 is not Hi-Res. If they started with 24/96 original files recorded digitally and made an mp3 copy of that file, it's quite easy for even untrained listeners to hear the difference.

I totally agree.  I took the test.  The Sabbath songs sound pretty much identical to me.  I'm not home to hear it on my hifi system but I listened on expensive in-ear monitors that should tell me the difference.  The last two tracks showed a little bit of difference, but normally when I compare MP3's with 96k/24bit it's pretty easy to hear the difference.  The differences weren't very clear so I'm wondering how they ended up at 96k/24 bit.  The Sabbath stuff was definitely recorded to tape originally so did they take the tape to 96k/24 bit?  Unlikely. Which means they upsampled the CD 44.1k/16 bit to 96k/24 bit.  That is far from being the same. 

FullRangeMan

  • Volunteer
  • Posts: 19908
  • To whom more was given more will be required.
    • Never go to a psychiatrist, adopt a straycat or dog. On the street they live only two years average.
Re: Blind Test: mp3 vs. 24bit
« Reply #8 on: 8 Oct 2021, 12:04 am »
Currently Iam working with outdoor MP3 files on HD, it barely works as a media, Its not possible to understand the words when there are vehicles passing by on the road. Definitely its a depressing test, linear PCM 24/44 its much better than MP3.

Onadifferentnote

  • Jr. Member
  • Posts: 38
Re: Blind Test: mp3 vs. 24bit
« Reply #9 on: 8 Oct 2021, 02:28 am »
I have a friend in the California Guitar Trio, in a recent album, he gave me four different files of the same song.  16/44, 24/96, 24/192, and 32/192.  He wondered if I could the difference in my system. My daughter played them in random order, 3 different times. 

Each time I chose the better file. Why?  My system has a high level of resolution and I have a trained ear.  If recorded correctly, I always prefer the higher resolution files which tends to have more air around the notes, more natural timbre, etc.
The notes just ring longer, more naturally.

When I hear people can't hear the difference, it does surprise me.
Cheers!
 

Norman Tracy

Re: Blind Test: mp3 vs. 24bit
« Reply #10 on: 8 Oct 2021, 09:24 pm »
Hahahahaha!! C'mon Norm.  Take the test!! It was much more difficult than I thought it would be and I still don't know the actual results.

OK, I downloaded the files and listened. With clenched teeth in the case of the Black Sabbath. Not my cup of tea and they had to pick the most overplayed FM Rock song in the BS catalog? At least Ozzie could still form English words when it was recorded. I listened on Win10 workstation's sound card via Fostex T-50RP headphones.

I listened A/B'ing both the full minute of each selection and also little sections that contained interesting sonic details. It’s been a few years since I knowingly listened to MP3s and it is impressive how close they are. After getting reacquainted with the sound I zeroed in on the fine detail of instrumental texture and the nature of sibilance and notes’ trailing off sounds. For each of the three I wrote down which I thought was the MP3 based on a slight coarsening effect heard in the three areas mentioned. I was 100% correct in identifying high-res vs. MP3.

I know my identifications were correct because after I wrote down my listening results I loaded all six files into Adobe Audition. Using Audition’s Frequency Analysis display set to Linear View 0 – 48k Hz it’s immediately apparent the MP3 by the brick wall filter cutting off everything above 21k Hz and the occasional complete drop outs between 15k to 20k when the MP3 algorithm decides that band can be discarded for awhile to save bits. While in Audition I also noted the Black Sabbath cut was taken from CD as both tracks frequency band cutoff above ~22k Hz. The ‘hi-res’ BS rolled off slightly more gently vs. the MP3. The Patricia Barber and Vivaldi were both sourced from true 96k or greater sources. Those two high-res tracks have the characteristic mostly noise with occasional (or nearly constant in the case of the Vivaldi) musically correlated signal in the 20k to 48k band. And in the case of the Barber a constant noise peak 22.7k Hz at -72 dB. I think every studio has a video monitor or SMPS buzzing along at ultrasonic frequencies. Well, not all, the Vivaldi was just music up there. It is interesting how much energy from musical overtones there are in string instruments in the 20k to 40k Hz band.

I also checked the levels of the A vs B samples and they did get those matched to within a few tenths of a dB for each of the three pairs.

DannyBadorine

  • Full Member
  • Posts: 376
Re: Blind Test: mp3 vs. 24bit
« Reply #11 on: 10 Oct 2021, 04:34 am »
That is excellent!

Letitroll98

  • Volunteer
  • Posts: 5613
  • Too loud is just right
Re: Blind Test: mp3 vs. 24bit
« Reply #12 on: 10 Oct 2021, 05:16 am »
Excellent post Norman, most helpful work that I've seen in a while on these pages, and we've got some great posters here.  Because no one's losing any money here I'll assume the op is sincere.  Is it possible that the differing recording chains might be on purpose?   Wouldn't one learn more by comparing various lower res chains upsampled to 96k as well as native 96k files to MP3?  And everyone seems to have a universal reaction that the files Norman id'd as low res weren't much different than MP3, and the native hi res files were easy to pick out.  And that tracks well with non blind comparisons, the issue now appears settled.

RDavidson

  • Full Member
  • Posts: 2863
Re: Blind Test: mp3 vs. 24bit
« Reply #13 on: 10 Oct 2021, 05:29 am »
No point in me taking the test.  In my stereo I can easily hear the difference between an MP3 recording and the same recording that was recorded in Hi-Rez.  MP3 is flat, dull and lifeless although some MP3 recordings are better than others.

Yep. Nail on the head. Sometimes the difference is obvious. Sometimes it is less so.

At the end of the day, who the hell even cares? We have the ability to stream and download hi res much more easily than we could 20 years ago. It cannot be argued that hi res isn't technically better than mp3, so why even debate? This is a waste of progress. Sorry, but I hate mp3's (well...all lossy formats in general) and just want them to go die finally. They had their place and purpose and have run their course. I want better and I want everyone, whether they know it or not, to also listen to better. :D

FullRangeMan

  • Volunteer
  • Posts: 19908
  • To whom more was given more will be required.
    • Never go to a psychiatrist, adopt a straycat or dog. On the street they live only two years average.
Re: Blind Test: mp3 vs. 24bit
« Reply #14 on: 10 Oct 2021, 06:13 am »
Well, one of the problem with MP3 low sound quality is that the weaker sounds are removed by the compression algorithm, while with linear PCM this does not happen even with low res PCM.

This makes MP3 unsuited to hi-fi only to cell phones audio, these people will not even notice the difference because they have never heard a tube amp, DSD or 24/192.

Tom Bombadil

  • Jr. Member
  • Posts: 246
Re: Blind Test: mp3 vs. 24bit
« Reply #15 on: 10 Oct 2021, 07:24 pm »
I recently read a post from an owner of a PS Audio Directstream DAC, which upsamples all audio formats into DSD256.  He hadn't listen to MP3 for a while but wanted to compare after getting a software upgrade.  He wrote that he was very surprised by how good the Spotify 320K MP3 track sounded.   Upon close listening in his system he could hear differences but he expected the differences to be immediate and very obvious. 

The Directstream DAC was once the Stereophile Product of the Year and was listed on their A+ Recommended list.  It is now better than it was at that time due to software upgrades. 

Kw6

  • Full Member
  • Posts: 471
Re: Blind Test: mp3 vs. 24bit
« Reply #16 on: 20 Mar 2022, 05:13 pm »
I tried Tidal,  Deezer, Amazon HD and decided to stick with Spotify  for it's  ease of use  and their large international  music content! :)