Honestly, after the 70's, most of arraus stuff isn't worth hearing, IMO as his technique and conceptions just got slower. Since I have what I consider "straight" intrepretations as my foundation of most of my collection, I now like to collect CD's that have a definite "interpretation", I find that helps shed even more light on to a piece.
For me, Jochum is THE brahms conductor, I like his brahms even better than the bruckner he is so famous for. If you get a chance, his traversal of the Brahms symphonies on EMI is still unsurpasses by anything I've heard (including Walter, Karajan, Tosconini, Szell). Sorry about the rambling, few conductors inspire a lot of passion from me, but Jochum's Brahms is definitely in that category.
I will have to re-listen to the Fleisher w/your comments in mind. For me Brahms has always been emotion first, structure second (unlike, say, Beethoven), but I've never conciously listened to Brahms from a more structural frame of mind. I'll give it a whirl and see what I think. . .