I would remove the socket and solder the adapter in. This means there is a proper solder joint instead of a push in joint.
I have both types of adapter, for the surface mount opamp and the one with legs, and both have round cross section legs so I think they are not meant to be pushed into a opamp socket as these are designed for flat wide legs not thin round ones.
Though, looking at the picture above and remebering you can specify the type of leg cant you? Either way I'd remove the socket.
I did a thorough mod to a Cambridge Audio Azur 640P phonostage and posted it on Vinyl Engine a year or two ago and I and others noted the improvements to be had from good quality opamps and resistors for that matter.