I had 3.6 Mapnepan for 8 years. Now I own 20.7 Maggies. IMO having a speaker next to the side of a pair of dipoles should not be much of a problem (IF the second speakers are on the outside)
If the second pair are on the inside I would think you would notice.
No solid evidence for or against. just my opinion.
I own an old pair of small, narrow, but tall speakers (Canton CD300) I never use, yet they are around. No problem. ne is next to the window with a bird playground in it. The other tucked in a 'corner' next to the shelving actually in the corner. No problem in my mind with either.