So I have been working on this for a few days now, starting out with just the NX-Otica's in the room. After going through some tracks, the speakers ended up mostly in the same position I had them previously, about 4ft from the front wall, 5.5ft apart, and the LP about 3ft from the back wall. Pulling the speakers in the room farther (to about 55") yielded a better soundstage but caused a bump around 200hz which muddied the sound. At least at this point I have a general area to move the speakers and LP to get it dialed in even more, but I would like to get the two main subs set correctly before fine tuning.
After bringing the subs back into the room, I tried moving them around (even flipping them around) in the general area they currently reside and did some sweeps in REW. The results were mostly the same, with a large dip around 60hz. I ended up leaving the subs about 40" from the front wall (wall to baffle), I also moved them closer to the outside wall, which helped clean up some muddiness I was hearing having the sub cabinets too close to the NX-Oticas. What did make a difference is the LP, having the LP 1ft from the back wall yielded a smoother response below 80hz, but choppier between 80 and 150. Having the LP 3ft from the back wall was the opposite. My final LP will likely fall between one and three feet from the back wall.

Next step is to dial in the subs with the mains, below is my current status with no integrating done. I'm not sure what smoothing should be done to determine the -3db point, or what steps to take from here.
Plate Amp Settings:
PEQ off
Phase: 0
Volume: 12 oclock
Crossover: 80hz
Line In/Low Pass: AVR/12
Rumble Filter: Off
Extension Filter: 14/High Damping


The Rythmik L12's are here, but I am not going to break them out until this is dialed in.