EDM,
I apologize for my slow response to this. I have been out of sorts for the past few days following a minor surgery that will provide complete cessation of population growth in the Ellis family

I do think it will be very difficult to obtain such a wide piece of quartersawn walnut. The tree would have to be extremely large. Such trees are become quite rare, and the good ones are purchased by gun companies.
I do recommend edge-bonding 2-3 pieces of lumber for the baffle. I think that all of my speakers have been done this way. The only possible way to error is by making the cuts and grain pattern non-symmetrical for the left and right baffle.
Also, I really don't see any problem using flat-sawn lumber across this distance. If the lumber is well-sealed there will be very little moisture related movement. For this reason, I generally apply some shellace ( a great vapor barrier) to the inside of my driver cutout.