Ben, I'm probably anal in this way, but I like to have drivers on hand and essentially mock things up as I go then dissemble and finish. That being said, if I finished boxes before I had drivers, I'd still wait to drill pilots. This is where the repeatability of CNC in a real luxury but, well, an expensive one too.