Jeff, I would advise against using a router freehand. If the bit chatches the side of the recess, it would not only gouge it, but might pull the router out of control for a split second and cause some ugly damage. Only use a router if you go to the trouble to make a template - route a hole in a large piece of MDF and use a bit with a bearing. Make that hole larger than the tweeter recess O.D. - how much larger depends on your router bit diameter. My advice is to scrape and sand until you sink the recess sufficiently. Take a piece of say, 3/4" diameter dowel, glue a disc of 60- or 80- grit sandpaper to the end, then go round and round the bottom of the recess. Replace the sandpaper disc, and keep going until you've got your depth correct. A bit tedious, but it will work.