Based on my experience with detailing cars, any cleaning cloth/rag made from COTTON will scratch the finish and leave swirl marks.
Use a microfiber towel for dusting and cleaning. A common detailing trick is to fold the microfiber towel into quarters and then wipe the towel on the surface in one direction only (no back and forth and no circles). After each wipe, turn the towel to the next clean face and continue until you are done. Use as many towels as you need. You can use a detailing solution made from Optimum No Rinse to help encapsulate the dirt and prevent scratching.
Do NOT wash microfiber towels together with cotton garments. The cotton fibers get stuck in the microfiber and will cause scratching.
http://www.amazon.com/32oz-Optimum-Rinse-Wash-Shine/dp/B000E9TS6OThere is a reason that I don't own a BLACK car. ; )
P.S. For removing scratches from automotive clearcoat finishes the general rule is to try the least abrasive method first and if that doesn't work then you go to the next level of abrasion.
Polishes that can be applied by hand or by your PC (from least abrasive to most)
Meguiers 205 (a finishing polish)
Meguiers Ultimate Compound
Meguiers 105 (Ultra-cut Compound)