Yes, you can swap the drivers in an out from one another.
For audiophile applications the lighter weight paper based cone will sound better and have a more natural sound. The paper cone version is also better for playing up into higher ranges. If you are beating on it to near X-max with action movies then the aluminum cone might suit your needs better.