Nope. If anything happens to your speaker, or if you're looking to experiment and try something new, you are perfectly fine to swap the speaker out of your amp.
Do note, however, speakers are only covered ninety (90) days under warranty. Please review our Warranty Policy for more info.