Yes, as the amplifier or interface is powering up it may disrupt the positive or negative rails as it turns on. A small click or pop from the amp is normal. If you are plugged into a PA system do not power up or down your product while plugged in. Mute the channel.
Pro tip: Did you know that by gently pulling out your 1/4" input cable that it automatically mutes the input signal?