I mean ..... what's the point of having the mic attached to your mouth right? Removing it makes your head more mobile so you can execute your dance better anyways.
And if you are using a handheld mic and lip-sycning, it interferes with the movement of your arms anyways so might as well not carry the hand held mic.