Yeah, since just because something is easily dealt with or worked around, it's okay to ban it anyway.
You're approaching this from the entirely wrong angle. The argument should never be why not to ban X, but always why should X be banned. Not simply because the burden is always on the one seeking to change the status quo, but because philosophically, people should have the right to anything they desire, unless there are clear and significant reasons against that.