But perhaps you can give me a good reason other wise.
The same argument has been made about carrying a gun. It's as wrong for that as it is for what you are suggesting. The answer to why one needs to wear a mask is, "I'll wear one if I want to, and not if I don't, and beyond that it's none of your fukking business."
That's the freedom we are assured in the Constitution.
When they harm others, they have crossed the line to being criminals who need to be prosecuted. I fully agree the mayors and/or police who do not do their duty with respect to these folks once they become harmful to the public are aiding and abetting, and should be equally prosecuted for that.
But, freedom requires personal responsibility for actions, not restrictions on people doing something that "might" be a bad thing, or that someone else can't justify as a reasonable thing to do, like carry a gun or wear a mask in public.
I fully support any store or home that wants to stop people from entering wearing a mask or carrying a gun to the same level I support the people who want to wear a gun or a mask - it's freedom on both sides, and completely acceptable.