makes us seem intolerant at best and capricious at worst

I don't know if I'd say one is "best" and the other "worst"; but it's hardly debatable that we are indeed both. These are the consequences of having not rigorously defined policies and rules and rather letting the community decide for itself what it tolerates or not, and the makeup of the community being in a constant state of flux over time.