The thing is, what is the definition of violence ?
Do you mean violence, or aggression (initiation of violence) ?
We use violence in defense of us or others. But initiation of violence is not moral. The thing is that is so hard to define or judge. Wars are always triggered by mutual provocations.
The definition of violence or aggression is linked with the definition of an individual and the definition of property, in the sense that to unjustifiably harm one's body or take one's property is considered aggression by most if not all cultures. But property has become a complex, historical thing that dates back to the property of land in the middle ages.
More than that, there is graduation in the use of violence. You can contain (i.e. use force against) someone who is perpetrating aggression (to be proven), but only with proportional force, not abusive nor uncontrolled force.
What I am trying to say is. There are so many questions that need to be answered before you can honestly say " I'm a anarcho-********* ". And people can and should band together according the their type of answer, provided there isn't also no aggression between such groups.
I still believe there is nothing wrong with all the different colours of anarchism and we all can get along.