If I force adults to cross the road only at pedestrian crossings, how does that harm them?
- loss of liberty
- greater harm for those who don't obey (jail, shoot-out with the cops, police brutality for someone who doesn't respond quick enough)
- lack of an objective basis for you to dictate what I do against my will versus me dictating what you do against your will (causing mental anguish or fuel for retaliation)
I think you are thinking of the end result as opposed to the entire process. If the mayor of New York outlaws sugary drinks greater than 16 ounces, or outlaws fried foods, you could say that everyone will be healthier and that there is a "net benefit." Such laws prevent people from doing what they want to do. That is loss of liberty. Nobody "needs" a cookie or ice cream, but it is a loss of liberty when those things are outlawed and people want them. Would it really "harm" you if I forced you to wear a hijab or a skirt? How about if I prevented you from wearing a hijab or a skirt? I say it is loss of liberty, and that constitutes harm the way I have been describing it.
In the street-crossing example, there are places near me where it is a mile to walk the long way (1/4 mile to the corner, then 1/4 back to your destination, then repeat when you come home) vs crossing the road in the middle. The "loss" might be 20 minutes for one person, or an hour for somebody who can't walk quickly. It could also mean being late for work or not having time to play with the kids or not having time to see grandma on her death bed before she dies.
Based on my prior paragraph, I would say another "harm" is establishing a pattern of behavior in which people pass laws based on failure to consider liberty or a tendency to confuse "I don't see any reason to stop controlling your behavior" with "there is no reason to stop controlling your behavior." Does that make sense? I say this because your question indicated that you see no harm in preventing someone from crossing in the middle of the street, but I suspect that now that you thought about it, you can understand some "adverse effects" of such a rule or similar rules. I don't know your final ruling on this type of laws. Restrictive laws made on hasty lack of consideration could easily abound if they are tolerated.
Some people don't mind being micromanaged by others (e.g., being told that they are not allowed to eat cookies and ice cream due to the health risk). Others do mind. It is a perspective-taking exercise to understand how others experience life. Some people are better than others and understanding the perspective of others.
As for escalation, how exactly would you prevent me from crossing in the middle of the street? I start to cross the street, you say "don't cross here," I start to cross, then what? Do you feel justified in escalating to a knife fight if I fail to comply with your ethical idea or a law that says I can't cross at that spot? What's the harm then? Do you just blame the victim for not complying and feel justified in whatever follows?
I should probably clarify that I include "loss of liberty" as a type of "harm" at the top of these posts.
As for letting the victim define harm, the words above are a reason why: because an observer might not know what the victim perceives as harm, so let the victim define it. This is absolutely essential for anything that I would view as ethical or prosocial behavior. Religious laws are not based on this idea, they, like you, believe they can determine the correct action without any input from the victim.
being asked to play by certain rules constitutes as forceful harm then one should probably find another game to play.
other games: try to get the person to understand that loss of liberty=harm; move to another town (has no effect where I live); shoot out. None of these are inconsistent with your actions because you do not respect the autonomy of others and see yourself as in a position of moral superiority that justifies controlling the behavior of others or harming them if they don't comply.