Safety will always require excluding some people.
And being more inclusive is often going to require taking on more risk.
You can try for a balance, but there are always going to be trade-offs. In order to make a space safer and more inclusive for some people, you're going to necessarily make it less safe and inclusive for others.
To not recognize this is to default to making things safer and more inclusive for the most powerful and privileged.