The largest round you can consistently place on target is best. I have a friend that carries a 50 cal desert eagle that can't hit the side of a barn! Ballistics mean nothing if you miss....
I also know a sweet thing that carries a 32, and she is a very good shot with it!
Additionally, the firearm size is important. Too heavy and large, and you won't carry it...that's a paperweight!