That's the point, people are more important. Generally speaking, if you find someone attractive, most likely you'll find his or her clothes attractive as well. Of course this is not always the case, but I suspect it's the overwhelming majority of the cases.