No, someone could still downvote you for any reason. There are abusive flaggers. But you will find others like myself that will be willing to upvote you if your posts if you do get flagged unfairly and it affects your reputation. Most of us will not upvote content that is considered "abuse" and detrimental to steemit and the community.