If you do regular work then you will not be able to stop anybody.

Downvoting a post can decrease pending rewards and make it less visible. Common reasons:

• Disagreement on rewards
• Fraud or plagiarism
• Hate speech or trolling
• Miscategorized content or spam