I agree with you on that. Down voting can be used to indicate you think the content is not useful. Where as flagging should be for spam or abuse. The concern with down voting is that it could lead to censorship of opinions that people dont agree with. Need to find some way to make it clear that down voting is not disagreeing but rather indiciating low value to all parties.