On the flip side, a downvote from me would have no effect on your rep whatsoever, but a downvote from him would have a pretty big negative effect on it (based on his SP, not his rep).

You can see your actual reputation score on Steemd on the left hand side near the bottom.

Edit: Upvoting myself in the name of science.