Honey is fine in moderation, manuka honey is the one i would recommend. With certain shop bought honeys sometimes they are padded out with other sugars. So always check the label. Buy local if you dont want to pay out for manuka. Just remember honey is actually sweeter than sugar so a little goes a long way.
I would still aim to get my sweetness from fruits and save honey for the more special treats.
With everything its more about portion control and varying your diet than cutting things out entirely.