Eeek, sorry not an expert on bugs and not grown anything in a few years but I'd say anything eating your plant is a bad thing, not not mention anything they may leave behind!
I think you have done the right thing in cleaning everything up, give the plants a go over with a duster to knock anything off, if they come back give a wipe down with some lightly soaped water then rinse, be gentle.
There is some industrial strength spray (sorry can't remember the name) but I'd only suggest for a major outbreak.
You should also consider checking your final product with a microscope before consuming.