Neem is pretty hit or miss in my experience and sometimes screws up early plant growth since it's an oil that likely somewhat suffocates the plant. If you continue to see damage I'd try it for sure. There are other pyrethrin based insecticides that work fairly well but are a bit more dangerous to bees (if you spray it on the flowers in particular) if Neem doesn't work.