budworm problem

I live in SF bay area California to harvest or to spray? I am ready to harvest and I noticed that I have moth/caterpillars. my question is that should I pull the buds away from the stem slightly and spray for them before I harvest and wait a few days or should I harvest and do the pain...