Monterey BT spray will take care of caterpillars for you. Not only will they munch the plant and leave caterpillar shit behind, where they nest tends to get botrytis mold.
BT is 100% OMRI organic as well.
BT is 100% OMRI organic as well.