If you see any of their supplies lying around, feel free to destroy them. Limiting their resources can go a long way into disrupting their plans.