The centaurs keep the supplies they steal east of here at Darkhoof Heights. Destroying their caches would set them back.