They could damage the pipes. Or worse, poison the water! I rely on that water for my crops. Better to kill any bandits you see before they cause trouble.