They send two caravans every time they move it: one with the orb and one decoy. We hit the wrong one, and the real one escapes.