Their group needs to stay and hold the altar, but you should press on to join the Pact forces in Malchor's Leap.