Some of us need to stay to hold the temple, but you should continue on and meet up with our troops in Malchor's Leap.