You are free to travel between the Astral Ward outpost in Nayos and the Wizard's Tower.