Just board the hot air balloon here. It'll take you right to the Crown Pavilion in Divinity's Reach. Once you're there, hop back on board when you're ready to return.