It's true that we're stuck. The bridge towers in front of Joko's fortress make it impossible to approach.