There are a few broken-down boats docked along the inlet. But if you can get them working again, you should be able to ferry some villagers back. Just watch out for those Aetherblades!