Head straight south. There's a cave there that they've set up camp in. Way too close to my farm, if you ask me.