Grab one of my Essence Extractors and use it to gather the harpies' essence, pluck their feathers or pick up any you find in their nests, and kill a few and destroy their roosts to keep them distracted.