You may have to, and destroy their roosts, just to keep them guessing. Problem is, the moment a harpy dies, its feathers wither and are useless. That's why dead harpies smell like...well, dead harpies.