Quite simple—kick mushroom servants at him to knock him down. Be the first to fell him three times, and earn the use of an enchanted armor.