The gods tried to wipe the Keeper of Secrets completely, but they couldn't. His shrines and statues are too intertwined with their own reliquaries. They'd have been locked out from their own secrets.