You also gain glory from completing secondary objectives, such as destroying or using trebuchets, or killing key non-player enemies. Seconday objectives change from map to map.