The bandits may be human, but they could care less about the safety of Divinity's Reach. The weaker the Seraph and the Queen are, the less to interfere with bandit operations.