From what you saw, so do these jotun. There has to be a connection. There are Sons of Svanir near Hirbadd's Camp. They might be involved.