The scrappers did steal my sire's key, but they didn't want to give it back, so my warband and I kicked them around until they were in a more cooperative mood. Now, I have to check in with Tribune Brimstone, then travel to Grendich Ruins to recover my treasure.