Don't be shy. Just pick up a shovel and start digging. Bring any recovered treasure back to the chests.