Absolutely. It's better to pull out the one brick that brings the whole thing down.