The show doesn't go too deep into it, but it was pivotal when Cersei casually re-armed the Faith Militant. Think of them sorta like the Knights Templar; it may be the common folk they represent but the ones actually wielding the weapons are seasoned soldiers and veterans. They're not just random monks, they've got the motivation, training, and numbers to back up their threats.