Their numbers aren't that many and yes, NEGAN will slaughter them all. This alludes to the fact that, RICK is growing more and more paranoid and is on the path to total lunacy.

I think the real threat will stem from, RICK hiding the truth from his people. The new group is also kind of suspect too...