it was taken by Rob B, and then he told Stannis to use his military force to hold it.

then when shit went south with Rob and the Lannisters, it became Stannis' spot cuz he was already there holding it w/ his army.

then, when it was time for Stannis to bounce, his army bounced.

you crying like "where's the handmaidens dawg, where's the stable boys?!@?!?!"

dude, it was a military occupying force, not a fucking society.

chill.