But they're not as recognizable as, say, Jay or Big or OutKast who rep bigger cities.

I'd have to say Cole. Like Hitokiri (I think) said, J. Cole is one of the leaders of his generation. Looking back, outside of someone like Nelly or BONE or Sir Mix-a-lot bubbling up for an album or two, I can't think of a major star that didn't come one of the 'meccas.'

<--- Me when my head hits the pillow