I'd say his record label problems was the biggest thing that cooled him off, when he couldn't lend his voice on hooks to the beats that he did.

I also think a white crowd "discovered" him via Chappelle Show, while his original audience (niggas) just wanted to pigeonhole him into that joke.