That's part of his motivation as well.

Up to this point, we've got an idea that he's a bit more complicated than just the petty hate machine we were introduced to by way of his growing friendship with the nun. Sure, he may have his hangups about those darkies but if his backs against the wall and a bunch of assholes are fuckin with him and his main source of income? He's pullin' the fookin carriage.