...in that I can culturally appropriate from races from further down the privilege pyramid, but they can't appropriate back upward, whereas transgender is a lateral transition that can go either way.

The norms and mores surrounding race are also profoundly different than those of gender, despite overlap and similarities.