sad ish :(
In a restaurant, I would think they associate a black face with a poor face, a violent face or even an anti-white face. I'd think it is a result of years with conditioning (just look at the american media in the past and now)

But dont confuse angry looks (my brother calls those looks "glooming") with suprised and even curious looks, specially when you travel outside USA!