Racism is giving (or the desire to give) one group of people an advantage (or disadvantage) compared to another on the basis of race. It's not automatically racism to put down an individual who happens to be of a different race than you.
That said, I'd describe your (not uncommon) behavior as offensive and inappropriate in that it reinforces racist stereotypes and sets a bad example for the people around you.
|