There is nothing in the argument that there is a system of oppression based on race that says only white people can be racist. That is the historical fact, not a conceptual fact, and it depends on culture, so it doesn't specify that people of color cannot be racist. If you disagree with the idea of structural racism, that is the definition of not thinking there is racism, so that would explain that people think "differently than me." That people and educators gave a name to a phenomena does not make it created by those who named it. This is just social science.