It is common in isekais anime for the protagonist to die and be reincarnated in ANOTHER different WORLD where everyone is white and Asian. Generally the protagonist is a Japanese person who was reincarnated in a fantasy world based on European mythologies in which he starts to live with elves, fairies, elves, etc.
So my question is: how likely is it that someone would complain about a story that takes place in another world where all the characters are black? Would a fantasy story based on African mythology be subject to complaints?
No, it would not be weird. Yes, you might get complaints. Write what makes you happy.