You've got to look at what laws existed at the time. During slavery, slaves were considered property and people PAID MONEY to get them. That is just a fact and I'm not getting into whether slavery was moral. Those people lost their property, based on government action (changing the laws), so you can make a case for compensating them for their loss.
I don't think anyone would have any problem with reparations for anyone, who had been a slave. It's been over 150 years, since anyone owned a slave in the US. What would you be getting reparations for?
Whites get blamed for slavery all the time, but let's go back to the source. Black tribes captured other Blacks in Africa and sold them to the Dutch traders, who subsequently sold them here. Why not seek reparations from the people, who started the slave trading chain?