In America at least slaves often raised their own masters. It was an entire category of enslaved people: house slaves.

Much like the European aristocrasy and upper crust left their children to governesses and wet nurses to rub elbows with the rest of high society, so did the Big Whites of America and the Carribean.