At the very least, only Natives in the Americas and Australia should get their cultures replaced upon colonization, since they went into a steep decline as the Europeans colonized them (mainly through disease, and then the weakened tribes were easily pushed west or outnumbered). It makes absolutely no sense for European colonies in Africa or Asia to replace the culture there.
