From what I understand of your situation, you probably correctly disabled exclaves, which are if the same country has a group of provinces in another location than its main location (for example, the infamous "Portuguese Siberia"). However, you seem to be talking about colonial nations, which are new countries taking the name of their original country and slapping next to it the name of the colonial region they were found in.
Since those countries need a name, I doubt you can deactivate the option to see those information. However, regarding your own country, you might have the option to rename them (I think it takes an expansion to do that).