Ah okay, so the problem isn't with enslaving my own species (because I'll be Fanatic Collectivist), it's when I start enslaving alien species that because I'm only Xenophobe, they only have a 50% tolerance to it. So they get a little unhappy, right? But that can be solved with buildings and edicts and if they join factions, suppressing them.
Should I do anything with the Docile Slaves faction?
Comining Xenophobe and Collectivist is a bit redundant. Collectivism allows enslaving and purging all pops. Xenophobia allows the same with pops not your primary species only alien Pops. Wich results in you being able to enslave everyone if you got both (Collectivism is the better brother).
The big thing about Collectivist are the techs: Frontier Collectivs -> Frontier Comissars and Galactic Benevolence. With those you got passive ethics divergence on par with Fanatic Spiritualist. But getting them is not that easy, actually. If you got Leviathan DLC, consider going for Ministery of Culture too.
The one thing Xenophobia adds (besides borders and Rivalries), is the Monument of Purity. Arguably the strongest, easiest to access happiness building. Only the Pacifists Paradise dome is comparable. And you will need it as you convert the people to be Xenophobic of your rule.
The Docile Slaves faction:
Early on you should consider lowereing it to regulated slavery. Keeps your slaves docile and Influence will be rather hard to come by that early.
Once you do got Malcontent Slaves anyway, just go back to full Slavery and double down on getting everyone in there to supress them in one neat package.
On low-medium support they will cause slave strikes. Beyond that, they only Radicalize.