This is why I always get driven away from Stellaris. I come back every few months to check but I always quit over the frustration of having to micro 5, 10, 15, 20, etc. worlds because there's no way I'm letting the past or current AI build my worlds. Once I get past about planet 5 in a game I'm done enjoying the micro. I want to move on to managing things on a more galactic level for conquest o liberation or whatever I'm up do. Instead I'm stuck constantly going from top to bottom on the outliner checking each planet to see what it needs built next.
But your top worlds, i.e. the first colonized, after a while should be built out, no? After that, there is effectively no micro, other than maybe when you get the next level of a building like Physics Lab, you have to eventually remember to go back and hit the yellow arrow symbol to upgrade them. And if you wait a little while to do that well, it may not be min-maxish but it is not going to be the end of your empire.