Would this take their planning bonus away? Also controlling them without being assigned to an army prevents them from getting a commander?
Planning bonus decays over time and does not disappear when your division switches armies, is assigned to other order or is removed from the order. There are 4 things I do to get planning bonus and avoid shuffling.
1. What I do most of the time is delating the whole frontline just before attacking. This way my army, which was preparing on the frontline all that time, is ready to move wherever I tell them to with no shuffling.
2. Sometimes when the front is going to get messy and I'd like AI to follow up with some of my troops I the the frontline and attack order, but remove part of the army from this order and these are the troops I use. Because I do not activate the plan the rest of divisions just follows the frontline shuffling, but also getting some planning bonus when they stand still. This way after some time I add troops that were attacking to the attack order and remove from it those guys who were just walking behind the frontline: they become my attack troops.
3. Use Spearhead Order, which does not allow units assigned to it to shuffle until it is completed.
4. Draw short, one province frontlines and assign troops to them. They will not shuffle because it's one province frontline and they have nowhere to go. However if you expand the width of your front (more provinces bordering the enemy as you progress) situation will get more messy and you'll have to adjust.