Technically not a bug. The units you get from "Organize Raid" are set to always loot. So whenever you move them to a targeted province, they will loot it directly. Instead of clicking the button to turn looting on, you can't click the button to actually turn it off.