This behavior is WAD. Whenever you engage someone in battle, any allies that stands in the same province is going to participate in the battle as well. The argument by sperril is pretty much spot on. It would be strange for an ally to just stand and watch while is friends in arms get killed and not do anything about it.