• We have updated our Community Code of Conduct. Please read through the new rules for the forum that are an integral part of Paradox Interactive’s User Agreement.

HOI4 Dev Diary - AI & Feature Updates

Hi everyone! From the time we show off features in dev diaries and release a lot happens. Usually it's just bugfixing and work behind the scenes, but sometimes it can be bigger changes too. So today we will pick out some stuff that's changed since you last read about it. But first, but not least, lets talk a bit about AI development!

AI Updates
When we started with 1.9 'Husky' and La Résistance there were 2 main things we wanted to achieve. First we wanted to nerf Germany (without actually nerfing them) by giving resistance more teeth. This worked pretty well, as after we had made the new resistance system Germany would consistently collapse to large Polish uprisings behind its lines and needed to be told how to manage all that as well as control its equipment production better. Resistance is now constantly hurting garrisons and you don't pre-build garrisons, so stockpiling and not rushing units is more important.

The second thing is also related to Germany (its WW2 after all). For HOI (no matter the version really) we have always striven for a balance where Germany defeats the Soviet Union if the allies do not take pressure off by invading. This ensures that all of the big sides need to be active and if played by a player you need to step up. Now before we jump to the 10 pages of comments discussing if this is a realistic target... It is, for gameplay I think. History wise I am personally convinced that the Soviets would have beaten Germany on their own. It just would have taken a lot longer and been much costlier, and there isn't much point in playing the UK or USA if Soviets will just take care of Germany on their own (now now, please keep reading the rest of the diary before we start arguing what-ifs :p).

Anyways, in 1.7 the allies seldom pulled off invasions well enough, and pretty much only if they got lucky in Italy or punched up through Greece or something like that. Firstly we have made a bunch of improvements and bugfixes to weird parts of the invasion logic for the AI that makes them perform better. The biggest impacts came from limiting the AI from shipping troops back and forth across the globe and simply getting them to buffer up its forces in specific allied territories. USA specifically here will now station troops ahead of time in UK so that when its time to do invasions they are already in the neighborhood. We have also improved prioritization of different fronts to make sure AI gets the importance of Europe and when landings have been made successfully.

One of our most important tools when working on high level AI stuff and history tuning is the "History Logger".
This is a tool that we developed to observe AI gameplay. When enabled, it collects & dumps data on how game progressed during a particular run and its output looks something like this when run through a web interface:
output.gif


You can find two example runs here if you want to experiment with it:
https://common-assets.paradoxplaza.com/hoi4-devdiary/history_viewer.html?zip=1.zip
https://common-assets.paradoxplaza.com/hoi4-devdiary/history_viewer.html?zip=2.zip
Watch out they are very javascript heavy and take a long time to load up :)

Other than showing country borders, it can also show many other other details for a selected country such as diplomacy status, army/navy mission/air mission positions, orders, taken decisions/focuses/ideas, executed operations/operative missions and many other things. On top of that, the things are logged using log effect will also appear in these logs so you can have custom logs in your effects if you want. Here is an example from USA:

upload_2020-2-17_14-32-21.png


The lines are invasion orders and red heat map is the army of USA. You can already see that USA successfully invaded southern France and has invasion plans for Northern France and Denmark.

And here is an example to things that are logged. Logs are filtered by country tag ENG and "operation" and here we see all operations that are executed by England.
upload_2020-2-17_14-48-59.png


We use this tool every day in our nightly automated tests. Everyday we run a bunch of AI only runs with history logger is enabled and at the end of the day we get an email like this:
upload_2020-2-17_13-58-7 (1).png


Our nightly tests inform us if the game is crashed or not, if there are some tests that failed and if there are performance issues. In this particular example in one of the machines Germany was not able to beat France. When we check history logger output for that particular run we see the following:
ger_fails.gif

(Green: Germany. Red: Enemies. Blue:Allies. Yellow: Potential Enemies. Heat map is the army position for Germany.)

In this run we see that Germany is attacking low countries way too early, before Poland falls and the front north west front is prepared. This allows France & England to be better prepared and push through. The fix was to add extra safety checks (we had broken some old ones too in an unrelated change a while back) for how the AI wants to feel prepared for this push.

This tool will be included with 1.9 so modders can take advantage of it. We think is going to be super good for anyone doing balance, AI or total conversion mods. There will be more info on that as well as some more details and info on how to set up the tests in the Friday diary :)


Espionage Changes
We have done some changes to operative recruitment. Rather than being a timer on actual operatives recruitment time the system now is tied to the actual slots you have.
upload_2020-2-19_10-46-12.png

This was needed because the old system was pretty confusing in practice, and giving more operatives from events, or historical operatives would really mess with the progression of the system so UK could gear up its agency way too fast.

Operations have also had a bunch of changes. The more visible one is the addition of the Outlook indicator:
upload_2020-2-19_10-57-4.png

This breaks down risks and the potential for better rewards on an operation. Both can be affected by agency upgrades and Operative traits. A 10% risk means that there is 10% something goes wrong. This usually means that the operatives will need to go into hiding for a while to avoid local investigations, or have suffered an injury, or more rarely, have been captured, killed or turned to the other side. When operations end you'll get to find out as risk trigger generally when trying to extract from the operation area.

We have also added some new ministers for nations. Having an Illusive Gentleman will be a good choice for those who want to go all in on making the strongest Agency possible:
upload_2020-2-19_11-7-40.png

You can also see that UK will get access to all programmers hero Alan Turing if they develop a cryptology department. He is more of a UK special though.

Portugal Changes
Hello everyone, Mano de Zombi here!
As many of you have already noticed, there have been some changes to the Portuguese Focus Tree since my last DD before Christmas, and today I’d like to talk a little bit about them.

Let’s begin with the National Spirit Unstable Republic:

01 Unstable Republic.png


The previous stability penalty (a flat 10%) has been changed to a -0.5% weekly stability penalty.
Salazar’s trait has also been changed from a flat stability bonus to a 0.5% weekly bonus.

As you can see, one stability modifier counters the other. The reason behind this is that while Salazar is in power, his Unstable Republic will be roughly under control. Stability might not increase but it will not decrease either (after all, even with some difficulties, Salazar historically managed to keep the Republic under control for decades).
But once you start tweaking your politics, you can find yourself in a tough situation where low stability might not be easily recovered, putting your country on the brink of civil war before changing your government. More on this later in the diary.


Now let’s take a look at the final focus tree:

02 Portugal tree.png


As you can see, there are some new focuses (12 to be precise), for a total of 122.
During Christmas I worked on a design for the historical Salazarist branch, as well as a bit of reworking and additions to other branches. Big kudos to Pedro, the original FT designer, who helped me a lot and provided me with incredibly useful documentation!


The Military branch looked quite small so we decided to include three more focuses. This branch has also seen some changes, so let’s take a quick look:

03 Military Branch.png


Army Organization, Metropolitan Army and Corpo do Estado Maior will each grant some Army XP. In addition to that, Army Reorganization will remove Unstable Army National Spirit and add a small stability penalty(-5%).

To the left, Metropolitan Army also grants two research bonuses, followed by a production bonus under Standardization. The defensive focuses have not been touched, you must still choose between heavy fortifications in Lisbon or a light fortification line along the coast. Finally, Portugal has two focuses that provide research bonuses for special forces.

Tropas Paraquedistas is based on the Parachute Rifle Battalion, a group of 12 Timorese soldiers trained in Australia during World War II to be launched in the rearguard of the Japanese forces occupying Portuguese Timor; as you can guess, this focus gives a research bonus for Paratroopers.

Regimento de Comandos is a reference to the (later) historical Portuguese Commando Regiment (a special forces unit prepared for counter-guerrilla operations) formed in the early 60s, as a consequence of the Ultramar War; it will provide two research bonuses for special forces, as well as a National Spirit that will slightly increase your special forces limit.

To the right, we have Corpo do Estado Maior, which improves army leaders and makes them cheaper, followed by Staff Wargames and its two research bonuses for land doctrine. Finally, Field Maneuvers will add more Army XP and an additional research bonus for land doctrine.

A final note on this, if you support a Spanish faction during the Spanish Civil War, you can access a focus that also gives you some research bonuses (different bonuses depending on the faction you support):

04a They Need our Help.png


04b Observation Mission.png


04c Assist the Requetes.png



Moving on to the political branch, you can see that some focuses have changed names. This is to clarify that they are related to the Spanish Civil War:

05 Focus Renamed.png


You may also notice that Securing the Free World is now available only through Allow Free Elections (aka Democratic path). This focus will guarantee the independence of every European minor country with a democratic/non-aligned government and not in a faction, as well as allowing you to create your own faction. It makes sense to have it as a democratic focus, since Communists have their own ways to deal with factions.

06a Securing the Free World.png


I would also like to clarify the requirements for the following focuses:

Protect Chinese Civilians: Will grant a wargoal against the owner of Guangzhou, the state surrounding Macau. This focus is available by completing either The Popular Front Bloc, They Need our Help or Allow Free Elections.

Intervention in Spain: This focus grants a wargoal against Spain if their ideology does not match Portugal’s. It is available only through They Need our Help and Allow Free Elections.

06b Focus Requirements.png



Regarding the change of ideology, throughout the different political branches (be it Communist, Democratic, Fascist or even Monarchist) you will always find something like this:

07a CW main.png


As you can read in the lower red tooltip, if you attempt to change your government through the Focus Tree, you better make sure that stability is high enough, otherwise you could find yourself in the middle of a messy and unexpected Civil War (hmm… This sounds familiar to me…).

You will find something similar in the following focuses:

07b CW.png


07c CW.png


07d CW.png



Now let’s talk about the historical path (cool new icons in the branch courtesy of our freelance artist @Indyclone77, who also made all the Portuguese Focus and National Spirit icons, event pictures, and plenty of other 2D assets... Big kudos to him!). We have added a new sub-branch by which Salazar will slowly strengthen his regime, eventually turning Portugal into a powerful nation, capable of dealing with great powers late-game:

08 Historical Branch.png


The National Spirit Estado Novo represents the Salazar regime and has several levels now, being improved by different focuses along the branch.

You get it when you complete Estado Novo focus, providing a small bonus in consumer goods and civilian factory construction speed.

09a Estado Novo 1.png



Strengthen the Regime represents Salazar dealing with all kinds of dissidents (historically, Communists were specially persecuted and oppressed, but there were also other groups, such as fascist-syndicalists). You will have to invest some manpower and equipment to strengthen the secret police, but you will get some Non-Aligned support, and your Estado Novo will get small bonuses.

Upon completion of Appease Monarchists you will get the support of most monarchists and will unlock a couple of Monarchist-related advisors (shared with the Monarchist branch). Historically, Salazar’s strategy was to co-opt the Monarchy supporters into the government and leave the restoration of the Monarchy open for the future. Among other benefits, this focus will add a small daily PP and a weekly stability bonus to Estado Novo.

Concordat with the Holy See: The Concordat of 1940 was an agreement between Portugal and the Vatican, which basically prevented the Church from interfering in the political affairs of Portugal. In-game, you will get a nice amount of PP and Estado Novo will get a bit more daily PP and weekly stability.

National Gold Reserves: During the War, Portugal played an important economic role (it was more complex than the simple “they sold tungsten to Germany”, but I'll leave that for another day). In-game this focus will give Portugal a National Spirit with some economic bonuses, as well as better trade relations with Germany and the United Kingdom. Keep in mind: you have to be at peace to complete this focus!

By completing Honor Anglo-Portuguese Alliance Portugal will join the Allies, gaining access to the focuses shared with the Democratic Path.

Proudly Alone is the final focus improving Estado Novo and finally removing Unstable Republic. From here Portugal can choose to leave behind the historical approach and go into the offensive against Japan or any major or neighboring Communist nation.

09b Estado Novo 5.png



Last but not least, The Capital of Espionage focus: There were countless agents and plots in Lisbon during the war, from double agents and traitors who cooperated with former enemies to spies who gathered information on trans-Atlantic shipments for the Germans. This is represented in-game with the following National Spirit:

10 Spies.png



Regarding Refuse the Naval Blockade focus, it is now available not only through the Fascist path after National Syndicalism, but also through the Monarchist path after Return of Duarte. Now the Kingdom of Portugal can take revenge on the United Kingdom and finally connect its Angolan and Mozambican colonies (Mapa Cor-de-Rosa).

11 Refuse Naval Blockade.png



For those of you concerned about not seeing any custom tech sprites during the streaming a couple of weeks ago, I can confirm that there are Portuguese tech sprites, but unfortunately they were not hooked-in on the build we used for the streaming.

12 Tech Sprites.png



And that’s all from me, as you can see Portugal has gone through a lot of work during the last months and I hope you enjoy playing the different paths once the DLC is released!

For the next dev diary you won't have to wait a whole week as on Friday we will be showing off a bunch of stuff for modders as well as post the full 1.9 patchlog in preparation for La Résistance release next week.
Don't miss the stream today where we will continue our playthrough as Germany. Tonight we also have an AMA on reddit where you can pop in and ask us questions.
reddit_proof_iama_20200219.jpg
 
Last edited:
  • 2
Reactions:
hello , this new ai thing sounds good , the biggest let down for me was the bad naval warfare and the soviets suiciding against my german infantry line , oh and the ai countries transporting troops up and down and dieing
will it come with the new dlc at 25th of this month?
 
Is this the modding diary that was mentioned?

edit: I am blind. This is a very helpful.

its on Friday in case more blind people pop by ;)
 
  • 1
Reactions:
hello , this new ai thing sounds good , will it come with the new dlc at 25th of this month?
yes, the free update drops at the same time
 
  • 1
Reactions:
https://forum.paradoxplaza.com/forum/index.php?threads/hearts-of-iron-iv-la-résistance-announced.1259412/
"This update will include a reworking of the resistance system, interface improvements to battleplans and air operations..."

I don't recall these ever getting addressed. Are battleplan interface improvements still part of the patch?

Oh ouch, that announcement is old info from before our feature complete gate. We experimented with battleplan changes but they caused a lot of issues so had to be scrapped for the time being. We have been working on some nice improvements to air management though, but they didnt make it in time for testing so I planned to add them for free in the big patch we usually do after release.
 
  • 1
Reactions:
So still nothing on the spamming of divisions and related supply issues?
the definition of division spam is pretty vague, AI works best with many divisions so will generally have more than a player would as holes in lines is death to it.
But I have tweaked stuff for stockpiling and such and limited training checks on division deployments, and there are overall less divisions given how garrisoning works (you can look at the overnight tool links, pick a nation and move time and it will show the number of divisions (written as armies because old eu4 code...) to get an idea).

there are also specific situations when the ai is losing badly that is intentionally staving things off and burning equipment by spamming untrained divisions at you
 
Last edited:
  • 1
Reactions:
Will we be getting unique general portraits for Portugal? The lack of those was the one thing I saw in stream a few weeks back that disappointed me. If they're not in launch La Resistance hopefully they will be included in the free post-patch update.
 
When are you gonna fix Battle Plans AI?

For example, I give troops straight order to attack through one lightly guarded province, but instead they start stupidly attack adjacent province which has hills and ton of enemy troops. Or, when AI does stupid landings and loses several divisions, then repeats, and repeats again... until he bleeds white of manpower.
 
the definition of division spam is pretty vague, AI works best with many divisions so will generally have more than a player would as holes in lines is death to it.
But I have tweaked stuff for stockpiling and such and limited training checks on division deployments, and there are overall less divisions given how garrisoning works (you can look at the overnight tool links, pick a nation and move time and it will show the number of divisions (written as armies because old eu4 code...) to get an idea).
The question was about AI "allies" eating up all the supply in a theatre (commonly a naval landing) to the point where the human player has to abandon the front due to crushing lack of supplies. It is one of the major topics under discussion for quite some time. Did you miss that somehow?
 
The Heavy Fortification focus around Lisbon should really be called "Rebuild the Lines of Torres Vedras". The Lines of Torres Vedras, built by the Duke of Wellington during the Napoleonic Wars and roughly correspond to those forts! https://en.wikipedia.org/wiki/Lines_of_Torres_Vedras

I think this is a nice suggestion with good flavor. I will consider changing the name for a future patch.

By the way, I believe those fortifications were mostly destroyed/abandoned after the Napoleonic wars (I will do some research here) and probably they wouldn't have been of much use for modern warfare... Anyways, it can be cool to have a reference to this fortification.

Interesting suggestion indeed! Thank you!
 
  • 1
Reactions:
The question was about AI "allies" eating up all the supply in a theatre (commonly a naval landing) to the point where the human player has to abandon the front due to crushing lack of supplies. It is one of the major topics under discussion for quite some time. Did you miss that somehow?
Oh gotcha. When saying Division spam people have usually been talking about AI committing too many divisions vs their ability to supply them with equipment.

Supply issues like this with AI/Player remains an issue still unfortunatly, but its something we care about going forward, but this expansion was not the time to redo how supply functions. Does requesting expeditionaries from allies and directing them elsewhere help with the issues sometimes?
 
  • 1
Reactions:
Oh gotcha. When saying Division spam people have usually been talking about AI committing too many divisions vs their ability to supply them with equipment.

Supply issues like this with AI/Player remains an issue still unfortunatly, but its something we care about going forward, but this expansion was not the time to redo how supply functions. Does requesting expeditionaries from allies and directing them elsewhere help with the issues sometimes?

I’m asking about both things. The fact that the AI needs an absurd amount of units to function is a big issue in itself and it’s quite frankly ridiculous to see small allied nations fielding armies that would have crashed their economies in real life. The issue is not that they can’t be supplied, because they mostly are fed and happy with ammo.

And yet you place focus on redoing the supply system, instead of taking care of the fundamental issue that your AI is woefully incompetent, combined with production that spirals out of control, resulting in something that looks more like ww1 than the one the game supposedly is about.
 
Supply issues like this with AI/Player remains an issue still unfortunatly, but its something we care about going forward, but this expansion was not the time to redo how supply functions. Does requesting expeditionaries from allies and directing them elsewhere help with the issues sometimes?
Rarely, because the worst offenders are the largest countries who are also least willing to give expeditionaries.

Edit: and the option to request expeditionaries for a particular plan is DLC-locked AFAIK
 
We got some new skins for Spain actually, but we didnt have time to do anything for Portugal
Ah yes the mystical Spanish sprites just like the attack of general Steiner I believe in it when I see it.
 
Oh gotcha. When saying Division spam people have usually been talking about AI committing too many divisions vs their ability to supply them with equipment.

Supply issues like this with AI/Player remains an issue still unfortunatly, but its something we care about going forward, but this expansion was not the time to redo how supply functions. Does requesting expeditionaries from allies and directing them elsewhere help with the issues sometimes?

It would be a band-aid solution, but would it possible to, akin to the garrison command, have an option in the diplomacy menu to deny military access and then be able to select the provinces?