Hearts of Iron IV - Development Diary 55 - HoI4 QA

Hearts of Iron IV - Development Diary 55 - HoI4 QA

  • Crusader Kings III Available Now!

    The realm rejoices as Paradox Interactive announces the launch of Crusader Kings III, the latest entry in the publisher’s grand strategy role-playing game franchise. Advisors may now jockey for positions of influence and adversaries should save their schemes for another day, because on this day Crusader Kings III can be purchased on Steam, the Paradox Store, and other major online retailers.


    Real Strategy Requires Cunning

Distantaziq

The Godless One
10 Badges
May 15, 2015
187
287
  • Magicka
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Hearts of Iron IV Sign-up
  • Stellaris - Path to Destruction bundle
  • Stellaris: Synthetic Dawn
  • Shadowrun: Dragonfall
  • Shadowrun: Hong Kong
  • IPO Investor
Good morning!

This weeks topic is brought to you by the embedded Quality Assurance on Hearts of Iron IV, and how we work. My name is Distantaziq and I'm one of the two embedded QA on HoI4. My partner is currently in flux, but at time of writing and until HoI4 is released it is Da9L who holds the position, or maybe you know him more prominently as the person who put the ”Y” in ”Yermany”.

Quality assuring a game is much like quality assuring any other piece of software, except in an arguably more creative setting. If you’re thinking of getting into the business “to get to play games the entire day” you’re more or less signing up for “a fun safari trip” while you’re really enlisting to the corps.

The Quality Assurance department in Paradox Development Studios is divided in two parts; Embedded Testers, that are a part of the project's development team, and Central QA that are more fluid as they jump between the titles.

Central QA are more generalists, and jack-of-all-trades. While the embedded testers are the first to test out all the new features, balance changes etc, the testers in the central group are able to support the embedded testers by providing with more long term gameplay testing, and a “fresh” perspective on things and catch anything that might have slipped through.

The Embedded QA are the true experts in their respective projects. As was mentioned above, we are the first ones to test out any new changes in the game, in order to see any possible problems with the changes, if they are entertaining or not, and provide this feedback to the projects producer/project lead.

We also have the opportunity to specialize in various areas. If we take Da9L as an example, he is the resident expert on AI, which means that a of the project leads can request him for a certain amount of time to have a sweep of the AI, or maybe see how the AI handles the new DLC features that was just implemented.

As two QA who are solely on HoI4 we are a part of the development team and our three main purposes are to assess the risks of the project, monitor the activity/numbers on our bug tracking service JIRA (and subsequently regress the issues) and give continuous feedback on the project, if something works better/worse and why/if it needs to be changed.

The risk assessment is where we analyze the project’s status that week, and pin down specific issues that we think (for instance) are destabilizing the build, or are crippling the AI/other essential features. We also take the time frame into aspect, if we have enough time to assure the quality of implemented changes before deadlines, and/or if a so-called “feature creep” is attempted.

If everything is working smoothly we don't really have anything to report that week, but there are usually crashes or other issues that are worth taking note of for the project leaders and managers.

Regression as such involves reading resolved JIRA issues and getting into the problem at hand and checking if the issue still exists in our latest version (which is why it’s so important when you report bugs to note what version you encountered the issue in). If the issue is fixed, we close the issue and help it pass on to the other side.

Every week we schedule multiplayer with the rest of the HoI4 team to make sure all multiplayer features are up to par (so far pretty good!), and in a perfect world we also get some scenario testing done, to uncover issues we might not have noticed otherwise. (Since one of the most dangerous things about being quality assurance is getting comfortable and losing your edge by following the same motions when you enter the game.)

As you can imagine, working on such a vast game as HoI4, our days are a blur of keeping track of bugs and trying to make sure none of the more severe bugs slip through the cracks.

Like that one time when Soviet had a coup trigger on them that turned into a civil war, and both sides ended up nuking each other to bits (needless to say, the AI received a lot of restrictions on their nuclear usage after that).

We’re therefore really grateful to the betas who provide observations and help testing the game to make sure it’s providing entertainment for as many players as possible. :)


Enclosing some tidbits of weird things that we've seen throughout the development process:

beautiful.jpg

In for a wild ride...

hoi4_630_01.jpg
Border updates took a break.

hoi4_91_01.jpg
Who needs ships anyway!

hoi4_19.jpg
Denied tech.

screenshot_28_01.jpg
Sticky player map mode names. Myes.

hoi4_176_01.jpg

(Pink IS programmer art.)


Until next time!
 
  • 74
  • 48
  • 1
Reactions:

Corelli

Colonel
29 Badges
Jun 4, 2006
813
128
  • Semper Fi
  • Hearts of Iron IV: Expansion Pass
  • Europa Universalis IV: Rule Britannia
  • Hearts of Iron IV: Expansion Pass
  • Europa Universalis IV: Cradle of Civilization
  • Hearts of Iron IV: Death or Dishonor
  • Europa Universalis IV: Third Rome
  • Europa Universalis IV: Rights of Man
  • Hearts of Iron IV: Field Marshal
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Europa Universalis IV: Common Sense
  • Mount & Blade: Warband
  • Europa Universalis IV: Pre-order
  • 500k Club
  • Europa Universalis III Complete
  • Europa Universalis III Complete
  • Heir to the Throne
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III
  • For the Motherland
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Divine Wind
  • Europa Universalis III Complete
  • Europa Universalis III
  • Crusader Kings II
  • Hearts of Iron II: Armageddon
What do we need to unlock to build the floating cube of death?
 
  • 87
Reactions:

tfrules

Second Lieutenant
63 Badges
Jul 25, 2012
104
305
  • Crusader Kings II
  • Stellaris
  • Stellaris - Path to Destruction bundle
  • Europa Universalis IV: Cossacks
  • Cities: Skylines Deluxe Edition
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Victoria: Revolutions
  • Europa Universalis IV: Res Publica
  • Hearts of Iron III Collection
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Darkest Hour
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sons of Abraham
  • Europa Universalis IV: Art of War
  • Crusader Kings II: The Republic
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV: Rights of Man
  • Stellaris: Leviathans Story Pack
  • Stellaris: Apocalypse
  • Hearts of Iron IV: Together for Victory
  • Crusader Kings II: Monks and Mystics
  • Steel Division: Normandy 44
  • Europa Universalis IV: Mandate of Heaven
  • Europa Universalis IV: Third Rome
  • Hearts of Iron IV: Death or Dishonor
  • Stellaris: Synthetic Dawn
  • Europa Universalis IV: Cradle of Civilization
  • Crusader Kings II: Jade Dragon
  • Hearts of Iron IV: Expansion Pass
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV Sign-up
  • Europa Universalis IV: Mare Nostrum
  • Europa Universalis IV: Rule Britannia
  • Crusader Kings II: Conclave
  • Cities: Skylines - Parklife Pre-Order
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Crusader Kings III
  • 500k Club
  • Victoria 2
Hodor.
 
  • 38
  • 11
Reactions:

Ricard2037

Not a terrorist.
57 Badges
Jan 24, 2012
4.006
378
  • Crusader Kings II
  • Hearts of Iron IV: Field Marshal
  • Crusader Kings II: Monks and Mystics
  • Stellaris - Path to Destruction bundle
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Semper Fi
  • Victoria: Revolutions
  • Europa Universalis IV: Res Publica
  • Lead and Gold
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III
  • For the Motherland
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sunset Invasion
  • Europa Universalis IV: Wealth of Nations
  • Crusader Kings II: The Republic
  • Crusader Kings II: The Old Gods
  • Cities in Motion 2
  • Crusader Kings II: Legacy of Rome
  • Hearts of Iron IV: Colonel
  • Cities: Skylines - Parklife
  • Crusader Kings II: Reapers Due
  • Stellaris: Leviathans Story Pack
  • Steel Division: Normandy 44
  • Crusader Kings Complete
  • Steel Division: Normand 44 Sign-up
  • Hearts of Iron IV: Death or Dishonor
  • Stellaris: Synthetic Dawn
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Humanoids Species Pack
  • Stellaris: Apocalypse
  • Hearts of Iron IV: Cadet
  • Stellaris Sign-up
  • Hearts of Iron IV Sign-up
  • Stellaris
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Magicka 2
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Stellaris: Megacorp
  • 500k Club
  • Victoria 2
  • Hearts of Iron IV: La Resistance
First image is. I must go, my people need me (stellaris mode)
 
  • 23
  • 1
Reactions:

Frosted Vert

First Lieutenant
48 Badges
Jan 14, 2012
235
301
  • Crusader Kings II
  • Crusader Kings II: Jade Dragon
  • Europa Universalis IV: Third Rome
  • Europa Universalis IV: Mare Nostrum
  • Europa Universalis IV: Res Publica
  • Hearts of Iron III
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Charlemagne
  • Arsenal of Democracy
  • Crusader Kings II: Legacy of Rome
  • Darkest Hour
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Prison Architect
  • Hearts of Iron IV: Expansion Pass
  • Imperator: Rome
  • Imperator: Rome Deluxe Edition
  • Crusader Kings II: Holy Fury
  • Shadowrun: Hong Kong
  • Shadowrun Returns
  • Steel Division: Normandy 44 -  Back to Hell
  • Hearts of Iron IV: Expansion Pass
  • Steel Division: Normand 44 - Second Wave
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: La Resistance
  • Europa Universalis IV: Mandate of Heaven
  • Steel Division: Normandy 44
  • Crusader Kings II: Monks and Mystics
  • Hearts of Iron IV: Together for Victory
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Reapers Due
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV Sign-up
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Shadowrun: Dragonfall
Was there any emergent gameplay that you did not expect but were surprised by and later developed as a feature of the game?
 
  • 9
  • 2
Reactions:

Med1980

Second Lieutenant
106 Badges
Feb 3, 2007
129
52
  • Supreme Ruler 2020
  • The Kings Crusade
  • Majesty 2
  • March of the Eagles
  • Europa Universalis III Complete
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Europa Universalis: Rome
  • Rome Gold
  • Semper Fi
  • Sengoku
  • Ship Simulator Extremes
  • Sword of the Stars
  • Lead and Gold
  • Victoria 2
  • Victoria 2: A House Divided
  • Rome: Vae Victis
  • 200k Club
  • 500k Club
  • Cities: Skylines
  • Cities: Skylines Deluxe Edition
  • Crusader Kings II: Holy Knight (pre-order)
  • Europa Universalis III: Collection
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Pre-order
  • Crusader Kings III
  • Commander: Conquest of the Americas
  • Arsenal of Democracy
  • Hearts of Iron II: Armageddon
  • Cities in Motion 2
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Deus Vult
  • Europa Universalis III
  • Divine Wind
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • For The Glory
  • For the Motherland
  • Hearts of Iron III
  • Heir to the Throne
Any dedicated testing for minor platforms such as linux? To be honest I have only encountered very few linux-specific bug.
 

Snow Wolf

Colonel
14 Badges
Jan 22, 2014
876
272
  • Darkest Hour
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Semper Fi
  • Victoria 2
  • Warlock 2: The Exiled
  • Cities: Skylines
  • Stellaris
  • Hearts of Iron IV Sign-up
  • Hearts of Iron IV: Cadet
  • Cities: Skylines - Parklife Pre-Order
  • Cities: Skylines - Parklife
  • Cities: Skylines Deluxe Edition
QA must be a bad job, considering most of the forum users here would do it for free for a certain amount of time :D
 
  • 2
  • 1
Reactions:

Nicolas I

Field Marshal
56 Badges
Oct 2, 2011
2.907
2.760
  • Crusader Kings II
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: The Republic
  • Hearts of Iron IV: Together for Victory
  • Europa Universalis IV: Common Sense
  • Tyranny: Archon Edition
  • Tyranny: Archon Edition
  • Europa Universalis IV: Rights of Man
  • Hearts of Iron IV: Cadet
  • Stellaris Sign-up
  • Hearts of Iron IV Sign-up
  • Stellaris
  • Crusader Kings II: Horse Lords
  • Stellaris: Distant Stars
  • Crusader Kings II: Monks and Mystics
  • Europa Universalis IV: Golden Century
  • Steel Division: Normand 44 Sign-up
  • Hearts of Iron IV: Death or Dishonor
  • Crusader Kings II: Holy Fury
  • Tyranny - Bastards Wound
  • Europa Universalis IV: Cradle of Civilization
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Humanoids Species Pack
  • Europa Universalis IV: Rule Britannia
  • Crusader Kings II: Way of Life
  • Europa Universalis III Complete
  • Hearts of Iron IV: Expansion Pass
  • Europa Universalis III Complete
  • Victoria 2
  • Imperator: Rome Sign Up
  • 500k Club
  • Europa Universalis IV: El Dorado
  • Pillars of Eternity
  • Europa Universalis IV: Res Publica
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis III Complete
  • Europa Universalis III: Chronicles
  • Hearts of Iron III
  • Semper Fi
  • For the Motherland
  • Hearts of Iron III: Their Finest Hour
  • Europa Universalis IV: Art of War
  • Sengoku
How could "quality insurance" let pass the fact that major equipments (tanks, planes, ships) are moving forever without fuel ?
 
Last edited:
  • 46
  • 13
Reactions:

panzerzombie

rotting soon at a place near you
45 Badges
Aug 20, 2009
777
1.109
  • Arsenal of Democracy
  • Stellaris: Leviathans Story Pack
  • Stellaris - Path to Destruction bundle
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Sword of the Stars II
  • Semper Fi
  • Hearts of Iron III
  • For the Motherland
  • Darkest Hour
  • Hearts of Iron II: Armageddon
  • Hearts of Iron IV: La Resistance
  • Stellaris: Synthetic Dawn
  • Tyranny - Bastards Wound
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Apocalypse
  • Steel Division: Normandy 44 -  Back to Hell
  • Stellaris: Distant Stars
  • Shadowrun Returns
  • BATTLETECH: Flashpoint
  • Stellaris: Megacorp
  • Stellaris: Ancient Relics
  • BATTLETECH: Season pass
  • BATTLETECH: Heavy Metal
  • Stellaris Sign-up
  • Victoria 2
  • 500k Club
  • Knights of Pen and Paper 2
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Hearts of Iron IV Sign-up
  • BATTLETECH
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Colonel
  • Tyranny: Archon Edition
  • Hearts of Iron IV: Expansion Pass
  • Steel Division: Normandy 44
  • Hearts of Iron IV: Expansion Pass
  • Shadowrun: Dragonfall
  • Hearts of Iron IV: Expansion Pass
  • Steel Division: Normand 44 - Second Wave
  • Tyranny - Tales from the Tiers
Sooo, you are the one we can make responsible for any mishap......Assemble the crosses and light the torches +++ iii :p
 
  • 1
  • 1
Reactions:

podcat

Oberkommando HOI4
Super Moderator
12 Badges
Jul 23, 2007
12.610
30.901
  • Hearts of Iron III
  • Semper Fi
  • 500k Club
  • Europa Universalis III: Collection
  • Europa Universalis IV: Pre-order
  • Hearts of Iron II: Beta
  • Europa Universalis: Rome Collectors Edition
  • Mount & Blade: Warband
  • Paradox Order
  • Hearts of Iron IV Sign-up
  • Hearts of Iron IV: Together for Victory
Any dedicated testing for minor platforms such as linux? To be honest I have only encountered very few linux-specific bug.
Some QA have more than one platform on their desk. So usually win+linux or win+osx. Dev team has mix of platforms as well so we can test as we go (@TomaszKowalczyk has like 12 screens on his desk)

Sooo, you are the one we can make responsible for any mishap......Assemble the crosses and light the torches +++ iii :p
Contrary to popular belief just because someone has found a bug doesn't mean it automatically get fixed ^_^
 
  • 17
  • 12
Reactions:

tass

Second Lieutenant
66 Badges
Dec 17, 2009
142
35
  • Victoria 2: A House Divided
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
  • Lead and Gold
  • Magicka
  • Europa Universalis IV: Res Publica
  • Semper Fi
  • Crusader Kings II: Charlemagne
  • Europa Universalis IV: Pre-order
  • Cities: Skylines - After Dark
  • Europa Universalis IV: Cossacks
  • Cities: Skylines - Snowfall
  • Europa Universalis IV: Mare Nostrum
  • Stellaris
  • Stellaris - Path to Destruction bundle
  • Europa Universalis IV: Wealth of Nations
  • Crusader Kings II
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Darkest Hour
  • Europa Universalis IV: Call to arms event
  • Europa Universalis III Complete
  • Divine Wind
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis III
  • Europa Universalis IV: Art of War
  • Crusader Kings II: Conclave
  • Hearts of Iron IV: Together for Victory
  • Stellaris: Leviathans Story Pack
  • Stellaris: Digital Anniversary Edition
  • Europa Universalis IV: Rights of Man
  • Imperator: Rome - Magna Graecia
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Europa Universalis III Complete
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Cities: Skylines
  • 500k Club
  • Europa Universalis III Complete
Now that is a refreshing DD, QA is a perspective you rarely hear!

Oh and: Hodor!
 
  • 1
Reactions:

Axe99

Ships for Victory
117 Badges
Feb 13, 2003
14.759
8.932
  • Crusader Kings II: The Republic
  • Crusader Kings III
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Call to arms event
  • For The Glory
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
  • Europa Universalis III Complete
  • Lead and Gold
  • The Kings Crusade
  • Magicka
  • Majesty 2
  • Majesty 2 Collection
  • March of the Eagles
  • Europa Universalis III Complete
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Rome Gold
  • Semper Fi
  • Ship Simulator Extremes
  • Sword of the Stars
  • Supreme Ruler 2020
  • Victoria 2
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Rome: Vae Victis
  • 500k Club
  • Cities: Skylines
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Pre-order
  • Pride of Nations
  • Rise of Prussia
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Cities: Skylines - After Dark
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Conclave
  • Cities: Skylines - Snowfall
  • Europa Universalis IV: Mare Nostrum
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Hearts of Iron IV Sign-up
  • Stellaris Sign-up
  • Hearts of Iron IV: Cadet
Ho ho ho hodor :). Cheers for the DD Distantaziq :D. From those pictures, it sounds like your time in the QA corps while serving on the HoI4 front has been an interesting one ;). Very much appreciate the work of yourself, Daniel and all the other QA involved, very important and often under-appreciated job - keep up the great work, HoI4 has been looking remarkably 'together' during the WWWs.
 
  • 2
  • 1
Reactions: