• We have updated our Community Code of Conduct. Please read through the new rules for the forum that are an integral part of Paradox Interactive’s User Agreement.
Greetings, fellow crusaders!

In this Dev Diary we’ll give a brief insight in how the CK2 QA team works and functions.

The team consists of myself (Servancour), PeterSkager, rageair and Leo Larsson. I’ve been here the longest and have been at Paradox for close to two years now, and so far it’s been a blast! We’re a close-knit team and work very well together, each and every one specializing in different types of gameplay.

As a team, we work very closely with the developers and attend all sorts of meetings to ensure that we stay up to date with the game. When you work with QA you need to know almost everything about the game, from overarching design to the smaller details of specific features. It’s challenging but also very rewarding.

While our primary responsibility may be to test the game, it’s not the only one. Many believe that the life of a QA only consists of reporting bugs, but it’s actually much more than that. We’re responsible for ensuring the overall quality of the product, by providing constant feedback, voice concerns where needed, comment on design and suggest improvements in order to make the game both better and more accessible!

Something we do every now and then when there’s new features to test is to simply play the game in order to get a feel for how to play with them. We usually test a variety of different scenarios, with varying start dates and setups, where we play for anything between a few years to several centuries. Sometimes we play for just a few hours, other times we have the campaigns going over the course of a few days, all while we gather feedback and impressions to the developers. This type of testing allows us to get a more accurate representation on how the game actually plays to find issues you wouldn’t find in a few minutes of playtime. Sometimes we even start using the same scenario just to see how far we can deviate from each other as we use very different playstyles. We believe that having many eyes on the same problem yield the best results.

We’re extremely passionate about the game. Each and every one of us here at the CK2 QA team has played the game for anything between a few hundred to several thousand hours and most of it has been purely for our own enjoyment. I myself play the game regularly outside of work and in my latest campaign I started off as Charlemagne himself, culture switched to German and created the Holy Roman Empire! I’m almost done with it though, with just the last hundred years or so left before the end date. My current ruler is Kaiserin Amalia “The Hammer”, ruling over Europe with an iron fist!

This passion also motivates us to not only ensure that the game performs well from a professional standpoint, but also from the perspective of a player. This causes us to often go above and beyond our ordinary tasks! We at QA has, on occasion, contributed with content to the game. Often to ensure that each and every part of the game feels like a quality experience. For example; we’ve created events to enhance certain aspects of the game (see the Sky Burial and Master Wrestling event chains) and even created art in the form of the Nomadic CoA’s introduced in Horse Lords.

I hope you gained some useful insight in how we approach CK2 from the QA team, and that we work hard to give you, the fans, a product that you deserve. Since we at QA love quality of life improvements, I’ll wrap this up by showing you the following screenshot of a previous feature we are extending somewhat:

ck2_diary_screen.jpg
 

Aardvark Bellay

Lord Wuffington of Grumpytown by the barks
21 Badges
Apr 5, 2001
15.449
2.865
  • Divine Wind
  • Stellaris Sign-up
  • Hearts of Iron IV Sign-up
  • Crusader Kings II: Horse Lords
  • Crusader Kings II: Holy Knight (pre-order)
  • 500k Club
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Victoria 2
  • Victoria: Revolutions
  • Heir to the Throne
  • Crusader Kings II
  • Europa Universalis III
  • Deus Vult
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: Charlemagne
SILINCE NOONE WANTS LOGIC !

Well, if you take relative proportion (aka ratio) instead of hours played and say 5000 of these 10.000 see a bug, then shouldn't two of the 4 in QA see it too ?

:D
Logic.

(this is a reply to you, not Darkrenown and no i'm not incredibly serious, just relatively)


@ OP/Servancour
Always good to read about things and perspectives. Thanks.
 
Last edited:

aono

Field Marshal
113 Badges
Aug 26, 2008
4.021
3.432
  • Europa Universalis 4: Emperor
  • Prison Architect
  • Stellaris: Necroids
  • Stellaris: Nemesis
  • Victoria 3 Sign Up
  • Hearts of Iron IV: By Blood Alone
  • Hearts of Iron IV: No Step Back
  • Knights of Pen and Paper 2
  • Stellaris: Federations
  • Prison Architect: Psych Ward
  • Battle for Bosporus
  • Island Bound
  • Cities in Motion
  • Europa Universalis IV
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Europa Universalis III
  • Europa Universalis III: Chronicles
  • Divine Wind
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III Collection
  • Heir to the Throne
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Stellaris: Megacorp
  • Stellaris: Ancient Relics
  • Semper Fi
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Rome: Vae Victis
  • Europa Universalis IV: Pre-order
  • Cities: Skylines - After Dark
  • Europa Universalis IV: Cossacks
  • Cities: Skylines - Snowfall
  • Europa Universalis IV: Mare Nostrum
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
QA always gets the worst from the community and the worst from the developers themselves " YOU have no clue about videogames! I make videogames, you simply play them! "
Well, to be really honest QA gets the worst from the community by right. After all, their work is to not allow bugs and glitches meet community.
 
  • 9
Reactions:

Korashy

Field Marshal
93 Badges
Jul 15, 2012
4.256
3.739
  • Stellaris: Synthetic Dawn
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
  • Europa Universalis IV: Res Publica
  • Crusader Kings II
  • Semper Fi
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Victoria: Revolutions
  • Europa Universalis IV: Pre-order
  • Europa Universalis IV: Third Rome
  • Pillars of Eternity
  • Europa Universalis IV: Mare Nostrum
  • Stellaris - Path to Destruction bundle
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • For the Motherland
  • Europa Universalis III
  • Europa Universalis III: Chronicles
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Divine Wind
  • Europa Universalis IV: Art of War
  • Europa Universalis III Complete
  • Cities: Skylines - After Dark
  • Stellaris Sign-up
  • Stellaris: Galaxy Edition
  • Europa Universalis III Complete
  • Europa Universalis III Complete
  • Cities: Skylines - Snowfall
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Stellaris: Necroids
  • Europa Universalis IV: El Dorado
  • Cities: Skylines Deluxe Edition
  • Cities: Skylines
QA always gets the worst from the community and the worst from the developers themselves " YOU have no clue about videogames! I make videogames, you simply play them! "

Quoting a little chump who mysteriously got his car on fire. Something to do with factory faulty ignition or something.

Most unfortunate, but with all these ongoing recalls all the time, not suspicious at all.
 

Spelf

Captain
87 Badges
Sep 16, 2012
385
37
  • Stellaris: Necroids
  • Stellaris: Federations
  • Cities: Skylines - Campus
  • Prison Architect: Psych Ward
  • Age of Wonders: Planetfall
  • Crusader Kings III
  • Hearts of Iron IV: La Resistance
  • Steel Division: Normandy 44
  • Cities: Skylines - Green Cities
  • Stellaris: Lithoids
  • Empire of Sin
  • Europa Universalis 4: Emperor
  • Cities: Skylines - Parklife
  • Island Bound
  • Battle for Bosporus
  • Cities: Skylines Industries
  • Crusader Kings III: Royal Edition
  • Hearts of Iron III
  • Europa Universalis IV
  • Cities: Skylines - After Dark
  • Europa Universalis IV: Pre-order
  • Rome: Vae Victis
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Victoria: Revolutions
  • Heir to the Throne
  • Cities in Motion 2
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Crusader Kings II: Rajas of India
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Divine Wind
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Europa Universalis III
  • Stellaris: Ancient Relics
  • Stellaris: Leviathans Story Pack
  • Cities: Skylines - Natural Disasters
  • Stellaris: Digital Anniversary Edition
  • Hearts of Iron IV: Together for Victory
  • Crusader Kings II: Monks and Mystics
  • Cities: Skylines - Mass Transit
  • Europa Universalis IV: Mandate of Heaven
  • Surviving Mars
  • Hearts of Iron IV: Death or Dishonor
Anyone else notice what appears to be Kingdom-level Tuscany and Verona for what clearly wouldn't be Kingdom-size otherwise? Maybe CK2+ style Grand Duchies?
 

Finnway

Lt. General
29 Badges
Feb 21, 2014
1.421
2.389
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Mare Nostrum
  • Crusader Kings II
  • Europa Universalis IV: Res Publica
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Art of War
  • Europa Universalis IV
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: Charlemagne
  • Shadowrun: Hong Kong
  • Europa Universalis IV: Cradle of Civilization
  • Age of Wonders III
  • Knights of Honor
  • Europa Universalis IV: Mandate of Heaven
  • Europa Universalis IV: Rights of Man
  • Stellaris
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Cities: Skylines
Between the enhanced dynastic the view, the tweaks to alliances (we know they're doing something with alliances, but we don't know what), and the fact that this expansion is something Groogy (or was it Doomdark?) has wanted to do for a long time, I wonder if this xpac could be cadet branches?

Hmm, a realm's sub-dynasties are now visible for people of that realm? Neat, I guess.
TBH, that's a feature I've been wanting for a long time. It's nice that they finally did it.
 

Will Steel

Centurion First-File
112 Badges
Oct 23, 2010
6.784
7.173
  • Heir to the Throne
  • Europa Universalis III Complete
  • Divine Wind
  • Imperator: Rome Deluxe Edition
  • Europa Universalis III Complete
  • Semper Fi
  • Stellaris: Leviathans Story Pack
  • Victoria 2
  • Stellaris: Digital Anniversary Edition
  • Cities: Skylines - Parklife
  • Stellaris: Humanoids Species Pack
  • Cities: Skylines
  • Cities: Skylines Deluxe Edition
  • Europa Universalis IV: El Dorado
  • Pride of Nations
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Hearts of Iron IV: Death or Dishonor
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Rights of Man
  • Surviving Mars: First Colony Edition
  • Stellaris: Galaxy Edition
  • Europa Universalis IV: Dharma
  • Stellaris: Distant Stars
  • Hearts of Iron IV Sign-up
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV
  • Prison Architect
  • Hearts of Iron IV: Expansion Pass
  • Surviving Mars
  • Stellaris: Ancient Relics
  • Europa Universalis IV: Golden Century
  • Cities: Skylines - Mass Transit
  • Surviving Mars: Digital Deluxe Edition
  • Cities: Skylines - Green Cities
  • Cities: Skylines - Natural Disasters
  • Surviving Mars: First Colony Edition
  • Crusader Kings Complete
  • Imperator: Rome Sign Up
  • Europa Universalis IV: Mandate of Heaven
  • Crusader Kings II: Monks and Mystics
  • Crusader Kings II: Holy Fury
  • For The Glory
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Europa Universalis III Complete
  • Cities: Skylines - Campus
  • Hearts of Iron IV: Together for Victory
'Dev diary' eh? I do appreciate giving us an insight about Paradox teams work, and this was a good diary and I thank you for that. Still, I'll keep waiting for a real one without any complaint. :)

Wait, are you guys changing the colour of ERE again? :eek:
 

Lord_P

Field Marshal
67 Badges
Apr 17, 2014
3.894
3.355
  • Crusader Kings II
  • Magicka
  • Europa Universalis IV
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: La Resistance
  • Crusader Kings II: Monks and Mystics
  • Hearts of Iron IV: Together for Victory
  • Stellaris: Leviathans Story Pack
  • Stellaris: Digital Anniversary Edition
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Reapers Due
  • Stellaris: Synthetic Dawn
  • Stellaris
  • Stellaris: Federations
  • Cities: Skylines - Mass Transit
  • Europa Universalis IV: Mandate of Heaven
  • Hearts of Iron IV: Death or Dishonor
  • Europa Universalis IV: Common Sense
  • Age of Wonders III
  • Stellaris: Distant Stars
  • Cities: Skylines - Parklife
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Humanoids Species Pack
  • Stellaris: Apocalypse
  • Cities: Skylines - Parklife Pre-Order
  • Warlock: Master of the Arcane
  • Battle for Bosporus
  • Crusader Kings II: Legacy of Rome
  • Stellaris: Lithoids
  • Stellaris: Ancient Relics
  • Prison Architect
  • Hearts of Iron IV: Expansion Pass
  • Imperator: Rome
  • Victoria 2
  • Crusader Kings II: Holy Fury
  • Europa Universalis IV: Dharma
  • Crusader Kings II: Conclave
  • War of the Roses
  • Cities: Skylines
  • Europa Universalis IV: El Dorado
  • Mount & Blade: With Fire and Sword
  • Crusader Kings II: Way of Life
  • Pillars of Eternity
  • Crusader Kings II: Horse Lords
  • Crusader Kings III: Royal Edition
That must explain why Capet dynasty is doing ok, I mean, they still control Flanders and they have not lost Aquitaine yet.
They have already lost Gent...

RIP Gent

Saddest place on Europe

Always War
 

Philadelphus

Not the Ptolemy. Nor the shrub.
75 Badges
Feb 8, 2015
931
927
  • Hearts of Iron IV: Death or Dishonor
  • Crusader Kings II
  • Stellaris - Path to Destruction bundle
  • Stellaris: Megacorp
  • Europa Universalis IV: Dharma
  • Stellaris: Nemesis
  • Stellaris: Necroids
  • Cities: Skylines - Green Cities
  • Europa Universalis 4: Emperor
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Humanoids Species Pack
  • Stellaris: Apocalypse
  • Europa Universalis IV: Rule Britannia
  • Cities: Skylines - Parklife
  • Stellaris: Distant Stars
  • Stellaris: Federations
  • Surviving Mars: First Colony Edition
  • Europa Universalis IV: Mandate of Heaven
  • Crusader Kings II: Holy Fury
  • Europa Universalis IV: Golden Century
  • Imperator: Rome Deluxe Edition
  • Hearts of Iron IV: Expansion Pass
  • Cities: Skylines - Campus
  • Stellaris: Lithoids
  • Hearts of Iron IV: La Resistance
  • Hearts of Iron IV Sign-up
  • Europa Universalis IV
  • Cities: Skylines
  • Europa Universalis IV: El Dorado
  • Crusader Kings II: Way of Life
  • Magicka 2
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Magicka 2: Ice, Death and Fury
  • Crusader Kings II: Conclave
  • Surviving Mars
  • Stellaris Sign-up
  • Hearts of Iron IV: Cadet
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV: Rights of Man
  • Stellaris: Digital Anniversary Edition
  • Stellaris: Leviathans Story Pack
  • Cities: Skylines - Natural Disasters
  • Hearts of Iron IV: Together for Victory
  • Crusader Kings II: Monks and Mystics
  • Cities: Skylines - Mass Transit
  • Cities: Skylines Deluxe Edition
Nice dev diary, @Servancour. It's nice to get these looks behind the Paradox curtain, even if some people seem to forget that the first several diaries after a major expansion never have major gameplay features, even for EU IV. :) I'm curious, how often do you guys run into major crash-to-desktop bugs that we never get to see?

Also as a Linux gamer it's wonderful to hear about you playing it for testing! Paradox support for Linux with EU IV and CK II is consistently good despite the fact that we must make up at best a few percent of your customers, and I certainly appreciate it. :)
 

CVDE

Major
17 Badges
Mar 31, 2015
687
771
  • Crusader Kings II: Charlemagne
  • Europa Universalis IV
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II
  • Crusader Kings II: Holy Fury
  • Crusader Kings II: Jade Dragon
  • Crusader Kings II: Monks and Mystics
  • Tyranny: Archon Edition
  • Crusader Kings II: Reapers Due
  • Crusader Kings II: Conclave
  • Crusader Kings II: Horse Lords
  • Crusader Kings II: Way of Life
I just have a simple question

Have you guys give any thought to adding the Dueling System to vanilla or something like it??

Also Sword traits

( And yes I do know you dont have to tell me )
 
Last edited:

Ferrous Will

I Invoke The Ancient Power That I May Return!
130 Badges
Jul 17, 2012
1.733
5.652
  • Sword of the Stars II
  • The Kings Crusade
  • Magicka
  • Majesty 2
  • March of the Eagles
  • Europa Universalis IV: Mare Nostrum
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Rome Gold
  • Semper Fi
  • Sengoku
  • Ship Simulator Extremes
  • Sword of the Stars
  • Europa Universalis IV: Rights of Man
  • Cities: Skylines - Snowfall
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Rome: Vae Victis
  • Europa Universalis IV: Cossacks
  • Cities: Skylines - After Dark
  • Magicka 2
  • Cities: Skylines Deluxe Edition
  • Stellaris: Galaxy Edition
  • Europa Universalis IV: Pre-order
  • Stellaris: Galaxy Edition
  • Stellaris
  • Europa Universalis III Complete
  • Cities in Motion
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Darkest Hour
  • Europa Universalis III
  • Arsenal of Democracy
  • Divine Wind
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
  • For The Glory
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
Not really.
QA can only inform the dev-team and producers about problems, they have no mandate to cancel or post-pone a game.
If someone is to blame it's either me or the producer (or anyone above us in the chain of command).

Producers need love too!

 
Last edited:

majorlupa

Captain
35 Badges
Jun 30, 2010
467
511
  • Crusader Kings II: Charlemagne
  • Europa Universalis IV: Mare Nostrum
  • Europa Universalis IV: Res Publica
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Legacy of Rome
  • Europa Universalis IV: Golden Century
  • Crusader Kings II: Holy Fury
  • Europa Universalis IV: Dharma
  • Europa Universalis IV: Rule Britannia
  • Crusader Kings II: Jade Dragon
  • Europa Universalis IV: Cradle of Civilization
  • Europa Universalis IV: Third Rome
  • Europa Universalis 4: Emperor
  • Europa Universalis IV: Mandate of Heaven
  • Crusader Kings II: Monks and Mystics
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Reapers Due
  • Hearts of Iron IV Sign-up
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV
  • Crusader Kings II: Sunset Invasion
Luckily people here understand things like math. If 10,000 people play for an undefined "few" hours, lets say 3, that is 30,000 hours of testing. For 4 QA working 8 hour days that would be ~2.5 years of testing. Which doesn't even consider that QA aren't testing the final version for the entire period, or that fixing one bug can reveal other bugs, unbalanced things, or exploits.

Why would someone continue to maintain and pay for 4 QA, while releasing closed beta for around 100-200 people would be better choice(imo) ?
 
  • 6
Reactions:

Jamey

Field Marshal
106 Badges
Sep 9, 2009
3.437
3.383
  • 500k Club
  • BATTLETECH - Backer
At the moment, we don't do a lot of automated testing. But this is definitely something we are looking to do much more in the future in order help us out with some of the more basic testing procedures.
Good luck with that. Covering a large existing code base with automated testing often feels thankless, but it is worth it when you start regularly catching new bugs as they are introduced. :)

I'm currently reading "Working Effectively with Legacy Code by Michael Feathers. I wish I read it before rather than after starting my current job. It's pretty good so far.
 

aono

Field Marshal
113 Badges
Aug 26, 2008
4.021
3.432
  • Europa Universalis 4: Emperor
  • Prison Architect
  • Stellaris: Necroids
  • Stellaris: Nemesis
  • Victoria 3 Sign Up
  • Hearts of Iron IV: By Blood Alone
  • Hearts of Iron IV: No Step Back
  • Knights of Pen and Paper 2
  • Stellaris: Federations
  • Prison Architect: Psych Ward
  • Battle for Bosporus
  • Island Bound
  • Cities in Motion
  • Europa Universalis IV
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Europa Universalis III
  • Europa Universalis III: Chronicles
  • Divine Wind
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III Collection
  • Heir to the Throne
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Stellaris: Megacorp
  • Stellaris: Ancient Relics
  • Semper Fi
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Rome: Vae Victis
  • Europa Universalis IV: Pre-order
  • Cities: Skylines - After Dark
  • Europa Universalis IV: Cossacks
  • Cities: Skylines - Snowfall
  • Europa Universalis IV: Mare Nostrum
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
Not really.
QA can only inform the dev-team and producers about problems, they have no mandate to cancel or post-pone a game.
If someone is to blame it's either me or the producer (or anyone above us in the chain of command).
Well, I'd say it's kinda of compicated.
First of all, it's not that I despise testers or something like that. I'm in this business exactly for nearly 15 years, so I believe I know the drill.
But to be honest I believe we're speaking different things here.
There is bugs such as "hey, this new mechanics unlock some spicy way to win, a-ha!". It's not QA responsibility - as was said already, just simple math says us users always find way better. If they catch something like that, well, they supposed to describe it to programmers with something about "suggestion" tag. No arguing here.
Also there is bugs such as "hey, it's obvious we need this feature here for hundred of years". It's not QA responsibility again, it's for dev.
But there is bugs, such as, you know, bugs. Sometimes button to reform non-norse pagan (if I recall a case right) just disappears from interface. Or maybe levies just don't dissolve. I offer some obvious bugs, with no sane developer or producer will release build with such things, that's not something you just put "do-not-fix" and ignore. Once again, that's obvious ones, but there happens something more obscure, such as "AI never build anything" or "AI builds, but too rarely". I'm trying to speak about that ones I saw in forums here, not something I noticed and ignored.
So if that bugs appear it's became a work for QA to find it. If this bugs slips away, well, it's definitly valid to blame QA for that. Yeah, QA can say "we found exactly that one, there is created task in tracker, from given date, with that exactly developer (or producer) who said it's not matter". It takes responsibility for that particular bug to somebody who closed the task, but it doesnt' take away responsibility for not creating the one. So, when we're thinking that developing process is structured nice, blaming the QA for such things is completly normal.
I know perfectly that you can't fish all glitches like that, maybe some kingdom creating crushs a game when performing with some obscure culture or with some trait, but skipping something like that is QA responsibility. That's why I was urging Paradox to hire more testers - because more testers find bugs more effective.

Why would someone continue to maintain and pay for 4 QA, while releasing closed beta for around 100-200 people would be better choice(imo) ?
https://forum.paradoxplaza.com/forum/index.php?threads/beta-testing-and-qa.827222/