• Victoria 3 - Sign up now!

    The journey begins, sign up now and get a special in-game item when the game is released.


  • Crusader Kings III Available Now!

    The realm rejoices as Paradox Interactive announces the launch of Crusader Kings III, the latest entry in the publisher’s grand strategy role-playing game franchise. Advisors may now jockey for positions of influence and adversaries should save their schemes for another day, because on this day Crusader Kings III can be purchased on Steam, the Paradox Store, and other major online retailers.


    Real Strategy Requires Cunning
  • Crusader Kings II Expansion Subscription

    Subscribe to the CK II Expansion and enjoy unlimited access to 13 major expansions and more!


CK3 Dev Diary #35 - User Testing Before Release

Hello everyone!

My name is Hanna and I work in a growing field of game development called User Research! I’m here to tell you a little about the job itself and also how me and my team have worked with user testing for Crusader Kings III.

Ah, user testing, I get it - you’re QA/Quality Assurance!
Oh, how many times I hear that! But no, I am not. Very, very simplified it’s kind of like this: When QA evaluate a feature they report on it in a yes/no kind of way - Does it work? Yes/No, so here’s a bug report.

When User Research are asked to evaluate a feature, we look at the game from a user perspective by trying to test and gather feedback on things like how well players understand the game, if any menus are confusing, if players are having fun, etc. This can be done in a variety of ways, but for Crusader Kings III we mostly used playtests where we let 2-15 players that match a specific profile (in this case - PDS strategy players) into our lab to play an unfinished version of the game while watching and recording them and then we brought video clips and player feedback to the dev team.

Woah, that seems pretty abstract! How can you make sure that you’re getting these things completely right and accurate?
You’re right, it is tough - We do this by using a lot of methods used in social science to be able to verify our findings. Most of the time we’ll use a combination of observation (meaning we watch the player playing and take notes on what they say/do), one or several surveys and then an interview. If we can see several people struggle with a tutorial step, chances are they won’t be alone in having that issue, and having them describe how it felt both verbally and in text let’s us pinpoint what’s wrong.

But of course humans are complicated, and it’s important to remember that while we use scientific methods our job is not to produce scientific results. Instead, our job is giving our colleagues a heads up on how to tweak things by providing a basis for discussion and re-design.

And this is relevant to Crusader Kings III because…?
Well, I think having User Research done is good for any kind of interactive medium when it comes to evaluating the ideas and designs put into the game. Crusader Kings III is also an interesting challenge from a user design perspective - How do we keep the complexity hardcore players want while still making sure new players can discover the awesome feeling of inheriting a title because your nephew had an “accident”? If we don’t listen to what actual players say and think, we risk making mistakes and finding out about it when it’s too late to change anything.

Enough about Using Research or whatever, what did you do for Crusader Kings III?
As you’ve likely seen we’re doing a lot of new things in this game compared to both other PDS titles and Crusader Kings II, so this means that having player feedback early is a good idea to avoid going ahead with something that turns out to be a mistake.

For example, one of the first things we did for Crusader Kings III was actually done internally - the dev team were making early designs for characters and User Research helped them out by sending out a survey to all of our colleagues to gather feedback. At the time, characters looked like this:

Early concept arts.jpg


And good thing we got some feedback, because the style turned out to be way too cartoony for most people! It might have brought our colleagues a lot of work, but I’m glad we discovered this way before release day…

Throughout the development of the game, we’ve also run bi-monthly 1 hour playtests with 2-4 players. These tests are often done in close collaboration with the UX designers and are very focused on us seeing how well players are able to finish basic gameplay actions like getting married, starting and finishing a war, setting up a scheme and things like that. Thanks to these tests, several changes have been made to menus that have proven difficult for players to navigate like the Council, Marriage and Building menus and the Siege/War overviews.

But my favourite part of my work is to actually see people play and experience the game during longer playtests. For Crusader Kings III the most important playtest was when it was time to evaluate the tutorial and systems for in-game help. For this test we had 12 participants, 6 of them with 200-800h of CK2 playtime and 6 of them “newbies”, try out the tutorial and then play the game for 2 hours using what they’d learned.

And you know what? Most of them managed just fine, which isn’t really something I’m used to seeing when it comes to Paradox onboarding. New players loved that the tutorial used visual cues to guide them through menus and the suggestions helped them with an issue that many PDS titles have - What the heck do I do next? “Old” players found the UI took some time to get used to, but they also found the suggestion systems useful as checklists on what to do next.

But of course, nothing is perfect - and thanks to the player feedback we could also pinpoint areas where more work was needed for both new and old players, especially regarding the UI. But throughout the playtests we’ve done I’ve been happy to see the game go from incomprehensible to approachable, both for new and returning Crusader Kings-fans.

So if you run these tests why aren’t the games perfect and amazing then?
Oh, I ask myself the same thing every day… But the truth is, game development is complicated and sometimes there’s just no time, manpower or money to address the issues we’ve discovered. We also share our results with community management and marketing to give them a heads up on the questions and concerns they can expect on release.

Has anything changed due to Corona?
Oh absolutely! The biggest change for my team of researchers is that we don’t have access to our beautiful lab at the Stockholm office. The lab is geared up with computer stations where you can prep game installation and recording setup beforehand. This makes setting up studies a lot easier for us and it’s also a good way of preventing leaks.
Crusader Kings III has been lucky in that we had concluded most of the lab activities we’d planned before the release, but for other projects we’ve done studies remotely meaning that we let players play the game on their own computers and do all interviews via video chats. While we’re still trying to work things out, we’re also discovering a lot of benefits from this method of working - the biggest one being that we could potentially run playtests with people from all over the world!

What will you do after the release?
For Crusader Kings III, I will start working on gathering and reporting on feedback following the release - which means that anything you write on Steam or other pages, I’ll go over and try to summarize topics so we know what to improve on next. Then, it’s time to plan new playtests for patches and DLCs!

I hope you’ve enjoyed reading about a lesser known field in game development and that you’ll look forward to the upcoming release of a game that I’ve absolutely loved working with. I will be on vacation when this is posted, but I’ll be happy to answer any questions about User Research when I’m back again on August 1st. Oh, and please be nice to my vanity character if you encounter her - she’s very, very weak.

Vanity Character.jpg
 
  • 102
  • 74Like
  • 11
Reactions:

Froggie

Major
47 Badges
Oct 4, 2013
601
767
  • Victoria 2: Heart of Darkness
  • Stellaris
  • War of the Vikings
  • Victoria 2: A House Divided
  • Magicka
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II
  • Crusader Kings II: Sons of Abraham
  • Surviving Mars: First Colony Edition
  • Stellaris Sign-up
  • Hearts of Iron IV: Cadet
  • Crusader Kings II: Reapers Due
  • Crusader Kings II: Monks and Mystics
  • Cities: Skylines - Mass Transit
  • Surviving Mars
  • Age of Wonders III
  • Cities: Skylines - Green Cities
  • Crusader Kings II: Jade Dragon
  • Surviving Mars: Digital Deluxe Edition
  • Cities: Skylines Industries
  • Crusader Kings III
  • Crusader Kings II: Holy Fury
  • Imperator: Rome
  • Prison Architect
  • Surviving Mars: First Colony Edition
  • Crusader Kings II: Conclave
  • Europa Universalis IV
  • Victoria 2
  • War of the Roses
  • Cities: Skylines
  • Europa Universalis IV: El Dorado
  • Magicka: Wizard Wars Founder Wizard
  • Mount & Blade: Warband
  • Mount & Blade: With Fire and Sword
  • Crusader Kings II: Way of Life
  • Magicka 2
  • Crusader Kings II: Horse Lords
  • Cities: Skylines - After Dark
  • Cities: Skylines - Snowfall
  • Knights of Honor
  • Victoria: Revolutions
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Legacy of Rome

Vohen

General
49 Badges
May 29, 2017
2.433
2.406
  • Europa Universalis IV: Rule Britannia
  • Europa Universalis IV: Cossacks
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Colonel
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV: Rights of Man
  • Hearts of Iron IV: Together for Victory
  • Crusader Kings II: Monks and Mystics
  • Europa Universalis IV: Mandate of Heaven
  • Hearts of Iron IV: Death or Dishonor
  • Europa Universalis IV: Cradle of Civilization
  • Hearts of Iron IV: Expansion Pass
  • Crusader Kings II: Conclave
  • Hearts of Iron IV: Expansion Pass
  • Europa Universalis IV: Dharma
  • Crusader Kings II: Holy Fury
  • Europa Universalis IV: Golden Century
  • Imperator: Rome
  • Hearts of Iron IV: Expansion Pass
  • Imperator: Rome Sign Up
  • Hearts of Iron IV: La Resistance
  • Battle for Bosporus
  • Europa Universalis 4: Emperor
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: El Dorado
  • Victoria 2
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV
  • Crusader Kings II: Jade Dragon
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sword of Islam
  • Darkest Hour
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
  • Hearts of Iron III
  • Europa Universalis IV: Third Rome
  • Europa Universalis IV: Res Publica
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Europa Universalis IV: Mare Nostrum
  • Crusader Kings II
in this case - PDS strategy players
Huh, I think using exclusively players already familiar with PDX games might not be quite a good indicative of the overall picture.
CK3 being played by someone coming from CK2 (or even another PDX game) will look very different from someone fresh into these games, it's worlds apart.

Also, we are now 4 DDs away from release, might be nice to use them to showcase the rest of the world outside of Western Europe.
 
  • 7
  • 3
  • 1Like
Reactions:

LeandroB

Second Lieutenant
On Probation
79 Badges
May 29, 2017
154
620
  • Surviving Mars: First Colony Edition
  • Crusader Kings II: Jade Dragon
  • Surviving Mars: Digital Deluxe Edition
  • Stellaris - Path to Destruction bundle
  • Europa Universalis IV: Common Sense
  • Pillars of Eternity
  • Crusader Kings II: Horse Lords
  • Battle for Bosporus
  • Crusader Kings II: Conclave
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Colonel
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV: Rights of Man
  • Tyranny: Archon Edition
  • Stellaris: Digital Anniversary Edition
  • Stellaris: Leviathans Story Pack
  • Hearts of Iron IV: Together for Victory
  • Crusader Kings II: Monks and Mystics
  • Cities: Skylines - Mass Transit
  • Europa Universalis IV: Mandate of Heaven
  • Europa Universalis IV: Third Rome
  • BATTLETECH
  • Surviving Mars
  • Hearts of Iron IV: Death or Dishonor
  • Cities: Skylines - Green Cities
  • Surviving Mars: First Colony Edition
  • Stellaris: Necroids
  • Crusader Kings II: Holy Fury
  • Europa Universalis IV: Golden Century
  • Imperator: Rome Deluxe Edition
  • Stellaris: Lithoids
  • Hearts of Iron IV: La Resistance
  • Europa Universalis IV
  • Stellaris: Federations
  • Crusader Kings III
  • Europa Universalis 4: Emperor
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Humanoids Species Pack
  • Stellaris: Apocalypse
  • Europa Universalis IV: Rule Britannia
  • Victoria 2
  • Cities: Skylines - Parklife
  • Cities: Skylines
  • Stellaris: Distant Stars
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Dharma
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Mare Nostrum
  • Cities: Skylines - Snowfall
  • Stellaris: Synthetic Dawn
Yours is one of the most important jobs. Thanks for the hard work!
 
  • 9Like
  • 2
  • 1
Reactions:

PapaRocks

Private
53 Badges
Apr 30, 2016
13
16
  • Crusader Kings II: Charlemagne
  • Europa Universalis IV: Rights of Man
  • Stellaris: Galaxy Edition
  • Tyranny: Archon Edition
  • Stellaris - Path to Destruction bundle
  • Knights of Honor
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Crusader Kings II
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Prison Architect
  • Stellaris: Digital Anniversary Edition
  • Hearts of Iron IV: Together for Victory
  • Crusader Kings II: Monks and Mystics
  • Cities: Skylines - Mass Transit
  • Surviving Mars
  • Hearts of Iron IV: Death or Dishonor
  • Cities: Skylines - Green Cities
  • Crusader Kings II: Jade Dragon
  • Hearts of Iron IV: Expansion Pass
  • Crusader Kings III
  • Cities: Skylines - Campus
  • Crusader Kings II: Holy Fury
  • Imperator: Rome Deluxe Edition
  • Imperator: Rome
  • Mount & Blade: With Fire and Sword
  • Europa Universalis IV
  • Victoria 2
  • Cities: Skylines
  • Europa Universalis IV: El Dorado
  • Crusader Kings II: Reapers Due
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Crusader Kings II: Conclave
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Hearts of Iron IV: Cadet
  • Cities: Skylines - After Dark
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Victoria: Revolutions
  • Europa Universalis IV: Res Publica
Those old portraits look like they'd be right at home in some tacky, outsourced free-to-play mobile social spin-off. Crusader Friends™ perhaps?
I hope that's not giving any ideas

I'm sure they are scheming some kind of mobile freemium game. It is a sad path companies like to go down for some reason.
 
  • 22
  • 9
  • 2Haha
Reactions:

tribnia

Major
33 Badges
Nov 26, 2017
589
455
  • Stellaris: Necroids
  • Stellaris: Federations
  • Europa Universalis IV
  • Stellaris: Digital Anniversary Edition
  • Crusader Kings III: Royal Edition
  • Crusader Kings III
  • Stellaris: Lithoids
  • Stellaris: Ancient Relics
  • Crusader Kings II: Holy Fury
  • Stellaris: Megacorp
  • Stellaris: Distant Stars
  • Stellaris: Apocalypse
  • Stellaris: Humanoids Species Pack
  • Crusader Kings II: Jade Dragon
  • Age of Wonders III
  • Stellaris - Path to Destruction bundle
  • Crusader Kings II: Monks and Mystics
  • Stellaris: Leviathans Story Pack
  • Crusader Kings II: Reapers Due
  • Hearts of Iron IV: Cadet
  • Stellaris: Galaxy Edition
  • Stellaris
  • Crusader Kings II: Horse Lords
  • Crusader Kings II: Way of Life
  • Victoria 2
  • Crusader Kings II
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: Charlemagne
  • Stellaris: Synthetic Dawn
  • Crusader Kings II: Sons of Abraham
Could you please show us more easteregg characters in CK3? Then we could compare them with themselves in CK2.
 
  • 3Haha
  • 1Like
  • 1Love
Reactions:

TheVoodooPope

Corporal
47 Badges
Jan 8, 2016
27
26
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Reapers Due
  • Stellaris - Path to Destruction bundle
  • Magicka
  • Europa Universalis IV: Conquest of Paradise
  • Crusader Kings II
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Legacy of Rome
  • Stellaris: Necroids
  • Stellaris: Digital Anniversary Edition
  • Stellaris: Leviathans Story Pack
  • Crusader Kings II: Monks and Mystics
  • BATTLETECH
  • Crusader Kings II: Jade Dragon
  • Stellaris: Humanoids Species Pack
  • Stellaris: Apocalypse
  • Cities: Skylines - Parklife
  • Stellaris: Megacorp
  • Crusader Kings II: Holy Fury
  • Imperator: Rome Deluxe Edition
  • Stellaris: Federations
  • Crusader Kings III
  • Crusader Kings III: Royal Edition
  • Magicka 2
  • Europa Universalis IV
  • Victoria 2
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • War of the Roses
  • Cities: Skylines
  • Europa Universalis IV: El Dorado
  • Crusader Kings II: Way of Life
  • Hearts of Iron IV: Cadet
  • Crusader Kings II: Horse Lords
  • Magicka 2: Ice, Death and Fury
  • Crusader Kings II: Conclave
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris Sign-up
  • Stellaris: Synthetic Dawn
  • Imperator: Rome
Cool how much thought has been put into this game.
My user experience with this dev diary would be improved greatly by more screenshots ;)... even if they are of just random characters and things.
 
  • 6
  • 2Like
  • 1Haha
Reactions:

Nitan17

Second Lieutenant
7 Badges
Sep 26, 2011
141
594
  • Cities in Motion
  • Europa Universalis III Complete
  • Divine Wind
  • Heir to the Throne
  • Europa Universalis III Complete
  • Europa Universalis III Complete
  • 500k Club
These portraits are mobile-tier awful, why in the world were they considered a viable option? Jesus, had you stuck with them you would just drown in negative feedback and your playerbase's faith in CK3 would be irreparably shaken right after its announcement.

Please slap the person who came up with them.
 
  • 14Haha
  • 12
  • 7
Reactions:

Olden Weiss

Colonel
Jul 11, 2020
845
3.572
So you're saying you and your team were responsible for setting portraits off the cartoony path and on the path to what we have today? In that case, you're my heroes and I wish I could buy you all a grand feast. The new portraits are a big reason I'm so excited for CK3, and those early ones... I don't know how excited I would have been if that were the style of the final look...

Oh, and please be nice to my vanity character if you encounter her - she’s very, very weak.

View attachment 603542

I wouldn't take her lightly if I came up against her. They say the pen is mightier than the sword, and look at that 27 Learning stat!
 
  • 26
  • 2Love
  • 1Like
Reactions:

Alenarae118

Captain
26 Badges
Jun 1, 2020
341
1.411
  • Pillars of Eternity
  • Crusader Kings III
  • Crusader Kings II: Way of Life
  • Europa Universalis IV
  • Prison Architect
  • Imperator: Rome
  • Crusader Kings II: Holy Fury
  • Crusader Kings II: Jade Dragon
  • Crusader Kings II: Monks and Mystics
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Reapers Due
  • Hearts of Iron IV: Cadet
  • Stellaris
  • Crusader Kings II: Conclave
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: El Dorado
  • Victoria 2
  • Hearts of Iron III
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: Charlemagne
  • Crusader Kings II
These portraits are mobile-tier awful, why in the world were they considered a viable option? Jesus, had you stuck with them you would just drown in negative feedback and your playerbase's faith in CK3 would be irreparably shaken right after its announcement.

Please slap the person who came up with them.
This is why you don't do drugs, kids. lol :D
 
  • 6Haha
  • 1Like
  • 1
Reactions:

SirPenetrator

Second Lieutenant
17 Badges
Apr 20, 2019
100
180
  • Crusader Kings II
  • Europa Universalis IV: Rights of Man
  • Crusader Kings III
  • Imperator: Rome - Magna Graecia
  • Imperator: Rome Sign Up
  • Prison Architect
  • Imperator: Rome
  • Imperator: Rome Deluxe Edition
  • Cities: Skylines - Parklife
  • Age of Wonders III
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Cities: Skylines - After Dark
  • Cities: Skylines
  • Europa Universalis IV
  • Crusader Kings II: Sword of Islam
  • Crusader Kings II: The Old Gods
Bless the 3D Portraits/Models

Interesting Dev Diary, nice insight, thank you!
 
  • 7
  • 1Like
Reactions:

Olden Weiss

Colonel
Jul 11, 2020
845
3.572
I'm sure they are scheming some kind of mobile freemium game. It is a sad path companies like to go down for some reason.

Probably because a great many people have mobile devices and use them regularly. I don't expect PDS will be going there anytime soon, though. Their games fit a popular niche, and they do so because of depth that would be incredibly difficult to capture with mobile hardware.
 
  • 4
  • 1
Reactions:

Knotz

[un]Secret Witch
1 Badges
Apr 4, 2013
2.371
4.046
Clearly the user testing people know what they're doing if people dislike something with such intensity upon exposure to it that they can't help but complain about it even though they know it isn't a thing anymore.
 
  • 26Haha
  • 3Like
  • 2
Reactions:

Ezumiyr

Field Marshal
70 Badges
Jul 21, 2012
3.741
5.475
  • Crusader Kings II
  • Crusader Kings II: Jade Dragon
  • Stellaris: Synthetic Dawn
  • Europa Universalis IV: Third Rome
  • Stellaris - Path to Destruction bundle
  • Crusader Kings II: Reapers Due
  • Stellaris: Galaxy Edition
  • Europa Universalis IV: Mare Nostrum
  • Magicka 2
  • Europa Universalis IV: Pre-order
  • Cities: Skylines Deluxe Edition
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Europa Universalis IV: Res Publica
  • Crusader Kings II: Sons of Abraham
  • Cities in Motion
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Magicka
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Hearts of Iron IV: Cadet
  • Europa Universalis IV: Cradle of Civilization
  • Age of Wonders III
  • Victoria 2
  • Europa Universalis IV: Mandate of Heaven
  • Crusader Kings II: Monks and Mystics
  • Stellaris: Leviathans Story Pack
  • Stellaris: Digital Anniversary Edition
  • Tyranny: Archon Edition
  • Europa Universalis IV: Rights of Man
  • Warlock 2: The Exiled
  • Europa Universalis IV: El Dorado
  • Stellaris Sign-up
  • 500k Club
  • Stellaris: Galaxy Edition
  • Stellaris
  • Stellaris: Necroids
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Common Sense
  • Europa Universalis IV
  • Pillars of Eternity
Huh, I think using exclusively players already familiar with PDX games might not be quite a good indicative of the overall picture.
If you read the entire dev diary, you'll see that they perform many tests, and one of them at least involved total newbies.
 
  • 8
  • 6
  • 1Like
Reactions:

arosenberger14

Captain
73 Badges
Jun 22, 2011
397
1.335
  • Semper Fi
  • Europa Universalis IV: Res Publica
  • Heir to the Throne
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III
  • For the Motherland
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Art of War
  • Rome: Vae Victis
  • Divine Wind
  • Victoria 2: Heart of Darkness
  • Crusader Kings II: Sword of Islam
  • Victoria 2: A House Divided
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: The Republic
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: Charlemagne
  • Crusader Kings II
  • Stellaris: Humanoids Species Pack
  • Europa Universalis IV: El Dorado
  • Victoria 2
  • 500k Club
  • Europa Universalis IV: Mandate of Heaven
  • Pride of Nations
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Conclave
  • Europa Universalis IV: Rights of Man
  • Stellaris
  • Crusader Kings II: Reapers Due
  • Stellaris: Digital Anniversary Edition
  • Age of Wonders III
  • Stellaris: Leviathans Story Pack
  • Crusader Kings II: Monks and Mystics
  • Europa Universalis IV: Rule Britannia
  • Stellaris: Ancient Relics
  • Europa Universalis 4: Emperor
  • Stellaris: Distant Stars
  • Crusader Kings II: Holy Fury
  • Europa Universalis IV: Golden Century
  • Europa Universalis IV
  • Stellaris - Path to Destruction bundle
  • Europa Universalis IV: Dharma
  • Stellaris: Megacorp
  • Europa Universalis IV: Cradle of Civilization
Great to hear about your work; this is something paradox games definitely need in addition to bug testing. Would it be possible to use these methods to help with balancing and the late-game experience too? While not entirely practical, seems you'd also want some data on how the back end of a centuries long campaign goes in order to help keep CK3 a great experience throughout an entire campaign. Could also help with some other Paradox titles such as Stellaris or EU4 where the fun tends to die down after a certain amount of time...
 
  • 7
  • 1Like
  • 1
Reactions: