Game slows to unplayable speeds after 60+ years of play [details inside]

[BlankJones]

Hello!

I've made a post 4 months ago concerning the same issue, however since then I've upgraded my system yet still encounter the issue. But first:

Version(s) Tested
[2.2.1] (DPOO) ---Played as one of the Welsh nations at the Charlemagne start date ending at 960. Clean install. Non Ironman.
[2.2.1.1] (SPSR) ---Played(ing) as one of the Saxon chief's at the Charlemagne start date ending at 960. Clean install. Non Ironman.

DxDiag
View attachment DxDiag.txt

Logs
View attachment logs.zip

Disk Fragmentation?

Settings

[COLOR="#D3D3D3"]gui=
{
	language=l_english
	has_set_language=yes
}
graphics=
{
	size=
	{
		x=1920
		y=1080
	}

	refreshRate=0
	fullScreen=no
	borderless=yes
	shadows=no
	shadowSize=2048
	multi_sampling=0
	anisotropic_filtering=0
	gamma=50.000000
}
sound_fx_volume=100.000000
music_volume=22.000000
scroll_speed=50.000000
camera_rotation_speed=50.000000
zoom_speed=50.000000
mouse_speed=50.000000
master_volume=58.000000
ambient_volume=50.000000
mapRenderingOptions=
{
	draw_terrain=yes
	draw_water=yes
	draw_borders=yes
	draw_trees=no
	draw_rivers=yes
	draw_postfx=yes
	draw_sky=yes
	draw_bloom=no
	draw_tooltips=yes
	draw_hires_terrain=no
	draw_citysprawl=no
}
camera_speed=50.000000
camera_tilt=100.000000
centered_zoom_in=yes
lastplayer=""
lasthost=""
serveradress="diplomacy.valkyrienet.com"
autosave="YEARLY"
difficulty="NORMAL"
outliner=
{
	1 2 3 4 5 6 7 9 13 }
outliner_open=no
windowmovetime=0.200000
disable_wikipedia_links=no
nudge_allowed=no
dont_track_data=no
has_made_data_tracking_choice=yes
has_disabled_welcome_screen=yes
hints=no
ironman=yes
mp_max_day_lead=7
compress_autosaves=no
autosaves_to_keep=0
low_res_textures=no
force_pow2_textures=no
last_used_id="76561198001063052"[/COLOR]

Summary specs
Motherboard http://www.newegg.com/Product/Product.aspx?Item=N82E16813130679 ---Bought less than a week ago
Harddrive http://www.newegg.com/Product/Product.aspx?Item=N82E16822148840 ---Bought less than a week ago
CPU http://www.newegg.com/Product/Product.aspx?Item=N82E16819113286 ---Bought less than a week ago
GPU http://www.geforce.com/hardware/desktop-gpus/geforce-gtx-570/specifications ---Bought when it was released
PSU http://www.newegg.com/Product/Product.aspx?Item=N82E16817139112 ---Bought less than a week ago
RAM http://www.gskill.com/en/product/f3-12800cl8d-4gbtd ---Not sure how old but meh
---Course I have an extra stick aswell to make the full 6GB

Comparisons
Old vs New http://cpuboss.com/cpus/AMD-Phenom-II-X4-965-vs-AMD-FX-6300
New vs Recommended http://cpuboss.com/cpus/Intel-Pentium-4-630-vs-AMD-FX-6300
---I should probably join the intel master race anyways, but isn't this good enough?
Current GPU vs Recommended GPU http://gpuboss.com/gpus/GeForce-GTX-570-vs-GeForce-GT-8800

Original Post
http://forum.paradoxplaza.com/forum/showthread.php?785092-Running-the-game-using-two-cpu-s-3-speed-at-5-speed-lag
======
To be more specific the lag I get doesn't seem to be FPS but more of processing speed. I notice that around the 60-100 year mark 5 speed is virutally identical to 4 speed, like wise as the years progress it only declines. Before I know it I can't get any faster than 1 speed. I know not many have been reporting this similar issue (except for recent regarding massive civil wars) However I do notice a slight difference whenever I overclock my CPU. Temperatures remain well under the maximum limit as shown in the picture below (I'm using my motherboards OC Genie II feature to overclock up to 3.8Mhz)

---Taken when game was running at full 5 speed on High priority using the task manager during overclock

This was tested with no background applications running except:
Anti-Virus http://www.avast.com/en-us/index
CPU Monitor Gadget http://addgadgets.com/all_cpu_meter/
Steam(allhailgaben.gaben)

So I'm at a loss really. Considering just returning this AMD setup for an Intel build but I feel the game should run fine regardless? Any help is appreciated. Thanks!

Additional Notes:
1.) The launcher sometimes doesn't have the button animations when hovering over them with the cursor, and generally seems a little buggy but still functions.
2.) I have some slight suspicions that my computer case could be shorting out my board as I don't have all the mounting screws in (missing two) however I have no evidence
3.) Over the time I've been using my GPU it hasn't always been properly screwed into the case for support, so I have a suspicion that it's bent however I have no evidence
4.) I haven't tested without using the portrait and unit packs, but could those be enough to cause lag?
5.) I haven't tested my current setup with older versions of the game
6.) I haven't tested the game running in windowed mode, but I've heard that running fullscreen performs better?
7.) I have the most updated driver version for my GPU ( http://puu.sh/dpSPa/718924920d.png )
8.) I have the exact issues with EU3 & EU4. Does clausewitz engine hate me? D:

Current Game screenshots: [BETA 2.2.1.1]
http://puu.sh/dpQYF/de8dc5b10a.jpg
http://puu.sh/dpR4V/e9d6f428f6.jpg


Edit: (12-11-14) I've just noticed that the game seems to be using only one core rather than all of them, however the process is set affinity to all of them.

 

[AndrewT]

This happens in any new game you start, regardless of starting date or who you are playing as?

What temperatures are you seeing on your GPU?

In Task Manager, is ck2game.exe assigned to High Priority? Try reducing Affinity to only, say, 2 cores - any difference?

 

[BlankJones]

(Tested with both 2.2.1 and 2.2.1.1)

1.) Yes regardless of who I play at any date

2.) My GPU temperature stays at a permanent range of 65c - 70c when playing both idle and 5 speed

3.) Always set to high priority. Reducing affinity significantly drops performance, increasing affinity helps but still remains at snails pace. I've compared the speeds whenever certain things happened such as revolts
--Using all cores from start date to 100 year mark at 5 speed
1 month = 4 seconds during peace and no revolts GPU 60c - 65c
1 month = 4.5 seconds during war however no revolts GPU 65c - 67c
1 month = 4.5 seconds during peace but revolts GPU 65 - 67c
1 month = 4.5 seconds during war and revolts GPU 67 - 70c

--Using all cores after the 100 year mark at 5 speed
1 month = 8.5 seconds during peace and no revolts GPU 65c - 66c
1 month = 12 seconds during war however no revolts GPU 67c - 70c
1 month = 12 seconds during peace but revolts GPU 69 - 65c
1 month = 15-30 seconds during war and revolts GPU 67 - 70c ---It was at this point I could barely move my mouse, had to wait until it randomly blew over.

--These are rough averages since they vary. Some revolts are bigger than others. Just to add in that i'm experiencing the same FPS issues that other's have been reporting with large nations and revolts however these revolts don't span across the map, maybe 15 provinces tops, mostly in the Byzantine Empire.
Edit: I loaded up the game to confirm start date times but suffered a random crash and two black screens ... never had this happen before

 

[AndrewT]

Should not be getting crashes on load any more ... OK then, time for a(nother) full clean re-install:

- move any valued save games elsewhere
- "delete local content" in Steam-CK2
- opt into new 2.2.1.3 beta
- manually delete all files and folders left under Steam/CK2 AND Documents/Paradox/CK2
- re-install game in Steam, run a Steam Verify when done.

 

[BlankJones]

Should not be getting crashes on load any more ... OK then, time for a(nother) full clean re-install:

- move any valued save games elsewhere
- "delete local content" in Steam-CK2
- opt into new 2.2.1.3 beta
- manually delete all files and folders left under Steam/CK2 AND Documents/Paradox/CK2
- re-install game in Steam, run a Steam Verify when done.

I'll give it another test tomorrow!

I remember on the old thread you mentioned my memory and page file might be a concern with the performance of the game? what has remained constant is both my gpu and memory so if that was a possibility 4 months ago it might still be currently?

To quote:

"The other potential issue I see is memory. You have 6gb but your video card can take away up to 2.8gb of that, leaving just 3.2gb for the game and Windows. While adequate it's not a lot these days - I note your memory page file is 3gb so Windows has had to swap stuff out of memory at some point. If you de-activate all DLCs except ones you actually need in your current game, does it go any better? And obviously do make sure you have no other apps running when going into CK2."

 

[AndrewT]

Sure, that could still be an issue. You could test that theory by rolling back to 2.0.4 - before the India map expansion - when the game used a lot less memory. And/or try with no DLCs loaded at all.

 

[BlankJones]

Sure, that could still be an issue. You could test that theory by rolling back to 2.0.4 - before the India map expansion - when the game used a lot less memory. And/or try with no DLCs loaded at all.

Tested with beta 2.2.1.3 and removed all unit and portrait packs

Good news: Haven't crashed or black screened

Bad news: Almost like clockwork the lag returns and slows to a crawl. It declines as the years progress. 3 speed is now equal to 4 speed at the date of 860+

I monitored my ram usage, cache, page file cache etc. It seems that the game uses 2.7gb memory with my system dedicating 3.4gb. clock speed remains at 667Mhz.

 

[NewbieOne]

I'm having similar problems, though the game doesn't become literally unplayable, just like maybe speed 3 kind of speed on max speed. The problem seems to relate to CPU/GPU temps (as in launching CK2 on the same computer I've been working on all day) and memory use by Windows (same deal). The other problem may be the number of characters in the game making it hard for the CPU to keep up and/or exhausting RAM pretty quickly and being too slow when falling back on swap file.

 

[AndrewT]

Tested with beta 2.2.1.3 and removed all unit and portrait packs

Good news: Haven't crashed or black screened

Bad news: Almost like clockwork the lag returns and slows to a crawl. It declines as the years progress. 3 speed is now equal to 4 speed at the date of 860+

I monitored my ram usage, cache, page file cache etc. It seems that the game uses 2.7gb memory with my system dedicating 3.4gb. clock speed remains at 667Mhz.

Of your 6,092gb of memory 2.815gb is taken away by your video card, leaving just 3.277gb, so that's roughly in accord with what you see. That should be enough of course, although Windows itself would only have about 0.5gb left to play with. I see your page file gets a workout

Page File: 2176MB used, 5579MB available

so some memory swapping is definitely happening.

I don't suppose using the Flat Map mod or other graphics simplification mod helps?

 

[AndrewT]

I'm having similar problems, though the game doesn't become literally unplayable, just like maybe speed 3 kind of speed on max speed. The problem seems to relate to CPU/GPU temps (as in launching CK2 on the same computer I've been working on all day) and memory use by Windows (same deal). The other problem may be the number of characters in the game making it hard for the CPU to keep up and/or exhausting RAM pretty quickly and being too slow when falling back on swap file.

Certainly if the temps get too high, Windows will throttle back your PC clock speed to prevent damage. If you want us to look into it further, you'd need to provide the kind of data you see above.

 

[BlankJones]

Of your 6,092gb of memory 2.815gb is taken away by your video card, leaving just 3.277gb, so that's roughly in accord with what you see. That should be enough of course, although Windows itself would only have about 0.5gb left to play with. I see your page file gets a workout

so some memory swapping is definitely happening.

I don't suppose using the Flat Map mod or other graphics simplification mod helps?

Now that Way of Life is fully released I can start testing!

Before I do though, what page file limits should I have? since memory swapping is in question. Here's the settings:

--To note that I've just now changed the settings to this.

I'm planning to test with the [VS] Flat Map Mod from the steam workshop:
http://steamcommunity.com/sharedfiles/filedetails/?id=255491399&searchtext=flat+map

 

[AndrewT]

Before I do though, what page file limits should I have? since memory swapping is in question. Here's the settings:

--To note that I've just now changed the settings to this.

It doesn't matter what limits you set. My point is that it is using the swap file at all, which means that it's run out of memory at some point.

 

[NewbieOne]

Certainly if the temps get too high, Windows will throttle back your PC clock speed to prevent damage. If you want us to look into it further, you'd need to provide the kind of data you see above.

Yeah, not fearing damage or anything like that, only wondering about the load generated by the database.

 

[BlankJones]

Clean reinstall

Tested with version 2.3 using the [VS] Flat Map mod.

I loaded all unit packs and portrait packs (except for the new Iberian units and portraits)

Memory usage never exceeded more than 2.5gb - 2.6gb

--Somehow I seem to have grown 3 more gigabytes of ram

GPU temperatures ranged from 64c - 68c

CPU temperatures ranged from 24c - 38c on high priority using all cores

No background applications except for steam, anti virus, speedfan, puush, and task manager

Some interestingly strange developments during the test.
1.) Played from the Charlemagne start date to 828 --see save game
2.) Lag would occur almost at random (5 speed = 4 speed) however maintained much longer whenever war/raids would occur on neighboring provinces
3.) Lag began as the viking age started --give or take a few years
4.) I encountered several bugs during my play through although i'm not sure if they would contribute to the lag --see pictures
5.) Before saving the game to upload here, the intensity of lag increased completely at random (4 speed = 3 speed)

Bugs encountered:

Events to lose traits that I don't have?
http://puu.sh/dy17L/0f07799407.jpg

Duplicating leaders?
http://puu.sh/dy1ap/2c15666f95.jpg

Save Game:

http://puu.sh/dy1iX/ba7a43af90.zip

What is interesting is that the game is using less memory than before..

*twilight zone theme*

 

[AndrewT]

Please report bugs in that forum, thanks. If you're not sure if they're bugs or not, discuss in the main CK2 forum first.

 

[AndrewT]

Yeah, not fearing damage or anything like that, only wondering about the load generated by the database.

The biggest load is usually on the GPU, not the CPU. We use the GPU to do certainly types of calculations that it does faster and better than the CPU. Consequently we sometimes see our games push the GPU to the edge sooner that more graphically complex games do.

 

[BlankJones]

Please report bugs in that forum, thanks. If you're not sure if they're bugs or not, discuss in the main CK2 forum first.

Alright then I'll have to do that. Figured I could just mention them now to save the reading time!

But as for the ever so persistent lag issue, any thoughts?

 

[AndrewT]

Lots of thoughts, yes, but we've eliminated all of them as suspects for your problem.

What if you go back to 2.1.6 - still an issue?
What if you go back to 2.0.4 (pre-India) - still an issue?

In settings.txt set refreshrate=60 and master_volume=0 - any different?

Can we get the full dxdiag.txt please?

 

[BlankJones]

Lots of thoughts, yes, but we've eliminated all of them as suspects for your problem.

What if you go back to 2.1.6 - still an issue?
What if you go back to 2.0.4 (pre-India) - still an issue?

In settings.txt set refreshrate=60 and master_volume=0 - any different?

Can we get the full dxdiag.txt please?

I'll test it tomorrow again. But heres the dxdiag in the meantime!

View attachment DxDiag.txt

 

[AndrewT]

Check out the end of that dxdiag file. You have at least two Windows problems:

+++ WER7 +++:
Fault bucket , type 0

Event Name: WindowsUpdateFailure2

Response: Not available

Cab Id: 0



Problem signature:

P1: 7.9.9600.17404

P2: 8024402c

P3: 00000000-0000-0000-0000-000000000000

P4: Scan

P5: 101

P6: Unmanaged {117CAB2D-82B1-4B5A-A08C-4D62DBEE7782}

P7: 0

P8:

P9:

P10:

+++ WER9 +++:
Fault bucket 90745679515, type 5

Event Name: CbsPackageServicingFailure2

Response: Not available

Cab Id: 0



Problem signature:

P1: 6.3.9600.17031

P2: Package_for_KB3000850

P3: 6.3.1.8

P4: amd64

P5: unknown

P6: 80070490

P7: CBS Other

P8: Absent

P9: Staged

P10: WindowsUpdateAgent

Which are both to do with Windows update. If you're not getting Windows patches, that's a problem - what's going on in that area?