EU3toVic2 / Vic2toHoi3 Converter Project

[dtremenak]

That would be a good solution, or maybe provinces in other continents, which are not connected by land to your capital, could be colonies? I can't think of any overseas provinces in V2 that are not colonies. I don't know if this is complicated, and there would probably be problems with countries like OE, but it would also be more in line with the situation OTL.

We don't know continent data. We do know two other things that are probably more applicable anyway: we know whether a province was colonized, and we know whether it was a pagan conquest.

I'm thinking about adding a config option for colony status.

I commented out all lines with "last_diplomat_sent", and it solved the problem. Probably stems from IN

Yes, it looks like IN uses a different date format for some fields. I've added support for it to our date parser, so those problems won't exist after the next build.

[Khorney]

what's left to be done for the converter mod?

BTW, i've been diff'ing my outputs, based on the AHD and vanilla folder, and there are some weird differences that might be causing the crash.
first theres the umlau in the AHD save where it isnt in vanilla:
"name="1st Lübeck Cavalry"" vs name="1st Lubeck Cavalry"

2nd its generating more states and pops for some reason (despite same province count?)
there seems to be 9 more, so all the ID's are adjusted by +9
eg:
aristocrats=
{
id=50936

vs

aristocrats=
{
id=50927



and a weird difference in the pop index:
start_pop_index=72503 vs start_pop_index=72477

just some pointers, haven't looked too deeply

[DasGuntLord01]

what's left to be done for the converter mod?

I can't for the life of me think of anything else the converter mod might need... Since victoria 2 mechanics are abstracted and generalised (the only exception, perhaps, being American Civil War events) that V2 doesn't need any extra work in form of, say, political leaders, unit types, technology, events etc... Maybe Zonix has some ideas, but he is already working on the HoI3 converter mod which will require extensive work.

In other words, the V2 mod is essentially sufficiently complete.

@Dtremenak: I posted in the other thread similar information, but in [Your Directory]/map/continents.txt you will find what appears to be a list of provinces sorted by continent. Perhaps this will be useful for many things?

[dtremenak]

Continent information is actually not all that useful, which is one reason we don't know it. It's not unknowable (as you've pointed out, it's pretty clear from the data files), just hasn't been worth knowing yet.

Consider Africa, for instance. North Africa should normally be treated very differently from subsaharan Africa. "Was colonised" or "was pagan conquest" status is more useful for just about everything we need to do.

[Khorney]

RE: converter mod,I meant to get it working with AHD? doesn't it still crash when loading the flags?

[DasGuntLord01]

RE: converter mod,I meant to get it working with AHD? doesn't it still crash when loading the flags?

Ah yes, of course...

I have no idea how to fix that, that'd be Zonix's department.

[Idhrendur]

BTW, i've been diff'ing my outputs, based on the AHD and vanilla folder, and there are some weird differences that might be causing the crash.
first theres the umlau in the AHD save where it isnt in vanilla:
"name="1st Lübeck Cavalry"" vs name="1st Lubeck Cavalry"

2nd its generating more states and pops for some reason (despite same province count?)
there seems to be 9 more, so all the ID's are adjusted by +9
eg:
aristocrats=
{
id=50936

vs

aristocrats=
{
id=50927



and a weird difference in the pop index:
start_pop_index=72503 vs start_pop_index=72477

just some pointers, haven't looked too deeply

If units are done the same as province names, we're picking up the names from V2. And as long as the name is in quotes, it should be fine.

There are the same number of provinces, but the states have been adjusted, including a few added in South America. The extra capitals in the extra states are going to generate extra upper class pops. And more pops should increment that index, or else numbers will collide and bad things happen.

[Khorney]

--got rid of big post--
Isn't there something to work from here? i thought you tested it?

what would i need to do to test this on a larger scale and make sure it was working?

EDIT: just checked out what you were looking at and i agree rendur, its just the output after the game has finish processing the flags

so have we heard any more from the devs about the country limit?

[Idhrendur]

Okay, sanity check time.

I know I can't convert directly to my AHD install, but if I convert to my vanilla install, I can load the save.
I know others can load saves from vanilla conversions.
I know DasGuntLord01 also couldn't convert to an AHD install. If I then understand right, a reinstall resolved it, and he can convert against AHD with no (major) problems.

So, who else has problems converting directly to AHD? Is it just me now? Is it some of us? Is it everyone?

[BootOnFace]

Does anyone have a province list for DAO to V2? I don't want to do it myself if someone else already did it.

[Avindian]

Okay, sanity check time.

I know I can't convert directly to my AHD install, but if I convert to my vanilla install, I can load the save.
I know others can load saves from vanilla conversions.
I know DasGuntLord01 also couldn't convert to an AHD install. If I then understand right, a reinstall resolved it, and he can convert against AHD with no (major) problems.

So, who else has problems converting directly to AHD? Is it just me now? Is it some of us? Is it everyone?

I just tried it now; Vicky 2 CTD'd, but then again, I don't have the right checksum. I will try a reinstall and let you know.

EDIT: Reinstalled, confirmed right checksum, still CTD's when I try to load a converted save. I used the converter, not the mod, if that makes a difference.

[WeissRaben]

I can't for the life of me think of anything else the converter mod might need... Since victoria 2 mechanics are abstracted and generalised (the only exception, perhaps, being American Civil War events) that V2 doesn't need any extra work in form of, say, political leaders, unit types, technology, events etc... Maybe Zonix has some ideas, but he is already working on the HoI3 converter mod which will require extensive work.

In other words, the V2 mod is essentially sufficiently complete.

Are you not going to put in population conversion? V2 can kill a populous (DW) nation just because it wasn't OTL, and that's...quite major, I would say.

[DasGuntLord01]

Oh, yeah, I made a mistake. I was converting against 1.4, not AHD. So it looks as though converting against AHD does cause a crash.

But why?!

The converter reads certain information from the game files. Those would be the immediately obvious culpripts... but since there's is essentially zero obvious change between vanilla and AHD one has a hard time imagining that that is true.

What exact information is extracted from the game files by the converter?

EDIT: Okay, the only other thing I can think of is states, which is something else that is hard to check manually.

[dtremenak]

What exact information is extracted from the game files by the converter?

From \map\region.txt: state mapping data
From \common\technology.txt: tech school bonus parameters
From \history\countries\*.txt: starting country data (used for countries which are NOT converted...unions, dead countries, releasable countries, etc)
From \technologies\<tech>_tech.txt: required techs for factories
From \inventions\<tech>_inventions.txt: required inventions for factories
From \common\production_types.txt: factory types, coastal/local-input requirements
From \map\definition.csv and \localisation\*.csv: province names
From \history\provinces\*: RGOs and liferating data
From \history\pops\1836.1.1\*: total population levels
From \map\positions.txt: naval base position data (see note below)
From \common\countries.txt: valid tags
From \common\countries\*.txt: party data

Note: someone please check your logs from an AHD conversion for lines beginning "Warning: assigning navy to non-whitelisted port province." Navy assignments to bad provinces do cause crashes; we may need to blacklist a few more provinces if another invalid position has been added to \map\positions.txt.

[DasGuntLord01]

Note: someone please check your logs from an AHD conversion for lines beginning "Warning: assigning navy to non-whitelisted port province." Navy assignments to bad provinces do cause crashes; we may need to blacklist a few more provinces if another invalid position has been added to \map\positions.txt.

I do not seem to get any such error. This would be expected, since the provinces themselves have not changed.

[Avindian]

I do not seem to get any such error. This would be expected, since the provinces themselves have not changed.

I also did not receive this error.

[DasGuntLord01]

From \map\region.txt: state mapping data
From \common\technology.txt: tech school bonus parameters
From \history\countries\*.txt: starting country data (used for countries which are NOT converted...unions, dead countries, releasable countries, etc)
From \technologies\<tech>_tech.txt: required techs for factories
From \inventions\<tech>_inventions.txt: required inventions for factories
From \common\production_types.txt: factory types, coastal/local-input requirements
From \map\definition.csv and \localisation\*.csv: province names
From \history\provinces\*: RGOs and liferating data
From \history\pops\1836.1.1\*: total population levels
From \map\positions.txt: naval base position data (see note below)
From \common\countries.txt: valid tags
From \common\countries\*.txt: party data

Oh god... none of that looks especially toxic to me... It's more likely be something hard coded, something based on vanilla V2 that was written for the converter that AHD doesn't like... I think...

[dtremenak]

Oh god... none of that looks especially toxic to me... It's more likely be something hard coded, something based on vanilla V2 that was written for the converter that AHD doesn't like... I think...

Just out of curiosity, can you try eliminating a few of these from the suspect list?

Changing starting_factories.txt to just read

starting_factories =
{
}

will rule out factories.

Appending the entire contents of port_whitelist to port_blacklist (and clearing port_whitelist) will rule out navy placement. I know there were no province changes, but they've slipped port changes into even minor patches in the past (1.4 has some, for instance).

Those are two of the most fragile bits of Victoria 2, and both are relatively easy to get the converter to ignore.

[Idhrendur]

I won't really have any time to do direct investigation until Friday, but I have another avenue to suggest others try. Download old versions of the converter from Sourceforge and convert to AHD. Hopefully the really old ones will work (with extremely limited features), and we can use that to figure out which features are at fault.

But someone should do dtremenak's tests first, as those are very easy.

[DasGuntLord01]

Just out of curiosity, can you try eliminating a few of these from the suspect list?

Changing starting_factories.txt to just read

starting_factories =
{
}

will rule out factories.

Appending the entire contents of port_whitelist to port_blacklist (and clearing port_whitelist) will rule out navy placement. I know there were no province changes, but they've slipped port changes into even minor patches in the past (1.4 has some, for instance).

Those are two of the most fragile bits of Victoria 2, and both are relatively easy to get the converter to ignore.

Neither of those things fixed it for me.