Lets have a taste of AI insanity

  • We have updated our Community Code of Conduct. Please read through the new rules for the forum that are an integral part of Paradox Interactive’s User Agreement.
Status
Not open for further replies.

Seven Sulivin

Captain
45 Badges
Oct 7, 2016
412
165
  • Hearts of Iron IV: Together for Victory
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Conclave
  • Stellaris
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Colonel
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Mandate of Heaven
  • Surviving Mars
  • Hearts of Iron IV: Death or Dishonor
  • Europa Universalis IV: Cradle of Civilization
  • Cities: Skylines - Parklife
  • Crusader Kings II: Holy Fury
  • Prison Architect
  • Imperator: Rome Sign Up
  • Crusader Kings III
  • Cities: Skylines
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Victoria 2
  • Victoria: Revolutions
  • Europa Universalis IV: Art of War
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Jade Dragon
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Europa Universalis IV: Third Rome
  • Europa Universalis IV
  • Cities: Skylines Deluxe Edition
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Res Publica
  • Europa Universalis IV: Mare Nostrum
  • Crusader Kings II
To be fair though there was widespread upset and community pressure to push the game out in 2016 after the previous two cancelled release dates.
True. That's probably why they're taking so long with announcing Vicky 3.
 
  • 3
Reactions:

Magnificent Genius

Perennial Also-Ran
95 Badges
Oct 28, 2014
1.493
1.046
  • Battle for Bosporus
  • BATTLETECH: Heavy Metal
  • BATTLETECH: Season pass
  • Prison Architect
  • Hearts of Iron IV: Expansion Pass
  • BATTLETECH: Flashpoint
  • BATTLETECH - Digital Deluxe Edition
  • Surviving Mars
  • BATTLETECH
  • Imperator: Rome - Magna Graecia
  • Stellaris: Federations
  • Hearts of Iron IV: Cadet
  • Europa Universalis IV
  • Stellaris: Nemesis
  • Europa Universalis 4: Emperor
  • Knights of Pen and Paper +1 Edition
  • Knights of Pen and Paper 2
  • Magicka
  • Stellaris: Necroids
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Field Marshal
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: Expansion Pass
  • Hearts of Iron IV: La Resistance
  • Imperator: Rome Sign Up
  • Imperator: Rome
  • Imperator: Rome Deluxe Edition
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris: Leviathans Story Pack
  • Stellaris - Path to Destruction bundle
  • Stellaris: Synthetic Dawn
  • Stellaris: Apocalypse
  • Stellaris: Distant Stars
  • Stellaris: Megacorp
  • Stellaris: Ancient Relics
  • Stellaris: Humanoids Species Pack
  • Stellaris: Digital Anniversary Edition
  • Stellaris: Lithoids
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Pre-order
  • Europa Universalis IV: Cradle of Civilization
  • Europa Universalis IV: Cossacks
  • Europa Universalis IV: Common Sense
  • Europa Universalis IV: Mandate of Heaven
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Golden Century
  • Europa Universalis IV: Dharma
I'm never going to believe that management found this game fit for release on June 6, 2016. There are just too many obvious problems that had to be known to Paradox, and yet they still sold it to us. What does that say about Paradox management in how they see customers?

I don't blame the developers. It's obvious they are way understaffed and unable to cope with the magnitude of unfinished work and software bugs. Even a few tweaks here and their by modders can avoid some of the drastic AI behavior, but yet the staff must have so little manpower to even explore these options themselves.

Let's call it for what it really is. HOI IV is a disaster. A disaster perpetrated, not only onto its customers, but also onto its developer team. It's woefully under-cooked. It's not being fixed nearly fast enough. It's already seen one DLC release when major core systems are still broken.

I pity everyone here. Customers, QA, and the development team. This disaster is a failure straight from the top. Paradox Interactive has to release a certain number of games -- at a certain frequency -- to grow revenue. It's crucial for their quarterly reports to share holders.

vbjXgIm.png


Look at that increase in revenue from last year helped, in part, by HOI IV.

LJcXoHV.png


Successful release? In terms of what? Quality? Customer base satisfaction? No, successful only in terms of sales.

NoZIKIj.png


Yes, internal developer teams that you have starved of manpower to properly support your "most successful" games. How about using that extra profit to pay for few more programmers?

B7beKmn.png


I almost choked on this point. A priority, huh?

zatsxCG.png

9q9haab.png


This....this is just lying to yourself or twisting the facts. Has management gone through the forums, or even Reddit, and read what their loyal fan base says about their game. Or are they just happy with superficial scores on Steam?

If by reading anything, management is very happy with HOI IV's revenue performance, and thus, in their eyes, must be doing something right. In other words, shareholders > customers.

I really pity the poor dev team, especially how demoralizing it must feel.

Oh, dear lord, that earnings report made me gag.
 
  • 12
Reactions:

Sanny

Italo-Scot
98 Badges
Mar 29, 2013
2.512
2.061
  • Stellaris: Necroids
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Megacorp
  • Cities: Skylines Industries
  • Europa Universalis IV: Dharma
  • Battle for Bosporus
  • Cities: Skylines - Green Cities
  • Crusader Kings III: Royal Edition
  • Crusader Kings III
  • Hearts of Iron IV: By Blood Alone
  • Stellaris: Nemesis
  • Hearts of Iron IV: Field Marshal
  • Europa Universalis 4: Emperor
  • Stellaris: Federations
  • Stellaris: Ancient Relics
  • Stellaris: Lithoids
  • Europa Universalis IV
  • Hearts of Iron IV: La Resistance
  • Europa Universalis IV: Golden Century
  • Cities: Skylines - Campus
  • Hearts of Iron IV: No Step Back
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Mare Nostrum
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Rights of Man
  • Crusader Kings II: Reapers Due
  • Europa Universalis IV: El Dorado
  • Mount & Blade: Warband
  • Magicka 2
  • Europa Universalis IV: Common Sense
  • Crusader Kings II: Horse Lords
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Crusader Kings II: Conclave
  • Hearts of Iron IV Sign-up
  • Victoria 2
  • Europa Universalis IV: Res Publica
  • Stellaris: Synthetic Dawn
  • Crusader Kings II
  • Imperator: Rome - Magna Graecia
  • Imperator: Rome Sign Up
  • Imperator: Rome Deluxe Edition
  • Europa Universalis IV: Rule Britannia
  • Rome Gold
  • Stellaris: Humanoids Species Pack
  • Hearts of Iron IV: Expansion Pass
  • The Showdown Effect
  • Steel Division: Normand 44 Sign-up
  • Europa Universalis IV: Mandate of Heaven
  • Cities: Skylines - Mass Transit
True. That's probably why they're taking so long with announcing Vicky 3.
Yeah I recall Johan saying somewhere after what happened with East v West and Hearts of Iron IV, they will stop announcing games too early before they have something of substantial quality (so probably in Alpha state).
 

Moser

First Lieutenant
16 Badges
Dec 23, 2015
240
264
  • Arsenal of Democracy
  • Darkest Hour
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III Collection
  • Lead and Gold
  • Semper Fi
  • Cities: Skylines
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Together for Victory
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: Expansion Pass
  • Hearts of Iron IV: Expansion Pass
  • Prison Architect
  • Hearts of Iron IV: La Resistance
If they're going to release a half-baked product, they should at least have the resources available to ensure the major problems post-release are fixed up in a reasonable time frame. Instead, it feels this development team has one hand tied behind their back because they aren't getting proper resources from up the chain to help them fix the major issues plaguing this game since June 6. It should be an all-hands-on-deck attitude from Paradox, but instead it looks to be a barebones team scrapping by with these huge post-launch problems.

I get it, Paradox. You want to free up resources to work on new IPs, but the SP experience is just a disaster, and resources need to be freed to fix your current IPs before your new customers, like myself, abandon this ship. I do appreciate the dev team's work on 1.3 which has finally mitigated some of the programming bugs that has hindered tinkerers and modders from improving certain aspects of the game, but there are still major design issues, such as the AI's use of the battle planner, division spam, lack of AI checks, etc. that greatly reduce the quality of the single player experience.

Forgive me for ranting, but I'm just losing my patience with this post-launch support process. I see so much potential in HOI IV, and I get excited when I see the AI fight it out over huge fronts, but then I just get so frustrated when I see Germany abandon the northern half of its front with the USSR and lose a whole year's worth of hard fought territorial gain for absolutely no logical reason. Or the endless suicidal British naval invasions that is still not curbed since ironically -- the anniversary of D-Day. How can one even play SP when the AI is just so inept in its decision making? It's just not fun at all.

Imagine playing a game of football where the first half of the game seems to be a good match. Then the other team randomly forfeits during the second match -- every damn time. You repeat this process maybe fifty times. You then go to the official and point out the other team and say "If people told us the other teams would just forfeit the match, then maybe we would have never signed up." They encourage you and say soon a new team will be there that won't forfeit, and you'll have a good match. And then you start a new match, and you see the other team is perhaps playing a little better, but still find a way forfeit in the second half. The officials say "We know. We are working on it. By the way, could you...perhaps...help us. We need a lot of information to find why the other teams are forfeiting." You think to yourself. Well, this is an odd request. They forfeit so often, it should be reproducible each time. Why would they need us to provide them with the information anyway? Shouldn't the football management have enough resources to find out themselves? You then realize its not just your team experiencing the problems. Many others are having horrible football experiences, and are being asked to help the officials.

A few months later, the officials announce that they have finally brought in some opponents that won't give up halfway through the match anymore. You are really excited. Finally! Let's have a great match! You play the other team. At first, it's a good match. They score several times on you. Then halfway through the second half -- the other team starts having more and more players. The growth is exponential. There are so many players on their side of the field, and then they stop advancing and scoring. They do some musical number where they shuffle back and forth -- back and forth -- back and forth -- back and forth -- for what seems an eternity. One player even runs off the field on his own -- yelling something about a Victory Point. You are flabbergasted. This isn't much of an improvement! Sure they play a little better, but they still give up completely with this non-sense. Soon, the game has to stop because the other team has effectively stopped playing. You go to the officials and complain. They acknowledge the problems, and ask for more information from you -- to help them solve it.

Just in time for Christmas, they tell you that there is a new, better football pitch available for purchase and it'll come with a new team that should play better. You don't even need to buy the new pitch. The new, improved team can be played against for free. As a token of gratitude from upper football management. You happily fork over the money anyway because you are desperate for some kind of improvement, and plus, you think the officials are really cool guys. You meet the new opposing team on the new shiny pitch. Hey, this is pretty cool!, you think to yourself. You shake hands and begin the new match. The other teams seems play a little better. It now moves the ball around a little more effectively. You think to yourself, Hey, this isn't so bad. Then they start multiplying again and do that strange musical number where they just constantly swap positions on the field. You wait things out and realize that the new players start to arrive without any equipment on -- there just isn't enough to go around -- they're absolutely naked and unprotected. There also isn't enough food and water. Some of the players start to get cold -- others begin to get hungry. Next thing you know the other team's players start dropping dead -- but in slow motion. Then you realize its not slow motion. There are so many bodies on the field that the space-time itself is warped by the appalling amount of mass. The game clock has slowed to a slow crawl. It's a horror show to witness -- slow deteriorating deaths. You can't stand it anymore. You decide to go home -- depressed over what you saw after hoping so much that things would be different.

Finally, you have had enough and decide to stop playing for a while. While at home, you pick up the newspaper, and you read an article about how the management of the football league is celebrating its "successful games", everything is fine and dandy, and that profits are going up. You shake your head and sag in disappointment. How did it come to this?
 
Last edited:
  • 18
  • 1
  • 1
Reactions:

maurel

Second Lieutenant
1 Badges
Oct 2, 2014
167
328
  • Hearts of Iron IV: Cadet
Is there an OBS observer tag for this exact purpose?



I understand you are trying to create a lab for the AI's behavior divorced from the developer's historical European setup. Some of your methodology is counter productive. You have countries locked into historical focuses and then add countries to factions ahistorically. Historical focus minors aren't going to prepare for war. South American nations have their AI programmed for neutrality, expecting them to execute wars among each other is a high bar.



You cheat to give them a bunch of airports, which the AI didn't expect or create, then wonder why they don't use their air-forces well. The game's AI is focused on the European conflict so in a scenario where you didn't use the console to ahistorically focus on South America by adding everyone to factions, the actions of the AI make much more sense.

Until the developers give focus to Latin America, it's not a bad idea to have those minor nations programmed to favor sending troops to the larger conflict. Obviously you have taken a South American conflict to an extreme so it's no surprise that the AI cannot handle it. Surely all nations should prioritize homeland defense higher, at the moment France sends far too many troops to North Africa while Metropolitan France gets overrun. So I think AI focus should be on larger nations, while South America should get attention when their respective DLC is released. And there are regions that I want to get DLC + focus before South America, China and European minors.





1- I already knew of the bugs before making this "test" so the metodology doesn't matter to me, i am just making a show, it was intended as a joke and not a report originally.
2- I added the new airports out of a joke, i already knew before that they would not use their airforces in SA
3- Historical focuses is to force everyone to go historical except for thoses 2 countries.
4- Even if they are not in a faction they will not use their airforces. but they will not redeploy troops elsewhere.
 
  • 1
Reactions:

Jamey

Field Marshal
106 Badges
Sep 9, 2009
3.437
3.383
  • 500k Club
  • BATTLETECH - Backer
Here is the thing: AI issues are probably one of the worst/most complicated types for us to investigate, so it is absolutely vital that I get as much data as possible. Our AI coder has to take a direct look at the AI while the game is running to identify which part of the vast AI code is at fault.

There is a reason why the report guidelins are pinned at the top of the forum:
https://forum.paradoxplaza.com/foru...idelines-on-how-to-write-a-bug-report.942103/
With other stuff (like UI issues) it's usually possible to find and fix the problem without too much of a hasstle. With AI? Absolutely not.

I know that I am asking for a lot, but I assume he'd rather want to make a useful report that I can actually add to our database instead of a half-baked thing that ends up ignored because it lacks necessary info.

...and in regards to that: I am thankful for everyone who takes the time do make proper reports. So:
Thank You!

(Also now you know that QA isn't just happy happy fun play the game fun time... :X)
Thank you for taking time during the holidays to check into the forums and be patient with those who are willing to provide helpful feedback.
 
  • 5
  • 2
Reactions:

roovin

Sergeant
36 Badges
Mar 13, 2014
71
56
  • Crusader Kings II: Rajas of India
  • Stellaris: Galaxy Edition
  • Europa Universalis IV: Pre-order
  • Semper Fi
  • Europa Universalis IV: Res Publica
  • Hearts of Iron III Collection
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III
  • Europa Universalis IV: Wealth of Nations
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • For the Motherland
  • Hearts of Iron IV: La Resistance
  • Imperator: Rome Sign Up
  • Hearts of Iron IV: Expansion Pass
  • Cities: Skylines - Parklife
  • Hearts of Iron IV: Expansion Pass
  • Age of Wonders III
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: Field Marshal
  • Battle for Bosporus
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV Sign-up
  • Stellaris: Galaxy Edition
  • Stellaris
  • Europa Universalis IV: Mare Nostrum
  • Europa Universalis IV: Cossacks
  • Europa Universalis IV: Common Sense
  • Pillars of Eternity
  • Europa Universalis IV: El Dorado
  • Cities: Skylines
  • Europa Universalis IV
I now know never to buy a game that on release has an option to give you the option to get the next two DLC's at a discount (pay upfront but lower overall). I'd rather just wait.

That is a clear sign that the game is not finished and they need money.

I enjoyed the game initially as I have never played HOI before, but I cannot play without mods anymore and as of right now I barely have any interest in playing.
 
  • 6
Reactions:

Taciturn Scot

Major
103 Badges
Jun 10, 2007
538
760
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Semper Fi
  • Sengoku
  • Victoria 2
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Warlock 2: The Exiled
  • Warlock 2: Wrath of the Nagas
  • 500k Club
  • Cities: Skylines
  • Cities: Skylines Deluxe Edition
  • Europa Universalis III Complete
  • Europa Universalis IV: Pre-order
  • Pride of Nations
  • Crusader Kings II: Way of Life
  • Europa Universalis IV: Common Sense
  • Cities: Skylines - After Dark
  • Europa Universalis IV: Cossacks
  • Crusader Kings II: Conclave
  • Cities: Skylines - Snowfall
  • Europa Universalis IV: Mare Nostrum
  • Stellaris
  • Stellaris: Galaxy Edition
  • Hearts of Iron IV: No Step Back
  • Divine Wind
  • Cities in Motion
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sword of Islam
  • Darkest Hour
  • Europa Universalis III
  • Europa Universalis III: Chronicles
  • Hearts of Iron II: Armageddon
  • Europa Universalis IV
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
  • Europa Universalis III Complete
Well, seeing as how it's considered good to have a rant now and then and that it's still the season of goodwill towards all men (except game developers and their testers and QA staff of course), why not? I see that 2017 is off to a fine start and bodes well for the future. Reading Yahoo News comments and comments on Youtube indicate that there are a very small number of extremely angry people who feel it their moral obligation to vent their 'righteous' outrage and hate for the 'other' at every opportunity. To spin any information to cast it in the worst possible light to inflame emotions of other similarly inclined or gullible readers and where there is no information, to speculate the worst yet post as if it were gospel. To insult and intimidate anyone, no matter how well informed their opinions might be.

Sorry folks, but the vast majority of folks are not angry, are not outraged and the launch of this game is not a disaster at all. If Paradox publish a report that states that they have a steady number of 1.5 million people playing their games, there ARE 1.5 million people playing steadily. There are, what, about 200-300 people posting here with any great frequency and of those, there are some very, very angry and frustrated folks. That's a tiny fraction of a percentage point of their regular player base.

This is a HOBBY. It's supposed to be a fun, recreational activity and many, many people ARE getting great pleasure from this game but have no interest in getting involved in discussions online for very, very good reasons. Further, it's not even an expensive hobby by most standards. Hell, I spend far more on books every month than I do on computer games. And books have doubled or tripled in price over the last 10-20 years whereas computer games have not risen by nearly as much.

Why do some people still completely fail to understand that the computer gaming industry has changed, that the DLC model has already been the standard for some time and will be in the future, that this IS a popular model with the majority of the hobbyists in spite of the few bad apples in the barrel. If you hate this business model and feel that all this should have been in the game on release or that we are entitled to all this work for free, it's time to find a new hobby, or at least move to a developer other than Paradox who are one of the proud pioneers of this model. And, YES, Paradox are a business with shareholders and they're doing this for money. Shame on them! Shame! (Sometimes, this smacks of pure jealousy to me. Store clerks, bank clerks and accountants bored and frustrated, madly envious that other people are making a good living making games.)

Why do some people feel that they are being ripped off and lied to when they make impulsive, poorly researched purchases and then blame the developers and insult both the developers and the people who dare, DARE to support this 'despicable practice that is killing the hobby for all of us'? WE, the happy 'few' need to be driven off for the 'common good' and that such behaviour is righteous and honourable because these fanatics think that they are saving the hobby. Our positivity needs to be silenced or shouted down so that the devs are sent a clear and loud message, that 'we' are angry and demand change.

Games have never been perfect. I have been playing them since the very start and they've often been unfinishable due to bugs. 8-bit text adventures would suddenly go into an endless loop and crash, shooters would crash etc, etc. Bugs have always been there. Further, the level of sophistication in games has grown tremendously as well. It's not just graphics, the AI has to be able to play the complex systems that we demand in our strategy games.

I used to be a proper Beta tester, i.e. I had to sign a NDA which I am still bound to and I know that games are extremely complex things to create, especially with respect to AI and when it comes to layers of sophistication, Paradox games are about as complex as it gets. Frankly, the fact that the game is already so playable is a testimony to the skill of the AI programmer, Steelvolt. While I'm sure he'd appreciate a bit more positive feedback, I'd wager his bosses know what a sterling job he's done so far and so his job is quite safe despite the baying for blood on these forums.

When I read Gaga Extreme's requests for saves and properly documented reports, I see him treating you guys as mature individuals who have a genuine interest in helping to make this game better. And he (she?) gets 'righteously' bitch slapped in public for doing so by some overly idealistic posters. Hopefully, s/he knows better now and that reason doesn't work with this community. You're not interested in helping and you're bloody mad that anyone has the temerity to suggest that you report bugs in a manner that might actually help them to identify the problem and fix it. It's 'their' job to find and fix this and not sell us this 'unfinished crap!'

There. End of rant.

And yes, I do feel better.:D
 
  • 18
  • 18
  • 1
Reactions:

PsychoLold

Victoria III enthusiast
45 Badges
Jan 7, 2013
240
217
  • Europa Universalis IV
  • Stellaris - Path to Destruction bundle
  • Stellaris: Leviathans Story Pack
  • Hearts of Iron IV: Field Marshal
  • Europa Universalis IV: Pre-order
  • Victoria 2: Heart of Darkness
  • Victoria 2: A House Divided
  • Crusader Kings II
  • Semper Fi
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III
  • For the Motherland
  • Europa Universalis IV: Res Publica
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: No Step Back
  • Europa Universalis IV: Cradle of Civilization
  • Hearts of Iron IV: Expansion Pass
  • Stellaris: Humanoids Species Pack
  • Stellaris: Apocalypse
  • Stellaris: Distant Stars
  • Stellaris: Megacorp
  • Imperator: Rome
  • Hearts of Iron IV: Expansion Pass
  • Hearts of Iron IV: La Resistance
  • Stellaris: Federations
  • Battle for Bosporus
  • Stellaris: Nemesis
  • Europa Universalis IV: Mandate of Heaven
  • Stellaris: Digital Anniversary Edition
  • Europa Universalis IV: Rights of Man
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV Sign-up
  • Stellaris
  • Europa Universalis IV: Mare Nostrum
  • Europa Universalis IV: Cossacks
  • Europa Universalis IV: Common Sense
  • Mount & Blade: Warband
  • Europa Universalis IV: El Dorado
  • Cities: Skylines
  • Victoria 2
  • Stellaris: Synthetic Dawn
Great thread! It highlights important problems and contains a lot of civil and constructive criticism. Here's my 2 cents.

AI development in video games always has an inherent problem: It comes last. While stuff like music and art can be done in parallel to the rest of the development, the AI programming only can really start after the mechanics are set in stone and only when there is a testable product. Since pretty much every software product gets delayed during development, and development costs and time get cut in the last stages, the AI and the performance are the aspects of a game that always suffer most from release pressure (together with stability, which is surprisingly good for HOI4).
That's why AI sucks in most video games (it is bad in every game I know and own).
That being said, PDX really should've learned by now and diverted even more ressources to AI development before release. If memory serves me right there were two people working on the AI before release and only one after, even though the issues must have been known, because Paradox placed more importance on play testing games in the recent past.

To be fair though there was widespread upset and community pressure to push the game out in 2016 after the previous two cancelled release dates.
I guess there also was internal pressure, since the game has been in development for years. That's a big investment and managers usually want to see profit asap.

Personal sidenote: I enjoy the game for the most part and as a Field Marshal Edition owner I will only judge the game after I get the 3rd DLC.
 
  • 1
Reactions:

BjornB

★Community Manager★
Paradox Staff
Moderator
81 Badges
Apr 2, 2012
4.987
18.227
  • March of the Eagles
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
  • Impire
  • King Arthur II
  • Knights of Pen and Paper +1 Edition
  • Leviathan: Warships
  • The Kings Crusade
  • Magicka
  • Majesty 2
  • Majesty 2 Collection
  • For The Glory
  • Europa Universalis III Complete
  • Naval War: Arctic Circle
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Rome Gold
  • Semper Fi
  • Ship Simulator Extremes
  • Sword of the Stars
  • Sword of the Stars II
  • Teleglitch: Die More Edition
  • Starvoid
  • Crusader Kings II: Sword of Islam
  • Ancient Space
  • Arsenal of Democracy
  • Cities in Motion
  • Cities in Motion 2
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • A Game of Dwarves
  • Commander: Conquest of the Americas
  • Darkest Hour
  • Deus Vult
  • Dungeonland
  • Europa Universalis III
  • Europa Universalis III Complete
  • Divine Wind
  • The Showdown Effect
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
Hi guys,

First of all, we'd like to ask everyone to keep to the "Great Official AI Thread" for AI discussions, thank you.

If you want to make a more elaborate report of a specific issue, then the bug report forum is the place to go.

We do not wish to get back to a situation where we have 10 active threads on pretty much the same issue, demanding our frequent answers in all of them. Thank you for understanding. If we can keep things well organized it will help us work out solutions to problems much easier, and I'm sure that is what we all want the most.
 
  • 3
  • 2
Reactions:

grandad1982

Field Marshal
103 Badges
May 1, 2012
3.562
5.180
  • Sengoku
  • Hearts of Iron III: Their Finest Hour
  • Heir to the Throne
  • Europa Universalis IV: Third Rome
  • Knights of Pen and Paper +1 Edition
  • March of the Eagles
  • Cities: Skylines - Snowfall
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Semper Fi
  • Crusader Kings II
  • Sword of the Stars
  • Europa Universalis IV: Cossacks
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Cities: Skylines - After Dark
  • Stellaris - Path to Destruction bundle
  • Crusader Kings II: Jade Dragon
  • Europa Universalis IV: Pre-order
  • For the Motherland
  • Cities in Motion 2
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • Europa Universalis III
  • Europa Universalis III Complete
  • Divine Wind
  • Stellaris
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
  • Hearts of Iron III
  • Crusader Kings II: Conclave
  • Crusader Kings II: Horse Lords
  • Hearts of Iron IV Sign-up
  • Europa Universalis IV: Common Sense
  • Pillars of Eternity
  • Crusader Kings II: Way of Life
  • 500k Club
  • Warlock: Master of the Arcane
  • Victoria 2
  • Teleglitch: Die More Edition
  • Europa Universalis III Complete
  • Victoria 3 Sign Up
  • Europa Universalis IV
Well, seeing as how it's considered good to have a rant now and then and that it's still the season of goodwill towards all men (except game developers and their testers and QA staff of course), why not? I see that 2017 is off to a fine start and bodes well for the future. Reading Yahoo News comments and comments on Youtube indicate that there are a very small number of extremely angry people who feel it their moral obligation to vent their 'righteous' outrage and hate for the 'other' at every opportunity. To spin any information to cast it in the worst possible light to inflame emotions of other similarly inclined or gullible readers and where there is no information, to speculate the worst yet post as if it were gospel. To insult and intimidate anyone, no matter how well informed their opinions might be.

Sorry folks, but the vast majority of folks are not angry, are not outraged and the launch of this game is not a disaster at all. If Paradox publish a report that states that they have a steady number of 1.5 million people playing their games, there ARE 1.5 million people playing steadily. There are, what, about 200-300 people posting here with any great frequency and of those, there are some very, very angry and frustrated folks. That's a tiny fraction of a percentage point of their regular player base.

This is a HOBBY. It's supposed to be a fun, recreational activity and many, many people ARE getting great pleasure from this game but have no interest in getting involved in discussions online for very, very good reasons. Further, it's not even an expensive hobby by most standards. Hell, I spend far more on books every month than I do on computer games. And books have doubled or tripled in price over the last 10-20 years whereas computer games have not risen by nearly as much.

Why do some people still completely fail to understand that the computer gaming industry has changed, that the DLC model has already been the standard for some time and will be in the future, that this IS a popular model with the majority of the hobbyists in spite of the few bad apples in the barrel. If you hate this business model and feel that all this should have been in the game on release or that we are entitled to all this work for free, it's time to find a new hobby, or at least move to a developer other than Paradox who are one of the proud pioneers of this model. And, YES, Paradox are a business with shareholders and they're doing this for money. Shame on them! Shame! (Sometimes, this smacks of pure jealousy to me. Store clerks, bank clerks and accountants bored and frustrated, madly envious that other people are making a good living making games.)

Why do some people feel that they are being ripped off and lied to when they make impulsive, poorly researched purchases and then blame the developers and insult both the developers and the people who dare, DARE to support this 'despicable practice that is killing the hobby for all of us'? WE, the happy 'few' need to be driven off for the 'common good' and that such behaviour is righteous and honourable because these fanatics think that they are saving the hobby. Our positivity needs to be silenced or shouted down so that the devs are sent a clear and loud message, that 'we' are angry and demand change.

Games have never been perfect. I have been playing them since the very start and they've often been unfinishable due to bugs. 8-bit text adventures would suddenly go into an endless loop and crash, shooters would crash etc, etc. Bugs have always been there. Further, the level of sophistication in games has grown tremendously as well. It's not just graphics, the AI has to be able to play the complex systems that we demand in our strategy games.

I used to be a proper Beta tester, i.e. I had to sign a NDA which I am still bound to and I know that games are extremely complex things to create, especially with respect to AI and when it comes to layers of sophistication, Paradox games are about as complex as it gets. Frankly, the fact that the game is already so playable is a testimony to the skill of the AI programmer, Steelvolt. While I'm sure he'd appreciate a bit more positive feedback, I'd wager his bosses know what a sterling job he's done so far and so his job is quite safe despite the baying for blood on these forums.

When I read Gaga Extreme's requests for saves and properly documented reports, I see him treating you guys as mature individuals who have a genuine interest in helping to make this game better. And he (she?) gets 'righteously' complain slapped in public for doing so by some overly idealistic posters. Hopefully, s/he knows better now and that reason doesn't work with this community. You're not interested in helping and you're bloody mad that anyone has the temerity to suggest that you report bugs in a manner that might actually help them to identify the problem and fix it. It's 'their' job to find and fix this and not sell us this 'unfinished crap!'

There. End of rant.

And yes, I do feel better.:D
Thats the post truth era for you :(
 
  • 8
  • 1
Reactions:

Krafty

Lt. General
7 Badges
Aug 15, 2006
1.269
2.112
  • Crusader Kings II
  • Europa Universalis IV
  • Supreme Ruler: Cold War
  • Hearts of Iron IV Sign-up
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Together for Victory
  • Hearts of Iron IV: Death or Dishonor
I love it when people say "I saw on reddit, Youtube, the forums, in MP games, on Steam, Steam Reviews, Grey Market forums, from my friends, from the neighbor, from some guy screaming on the corner, that a small minority of very angry posters are angry."

Im not angry. Im not in a minority.

Im just pointing out that the game is subpar with regards to the AI. Which is even an opinion held by the review writers of Rockpapershotgun, Kotaku, Gamespy, et all.

I also dislike being minimized and stereotyped.

The "millions playing, handful posting" comment isnt backed up by anything other than the posters feelings and anecdotes. You dont see anyone else saying "Its only a minority who thinks the AI is good". Even though ill bet you couldnt find a majority to say its good. Possibly adequate, but without any data, im not going to be a nub and make that claim.
 
  • 21
  • 4
  • 1
Reactions:

Hidden Gunman

Major
39 Badges
May 1, 2012
696
223
  • Stellaris: Galaxy Edition
  • Steel Division: Normand 44 - Second Wave
  • Stellaris: Synthetic Dawn
  • Stellaris - Path to Destruction bundle
  • Hearts of Iron IV: Cadet
  • Semper Fi
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III Collection
  • Hearts of Iron III: Their Finest Hour
  • Naval War: Arctic Circle
  • Stellaris: Ancient Relics
  • Stellaris: Apocalypse
  • Steel Division: Normandy 44 -  Back to Hell
  • Stellaris: Distant Stars
  • BATTLETECH: Flashpoint
  • Stellaris: Megacorp
  • BATTLETECH: Season pass
  • Stellaris: Necroids
  • Age of Wonders: Planetfall
  • BATTLETECH: Heavy Metal
  • Stellaris: Federations
  • Empire of Sin
  • Empire of Sin - Deluxe Edition
  • Stellaris: Humanoids Species Pack
  • Hearts of Iron IV: Death or Dishonor
  • BATTLETECH
  • Steel Division: Normandy 44 Deluxe Edition
  • Steel Division: Normandy 44
  • Hearts of Iron IV: Together for Victory
  • Stellaris: Leviathans Story Pack
  • Stellaris: Digital Anniversary Edition
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris
  • 500k Club
  • War of the Roses
  • Hearts of Iron IV: Expansion Pass
  • Crusader Kings II
This sounds similar to my last game...Japan had massive forces in Norway and Mongolia, so I ran a check and they had 1 division in the home islands, with the enemy still in the Phillipines, SEA, and southern China. Crazy.
 

killswitch

Sergeant
16 Badges
Aug 5, 2010
97
155
  • Crusader Kings II
  • Divine Wind
  • Europa Universalis IV: Art of War
  • Hearts of Iron III
  • Victoria: Revolutions
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Europa Universalis IV
  • Victoria 2
  • 500k Club
  • Europa Universalis IV: El Dorado
  • Mount & Blade: Warband
  • Crusader Kings II: Way of Life
  • Hearts of Iron IV Sign-up
  • Stellaris Sign-up
  • Cities: Skylines
I love it when people say "I saw on reddit, Youtube, the forums, in MP games, on Steam, Steam Reviews, Grey Market forums, from my friends, from the neighbor, from some guy screaming on the corner, that a small minority of very angry posters are angry."

Im not angry. Im not in a minority.

Im just pointing out that the game is subpar with regards to the AI. Which is even an opinion held by the review writers of Rockpapershotgun, Kotaku, Gamespy, et all.

I also dislike being minimized and stereotyped.

The "millions playing, handful posting" comment isnt backed up by anything other than the posters feelings and anecdotes. You dont see anyone else saying "Its only a minority who thinks the AI is good". Even though ill bet you couldnt find a majority to say its good. Possibly adequate, but without any data, im not going to be a nub and make that claim.


Well said.
 
  • 9
  • 2
Reactions:

Moser

First Lieutenant
16 Badges
Dec 23, 2015
240
264
  • Arsenal of Democracy
  • Darkest Hour
  • For the Motherland
  • Hearts of Iron III
  • Hearts of Iron III: Their Finest Hour
  • Hearts of Iron III Collection
  • Lead and Gold
  • Semper Fi
  • Cities: Skylines
  • Hearts of Iron IV: Cadet
  • Hearts of Iron IV: Together for Victory
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: Expansion Pass
  • Hearts of Iron IV: Expansion Pass
  • Prison Architect
  • Hearts of Iron IV: La Resistance
I love it when people say "I saw on reddit, Youtube, the forums, in MP games, on Steam, Steam Reviews, Grey Market forums, from my friends, from the neighbor, from some guy screaming on the corner, that a small minority of very angry posters are angry."

Im not angry. Im not in a minority.

Im just pointing out that the game is subpar with regards to the AI. Which is even an opinion held by the review writers of Rockpapershotgun, Kotaku, Gamespy, et all.

I also dislike being minimized and stereotyped.

The "millions playing, handful posting" comment isnt backed up by anything other than the posters feelings and anecdotes. You dont see anyone else saying "Its only a minority who thinks the AI is good". Even though ill bet you couldnt find a majority to say its good. Possibly adequate, but without any data, im not going to be a nub and make that claim.

Yeah, it's not constructive to be cast as some self-righteous dissenter who is apparently very angry and very vocal -- only because I have a strong criticism of one of the core pieces of the game. I'm guessing it was meant to be some indirect blow toward me because I mentioned (God forbid) Reddit, albeit I was just mentioning another large community where the AI is frequently discussed and criticized. On the contrary, that community often shows off wonderful examples of how the Hearts of Iron series shines. If anything, my post history would show that up to now, I've been nearly silent with my criticism.

I do have a strong opinion about the state of the game upon release. I do think its AI, as sold, is a disaster, and I'll stand by that opinion. It's in no way, a sleight at the development team; I've always felt they are the real victims in being forced to release and then support an unfinished, unready game by Paradox -- unless they do actually feel it was ready for mass consumption which I doubt. And I hold those who decided to release it in its unfinished state accountable. I don't find anything wrong with that assessment. Hearts of Iron 4 is not the only game that was launched when it surely wasn't ready. I remember the juggernaut Battlefield 4 was a huge mess with its bugs, stability, and server issues, and much of it was reported on in the press. I found that to be fair. Electronic Arts must have learned something from that mess because their recent launch of Battlefield went much more smoothly and players are much more content -- although it's not perfect.

Nobody is asking for perfection here. We all knew the game would not have the level of polish the older entries in the series had after all their updates. I just didn't expect the level of incompetence when it came to the AI in nearly all aspects of the game -- production priorities, division spam, broken templates, abandoned fronts, suicide invasions, unnecessary DOW, lack of AI checks, etc. It was no way shape or form ready for release. It needed at least 8-12 months of work, judging by how its coming along (slowly but steadily) since the first patch. Without a competent AI, there is not a Hearts of Iron to me (I avoid MP like the plague).

And don't really see this as a DLC argument either. I've never held resentment over DLC releases -- for any game. One can research whether or not they think a DLC is worth it on their own. I'd just rather it would wait, or rather the release of the game wait, until it met some minimum threshold of quality.

And I understand how difficult and finicky of a job programming, so that's why I'd wish management would get on the ball here and give our poor boys, who have to rewrite entire portions of the code from what I've read, some additional help. From what I know, it's only 2-3 people working on the AI. How much could it possibly cost Paradox, a corporation that made $30M in profit last year, to hire a few more able-bodied individuals to help them on one of their flagship games?
 
  • 9
  • 1
Reactions:

Magnificent Genius

Perennial Also-Ran
95 Badges
Oct 28, 2014
1.493
1.046
  • Battle for Bosporus
  • BATTLETECH: Heavy Metal
  • BATTLETECH: Season pass
  • Prison Architect
  • Hearts of Iron IV: Expansion Pass
  • BATTLETECH: Flashpoint
  • BATTLETECH - Digital Deluxe Edition
  • Surviving Mars
  • BATTLETECH
  • Imperator: Rome - Magna Graecia
  • Stellaris: Federations
  • Hearts of Iron IV: Cadet
  • Europa Universalis IV
  • Stellaris: Nemesis
  • Europa Universalis 4: Emperor
  • Knights of Pen and Paper +1 Edition
  • Knights of Pen and Paper 2
  • Magicka
  • Stellaris: Necroids
  • Hearts of Iron IV: Colonel
  • Hearts of Iron IV: Field Marshal
  • Hearts of Iron IV: Death or Dishonor
  • Hearts of Iron IV: Expansion Pass
  • Hearts of Iron IV: La Resistance
  • Imperator: Rome Sign Up
  • Imperator: Rome
  • Imperator: Rome Deluxe Edition
  • Stellaris
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris: Galaxy Edition
  • Stellaris: Leviathans Story Pack
  • Stellaris - Path to Destruction bundle
  • Stellaris: Synthetic Dawn
  • Stellaris: Apocalypse
  • Stellaris: Distant Stars
  • Stellaris: Megacorp
  • Stellaris: Ancient Relics
  • Stellaris: Humanoids Species Pack
  • Stellaris: Digital Anniversary Edition
  • Stellaris: Lithoids
  • Europa Universalis IV: Call to arms event
  • Europa Universalis IV: Pre-order
  • Europa Universalis IV: Cradle of Civilization
  • Europa Universalis IV: Cossacks
  • Europa Universalis IV: Common Sense
  • Europa Universalis IV: Mandate of Heaven
  • Europa Universalis IV: El Dorado
  • Europa Universalis IV: Golden Century
  • Europa Universalis IV: Dharma
Yeah, it's not constructive to be cast as some self-righteous dissenter who is apparently very angry and very vocal -- only because I have a strong criticism of one of the core pieces of the game. I'm guessing it was meant to be some indirect blow toward me because I mentioned (God forbid) Reddit, albeit I was just mentioning another large community where the AI is frequently discussed and criticized. On the contrary, that community often shows off wonderful examples of how the Hearts of Iron series shines. If anything, my post history would show that up to now, I've been nearly silent with my criticism.

I do have a strong opinion about the state of the game upon release. I do think its AI, as sold, is a disaster, and I'll stand by that opinion. It's in no way, a sleight at the development team; I've always felt they are the real victims in being forced to release and then support an unfinished, unready game by Paradox -- unless they do actually feel it was ready for mass consumption which I doubt. And I hold those who decided to release it in its unfinished state accountable. I don't find anything wrong with that assessment. Hearts of Iron 4 is not the only game that was launched when it surely wasn't ready. I remember the juggernaut Battlefield 4 was a huge mess with its bugs, stability, and server issues, and much of it was reported on in the press. I found that to be fair. Electronic Arts must have learned something from that mess because their recent launch of Battlefield went much more smoothly and players are much more content -- although it's not perfect.

Nobody is asking for perfection here. We all knew the game would not have the level of polish the older entries in the series had after all their updates. I just didn't expect the level of incompetence when it came to the AI in nearly all aspects of the game -- production priorities, division spam, broken templates, abandoned fronts, suicide invasions, unnecessary DOW, lack of AI checks, etc. It was no way shape or form ready for release. It needed at least 8-12 months of work, judging by how its coming along (slowly but steadily) since the first patch. Without a competent AI, there is not a Hearts of Iron to me (I avoid MP like the plague).

And don't really see this as a DLC argument either. I've never held resentment over DLC releases -- for any game. One can research whether or not they think a DLC is worth it on their own. I'd just rather it would wait, or rather the release of the game wait, until it met some minimum threshold of quality.

And I understand how difficult and finicky of a job programming, so that's why I'd wish management would get on the ball here and give our poor boys, who have to rewrite entire portions of the code from what I've read, some additional help. From what I know, it's only 2-3 people working on the AI. How much could it possibly cost Paradox, a corporation that made $30M in profit last year, to hire a few more able-bodied individuals to help them on one of their flagship games?

I think most of us wouldn't be here if we weren't fairly loyal to Paradox. The fact that the complaints are so widespread says something.
 
  • 10
Reactions:

GAGA Extrem

Per Ardua Ad Astra
External QA
121 Badges
Mar 19, 2004
11.469
4.989
  • Semper Fi
  • Heir to the Throne
  • Europa Universalis III Complete
  • King Arthur II
  • Knights of Pen and Paper +1 Edition
  • Leviathan: Warships
  • Magicka
  • Majesty 2
  • Majesty 2 Collection
  • Europa Universalis III Complete
  • Europa Universalis IV: Res Publica
  • Victoria: Revolutions
  • Rome Gold
  • Hearts of Iron III
  • Ship Simulator Extremes
  • Sword of the Stars II
  • Supreme Ruler 2020
  • Teleglitch: Die More Edition
  • The Showdown Effect
  • Victoria 2
  • Victoria 2: A House Divided
  • Victoria 2: Heart of Darkness
  • Warlock: Master of the Arcane
  • Warlock 2: The Exiled
  • Warlock 2: Wrath of the Nagas
  • Hearts of Iron IV: No Step Back
  • Darkest Hour
  • Arsenal of Democracy
  • Hearts of Iron II: Armageddon
  • Cities in Motion
  • Crusader Kings II
  • Crusader Kings II: Charlemagne
  • Crusader Kings II: Legacy of Rome
  • Crusader Kings II: The Old Gods
  • Crusader Kings II: Rajas of India
  • Crusader Kings II: The Republic
  • Crusader Kings II: Sons of Abraham
  • Crusader Kings II: Sunset Invasion
  • Crusader Kings II: Sword of Islam
  • A Game of Dwarves
  • Dungeonland
  • East India Company Collection
  • Europa Universalis III
  • Europa Universalis III Complete
  • Divine Wind
  • Europa Universalis IV
  • Europa Universalis IV: Art of War
  • Europa Universalis IV: Conquest of Paradise
  • Europa Universalis IV: Wealth of Nations
  • Europa Universalis IV: Call to arms event
I know it's a different game, but it's pretty similar in concept, but how can a game/series like EU have good/great AI while it is next to horrendous for HOI?
Combat (and a lot of other basic stuff) in EU4 is very similiar to EU3 (and Vicky 2), so there was *a lot* more time to iterate on AI behaviour. If you look back, you'll see that the difference in AI quality between EU3 and EU4 is massive.

HOI on the other hand has a significantly more detailed and complex military/combat system and there where big changes related to those game mechanics between HOI3 and HOI4.
 
  • 2
  • 1
Reactions:
Status
Not open for further replies.