+ Reply to Thread
Page 1 of 3 1 2 3 LastLast
Results 1 to 20 of 41

Thread: Mnplastic AARs rating

  1. #1

    Mnplastic AARs rating

    It is useful sometimes to know quality or rating of AARs especially when there are hundreds or even thousands of them in each game category. I have tried many times to understand Paradox rating system but to no avail. At the moment “Biplanes available - Cheap!” advertisement holds the second place in the HOI3 AAR forum. This doesn’t make any sense.

    I have therefore created my own system. I am sure it is very subjective in some sense but at least makes some sense to me and I hope to you as well.

    I have decided that decided that the most important available information is the numbers of Posts, Author Posts and Reviews. The proportion of comments to all Posts shows an interest in discussing an AAR, while the proportion of Posts to all Views shows an interest to follow the AAR.

    Mathematically I have expressed my thought into the formula:

    Rating = (1-AP/TP)/2-ln(TP/VW)/10

    Where:
    AP – Author Posts
    TP – Total Posts
    VW – Views

    I have disqualified all AARs where there less than 100 total posts and author had less than 20 posts or less than 30 posts and have not completed AAR. The interactive and succession game AARs are left out.


    I have also separated Tutorial AARs from standard AARs. Please see the results yourself.

    Top 40 HOI3 AARs 06.01.12




    Top 10 HOI3 Tutorial AARs 06.01.12


  2. #2
    Human Enewald's Avatar
    200k clubArsenal of DemocracyHearts of Iron 2: ArmageddonCities in MotionCrusader Kings II
    Darkest HourDeus VultDungeonlandEast India Company CollectionEU3 Complete
    Divine WindFor The GloryFor the MotherlandHearts of Iron IIIHearts of Iron III Collection
    HOI3: Their Finest HourHeir to the ThroneImpireEuropa Universalis III: In NomineIron Cross
    Leviathan: WarshipsThe Kings CrusadeMagickaMajesty II CollectionMarch of the Eagles
    EU3 Napoleon's AmbitionVictoria: RevolutionsEuropa Universalis: RomeRome GoldSemper Fi
    SengokuThe Showdown EffectVictoria 2Victoria II: A House DividedVictoria II: Heart of Darkness
    Rome: Vae VictisWarlock: Master of the ArcaneWar of the RosesEU Rome Collectors EditionEU3 Collectors Edition
    500k clubEuropa Universalis IV: Pre-orderEUIV: Wealth of NationsEUIV: Conquest of Paradise

    Join Date
    Oct 2007
    Location
    Hellsinki,Finland
    Posts
    22,745
    Uriah and Myth did something... unexpected there.

  3. #3
    Caramelised Utopian tuore's Avatar
    200k clubArsenal of DemocracyCrusader Kings IIDarkest HourDeus Vult
    EU3 CompleteDivine WindFor the MotherlandHearts of Iron IIIHOI3: Their Finest Hour
    Heir to the ThroneThe Kings CrusadeLost Empire - ImmortalsMagickaMarch of the Eagles
    Victoria: RevolutionsRome GoldSemper FiSupreme Ruler: Cold WarVictoria 2
    Victoria II: A House DividedVictoria II: Heart of DarknessMount & Blade: WarbandMount & Blade: With Fire and Sword500k club
    Europa Universalis IV: Pre-orderEUIV: Call to arms event

    Join Date
    Mar 2009
    Location
    Finland
    Posts
    6,983
    "What does this button do?" Is not a tutorial AAR to you? It's in the top 40 list.
    1914-1964 - the Ultimate Strategy Game


  4. #4
    January 2011


    Top 40 HOI3 AARs 11.01.11




    Top 10 HOI3 Tutorial AARs 11.01.11




    Top 20 AoD AARs 22.01.11



    There are several AoD interactive AARs which scored relatively low but I am sure this is due to different style. I have counted all posts of participating writers as "author's". While it works well with MP AARs I am not sure it is a good method for Interactive AARs.

    The only Tutorial: An Arsenal of Democracy Review-AAR scored 0.91

    Top 30 Victoria 2 AARs 23.01.11



    Tutorials:
    Under the Rising Sun - A V2 Review AAR Rating 0.99
    V2 Beta AAR : France 1836 - A Learning The Game AAR Rating 0.76

    Due to the low number of AARs I have included AARs with 15+ Author posts and/or AARs with 80+ total posts.

    Top 20 Rome AARs 23.01.11



    Due to the low number of AARs I have included AARs with 15+ Author posts and/or AARs with 80+ total posts.


    Top 60 EU3 AARs 02.02.11





    Courtesy of Dewirix


    Due to the high number of AARs, only AARs with 200+ total posts are included.

  5. #5
    Unpaid Ulm PR employee Svip's Avatar
    For The Glory

    Join Date
    Sep 2009
    Location
    Kopenhaagen, Taani Kuningriik
    Posts
    2,451
    Isn't the correct term 'views', rather than 'reviews'? Sounds like a lot of people wrote a detailed review on the AAR.

    And while we are being pedantic, isn't there a problem with considering author posts regarding MP AARs, as in some cases, many contributors speak for the AAR, i.e. more than one author. Is this taken into account?
    AARs of Sir Svip OLIR:
    Glory for Ulm A Flagland AAR (Europa Universalis IV) (ongoing)
    Winner of: ACA 2014 Q2: EUIV, ACA 2014 Q1: EUIV (Split), AARtist of the Month (May 2014), Seal of Mythic Approval and having the same title as another popular AAR.
    Ulm plays Crusader Kings II: The Old Gods as Someone (finished), Victoria 2: Heart of Darkness as Austria (finished) and March of the Eagles as Russia (finished)
    Winner of: Hats.
    Glory for Ulm A Flagland AAR (Europa Universalis III) (ended)
    Winner of: Europa Univeralis: The Musical, Cities in Motion DLC: Ulm, AARtist of the Month (June 2011), (Royal Dutch Cheese of Anti-Frognessship), (Swedish Meatball of Volvo and Björn Borg), (Cyan Blue Cookie of Awesomeness), (Lord Strange Cookie of British Awesomeness), ACA 2010 Q4: EU Comedy, (Paradox Cookie), WritAAR of the Week (2011-01-30), "Best everything, ever" award, (Irish Shamrock Cookie) and being in this signature.
    Full list at my Inkwell

  6. #6
    I have added posts which were contribution to storyline. However I can not guarantee 100% accuracy

    I will amend Reviews to Views - good spot


    Edit: I have amended now

  7. #7
    Maestro Director's Avatar
    For the MotherlandHearts of Iron IIIHeir to the ThroneEuropa Universalis III: In NomineEU3 Napoleon's Ambition
    Victoria: RevolutionsSemper FiVictoria 2Victoria II: A House DividedVictoria II: Heart of Darkness
    EU3 Collectors Edition500k clubEuropa Universalis IV

    Join Date
    Aug 2002
    Location
    York PA
    Posts
    4,043
    Despite this I am not convinced that number of posts, views or replies determines the quality of a work.

    Please advise which moderators you secured permission from before running this initiative?
    "That which does not kill me, has made a grave tactical error." - Jerry Pournelle

    Seven AARs and a picture, too: Director's Inkwell

  8. #8
    Quote Originally Posted by Director View Post
    Despite this I am not convinced that number of posts, views or replies determines the quality of a work.
    Yes you are right, but this is the only readily available information. It is like the UK Top 40 do not determine the quality of songs because it is based only on sales. Nevertheless The Anthology of HoI AARs and The Anthology of EUII AARs are based on the same data I am using. However, having in mind that writing longer automatically attracts more views and posts I think it is unfair for shorter AARs which could have been in the anthologies. This is why I have used the above mentioned proportions with which I have tried to separate "quality" from the effect longevity of some AAR's.


    Quote Originally Posted by Director View Post
    Please advise which moderators you secured permission from before running this initiative?
    No, I have not. The reasons I wrote in a PM.

  9. #9
    Colonel quaazi's Avatar

    Join Date
    Oct 2009
    Location
    Aestii
    Posts
    1,045
    I didn't know you had to check with mods to make a thread to discuss AARs.

    I think the best word to describe the quality that this rating system gauges is "health": how healthy an AAR is. Just outta interest, apparently my AAR's rating would be 0,676, but then again, I'm awful at math.
    History of the Modern Red Army - Soviet Union Total War AAR
    Military only style AAR, detailing the battles of the Red Army
    Currently at Update 44 - 13.03.11.

  10. #10
    Quote Originally Posted by quaazi View Post
    I didn't know you had to check with mods to make a thread to discuss AARs.

    I think the best word to describe the quality that this rating system gauges is "health": how healthy an AAR is. Just outta interest, apparently my AAR's rating would be 0,676, but then again, I'm awful at math.
    I don't think you could compare the HOI3 rating with the AoD because of different traffic. Your AAR with 0.676 could be in top 10 in AoD Because of that reason I would never risk to pick the best Paradox AAR.


    Edit: I have posted TOP 20 AoD AARs 22.01.11

  11. #11
    Strategy GuidAAR Rensslaer's Avatar
    Crusader Kings IIHearts of Iron IIIEU3 Napoleon's AmbitionVictoria: RevolutionsEuropa Universalis: Rome
    Victoria 2Rome: Vae Victis

    Join Date
    Jun 2004
    Location
    Colorado
    Posts
    7,576
    Thanks, MnPlastic, for doing this calculation! It's interesting that my AAR scored higher than Myth's despite his having so many more views, and an approximately similar distribution of author posts to other posts.

    I'll agree that it's not necessarily equivalent to quality, but given the information we have it is a reasonable approximation within some bounds. The number of non-author posts helps indicate relative interest level for an AAR, but I also think there are AARs which are really good but don't get noticed. I get a boost because of name recognition, I think. It also helps that I started mine very soon after the game came out -- something which might be hard to calculate, but which I think greatly impacts overall viewcount and number of non-author posts (look at Singleton Mosby's tutorial AAR on Barbarossa, for instance -- great quality, but many of those posts and views pre-dated even the game release! -- quite an achievement!).

    Sometimes I gauge how well my AAR is doing by the number of views per week, for instance. Did you calculate the amount of time running at all?

    This sounds similar to the "Phatness Index" which... I think it was Sir Humphrey who developed it (forgive me if I've misattributed!). Similar criteria used.

    Rensslaer
    Serenity - (V2 v1.3) - An isolationist Japan tries to stay out of everybody's way (Updated July '13)
    Kriegsgefahr (Impending War) - (HOI3/SF/HPP) - Germany attempts to remain at peace! (Updated Apr '13)
    Locarno - Italy vs. Germany (HOI3/SF/HPP) - What if Mussolini stood with France against Hitler?
    The Die is Cast (Roman Civil War) - Caesar will make a name for himself! (Updated June '12)
    Império Novo - An Axis Portugal AAR for HOI 3 (Updated May '13)
    Fire Warms the Northern Lands - A Prussian Victoria 1 AAR (Awarded the VictAARian Cross for Jan-Jun 2006)
    Castles In the Sky (Vicky 1) * Sforza!!! - A Milan AAR (EU III) (Updated May '13) * I Am Siam (V2 Minor) (tied for Silver VictAARian Cross for Best AAR completed in 2011) * A Long Time Ago... (HOI 1 Argentina)* Check Rensslaer's Inkwell! (list of online writings)

  12. #12
    Alternative Affairs Specialist TekcoR's Avatar
    Hearts of Iron 2: ArmageddonDarkest HourFor the MotherlandHearts of Iron IIIHOI3: Their Finest Hour
    Victoria: RevolutionsSemper FiVictoria 2Victoria II: A House Divided

    Join Date
    Jul 2003
    Location
    Omaha, NE
    Posts
    2,168
    Blog Entries
    11
    This is really quite interesting and I like the breakdowns. I was wondering if you were going to do anything like these ratings for Victoria 2?
    Visit TekcoR Productions and get additional news and information about all characters and writings featured! While your at it, become a fan by liking the page!

    Featured::
    Prince Imperial - Best Character Writer of the Week (November 7th - November 14th, 2010)
    Descendants of Alexander - Weekly AAR Showcase (August 4th - August 11th, 2011)
    In den Augen Gottes - Prussia in an Alternative History Affair
    Alptraum (Nightmare) - Writer of the Week (December 4th - December 11th, 2011) & AARland Choice AwAARd 2012 (Round 1)

  13. #13
    Quote Originally Posted by Rensslaer View Post
    Thanks, MnPlastic, for doing this calculation! It's interesting that my AAR scored higher than Myth's despite his having so many more views, and an approximately similar distribution of author posts to other posts.

    I'll agree that it's not necessarily equivalent to quality, but given the information we have it is a reasonable approximation within some bounds. The number of non-author posts helps indicate relative interest level for an AAR, but I also think there are AARs which are really good but don't get noticed. I get a boost because of name recognition, I think. It also helps that I started mine very soon after the game came out -- something which might be hard to calculate, but which I think greatly impacts overall viewcount and number of non-author posts (look at Singleton Mosby's tutorial AAR on Barbarossa, for instance -- great quality, but many of those posts and views pre-dated even the game release! -- quite an achievement!).

    Sometimes I gauge how well my AAR is doing by the number of views per week, for instance. Did you calculate the amount of time running at all?

    This sounds similar to the "Phatness Index" which... I think it was Sir Humphrey who developed it (forgive me if I've misattributed!). Similar criteria used.

    Rensslaer
    You are right time is very important because longer AARs exist more they attract views. I also suspect, that more pages AARs have more views they attract too because each page counts as 1 view, I might be wrong. This is why I have included "ln" function in posts/view section of formula. I know that this is not ideal way to do it but it somehow dilutes the time and number of pages effects.

    I am happy that in the HOI3 TOP 40 many shorter and long forgotten AARs appeared, even in the TOP 10 spot. I have also printed the "best" 40 and not 10 or 20 because I think the Rating is not perfect and it is good to show big variety of AARs with some extra information like Country. It would be great to include also "Style" (ie. narrative, history, comedy etc.). The Rating showed that there is a big interest in "Minors'" AARs (look Portugal, Finland and Hungary in the top 10 HOI3, or Yugoslavia, Jamaica (Tropical Country) and Ethiopia in the top 10 AoD).


    BTW, I have noticed that the AoD thread has many experimental AAR

  14. #14
    Quote Originally Posted by TekcoR View Post
    This is really quite interesting and I like the breakdowns. I was wondering if you were going to do anything like these ratings for Victoria 2?
    I might do Victoria 2, but when I saw how many AARs in EU, Vicroria, HOI1-2 or CK threads I almost gave up the idea. I'll become grey before I ever finish :O


    Edit: I have done Victoria 2 rating but I am sure the TOP 20 will be very volatile in the next 6-12 months

  15. #15
    Strategy GuidAAR Rensslaer's Avatar
    Crusader Kings IIHearts of Iron IIIEU3 Napoleon's AmbitionVictoria: RevolutionsEuropa Universalis: Rome
    Victoria 2Rome: Vae Victis

    Join Date
    Jun 2004
    Location
    Colorado
    Posts
    7,576
    Hmm... I'm not sure it helps the accuracy to penalize (if that's what you're doing) for the number of pages. If an AAR gets a point/viewpoint for every page read, that just means people are interested enough to keep reading.

    Yes, to contemplate going through hundreds of AARs is quite daunting! I'm having a hard enough time psyching myself up to read enough to judge for the AARLand Choice Awards -- I'll enjoy the reading, but it'll take a while to get through so many to make sure I'm not missing a great AAR.

    It would also be helpful if in the chart you put the author next to the title, maybe in parentheses. Sometimes I don't remember the exact name of an AAR, but I'll think of it as "Robou's AAR" or whatever, so the author name would help remember which is which.

    Rensslaer
    Serenity - (V2 v1.3) - An isolationist Japan tries to stay out of everybody's way (Updated July '13)
    Kriegsgefahr (Impending War) - (HOI3/SF/HPP) - Germany attempts to remain at peace! (Updated Apr '13)
    Locarno - Italy vs. Germany (HOI3/SF/HPP) - What if Mussolini stood with France against Hitler?
    The Die is Cast (Roman Civil War) - Caesar will make a name for himself! (Updated June '12)
    Império Novo - An Axis Portugal AAR for HOI 3 (Updated May '13)
    Fire Warms the Northern Lands - A Prussian Victoria 1 AAR (Awarded the VictAARian Cross for Jan-Jun 2006)
    Castles In the Sky (Vicky 1) * Sforza!!! - A Milan AAR (EU III) (Updated May '13) * I Am Siam (V2 Minor) (tied for Silver VictAARian Cross for Best AAR completed in 2011) * A Long Time Ago... (HOI 1 Argentina)* Check Rensslaer's Inkwell! (list of online writings)

  16. #16
    Field Marshal Tommy4ever's Avatar
    Arsenal of DemocracyCrusader Kings IIDiplomacyEU3 CompleteDivine Wind
    Hearts of Iron IIIHeir to the ThroneRome GoldVictoria 2Victoria II: A House Divided
    Victoria II: Heart of Darkness500k clubEuropa Universalis IV: Pre-order

    Join Date
    Sep 2008
    Location
    St Andrews
    Posts
    4,333
    Quote Originally Posted by mnplastic View Post
    I might do Victoria 2, but when I saw how many AARs in EU, Vicroria, HOI1-2 or CK threads I almost gave up the idea. I'll become grey before I ever finish :O


    Edit: I have done Victoria 2 rating but I am sure the TOP 20 will be very volatile in the next 6-12 months
    Why did you not include ''let the ruling classes tremble''?

    With 160,000 views and 4,500 replies it should surely make it in. I just wanted to see where it would rank on your list.

  17. #17
    Human Enewald's Avatar
    200k clubArsenal of DemocracyHearts of Iron 2: ArmageddonCities in MotionCrusader Kings II
    Darkest HourDeus VultDungeonlandEast India Company CollectionEU3 Complete
    Divine WindFor The GloryFor the MotherlandHearts of Iron IIIHearts of Iron III Collection
    HOI3: Their Finest HourHeir to the ThroneImpireEuropa Universalis III: In NomineIron Cross
    Leviathan: WarshipsThe Kings CrusadeMagickaMajesty II CollectionMarch of the Eagles
    EU3 Napoleon's AmbitionVictoria: RevolutionsEuropa Universalis: RomeRome GoldSemper Fi
    SengokuThe Showdown EffectVictoria 2Victoria II: A House DividedVictoria II: Heart of Darkness
    Rome: Vae VictisWarlock: Master of the ArcaneWar of the RosesEU Rome Collectors EditionEU3 Collectors Edition
    500k clubEuropa Universalis IV: Pre-orderEUIV: Wealth of NationsEUIV: Conquest of Paradise

    Join Date
    Oct 2007
    Location
    Hellsinki,Finland
    Posts
    22,745
    Quote Originally Posted by Tommy4ever View Post
    Why did you not include ''let the ruling classes tremble''?

    With 160,000 views and 4,500 replies it should surely make it in. I just wanted to see where it would rank on your list.
    Quite high, at the moment 4598 replies, you have 426 posts there.
    And I have 293 posts there.

  18. #18
    Alternative Affairs Specialist TekcoR's Avatar
    Hearts of Iron 2: ArmageddonDarkest HourFor the MotherlandHearts of Iron IIIHOI3: Their Finest Hour
    Victoria: RevolutionsSemper FiVictoria 2Victoria II: A House Divided

    Join Date
    Jul 2003
    Location
    Omaha, NE
    Posts
    2,168
    Blog Entries
    11
    I'm a bit perplexed on the rating for Victoria 2 AARs, based on the the list of AARs there certainly my French AAR, would be there. I am amazed some of the other writers on there, and some scored higher than others. Do you have a list that expands further than the top 20?
    Visit TekcoR Productions and get additional news and information about all characters and writings featured! While your at it, become a fan by liking the page!

    Featured::
    Prince Imperial - Best Character Writer of the Week (November 7th - November 14th, 2010)
    Descendants of Alexander - Weekly AAR Showcase (August 4th - August 11th, 2011)
    In den Augen Gottes - Prussia in an Alternative History Affair
    Alptraum (Nightmare) - Writer of the Week (December 4th - December 11th, 2011) & AARland Choice AwAARd 2012 (Round 1)

  19. #19
    Quote Originally Posted by Rensslaer View Post
    Hmm... I'm not sure it helps the accuracy to penalize (if that's what you're doing) for the number of pages. If an AAR gets a point/viewpoint for every page read, that just means people are interested enough to keep reading.Rensslaer
    Lets assume that somebody wrote a book 300 pages and somebody else 500. Now 3 people read the first book and only 2 read the second. If we count views then the second book would be a winner because 1000 pages were read.

  20. #20
    Quote Originally Posted by Tommy4ever View Post
    Why did you not include ''let the ruling classes tremble''?

    With 160,000 views and 4,500 replies it should surely make it in. I just wanted to see where it would rank on your list.
    Quote Originally Posted by Enewald View Post
    Quite high, at the moment 4598 replies, you have 426 posts there.
    And I have 293 posts there.


    This is the same problem as I had with AoD. Interactive AARs are so different from others that it is difficult to fit them under the same system. In this specific case this happened because number of views compared to total post is not high enough - just 40 views per post.

    I am open to suggestions how to objectively deal with interactive and multiplayer AARs.


    Edit: I just found out that there was a contest of Victoria 2 AARs.

    The comparison of the first 5 places:

    Contest v Rating:
    1 v 10
    2 v 30
    3 v 6
    4 v 9
    5 v 8

    Out of 5 AARs 4 are in my top 10

    Contest v Views

    1 v 4
    2 v 29
    3 v 14
    4 v 3
    5 v 25

    Out of 5 AARs 2 are in top 10 views

+ Reply to Thread
Page 1 of 3 1 2 3 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts