AllegSkill auto balance

Allegiance discussion not belonging in another forum.
Adept
Posts: 8660
Joined: Thu Sep 27, 2007 12:53 pm
Location: Turku, Finland

Post by Adept »

sgt_baker wrote:QUOTE (sgt_baker @ Jan 17 2008, 07:15 PM) And, excuse me for going out on a limb here, but this 'worst idea in the history of mankind' is worse how, exactly, then a system that prevents a player from joining indefinately?

Edit: Or a system that somehow believes that a 2 vs 8 is balanced. The mind boggles.
Hyperbole

http://en.wikipedia.org/wiki/Hyperbole

Not a very nice way to present your argument, but there you go.

/edit By the way, Fingerbanger said it was the worst idea in the history of Allegiance. Still pretty rich, considering the torrid history of our beloved game. /laugh.gif" style="vertical-align:middle" emoid=":lol:" border="0" alt="laugh.gif" />
Last edited by Adept on Thu Jan 17, 2008 6:41 pm, edited 1 time in total.
ImageImageImageImageImage
<bp|> Maybe when I grow up I can be a troll like PsycH
<bp|> or an obsessive compulsive paladin of law like Adept
sgt_baker
Posts: 1510
Joined: Wed Oct 20, 2004 7:00 am
Location: London, UK.
Contact:

Post by sgt_baker »

TheVoid37 wrote:QUOTE (TheVoid37 @ Jan 17 2008, 06:36 PM) I don't know, I just can't see how a system can accurately project how good a player is overall in this game.

You can't measure how well someone places probes, that spot a constructor that allows me to kill it.
You can't measure how well someone places probes to spot bomber runs and miners.
You can't measure someones perception of another player, if VetA is podded repeatedly by VetB and becomes leiry of standing toe to toe with them how do you measure it?
You can't measure someones kill ratio in a turret as compared to an int or Sfig. IE how good they are with certain techs.
you can't measure how well someone rams a bomber to get it to the base sooner resulting in a base kill instead of none.
You can't measure how well someone places a TP2 drop.
You can't measure someones contribution to escorting a constructor and enabling it to build.
etc...

At least not that I know of /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" />

But I pleasantly look forward to being proven wrong.

There is just so much involved in allegiance and it all compounds greatly through the entire course of a game, I can't fathom how any automated system can measure it all; however, people can.
These are the very reasons I maintain that a points-based scoring and ranking system for alleg is a dream at best. The closest possible solution is to measure the outcome of said actions over time. This is why we chose a win/loss solution over a points-based one. The information theory workings of such systems allow for assessing skill based on indirect observation. It's pretty easy to understand in a 1 vs 1 example:

If player A beats player B 7 times out of 10 it's reasonable to assume that player A is more skilled than player B.

The great benefit of applying known statistical methodologies to the information contained in game outcomes is that the skill rating system is indifferent to the exact nature of the actions being taken by the player. Thus, we are able to, albeit via a mathematical round-trip, compare the skill value of a whore to the skill value of a scout nan, TP2er etc etc. Many people claim that Alleg is too complicated for a win/loss system to be more effective than a points-based one. As it happens, the exact opposite is true!

B
Image
Granary Sergeant Baker - Special Bread Service (Wurf - 13th Oct 2011)
sgt_baker
Posts: 1510
Joined: Wed Oct 20, 2004 7:00 am
Location: London, UK.
Contact:

Post by sgt_baker »

Adept wrote:QUOTE (Adept @ Jan 17 2008, 06:39 PM) Hyperbole

http://en.wikipedia.org/wiki/Hyperbole

Not a very nice way to present your argument, but there you go.

/edit By the way, Fingerbanger said it was the worst idea in the history of Allegiance. Still pretty rich, considering the torrid history of our beloved game. /laugh.gif" style="vertical-align:middle" emoid=":lol:" border="0" alt="laugh.gif" />

Excuse my becoming tired of the umpteenth post where the poster assumes I've not thought an idea through properly. Notice also that I said 'one of the modes', implying that there are different solutions to the varying conditions in Alleg. Frankly, I don't recall signing a care bear decree. If a post annoys me I'll jolly well let you know if I see fit to do so.

Thanks,

B

Edit: fur spelink
Last edited by sgt_baker on Thu Jan 17, 2008 6:54 pm, edited 1 time in total.
Image
Granary Sergeant Baker - Special Bread Service (Wurf - 13th Oct 2011)
TheVoid37
Posts: 1416
Joined: Mon Nov 28, 2005 8:00 am
Location: Orlando, FL.

Post by TheVoid37 »

I never said the proposed system wouldn't work /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" /> just talking. don't want to change the topic of this thread.

But I agree, a system based off win/loss % would be much preferred over pure points for actions taken as measured as an individual.

Afterall IMHO the only thing that matters in alleg is whether your team wins or looses.
ImageImage
"Someday, We'll Find It... The Rainbow Connection." ~ Kermit
sgt_baker
Posts: 1510
Joined: Wed Oct 20, 2004 7:00 am
Location: London, UK.
Contact:

Post by sgt_baker »

TheVoid37 wrote:QUOTE (TheVoid37 @ Jan 17 2008, 06:57 PM) I never said the proposed system wouldn't work /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" /> just talking. don't want to change the topic of this thread.

But I agree, a system based off win/loss % would be much preferred over pure points for actions taken as measured as an individual.

Afterall IMHO the only thing that matters in alleg is whether your team wins or looses.

No no, was a very good point. /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" />
Image
Granary Sergeant Baker - Special Bread Service (Wurf - 13th Oct 2011)
sgt_baker
Posts: 1510
Joined: Wed Oct 20, 2004 7:00 am
Location: London, UK.
Contact:

Post by sgt_baker »

An excerpt from the big-daddy stats in Alleg paper. It puts the points problem in different, yet understandable, terms:

http://www.fe23.co.uk/alleg/AS/AllegSkillf...sUNFINISHED.pdf
Last edited by sgt_baker on Thu Jan 17, 2008 7:10 pm, edited 1 time in total.
Image
Granary Sergeant Baker - Special Bread Service (Wurf - 13th Oct 2011)
Grim_Reaper_4u
Posts: 356
Joined: Wed Jul 30, 2003 7:00 am
Location: Netherlands

Post by Grim_Reaper_4u »

sgt_baker wrote:QUOTE (sgt_baker @ Jan 17 2008, 07:45 PM) Many people claim that Alleg is too complicated for a win/loss system to be more effective than a points-based one. As it happens, the exact opposite is true!

B
Eh that seems to be your opinion and not scientific fact Baker /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> a win/loss system is a lot easier to implement though and of course a good points based system might not be possible with current logging technology /mrgreen.gif" style="vertical-align:middle" emoid=":D" border="0" alt="mrgreen.gif" />

a) the more people on a team the more games you need to accurately judge a persons skill, peeps that only play 20 vs 20 will never be ranked accurately before 2015 /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" />
b) all the theory quoted in your articles fails to take into account anti-stackers : peeps with great skills that don't mind losing and join the underdog team that is almost dead, even though AB says teams are even (cause it defies logic /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> )
c) despite your claims to the contrary I think that the new Trueskill was only tested between teams of similarly ranked players (in which it is much easier to identify players with higher skills, esp. with random team assignments)
d) preferably the teams should be random every time when calculating those stats (to prevent for example a skill-less noob to always join the same team as Aarm+Snack+Frag and thus freeride the skill-ladder on their backs)

trueskill in combo with autobalance will never be better than the "eye" of a seasoned vet where balance is concerned, however it is probably the next best thing /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> but ..........


Regarding a points based system : IMHO if we balanced out int whores and miner killers over both teams then 95% of allegiance games would be balanced. In most games the balance is ruined by several whores joining 1 team and having a few good miner killers (who aren't ints whores too) on 1 side also ruins game balance often /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" /> If your AB would divide whores and miner killers evenly over both teams then most games would be even (esp. since all "follow the int hos" stackers could now chose between 2 teams /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> )
badpazzword
Posts: 3627
Joined: Thu Jan 12, 2006 8:00 am
Contact:

Post by badpazzword »

Points based system:
Sgt_Baker wrote:QUOTE (Sgt_Baker @ his paper)For equal contribution to game outcome, how many kills are worth a tech rock spotted?
Reputation based system:

What would be the rank of Malice or Yanlin right now? Do you think being in a squad could yeld better ranks in such a system? Would it actually reflect the skill of a player?
Have gaming questions? Get expert answers! Image Image
sgt_baker
Posts: 1510
Joined: Wed Oct 20, 2004 7:00 am
Location: London, UK.
Contact:

Post by sgt_baker »

Grim_Reaper_4u wrote:QUOTE (Grim_Reaper_4u @ Jan 17 2008, 07:16 PM) Eh that seems to be your opinion and not scientific fact Baker /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> a win/loss system is a lot easier to implement though and of course a good points based system might not be possible with current logging technology /mrgreen.gif" style="vertical-align:middle" emoid=":D" border="0" alt="mrgreen.gif" />
Give me *one* way of accurately scoring situational awareness and I'm all ears.

QUOTE a) the more people on a team the more games you need to accurately judge a persons skill, peeps that only play 20 vs 20 will never be ranked accurately before 2015 /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" />[/quote]

That's supposition and exaggeration. I asked you to read up on the facts. If you had you'd know that accurate ranking depends not only on how many games you've played, but also *who you play against*. Opponents with low sigmas lead to bigger decreases in one's own sigma.

QUOTE b) all the theory quoted in your articles fails to take into account anti-stackers : peeps with great skills that don't mind losing and join the underdog team that is almost dead, even though AB says teams are even (cause it defies logic /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> )[/quote]

I'd like you to expand upon this statement. I've explained this to you once already (I think). /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" />

QUOTE c) despite your claims to the contrary I think that the new Trueskill was only tested between teams of similarly ranked players (in which it is much easier to identify players with higher skills, esp. with random team assignments)[/quote]

OK. I'll email Ralph Herbrich @ MSR and explicitly ask this question. Will that settle this? (Q: How does testing against the Alleg database constitute 'similarly ranked players'?)

QUOTE d) preferably the teams should be random every time when calculating those stats (to prevent for example a skill-less noob to always join the same team as Aarm+Snack+Frag and thus freeride the skill-ladder on their backs)[/quote]

The first part of this statement doesn't make sense. In retort to the second part: It is well documented that Trueskill, or any other win/loss system for that matter, is unable to differentiate between players who *always* play on the same team. There is not one instance of this in the whole of the Alleg DB.

QUOTE trueskill in combo with autobalance will never be better than the "eye" of a seasoned vet where balance is concerned, however it is probably the next best thing /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> but ..........[/quote]

See my point regarding human aptitude in parallel estimation.

QUOTE Regarding a points based system : IMHO if we balanced out int whores and miner killers over both teams then 95% of allegiance games would be balanced. In most games the balance is ruined by several whores joining 1 team and having a few good miner killers (who aren't ints whores too) on 1 side also ruins game balance often /smile.gif" style="vertical-align:middle" emoid=":)" border="0" alt="smile.gif" /> If your AB would divide whores and miner killers evenly over both teams then most games would be even (esp. since all "follow the int hos" stackers could now chose between 2 teams /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" /> )[/quote]

"Eh that seems to be your opinion and not scientific fact Baker" <-> "IMHO" Surely some mistake? /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" />
Image
Granary Sergeant Baker - Special Bread Service (Wurf - 13th Oct 2011)
Grim_Reaper_4u
Posts: 356
Joined: Wed Jul 30, 2003 7:00 am
Location: Netherlands

Post by Grim_Reaper_4u »

sgt_baker wrote:QUOTE (sgt_baker @ Jan 17 2008, 08:38 PM) "Eh that seems to be your opinion and not scientific fact Baker" <-> "IMHO" Surely some mistake? /wink.gif" style="vertical-align:middle" emoid=";)" border="0" alt="wink.gif" />
LOL Touche /laugh.gif" style="vertical-align:middle" emoid=":lol:" border="0" alt="laugh.gif" />
Post Reply