Analysis SuperCoach Scoring Explained, Observations & Complaints On Scoring

Rowsus

Statistician
Joined
19 Mar 2012
Messages
29,132
Likes
64,898
AFL Club
Melbourne
Someone mentioned "double scaling", and another scaling up for doing nothing. THIS is what gets up my nose, plus some obvious double standards.
2 examples.
The famous Rance game, where he was 98 at half time, had 3 touches in the 2nd half, 2 of them short and sideways, yet still got 170 odd. Yes, he was the most influential player, but that's ridiculous scaling. Rance went up 18 points without touching the ball in a 3 minute period in the 4th. In that same 3 minutes, Dusty took a contested mark, kicked a goal and got a total of 6 points. Yes, scale Rance up, but not THAT much for doing nothing, while robbing others of points.
I saw a classic example of a double standard near the end of 2017. Lobb took a contested mark in the Def arc late in the game. The game was over, Freo were getting flogged. Lobb kicked long to a contest and got a total of 2 points for mark and kick. At the contest, the ball spilled to the ground and was kicked right back to where Lobb marked it. This time another Freo player took a contested mark, and he too kicked long to a contest. He got 8 points. The only difference I could see was, Lobb was already having a shocker, and was on about 40 points. Apart from that EVERYTHING was identical.
Hard to explain.
 
Joined
23 Jan 2014
Messages
663
Likes
186
AFL Club
Geelong
Yeah crossing to AFL Fantacy has crossed my mind :)
But why CD don't just try to remove the anomalies?
Maybe because what @Kumamoto Ken said, that CD's scoring system wasn't designed for Supercoach, so that isn't their priority?
I genuinely don't think CD care much about Supercoach and because the AFL website already had AFL Fantasy the Herald Sun needed something to score their own fantasy game. Instead of reinventing the scoring wheel they just jumped on board with CD.
 

lappinitup

2006 AFL SuperCoach Winner
Joined
16 Apr 2014
Messages
999
Likes
2,067
AFL Club
Carlton
^^^
Forward to Freako please
It is a waste of time trying to get answers or discuss the underlying drivers behind their calculations.

They want to make it out as if it is really complicated, but in reality, it would be extremely simple!

Couldn't see it being more than a few steps in each calculation, with a relatively simple formula completing the calculation and a human adding in the one variable (each stat recorded). Whilst this is slightly subjective, it all would be fairly defensible. The last part of the calculation would be * game weighting.

The bit that always gets me is the weighting - if this is just one persons opinion of the game importance, and is inconsistent between games/or simply incorrect, it massively distorts output.

Freako suggests in his comparison between Crouch and Neale, that Neale's goal to put suns up by 30 points was when the game was on. However, Crouch did nothing whilst the game was on, despite having 22-25 touches whilst game was within within 20 points. Hard to agree those assertions are consistent
 
Joined
15 Mar 2019
Messages
15,036
Likes
57,924
AFL Club
Hawthorn
You would think someone could program things easily enough so that each of the various stats are worth X points based on the current margin/game time left easily enough. Scale all scores accordingly at full time automatically - if the total is 5% off, all player totals get adjusted by 5%. I would have thought their system did something like that already, guess not.
 
Joined
8 Oct 2018
Messages
10,255
Likes
36,912
AFL Club
Port Adelaide
Perhaps this is intended to increase the perceived value of the system to the clubs they're trying to sell it to.
I've tried to stay out of this debate but think the scores should be almost irrelevant to clubs for analytical purposes as they don't pass the eyeball test ... not for me anyway but I've just learned to live with the fact CD have their pets and pet hates.

Sure some of the stats are useful (contested possessions, clangers etc) but the SC ones IMO I'd call almost rubbish ... I mean we can all watch a game and probably identify the most influential player for a game .... be nice if the SC stats actually reflected that though ...
 

lappinitup

2006 AFL SuperCoach Winner
Joined
16 Apr 2014
Messages
999
Likes
2,067
AFL Club
Carlton
Sure some of the stats are useful (contested possessions, clangers etc) but the SC ones IMO I'd call almost rubbish ... I mean we can all watch a game and probably identify the most influential player for a game .... be nice if the SC stats actually reflected that though ...
Funny thing is, I do believe they are the best reflection of the most influential player in the game. I also believe, majority of the true supercoach fans are in the same boat.

That is why responses like the one given earlier this week are simply disrespectful. They are giving a false answer that will appease the masses, yet be seen through by those who have the deeper understanding of the game.

Actually wouldn't be hard to give a true answer either i suspect, however it may expose some flaws.
 
Joined
4 Apr 2013
Messages
853
Likes
3,298
AFL Club
Hawthorn
My thoughts on SC scoring, warning essay incoming.

From playing SC over the years, I think that scaling has become a bit of a bogeyman, with people overrating the influence of scaling and that the actual effect of reduced scores for kicks, etc during blowouts is not as big as people think it is. Instead the main issues causing confusion over SC scoring are:

1. The way live SC scores are updated and normalised
and
2. Champion Data do not explicitly tell us what stats they record, let alone what points are scored from those stats

Number 2 has the biggest influence, but I’ll start with 1.

SC Live Scores
Since the combined SC of every game has to add up to 3300 but CD don’t know how many kicks, goals, etc are going to be in each game, they have to make assumptions when creating the live scores. The main assumption being that the rate of the scoring for the rest of the game is going to stay the same.

So let’s take an extreme example. Imagine that at half time a game is tied at 0 with both teams playing horribly and running at 10% disposal efficiency. The total SC scores will be about 1650 as CD will assume that the 2nd half will be played in the same manner. And let’s say that Player A is on 50 points at half time, but falls off the massage table and doesn’t play in the second half. If both teams come out and play brilliantly in the 2nd half, kicking 25 goals straight, CD’s assumption of the scoring rate will have been wrong, and they would have overestimated the worth of the points scored in the 1st half. Therefore Player A’s score will go down, probably rather drastically in this example.

Most people don’t take this normalisation into account, and think of it more like DT, where 50 points = 50 points. This is most apparent in the first few minutes of the game where scores can fluctuate wildly due to the small sample size of actions.

The other issue with SC live scores are that they are not updated in real time, but instead updated in batches every 30 seconds or so. This can make it difficult to determine which points were scored for which action. “OMG!! HE ONLY GOT 1 POINT FOR THAT MARK AND KICK!!!!!” Maybe the mark was at the 28th second of the last batch and the kick will be included in the next batch. Or maybe he had a clanger 20 seconds earlier which was included as well.

Champion Data Scoring
But the main issue is that CD does not tell us what stats they collect nor how they score them. We know that they record 50+ different stats and they have mentioned some of them in the past. But since their goal is to try to determine the actual influence of a player within a game (rather than raw possession counts, marks, etc.) we can start to make some assumptions.

Due to the increase of player skills over the past decades, in the modern AFL the #1 goal is possession. Gaining possession, keeping possession, preventing the opposition from easily maintaining possession, pressuring your opponent into losing possession. Some teams focus more on some aspects than others, but these are the cornerstones of the current AFL. Therefore we can break down the game into 3 states.

Game state.png

Performing actions that move up states score you extra points, while actions that move down generally either score minimal or negative points. Therefore how a player scores points is due to the following three things:
1. How they use the ball (possessions, kick/handball ratios, disposal efficiency %)
2. How they get the ball (contested vs. uncontested possessions/marks)
3. Defense (tackles, spoils, smothers, causing turnovers)

Most people focus mainly on #1, comparing players by posting raw possession counts, DE%, etc. But the other two, especially #2 above are not given enough consideration. If you are watching live and are interested in SC scoring, I’ve found that the best question to ask yourself is this:

“Who won the ball?”

I’m not talking about which player got the clearance (meaningless), I’m talking about which player was responsible for their team winning the ball when it was in dispute. This could be a Hitout-to-advantage from a ruckmen, a ground ball get from a midfielder or even a tap along the ground to an open teammate. That last one is actually rather important, because it is something that doesn’t show up on any of the stat sheets we have access to, but CD definitely record it and include it in SC scores. Which leads us to...

Not All Stats are Created Equal (plus Hidden Stats)
You often hear complaints that CD somehow have favourites, that some players have the golden SC ticket, that players are gaining points for “doing nothing”. And yes I’m aware that there is some human judgement involved in determining whether a kick was ineffective or a clanger, but for the most part there are reasons why some players are scoring more than other players. It’s because the actions they do are more valuable actions than other players, and because they do things that don’t show up on the traditional stat sheets. This includes most of the defensive actions which outside of tackles, aren’t really widely recorded.

Let’s take a somewhat hidden stat: Spoils. These don’t show up on the live stats but are included after the game. I think it was early in the Collingwood/Essendon game when Darcy Moore was on 0DT:10SC a few minutes into the game with a completely empty stat line next to him. But he had spoiled 3 marking contests to that point, earning him 10SC. 3+ points per spoil seems a bit excessive don’t you think? Well let me ask you a question: How many of you know that CD actually record 3 different spoil stats? They seem to be:

Spoil-to-advantage (teammate picks up the loose ball): ~3 points
Spoil-neutral (loose ball is in dispute or out of bounds): ~2 points
Spoil-to-disadvantage (opponent picks up the loose ball): ~1 point

So not all spoils are created equal, you not only need to look at what a player did, you also have to look at the consequences of those actions as well.

This is the core problem we have. The stats we have access to (especially in-game) are only a summary of what CD are recording. Let’s look at a popular one:

Effective kicks
According to the stats we have, kicks are either effective, ineffective or a clanger. But CD have an entire range of stats recording effective kicks. I’m not sure exactly what they are, but the following would be a rough guess of the types of effective kicks they record, which are all scored differently:
- Long kick to an open player
- Long forward kick to a 50:50 contest
- Medium kick to an open player
- Short kick to an open player

And this isn’t even taking into account the directionality of the kicks, nor where they are happening on the ground. A short kick from the back pocket to an open player in the goalsquare probably scores you maybe 1 point. A long kick from the centre square to an open player 30m out from goal probably earns you 6+ points (not including goal assists or anything else). So trying to compare one effective kick with another effective kick without actually watching the game is impossible.

Even effective kicks that gain the same metres are scored differently. A 50m kick down the line to an open player is scored more than 50m kick down the line to a contest. They both show up as an effective kick that gained 50m but one is scored higher than the other. This is a big reason why Jake Lloyd scores so well. He has a high disposal efficiency plus the majority of his kicks are long kicks to open players, not to contests.

Contested Possessions
CPs are another stat that summarise a whole collection of different actions. According to the AFL, CPs are looseball-gets, hardball-gets, contested marks, gathers from a hit-out and frees for. And those are just the AFL stats, I’m sure CD have a whole bunch of different types of these actions as well. All of these are scored at different rates so trying to compare 2 different players based on CP counts is always going to be difficult, unless you are actually watching the game and making note of what type of CPs they are, where they are occurring on the field, etc.

Let's compare 2 examples:
- Grundy wins a hitout-to-advantage to Pendlebury who then handballs
- Gawn wins a hitout but the ball falls into dispute where it is picked up by Oliver who then handballs

In both cases Pendlebury and Oliver gain a CP, but Oliver earns more for his because he "won" the ball, while Grundy "won" the ball in the first example.

Lachie Neale
Let’s summarise by considering Lachie Neale’s 3rd quarter last week. Earlier in the thread there was talk of scaling playing a part in his big 3rd quarter score. This for the most part is BS. The main reason he was scored highly because he was doing things like this:

neale.gif

I was watching this game live, and am a Neale owner, and when this happened I said to myself “KA-CHING!”. Why? Because that one play is emblematic of how CD score the game. That one play earned Neale at least 12 points, probably even more than that. The ball was in dispute, he won the ball in a hard contest, bounced, and then kicked a 40m kick to a wide open player in an attacking position who was able to kick an uncontested goal. Yet people not watching the actual game will see that as a CP and an effective kick, maybe a goal assist if that stat is available, without realising how valuable that play actually was.

So keep asking yourself
"Who won the ball?"
 
Last edited by a moderator:

THCLT

BBL|05 Winner
Joined
13 Sep 2014
Messages
18,594
Likes
118,245
AFL Club
North Melb.
Joined
18 Sep 2012
Messages
171
Likes
304
AFL Club
Richmond
My thoughts on SC scoring, warning essay incoming.

From playing SC over the years, I think that scaling has become a bit of a bogeyman, with people overrating the influence of scaling and that the actual effect of reduced scores for kicks, etc during blowouts is not as big as people think it is. Instead the main issues causing confusion over SC scoring are:

1. The way live SC scores are updated and normalised
and
2. Champion Data do not explicitly tell us what stats they record, let alone what points are scored from those stats

Number 2 has the biggest influence, but I’ll start with 1.

SC Live Scores
Since the combined SC of every game has to add up to 3300 but CD don’t know how many kicks, goals, etc are going to be in each game, they have to make assumptions when creating the live scores. The main assumption being that the rate of the scoring for the rest of the game is going to stay the same.

So let’s take an extreme example. Imagine that at half time a game is tied at 0 with both teams playing horribly and running at 10% disposal efficiency. The total SC scores will be about 1650 as CD will assume that the 2nd half will be played in the same manner. And let’s say that Player A is on 50 points at half time, but falls off the massage table and doesn’t play in the second half. If both teams come out and play brilliantly in the 2nd half, kicking 25 goals straight, CD’s assumption of the scoring rate will have been wrong, and they would have overestimated the worth of the points scored in the 1st half. Therefore Player A’s score will go down, probably rather drastically in this example.

Most people don’t take this normalisation into account, and think of it more like DT, where 50 points = 50 points. This is most apparent in the first few minutes of the game where scores can fluctuate wildly due to the small sample size of actions.

The other issue with SC live scores are that they are not updated in real time, but instead updated in batches every 30 seconds or so. This can make it difficult to determine which points were scored for which action. “OMG!! HE ONLY GOT 1 POINT FOR THAT MARK AND KICK!!!!!” Maybe the mark was at the 28th second of the last batch and the kick will be included in the next batch. Or maybe he had a clanger 20 seconds earlier which was included as well.

Champion Data Scoring
But the main issue is that CD does not tell us what stats they collect nor how they score them. We know that they record 50+ different stats and they have mentioned some of them in the past. But since their goal is to try to determine the actual influence of a player within a game (rather than raw possession counts, marks, etc.) we can start to make some assumptions.

Due to the increase of player skills over the past decades, in the modern AFL the #1 goal is possession. Gaining possession, keeping possession, preventing the opposition from easily maintaining possession, pressuring your opponent into losing possession. Some teams focus more on some aspects than others, but these are the cornerstones of the current AFL. Therefore we can break down the game into 3 states.

View attachment 8588

Performing actions that move up states score you extra points, while actions that move down generally either score minimal or negative points. Therefore how a player scores points is due to the following three things:
1. How they use the ball (possessions, kick/handball ratios, disposal efficiency %)
2. How they get the ball (contested vs. uncontested possessions/marks)
3. Defense (tackles, spoils, smothers, causing turnovers)

Most people focus mainly on #1, comparing players by posting raw possession counts, DE%, etc. But the other two, especially #2 above are not given enough consideration. If you are watching live and are interested in SC scoring, I’ve found that the best question to ask yourself is this:

“Who won the ball?”

I’m not talking about which player got the clearance (meaningless), I’m talking about which player was responsible for their team winning the ball when it was in dispute. This could be a Hitout-to-advantage from a ruckmen, a ground ball get from a midfielder or even a tap along the ground to an open teammate. That last one is actually rather important, because it is something that doesn’t show up on any of the stat sheets we have access to, but CD definitely record it and include it in SC scores. Which leads us to...

Not All Stats are Created Equal (plus Hidden Stats)
You often hear complaints that CD somehow have favourites, that some players have the golden SC ticket, that players are gaining points for “doing nothing”. And yes I’m aware that there is some human judgement involved in determining whether a kick was ineffective or a clanger, but for the most part there are reasons why some players are scoring more than other players. It’s because the actions they do are more valuable actions than other players, and because they do things that don’t show up on the traditional stat sheets. This includes most of the defensive actions which outside of tackles, aren’t really widely recorded.

Let’s take a somewhat hidden stat: Spoils. These don’t show up on the live stats but are included after the game. I think it was early in the Collingwood/Essendon game when Darcy Moore was on 0DT:10SC a few minutes into the game with a completely empty stat line next to him. But he had spoiled 3 marking contests to that point, earning him 10SC. 3+ points per spoil seems a bit excessive don’t you think? Well let me ask you a question: How many of you know that CD actually record 3 different spoil stats? They seem to be:

Spoil-to-advantage (teammate picks up the loose ball): ~3 points
Spoil-neutral (loose ball is in dispute or out of bounds): ~2 points
Spoil-to-disadvantage (opponent picks up the loose ball): ~1 point

So not all spoils are created equal, you not only need to look at what a player did, you also have to look at the consequences of those actions as well.

This is the core problem we have. The stats we have access to (especially in-game) are only a summary of what CD are recording. Let’s look at a popular one:

Effective kicks
According to the stats we have, kicks are either effective, ineffective or a clanger. But CD have an entire range of stats recording effective kicks. I’m not sure exactly what they are, but the following would be a rough guess of the types of effective kicks they record, which are all scored differently:
- Long kick to an open player
- Long forward kick to a 50:50 contest
- Medium kick to an open player
- Short kick to an open player

And this isn’t even taking into account the directionality of the kicks, nor where they are happening on the ground. A short kick from the back pocket to an open player in the goalsquare probably scores you maybe 1 point. A long kick from the centre square to an open player 30m out from goal probably earns you 6+ points (not including goal assists or anything else). So trying to compare one effective kick with another effective kick without actually watching the game is impossible.

Even effective kicks that gain the same metres are scored differently. A 50m kick down the line to an open player is scored more than 50m kick down the line to a contest. They both show up as an effective kick that gained 50m but one is scored higher than the other. This is a big reason why Jake Lloyd scores so well. He has a high disposal efficiency plus the majority of his kicks are long kicks to open players, not to contests.

Contested Possessions
CPs are another stat that summarise a whole collection of different actions. According to the AFL, CPs are looseball-gets, hardball-gets, contested marks, gathers from a hit-out and frees for. And those are just the AFL stats, I’m sure CD have a whole bunch of different types of these actions as well. All of these are scored at different rates so trying to compare 2 different players based on CP counts is always going to be difficult, unless you are actually watching the game and making note of what type of CPs they are, where they are occurring on the field, etc.

Let's compare 2 examples:
- Grundy wins a hitout-to-advantage to Pendlebury who then handballs
- Gawn wins a hitout but the ball falls into dispute where it is picked up by Oliver who then handballs

In both cases Pendlebury and Oliver gain a CP, but Oliver earns more for his because he "won" the ball, while Grundy "won" the ball in the first example.

Lachie Neale
Let’s summarise by considering Lachie Neale’s 3rd quarter last week. Earlier in the thread there was talk of scaling playing a part in his big 3rd quarter score. This for the most part is BS. The main reason he was scored highly because he was doing things like this:

View attachment 8589

I was watching this game live, and am a Neale owner, and when this happened I said to myself “KA-CHING!”. Why? Because that one play is emblematic of how CD score the game. That one play earned Neale at least 12 points, probably even more than that. The ball was in dispute, he won the ball in a hard contest, bounced, and then kicked a 40m kick to a wide open player in an attacking position who was able to kick an uncontested goal. Yet people not watching the actual game will see that as a CP and an effective kick, maybe a goal assist if that stat is available, without realising how valuable that play actually was.

So keep asking yourself
"Who won the ball?"

Awesome post
 
Joined
9 Mar 2014
Messages
4,259
Likes
7,602
AFL Club
Port Adelaide
Sorry i removed as couldn't post over the character limit

Excellent post, absolutely spot on. Exactly why key defenders like Andrews and Rance etc have scored well because of those hidden stats that aren't avaliable and don't generate fantasy points.

The AFL Footy Live app is generally the best one to get a few extra stats when clicking into a player that are directly picked up from CD themselves. These include goal assists, score involvements, tackles inside 50, clangers, disposal efficiency and contested/uncontested possessions that a lot of other apps/websites don't have stats on.

Would love them to start including hard ball gets, loose ball gets, possession won/possession received stats etc.

I don't think we are too far away though.

Watching the game will always give the best indicator of how a player is probably going sc wise as you can see who is having influence that may not be having a heap of stats. Prime example, Dougal Howard in recent games who has been awesome and like Andrews leads the league in recent years in one percenters which are also huge for SC scoring (spoils, bumps, tap on's)
 
Top