1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Harvard like us.

Discussion in 'Miami Dolphins Forum' started by WELDERPAT, Jul 22, 2015.

  1. dolfan7171

    dolfan7171 Well-Known Member

    18,065
    3,629
    113
    Jun 12, 2009
    Arizona
    Fin4Ever and WELDERPAT like this.
  2. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    Leaving aside the merit (or lack thereof) of using approximate value (AV) to estimate a player's value (ideally, to win %), the reason the Dolphins came in 3rd is probably due to this quote:


    "I aggregated each team's per game approximate value of what I considered to be the "core" makeup of an NFL team: QB, RB, 2 WR, TE, Top 2 OL, the Top-4 "Front Seven" defensive players, and the Top-2 players from the secondary."

    ..

    Notice the "Top 2 OL" in there? Yeah, when you only look at the top two on our OL, our OL looks GREAT!! Wish we could play with an OL whose strength was best estimated by our top two players on the OL.

    Anyway, you get the idea.. they are only ranking teams based on how balanced the distribution of "top players" are on the team. That being said, I do hope their predictions are accurate.
     
  3. Galant

    Galant Love - Unity - Sacrifice - Eternity

    19,127
    11,058
    113
    Apr 22, 2014
    Coaching totally excluded.
     
  4. Unlucky 13

    Unlucky 13 Team Raheem Club Member

    51,931
    63,009
    113
    Apr 24, 2012
    Troy, Virginia
    Check out how high their formulas have the Jets as well. The problem, along with what cbrad pointed out, is that it doesn't take into account what a big deal having a horrible QB can be. Unlike baseball, where you could argue that all eight position starters are of fairly equal importance, that's obviously not the case in the NFL. I terrible QB makes an average team a bad one, and a great QB gets an average team into the playoffs.

    The system also doesn't take into account that, even if a player is very good, older players are more likely to spend time injured than younger ones. A team loaded with vets, especially ones who have suffered serious injuries in the past, is likely to lose important players as they go along.

    The whole thing is an interesting idea, but it doesn't see things that people would.
     
    Fin4Ever, Bpk, cbrad and 1 other person like this.
  5. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    This is partly true, partly not. It tends to weight QB's more because the weights were chosen to "look right". So, if you look at AV for all the Patriots players on that nearly perfect 2007 team that went undefeated except for the (THANK YOU GIANTS!!) Super Bowl, you'll see this:

    Brady = 26
    Moss = 21
    Light = 21
    Welker = 17
    Vrabel = 15
    Wilfork = 13
    Mankins = 13
    etc..

    So you do get the extra weight on the QB because they want the stats to come out "right". However.. the weights are entirely subjective (I mean they really are). And you'd have a hard time arguing that the resulting AV's actually represent the relative importance of the QB to the final outcome. I mean, was Brady 26/21 times more important than Moss to the Patriots 2007 season? Very likely no. So in that sense you're right: AV probably doesn't capture the relative importance of the QB in the modern NFL.
     
    Fin4Ever, WELDERPAT and Unlucky 13 like this.
  6. Section126

    Section126 We are better than you. Luxury Box

    47,525
    72,483
    113
    Dec 20, 2007
    Miami, Florida
  7. Harmalama

    Harmalama Season Ticket Holder Club Member

    478
    149
    43
    Mar 23, 2008
    England
    Well if that first list is anything to go by, then the AFC East will be the best division in football and it's not even close.

    All four teams are in the top 10
     
    Da 'Fins and WELDERPAT like this.
  8. rafael

    rafael Well-Known Member

    27,364
    31,261
    113
    Apr 6, 2008
    I do think three of the four teams should be among the top 10 defenses and the one that isn't is the defending champ.

    The formula was reportedly predictive from the previous year so that gives it some credibility.
     
    Piston Honda and WELDERPAT like this.
  9. PhinFan1968

    PhinFan1968 To 2020, and BEYOND! Club Member

    As has been the case for decades...it's been close at times though.
     
    WELDERPAT likes this.
  10. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    I'm guessing you're referring to this statement from the study:

    "To make sure this was a sound method, I tested it out on last year's data and ran a regression to see if AV was predictive of the end-of-regular season ELO ratings as reported by FiveThirtyEight. Aggregated AV was indeed significant with a T-stat of 8.57. It was also a strong predictor of ELO, as the regression returned a .72 R-Squared value."

    ..

    That quote makes it sound like he used 2013 AV ratings to predict 2014 end-of-year ELO rankings (there's nothing wrong with ELO rankings btw.. it's probably the best ranking method out there), BUT I am pretty sure he did not do that. I'm almost 100% positive he used 2014 AV rankings to predict 2014 end-of-year ELO rankings.

    Why?

    Because if you can predict end-of-the-year ELO rankings with 72% probability you can make a killing in sports betting. ELO rankings tells you the probability of any team beating any other team (thus, it's not just rank order.. ELO rankings includes information to calculate probability of winning). If you can get that right 72% of the time (or be correlated that high), that's more than the % correct you need in sports betting to consistently win (often, just getting 55% correct may be enough.. certainly 60%+ is a no brainer).

    So no, I don't think that quote means the formula was predictive of the previous year (the quote can be interpreted both ways).
     
  11. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    Predicting NFL win totals at 72% does not mean you can make money gambling. You are ignoring the fact that Vegas predicts at around the same rate. Question is whether you can predict at a significantly higher rate than sportsbooks.

    Also consider that when it comes to futures bets, there is a huge opportunity cost - your money is being held by the books for 6 months, which means you aren't able to generate profit from it. Additionally, most sportsbooks have pretty low limits on futures bets.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
  12. djphinfan

    djphinfan Season Ticket Holder Club Member

    111,652
    67,546
    113
    Dec 20, 2007
    Pretty fu##in cool nerds if you ask me.. I like it, we have a lot of talent
     
    Fin4Ever likes this.
  13. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    You're not predicting win totals. You're predicting probability of A beating B for any two A and B that are ranked. ELO is capable of that. If this were just predicting win totals that's another story. Saying you're predicting ELO rankings implies you are predicting probability of winning for any two teams that play each other.

    And when you have that information, there is no opportunity cost. You bet the day of the match based on the moneylines/odds and get your winnings immediately after the game.
     
  14. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    Even then my point still stands. Sportsbooks are predicting the winner of the game ~70% of the time.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
  15. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    No you're not getting it. The probability of winning directly translates into a moneyline (let's just assume the bookie keeps nothing for the moment). If you can accurately predict the actual probability of winning, then you can compare this to the moneyline and bet accordingly (or not bet at all). If the moneyline is too small you bet the other way, etc..

    Adding in the effect of the bookie having to make money is where you get that 55% I was talking about. That's not 55% you predict the winner correctly. That's 55% of the time you correctly predict the probability of winning. Whether you actually bet or not depends of course on the moneyline itself. So sportsbooks could predict the winner of the game correctly 90% of the time and it wouldn't matter.. it's the moneylines = probability of winning that matters.
     
  16. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    A system based off elo ratings will not win money in the long term, despite it's ability to predict the winner 70% of the time, or picking the right probability 99% of the time. If it predicted better than the sportbooks, the sportsbooks would simply use that to set their moneylines.

    By definition, a system such as the ELO system will not beat a market-based moneyline. Sportsbooks will always beat systems such as ELO.

    Predicting the probability 55% of the time doesn't matter if the sportsbooks predicts it right 55% of the time as well.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
  17. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    Two things:

    1) Again, it's not about predicting the winner 70% of the time.. it's about predicting the probability of winning 70% of the time.

    2) My whole argument was exactly what you were trying to say in this last post: what they claim cannot be true because IF it was true and IF it was novel, you'd make a killing in betting. IF it's true, and if it's NOT novel, then bookies would use it as you point out. Of course, they're claiming they have a novel method.
     
  18. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    No, it can be true. Thats my point. They said they can predict the winner of the game 70% of the time.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
  19. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    No, read the quote again. They said the regression (straight line fit) with ELO is 0.72. That means that on average they're essentially predicting the probability of winning 70% of the time. There's no implication about predicting who wins the game per se (because it's irrelevant).
     
  20. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    You can't predict a probability.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
    WELDERPAT likes this.
  21. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    That's exactly what a lot of statistics does. In most cases you can just interpret it as predicting the frequency of occurrence, which can obviously be tested.

    btw.. physics has the best example: predicting the probability of a subatomic particle being in a certain location. Quantum mechanics predicts the probability distribution there.
     
    WELDERPAT likes this.
  22. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    Also - probabilities can never be wrong, unless you're predicting a 100% probability.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
    WELDERPAT likes this.
  23. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    Two things:

    1) They can be statistically speaking (so probabilistically) wrong, and that's what in practice is used in science/engineering etc..

    2) Even predicting 100% or 0% you can never prove wrong after a finite number of trials. The probability of choosing any positive integer from the set of all possible positive integers is 0%. How do you know that the true answer is or isn't 0% after an infinite number of trials? No matter how many finite trials you have, you can't in principle prove or disprove it.
     
    WELDERPAT likes this.
  24. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    And what is the occurrence happening in an NFL game. It's either win or lose. You can only measure accuracy by wins and losses.

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
    WELDERPAT likes this.
  25. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    In the case of betting, the accuracy is measured by profit over time, not whether a team won or lost in a single game.
     
    WELDERPAT likes this.
  26. Stringer Bell

    Stringer Bell Post Hard, Post Often Club Member

    44,356
    22,480
    113
    Mar 22, 2008
    We aren't talking about betting, we are talking about the predictive ability of ELO. How do we measure the accuracy?

    Sent from my SAMSUNG-SM-G920A using Tapatalk
     
    WELDERPAT likes this.
  27. djphinfan

    djphinfan Season Ticket Holder Club Member

    111,652
    67,546
    113
    Dec 20, 2007
    this thread is just for folks who have ivy league educations obviously..
     
  28. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    Well, my argument WAS about betting.

    But I'll answer your question anyway. If you have a ton of games between different pairs of opponents whose ELO rankings for the sake of argument do not change over time (in ELO they do but that is an added variable one can add if one wants), then you have the predicted probability of winning for every match.

    What you now do is calculate the probability of the actual (observed) wins/losses by all teams assuming they came from the predicted probability distributions. If you don't mind using a computer, you can do that by using something called Monte Carlo simulations (so let the computer assume your predicted probability distributions are the actual ones, and randomly sample from them). For each simulation, you will get a result of wins/losses by all the teams in all the matches.

    Do the simulation over and over again until you get a distribution of wins/losses for all the teams. You can now do traditional hypothesis testing on that distribution to determine how likely it was that the observed win/loss records came from your predicted distribution. That's how you would test your prediction.
     
    WELDERPAT likes this.
  29. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    It is a Harvard study lol..

    Hey as long as Stringer Bell is asking questions, I gotta answer, and in some cases I can't answer without some technical detail. You can just skip over those posts though :wink2:
     
    WELDERPAT likes this.
  30. djphinfan

    djphinfan Season Ticket Holder Club Member

    111,652
    67,546
    113
    Dec 20, 2007
    I think its all a fascinating discussion, but i'll beat your conclusions based on numbers in the long run using my techniques theories and knowledge.
     
    WELDERPAT likes this.
  31. Galant

    Galant Love - Unity - Sacrifice - Eternity

    19,127
    11,058
    113
    Apr 22, 2014
    "In baseball, my theory is to strive for consistency, not to worry about the numbers. If you dwell on statistics you get shortsighted, if you aim for consistency, the numbers will be there at the end." Tom Seaver

    Here's to more Dolphins' consistency in playing well and winning!

    (And less consistency in mediocrity)
     
  32. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    My conclusion was only that the study's claim of validating their method (using AV to predict ELO rankings) on last year's data doesn't mean what it at first sight seems. The wording was ambiguous and you could interpret it as saying they used 2013 data to predict 2014 data (which would be impressive) OR that they used 2014 data to predict 2014 data (which isn't that impressive). I'm pretty sure it means they used 2014 to predict 2014 because if it was using 2013 to predict 2014, they'd be able to beat the bookies by a large margin.
     
    WELDERPAT likes this.
  33. Alex13

    Alex13 Tua Time !!! Club Member

    25,809
    39,060
    113
    Dec 21, 2007
    Berlin,Germany
    anyone have a link of the guys from harvard doing that list last year ?
     
    WELDERPAT and cbrad like this.
  34. byroan

    byroan Giggity Staff Member Administrator Luxury Box

    27,269
    44,477
    113
    Nov 25, 2007
    NC
    Can't seem to find it. But I know they had Seattle losing to NE in the Super Bowl. :shifty:
     
    WELDERPAT and Alex13 like this.
  35. Tin Indian

    Tin Indian Rockin' The Bottom End Club Member

    7,929
    4,404
    113
    Feb 10, 2010
    Palm Bay Florida
    Well, I guess we'll see how smart these actually are.
     
    WELDERPAT likes this.
  36. DevilFin13

    DevilFin13 Season Ticket Holder Club Member

    9,713
    6,282
    113
    Mar 22, 2008
    This is a best case scenario. Tannehill improves, Suh is his usual dominant self, the WRs mostly replicate what they did on other teams, the guards are serviceable and don't get Tannehill killed, and no starter misses much time. That's possible (some teams don't have many significant injuries). But it seems more unlikely than not. I think those 8.5 lines are more realistic, with injury luck (though there's probably some skill there) bumping us over or under that line.
     
    WELDERPAT likes this.
  37. cbrad

    cbrad .

    10,659
    12,657
    113
    Dec 21, 2014
    Yeah, this is the right question to ask. Just gotta remember that the rank order is not what's important. It's the numbers (the ELO ratings) themselves, which gives you a prediction for each game. In the NFL, ELO may predict the final ranking of teams in terms of record to be different than the actual rank order because you have different divisions with varying levels of ELO-rated competition.

    I'd say if they can beat the average of the two moneylines per game (basically tells you what the bookies/bettors think will occur if you remove bookie profits), then they've got something. If not, then just go with the moneylines as your best prediction (or if you want predictions of end-of-season record, go with futures).
     
    WELDERPAT likes this.
  38. Rocky Raccoon

    Rocky Raccoon Greasepaint Ghost Staff Member

    30,224
    36,965
    113
    Dec 2, 2007
    Jersey
    Nothing will kill me more slowly than the two weeks leading up to the Super Bowl if we get there. There is nothing worse.
     
    WELDERPAT, RoninFin4 and ckparrothead like this.
  39. Unlucky 13

    Unlucky 13 Team Raheem Club Member

    51,931
    63,009
    113
    Apr 24, 2012
    Troy, Virginia
    I actually think that I'd be on cloud 9 the whole time. Like a dream.
     
    WELDERPAT and 77FinFan like this.

Share This Page