Search This Blog

Tuesday, November 17, 2009

Dumbest call of the week: Belichick or economists

A lot of economists seem to make this aggregation of data mistake and of glorifying results of studies without reading about the underlying assumptions. Levitt and also apparently Prof. Mankiw are apparently applauding the Patriots' for their 'gutsy' fourth down move to go for it on their own 30 yard-line at 4th and 2. They cite a study by Prof. Romer which states that, using historical data, contrary to supposed maximizing behavior, teams are often too conservative on fourth down situations (they punt too much).

Problems abound

First, Romer analyzed 1st quarter attempts, NOT 4th quarter attempts with 2 minutes remaining. Behavior and optimal choices are and should be different in toward the end of a finite game, than early on when one failed risk taking measure might hurt you but not doom you. The risk is substantially greater at the end of the game.

From Romer himself:
"I am implicitly assuming that a team that wants to maximize
its chances of winning should be risk-neutral over points scored. Although
this is clearly not a good assumption late in a game, I show in
Section IV that it is an excellent approximation for the early part.
...direct evidence about the impact of points on the probability
of winning suggests that risk neutrality is an excellent approximation
for the early part of the game. Because teams adjust their play late in
the game on the basis of the score, one cannot just look at the distribution
of actual winning margins."

Second, Romer actually used third downs to estimate what 'would have' happened on fourth downs since fourth down attempts are so rarely attempted. The assumption of course is that third down plays and results would be similar to fourth down plays and results, which I don't necessarily agree with.

Finally, the study is analysis which uses simulation estimation, which means it is wholly dependent on the author's underlying assumptions and judgments of behavior - ie. it is inherently subject to bias. It can model behavior of a 'typical' NFL team based on a host of assumptions, but it can not take into account the specific variables in a specific football game (like Colts V. Patiots).

Make no mistake, Bill Belicek made a dumb move.

3 comments:

Anonymous said...

It is rather interesting for me to read this post. Thanx for it. I like such topics and everything that is connected to this matter. I definitely want to read a bit more on that blog soon.

oakleyses said...

hollister, herve leger, canada goose, insanity workout, nfl jerseys, canada goose, soccer jerseys, north face outlet, p90x, ugg, uggs outlet, canada goose, marc jacobs, new balance shoes, ugg pas cher, canada goose outlet, ferragamo shoes, canada goose uk, celine handbags, jimmy choo outlet, abercrombie and fitch, reebok outlet, mac cosmetics, longchamp, wedding dresses, ugg boots, beats by dre, mcm handbags, asics running shoes, ghd, giuseppe zanotti, babyliss pro, soccer shoes, canada goose jackets, ugg boots, ugg australia, lululemon outlet, birkin bag, mont blanc, north face jackets, nike huarache, nike roshe run, bottega veneta, chi flat iron, rolex watches, instyler, vans shoes, valentino shoes

oakleyses said...

montre homme, iphone 6 cases, thomas sabo, swarovski crystal, hollister clothing store, swarovski, lancel, rolex watches, moncler, ray ban, wedding dresses, air max, hollister, ugg, ralph lauren, coach outlet store online, pandora jewelry, converse, baseball bats, oakley, louboutin, juicy couture outlet, moncler, gucci, air max, pandora charms, hollister, moncler outlet, timberland boots, louis vuitton, toms shoes, juicy couture outlet, canada goose, vans, parajumpers, moncler, ugg, pandora charms, canada goose, moncler, moncler, links of london, converse shoes, moncler, supra shoes, karen millen