Friday, May 23, 2008

Does the Wonderlic test predict QB performance?

The Wonderlic is a kind of intelligence test, used to screen potential employees. Apparently the NFL has been using it as part of scouting the draft.

Does a player's Wonderlic score predict how well he'll perform in the NFL? According to
this study, by Arthur J. Adams and Frank E. Kuzmits, the answer is no. They found no statistically-significant correlations between Wonderlic score and measures of draft position, salary, QB rating, or games played.

However, a subsequent
study by a testing company called "Criteria" *did* find an effect. Criteria looked at the 61 QBs drafted between 2000 and 2004. For performance measures, they looked at total passing yards and TD passes (which you would think would be so highly correlated with each other that they would be measuring almost the same thing, but never mind). They found a mild positive correlation of about .2.

But: when they included only quarterbacks with at least 1,000 yards – effectively eliminating the ones that didn't get any playing time – the correlation jumped to .5. As
Brian Burke points out on his own blog, .5 is a HUGE correlation in a study of this type.

Now, it should be mentioned that Criteria has a vested interest in making aptitude tests look effective. If this is a trial and I'm on the jury, I'm going to assume that they tried a bunch of possible cutoffs and methods and chose the one that makes the test look the most predictive. Brian notes that if you change the cutoff from 1,000 yards to 2,000, and take Tom Brady (high Wonderlic, very high NFL performance) out of the study, the correlation drops to about .26 (still pretty significant).

I'm even more skeptical than Brian. Well, I am and I'm not. First, I would be willing to bet a lot of money that there IS a significant correlation between the Wonderlic and QB effectiveness. There's no doubt that QB requires good intelligence and quick decision-making skills, which is partly what the Wonderlic measures. In fact, I'd bet that
Vince Young's supposed score of 6 out of 50 is a mistake – I don't believe that anyone with Wonderlic skills that low could have been a successful college quarterback, never mind a top-ranked one. (See these sample questions for yourself – supposedly Vince Young would only score 2 out of 15.)

So, yes, of course intelligence (or whatever you want to call what the Wonderlic measures) is important to making a good quarterback. But that's really not the question. The question is, *given what you already know* about the quarterback, in four years of extremely competitive college play, does the Wonderlic give you any *additional* useful information about the player?

On that, I'd bet that it doesn't.

Look at it this way: switch to baseball for a minute, and suppose I ask you to predict what Albert Pujols will do in the remainder of this season. You'd have a pretty good idea, and would make a fairly accurate estimate. Now, suppose I boot on over to St. Louis, give Pujols the Wonderlic test, and tell you his score. Will that affect your estimate? No, of course not. Whatever effect Pujols' Wonderlic skills have on his performance has already shown itself in several seasons of major league play. No matter how much Wonderlic correlates with having a high OPS, if you know the player's skill in achieving OPS, no intelligence test is going to give you a better estimate.

Where the Wonderlic would help you is if you didn't know what real-world skills an applicant has. It would be much more useful to know the Wonderlic scores of presidential candidates than football players, because, for instance, we don't have a good idea of their president skills -- we haven't seen Obama or Hillary play president for four years in college. It would be less useful for George W. Bush, because we have strong, first-hand observations on what he's like as president. Did he achieve his Bushness with a high Wonderlic, a medium Wonderlic, or a low Wonderlic? That might be interesting trivia, but shouldn't affect how we evaluate his potential, because we've actually seen him in action.

And the same is true for drafting quarterbacks. The question we *really* want to answer, in the NFL context, is this: given what you know about the player, and have discovered in the NFL combine and from watching him play college football for four years, does the Wonderlic tell you anything *additional* to that?

That is: you have two identical quarterback candidates, with identical college records playing for identically-skilled college teams against identical opponents. At the combine, they look exactly the same in every respect, except the Wonderlic. One of them has a Wonderlic score of 30, and one has a Wonderlic score of 20 (24 is average for QBs). Should you expect a difference in NFL performance?

It's possible to study that question, but I think you'd have trouble finding enough data, and adjusting for the different environments in which quarterbacks play, to be able to make any significant conclusions.

And intuition suggests that they'd probably be about the same. If A and B had equal performance, despite a being significantly "smarter" than B, it follows that B must have had *other* compensating aptitudes that made up for it. Doesn't it?

As for this study, if you believe the results, all we have is a conclusion that better and faster thinkers make better quarterbacks. Well, duh.

Hat tip:
NFL Stats (Brian Burke)

Labels: , ,

5 Comments:

At Friday, May 23, 2008 6:44:00 PM, Anonymous ChuckO said...

I looked at the sample questions. It seems quite possible to me that a player who is reasonably intelligent but poorly educated could fail to perform well on it.

 
At Wednesday, June 18, 2008 12:55:00 PM, Blogger Joshua said...

I have taken the wonderlic test and there is no correlation between education and scores. the majority of the questions are of elementary or middle school difficulty. how fast you are able to process the answer is where you shine.

 
At Thursday, July 31, 2008 12:34:00 PM, Anonymous Domo said...

The issue here really is that the wonderlic is a test of general intelligence. Although it can give you a decent overall picture of a person's mental capacity, a much more accurate measure would be a test of QB IQ or Football IQ. The general intelligence test score includes a lot of noise because it measures things that may not necessarily help or hurt an NFL QB's performance.

Consider the 40-time and RB performance... The 40 time tells us how fast a RB is, but how often does a RB get to just run along in open space. We know the general speed of a player, but that speed doesn't translate perfectly to the game.

I won't even go into the whole debate on whether general intelligence tests actually test intelligence or just your ability to take that particular test. But realize that the jury is still out on that one.

 
At Thursday, January 01, 2009 5:59:00 AM, Blogger sexy said...

情趣用品,情趣用品,情趣用品,情趣用品,情趣用品,情趣用品,情趣,情趣,情趣,情趣,情趣,情趣,情趣用品,情趣用品,情趣,情趣,A片,A片,A片,A片,A片,A片,情趣用品,A片,情趣用品,A片,情趣用品,a片,情趣用品

A片,A片,AV女優,色情,成人,做愛,情色,AIO,視訊聊天室,SEX,聊天室,自拍,AV,情色,成人,情色,aio,sex,成人,情色

免費A片,美女視訊,情色交友,免費AV,色情網站,辣妹視訊,美女交友,色情影片,成人影片,成人網站,H漫,18成人,成人圖片,成人漫畫,情色網,日本A片,免費A片下載,性愛

色情A片,A片下載,色情遊戲,色情影片,色情聊天室,情色電影,免費視訊,免費視訊聊天,免費視訊聊天室,一葉情貼圖片區,情色視訊,免費成人影片,視訊交友,視訊聊天,言情小說,愛情小說,AV片,A漫,avdvd,情色論壇,視訊美女,AV成人網,情色文學,成人交友,成人電影,成人貼圖,成人小說,成人文章,成人圖片區,成人遊戲,愛情公寓,情色貼圖,成人論壇

免費A片,AV女優,美女視訊,情色交友,色情網站,免費AV,辣妹視訊,美女交友,色情影片,成人網站,H漫,18成人,成人圖片,成人漫畫,成人影片,情色網

視訊聊天室,聊天室,視訊,,情色視訊,視訊交友,視訊交友90739,免費視訊,免費視訊聊天,視訊聊天,UT聊天室,聊天室,美女視訊,視訊交友網,豆豆聊天室,A片,尋夢園聊天室,色情聊天室,聊天室尋夢園,成人聊天室,中部人聊天室,一夜情聊天室,情色聊天室,080中部人聊天室,080聊天室,美女交友,辣妹視訊

 
At Thursday, March 19, 2009 1:57:00 AM, Blogger aa-aa said...

a片,成人網站,美女交友,美女視訊,a片,成人網站,美女交友,美女視訊,a片,成人網站,美女交友,美女視訊,聊天室,美女視訊,聊天室,美女視訊




成人網站,成人影片,av女優,h漫,成人網站,成人電影,a片,色情,成人影片,色情,成人電影,色情,h漫,成人影片,成人電影,免費A片,色情,成人電影,成人影片,免費A片,色情,成人網站,情趣用品,免費A片,成人網站,色情,a片,成人影片,情色,免費A片,微風成人,情色,成人影片,微風成人,av女優



成人網站,色情網站,av女優,色情,成人網站,成人影片,成人電影,av女優,a片,成人網站,成人網站,成人網站,成人影片,av女優



色情,h漫,sex,情色,a片,成人網站,成人影片,av女優,色情
h漫,sex,情色,辣妹視訊,080視訊聊天室,美女交友
情色視訊,哈啦聊天室,ut聊天室,聊天室



打卡鐘,情趣用品,吃到飽麻辣鍋,黃金回收,牙醫,跳蛋,指甲彩繪,植牙,影印機,賺錢,持久液,碎紙機,黃金,情趣用品,創業加盟,打卡鐘,借錢,蒙古火鍋,當舖,情趣,賺錢,鑽石回收,咖啡機,亞太電信,情趣用品,水晶指甲,情趣用品,跳蛋,持久液,情趣用品,碎紙機,美女交友,美女交友,美女交友,視訊辣妹,視訊辣妹,視訊辣妹,視訊聊天室,視訊聊天室,視訊聊天室,成人交友,成人交友,成人交友,視訊美女,視訊美女,視訊美女,聊天室,聊天室,聊天室



成人網站,av女優,成人網站,a片,成人影片,成人電影,h漫,成人電影,色情,成人影片,色情,免費A片,成人影片,免費A片,情色,微風成人




美女交友,美女交友,視訊辣妹,視訊辣妹,視訊聊天室,視訊聊天室,成人交友,成人交友,視訊美女,視訊美女,聊天室,聊天室
美女交友,美女交友,美女交友,視訊辣妹,視訊辣妹,視訊辣妹,視訊聊天室,視訊聊天室,視訊聊天室,成人交友,成人交友,成人交友,視訊美女,視訊美女,視訊美女,聊天室,聊天室,聊天室

 

Post a Comment

Links to this post:

Create a Link

<< Home