
It’s 5 o’clock somewhere…
The 5 o’clock club is published from time to time during the season, and aims to provide a forum for reader-driven discussion at a time of day when there isn’t much NFL news being published. Feel free to introduce topics that interest you in the comments below.
CLICK HERE to see the full 5 o’clock club archive
Kent Lee Platte is the guy who developed the Relative Athletic Score (RAS), and he regularly looks for and discusses the strengths and limitations of RAS in both blogs and social media platforms like Twitter/X.
In case you’re not familiar with RAS, let me share this pretty cogent explanation from Pro Football Network that was published just a few months ago:
[T]his evaluation formula — created by Kent Lee Platte — collects a multitude of a player’s testing metrics and physical attributes to generate a score to measure a prospect’s athleticism entering the NFL. The final number is determined by what percentile a player falls relative to their peers at a particular position.
The highest score a prospect can achieve in this tool is a 10. Prospects are graded on a scale of 1-10 for each contributing factor, which is a great reference point to help determine exactly how a player’s athleticism stacks up against incoming prospects at the same position to help aid the evaluation process.
What Measurements Contribute to RAS?
The algorithm that helps determine a prospect’s RAS can be broken into two different categories: physical measurements — which consist of a player’s height, weight, hand size, and arm length — and testing numbers — which can come from NFL Combine events/drills like the 40-yard dash, 20-yard shuttle, vertical jump, broad jump, three-cone, and bench press.
To help paint a picture of how individual testing numbers are translated into the model — if a WR has a vertical jump that lands in the 95th percentile for that position, the player would earn a score of 9.5 for that specific testing metric.
This data model certainly helps contextualize a player’s athletic profile relative to their peers in an easily digestible number.
Some perfect scores have been achieved according to this data model over the years that are worth revisiting.
Cam Newton’s elite combination of size and athleticism set a new gold standard for athleticism entering the league in 2011. His unique prospect profile translated to immense success at the next level, winning a league MVP award in 2015.
Another signal-caller who turned heads with a spectacular performance at the NFL Combine was Anthony Richardson. His 4.43 time in the 40-yard dash at 6’4″, 244 pounds, helped send his draft stock through the roof. That ultimately saw the Indianapolis Colts use the fourth pick in the 2023 NFL Draft in hopes of finding their next franchise QB.
One position that has produced some athletic specimens over the years has been wide receiver. Perhaps no player had a more impressive athletic profile entering the league than Calvin Johnson, whose time of 4.4 in the 40-yard dash proved abnormally exceptional when considering his 6’5” 239-pound frame.
This is what a RAS card looks like:
Brandon Coleman was drafted in round 3 pick 67 in the 2024 draft class. He scored a 9.96 #RAS out of a possible 10.00. This ranked 7 out of 1583 OG from 1987 to 2024. https://t.co/cltQWcTuGI pic.twitter.com/F8RGD9DJtS
— Kent Lee Platte (@MathBomb) April 27, 2024
This week, Kent Lee Platte took to Twitter/X to elucidate some of the research he’s been doing of late. In this particular case, he was looking for correlation between RAS scores and the Approximate Value (AV) metric developed by Pro Football Reference. Again, if you’re unfamiliar with AV, here’s an explanation, this time, from PFR, the guys who developed it.
Created by PFR founder Doug Drinen, the Approximate Value (AV) method is an attempt to put a single number on the seasonal value of a player at any position from any year (since 1960). The way Drinen described the intent of this measurement was:
“AV is not meant to be a be-all end-all metric. Football stat lines just do not come close to capturing all the contributions of a player the way they do in baseball and basketball. If one player is a 16 and another is a 14, we can’t be very confident that the 16AV player actually had a better season than the 14AV player. But I am pretty confident that the collection of all players with 16AV played better, as an entire group, than the collection of all players with 14AV.”
“Essentially, AV is a substitute for — and a significant improvement upon, in my opinion — metrics like ‘number of seasons as a starter’ or ‘number of times making the pro bowl’ or the like. You should think of it as being essentially like those two metrics, but with interpolation in between. That is, ‘number of seasons as a starter’ is a reasonable starting point if you’re trying to measure, say, how good a particular draft class is, or what kind of player you can expect to get with the #13 pick in the draft. But obviously some starters are better than others. Starters on good teams are, as a group, better than starters on bad teams. Starting WRs who had lots of receiving yards are, as a group, better than starting WRs who did not have many receiving yards. Starters who made the pro bowl are, as a group, better than starters who didn’t, and so on. And non-starters aren’t worthless, so they get some points too.”
Now, let’s look at what Kent Lee Platte claims to have uncovered about the relationship between RAS and AV.
Looking at #RAS and AV, which is a metric used by @pfref to show player value, and found some interesting nuggets. You can learn more about AV here:https://t.co/85NQEUBYTx pic.twitter.com/exeQ9Bh0tU
— Kent Lee Platte (@MathBomb) June 6, 2024
Of all of the players with a top 58 AV (Top 50, with ties), only two had a #RAS under 5.00.
Both were quarterbacks, Brock Purdy and Baker Mayfield.
The lowest, Purdy, was 4.51, so only just below average for RAS. pic.twitter.com/W7rmU07BXS
— Kent Lee Platte (@MathBomb) June 6, 2024
If we extend it out to the top 100, which also happens to be all players with double digit AV in 2023, we end up with 107 players (again due to ties), and we only pick up another 4 players with low #RAS:
Keisean Nixon
Kyren Williams
Jahlani Tavai
Davon Godchaux pic.twitter.com/niLOyezpf6— Kent Lee Platte (@MathBomb) June 6, 2024
There are 13 players in that range for AV without a RAS, so we’re looking at a group of 94 with scores here.
Breakdown looks like this:
No #RAS-12.1%
Below 5.00-5.6%
Between 5 and 8-23.4%
8.00 RAS and above-58.9% pic.twitter.com/VC1qMbMzcm— Kent Lee Platte (@MathBomb) June 6, 2024
So, no surprises here, really. All of the other success metrics line up in a similar fashion. Let’s look at just players with scores to see if it’s dead on with our normal expected results.
— Kent Lee Platte (@MathBomb) June 6, 2024
That ends up maybe a little on the higher side for correlation as we normally look at it, but it’s right about what we’d expect. Roughly 2/3 in that top tier athletically, with most of that remaining 1/3 being at least above average and a single digits below average group. pic.twitter.com/zOkBAsByRu
— Kent Lee Platte (@MathBomb) June 6, 2024
How can we comfortably say that the data correlates to success if the fail rate for NFL prospects is so ridiculously high?
Well, here is what the distribution of #RAS is any time we run. If testing didn’t matter, we’d expect all of our success metrics to look pretty similar. pic.twitter.com/K2fQ5Q1L8X
— Kent Lee Platte (@MathBomb) June 6, 2024
When we’re looking at players who have found success in the NFL, we’re looking at how different the prospect distribution is compared to the success distribution.
— Kent Lee Platte (@MathBomb) June 6, 2024
We generally see that a high score is a significantly positive factor, a low score is a VERY significant limiting factor, and an above average but not elite score is basically a wash, but since we know below average is very bad, it’s ultimately a positive as well.
— Kent Lee Platte (@MathBomb) June 6, 2024
tl;dr
RAS is a little bit like PFF scores in that both try to aggregate a lot of data into a single number to allow comparison between players. There are, in my opinion, two key differences between PFF grades and RAS:
- The first is that PFF aims to quantify on-field play, while RAS quantifies a player’s personal measurements (height, weight, etc) and testing numbers from the NFL Combine or the player’s pro day.
- The second is that PFF has a rather opaque grading system, while RAS is fully transparent.
In his analysis, KLP has used AV as a proxy for NFL success, and then evaluated the predictive power of RAS by looking for positive correlation between RAS and AV for players with very high AV scores.
The bottom line of KLP’s analysis, if I’ve understood this collection of tweets correctly, is that when a prospect scores below 5 on RAS, it is a very strong ‘red flag’ to indicate that the player likely will struggle to succeed in the NFL. A score above 8 is not as reliable an indicator, but is a pretty good data point in projecting NFL success. Scores between 5 and 8 are not very reliable for predicting a prospect’s future success or failure in the NFL.
This would indicate that a GM who likes a specific draft prospect that has an RAS of <5 should think long and hard about the analysis of that player because the odds of NFL success will be heavily stacked against that player.
Any prospect with a score of 8+ should be seen as having the physical tools that will predispose the player to success in the NFL, which should support any positive analysis of the player’s film and character, but not override any negative analysis of those elements.
For players that achieve scores between 5 and 8 on the RAS, the metric will not really help the GM separate the wheat from the chaff as this range was not found to have significant correlation with eventual NFL success or failure.