Tag Archives: People

An overnight at Cumberland Island

The weekend before Thanksgiving, Sean, John, and I visited Cumberland Island National Seashore for an overnight trip. The island is accessible via ferry and has several areas to camp, including some that are ‘primitive’ – that is, without water or a restroom.

We hiked in about 7 miles and stayed at the aptly named campsite, Yankee’s Paradise.

No big changes: Castro is still wrong, a single workout doesn’t predict things well, and 300 is a magic number

Here’s a summary post for my series on predicting regional qualification from single-workout performance during the CrossFit Games Open.

I’ve again copied the leaderboard data from the Games website for the top 180 women in the five regions indicated in my first post (additionally, I’ve added a sixth region with the dataset used in these analyses, the South Central region, only because I couldn’t remember if I took SoCal or S. Central last time).

“You should not go to Regionals, you should not go to Regionals if you don’t have a basic move like the muscle-up. Period.” – Dave Castro

No, Dave Castro, you do not need to have a muscle-up to qualify for Regionals… although it would help.

The results of 2014’s CrossFit Games Open were similar to past years in that there was a high range in overall score in the top 48 in each region, and there were atheletes that qualified for Regionals that did not complete a muscle-up in 14.4.

The overall score ranged from 16 to 516 total points for women qualifying for Regionals – this is consistent with previous years, and my estimate that 500 total points would be about the cut-off for Regional qualification (Fig. 1).

Figure 1: A subset plot of overall score against overall place in six regions during the 2014 CrossFit Games Open. The green line is drawn to show 48th place, and the red line shows 60th place. Athletes finishing 48th scored between 322 and 516 points.

In the leaderboard data I analyzed, four women qualified for Regionals that did not complete a muscle-up in 14.4, but each did achieve a score of 180 on that work out, meaning they completed all the Power Cleans, and probably had some time to attempt a muscle-up. These women did place relatively high in the overall regional placement (each placed 39, 46, 47 and 48), but they still qualified.

And, this is exactly what we’ve seen in the past; the Open workouts are broad enough that a single movement will not necessarily disqualify an athlete.

Five workouts still serve a purpose

Somewhat mundanely, 2014’s Open competition supports my original conclusion: predicting regional qualification from a single workout’s performance is useless.

Figure 2 is similar to Figure 2 in a previous post, but includes only leaderboard data from 2014. Again, the r-squared of the regression (red line) is low (0.33), suggesting that a single workout score is little indication of how an athlete with place in the end and, therefore, whether or not she will qualify for Regionals.

Fig. 2: Placing in a single, randomly-drawn, workout from the 2014 CrossFit Open regressed against overall place at the end of the Open. A regression line is plotted in red, and the regional qualification cut-off (48th place) is presented in green.

Let’s magnify again:

Fig. 3: Same plot as Figure 2, except the x-axis view is limited to 60.

Now, think about it this way: An athlete places in the top 60 on an Open workout (or even in the top 10)… will she qualify for Regionals? Figure 3 says: who knows!? There are plenty of points above the green line in this plot, which represent athletes who finished in the top 60 in at least one workout, but didn’t make it to Regionals.

Let’s wrap it up

From a predictability standpoint, the 2014 CrossFit Games Open wasn’t that different from 2012 or 2013. Not even muscle-ups were as hard a line as Castro predicted.

The range of overall scores were similar: a total point score of ~500 was the cut-off in all three years.

The maximum placing was similar; I predicted getting over 300th place in any one workout will doom a competitor from qualifying for Regionals, and guess what the maximum place for a Regional qualifier was: 322 achieved by Hanna Gartman of CrossFit Hardcore North finishing 47th in the South East. Behind her was Becky Conzelman of Backcountry CrossFit, having a maximum placing of 294, but finishing 47th in the South West region. Importantly, Becky’s profile reports that she’s 42 years-old. Of regional qualifiers, she had the second worst performance across six regions in a single workout, but she still rocked it hard enough to qualify… at the individual women’s level, not just masters’ level. Awesome.

And the regional qualifier with the third worst performance in any single 2014 Open workout was… Allison Brager, of CrossFit Terminus, finishing 44th in the South East with a maximum placing of 273. So perhaps her worry of qualifying for Regionals as an individual was justified…

The Final Countdown: An Overall Score Cut-off

CrossFit Games Open workout 14.5 will be released in about 24 hours, and there are many athletes still on edge about qualifying for Regionals.

The Question

My overall score is 466, is it too late? Is this likely to disqualify me from Regional qualification?

Remember, the overall score is calculated by summing each of the placings for each Open workout. So if you place 1st, 2nd, 11th, and 1st in the past four workouts within your region, your score is 15 (and your awesome and likely named Emily Bridgers). The score can quickly get jump though, given the huge number of competitors there are… something like 5,000 women in just the South East region.

Let’s look at a simple plot to see what has happened in 2012 and 2013.

Fig. 1: Women’s overall score plotted against overall place in Open competitions 2012 and 2013 within five CrossFit Regions. The red line is drawn to illustrate the top 60.

Figure 1 shows overall scores against overall placings for women after completion of the Open competition in five Regions across two years. If I were to draw a trend line or linear regression, you’d see a positively sloped line following the center of that cloud of points.

However, there is variation – not all of those points would fall along the trend line.  And to make my point clearer, let’s zoom in:

Fig. 2: A magnified portion of Figure 1 illustrating ‘edge-qualifiers’. The red line indicates top 60, and the green line indicates top 48.

Look at the red line: Any points that lie on the line are individuals who placed 60th overall. Their overall scores ranged from 390 to 508. Similarly, any points on the green line are individuals who placed 48th (the Regionals cut-off for 2014). Their scores ranged from 302 to 435. The minimum score in the Top 60 was 7 attained by Lindsay Bourdon and Julie Foucher of the South East and Central East, respectively.

Big Picture

So there is some overlap in the ranges (years and regions can vary), but the point is that 500 points is a rough cut-off for ‘edge’ athletes. At 466 points after four workouts, there is a lot of pressure to keep the score low in 14.5. Low as in top 50.

I also want to emphasize something. Variation: This is NOT all of it. The data I have is a tiny sub-sample of all the Open data on http://games.crossfit.com. This means that my 500 point cut-off is conservative. With more data, the cut-off will probably increase. Additionally, because no one has made the Top 60 with a score above 508 in my data set, does not mean it can’t or won’t happen this year. The Open is more competitive this year; there are more athletes registered that can cause more dramatic swings in scores… which will only lead to increased variation, and a higher score cut-off for 2014.

Lastly, if it wasn’t obvious, Allison Brager, my wife, is my imaginary CrossFit competitor inquiring about her score and chances of Regional qualification in this year’s Open. I’m a scientist: I’m trying to be objective and realistic. This is not a fluffy, “you can do it”, feel-good, post to encourage her to perform well in 14.5. I sincerely believe she can make it – I would have written this with much more cynicism if I didn’t (she knows that I’ll call her out if chances, acts, or statements are bullshit…).

Are muscle-ups that important, Castro?

In previous posts, I’ve presented on the range of Open workout placings athletes have and its impact on CrossFit Games Regional qualification. These results were posted in a series entitled “Predicting regional competitors from single open workouts” and can be found here:

I believe these results partially counter Dave Castro’s statement during the introduction to Open workout 14.4 (around minute 37:00 here):

We wanted the best of the best to be able to finish it and get back to the rower. … You should not go to Regionals, you should not go to Regionals if you don’t have a basic move like the muscle-up. Period.

The Open is changing year-to-year, becoming more competitive and more challenging to qualify for Regionals, but one thing my posts have illustrated: there is a lot of variation and a single Open workout is a poor predictor of regional qualification.

So how can Castro make this claim? Have muscle-ups been a deciding factor in Regional qualification in the past?

No.

In fact, muscle-ups have been featured in the past two Open competitions during the Karen-esque, miserably painful 12.4 and 13.3, and there were plenty of Regionally qualifying women who didn’t perform a single muscle-up during these workouts. Indeed, 39 in 2012, and 5 in 2013 just from my sub-sampled data set (described in my first post).

The range in scores for 12.4 and 13.3 for Regional qualifiers (overall place is less than 60) in my data set: 240-270, and 240-273, respectively. This means that an athlete needed to complete double-unders, (the workout was 150 wall balls, 90 double unders, then muscle ups), but muscle-ups were optional…

But… the Open is becoming more competitive. It was much harder to get to Regionals last year than in 2012 without muscle-ups (i.e., 39 athletes in 2012 versus 5 in 2013 in the sub-set I’m working with).

So Castro might be right this year: Perhaps no one will qualify for Regionals this year that doesn’t compete a muscle-up in 14.4. We can only, anxiously wait. But the way I see it: CrossFit is more than a muscle-up, and the Open generally does a good job of demonstrating it.