Two conversations in the same week. Two colleagues, completely independent of each other, talking through the same set of problems with me. And arriving at the same word.
The first was a school leader. Talented, reflective, great in interviews. They’ve landed strong roles over the years. But they’ve also landed in roles that looked right on paper and felt wrong within months. Not because they weren’t good. Because no one had the tools to see where their strengths would actually fit. “How do I find a school that can understand what I’m actually good at,” they asked, “so that the role I’m hired into is built for success?” We talked about what it would look like if schools could measure fit before the hire, not just credentials and chemistry.
The second was a school superintendent who had started to question why their talent pipeline kept producing the same profile over and over. Hires ended up all too familiar across several demographics. The process was rewarding familiarity: the right university, the familiar school they had worked at, and the right career arc. Capable people with less conventional paths or from different parts of the world weren’t making it past the resume screen. The superintendent suspected the process itself was filtering out talent, not surfacing it. So they changed how they hired. They introduced evidence-based assessments that measured how candidates actually think and lead. And something striking happened: candidates who never would have reached the interview stage under the old system turned out to be among the strongest performers. They were hired, and the school now has a rich, capable, and more diverse team that the old process could never have built.
Both of them, mid-conversation, reached for the same comparison.
“This is Moneyball for hiring.”
They’re right. And the parallel runs deeper than most people realize.
The Scout’s Eye
Billy Beane was a five-tool prospect. Six-foot-four, 195 pounds, the kind of athlete scouts described as having “a baseball body” and “a good face.” The Mets drafted him in the first round. He was supposed to be a star.
He wasn’t. Across six major league seasons, Beane hit .219. The scouts had seen everything they were trained to see (the body, the swing, the potential) and missed what actually mattered: whether he could perform.
That failure became his education. When Beane took over as general manager of the Oakland Athletics, he asked a question that made the entire scouting establishment uncomfortable: What if the things we’ve always measured don’t predict what we think they predict?
Beane discovered something the scouting world didn’t want to hear: on-base percentage, a stat most scouts ignored, was three times more predictive of scoring runs than batting average, the stat everyone worshipped. The things that actually predicted winning were not the things baseball had been measuring.
The resistance was fierce. “You don’t put a ballclub together with a computer,” they said. Beane’s own head scout resisted so forcefully he was eventually let go. But Oakland won 103 games that season, including a record 20-game winning streak. Not because they had better athletes. Because they finally measured what mattered.
Now Replace “Baseball” with “Education”
Walk into any school district’s hiring process and you’ll hear language that would feel familiar to a 2001 baseball scout.
“This person has similar experience to me, I like them. I can feel it when someone is going to be good.”
That’s the eye test. That’s “he’s got a baseball body” translated into education.
Here’s what the research actually shows: unstructured interviews, the most common tool in school hiring, predict just 19% of the variance in job performance, according to Sackett et al.’s 2022 meta-analysis. Resumes and credentials predict about 10%. These are the tools we lean on hardest, and they are the weakest predictors available.
Meanwhile, structured behavioral simulations (the equivalent of on-base percentage) predict performance at roughly twice the rate of unstructured interviews. But almost no school district uses them.
We are playing the game the way baseball played it before Moneyball. We’re spending our scouting budget on the eye test and wondering why our draft picks don’t pan out.
The Five-Tool Candidate
In baseball, the five-tool player was the ideal. Scouts who found a five-tool prospect believed they’d found a sure thing.
In education hiring, we have our own version. The candidate who:
- Has an advanced degree from a respected university
- Lists impressive job titles and district names on their resume
- Interviews with poise, confidence, and the right vocabulary
- Seems familiar, like they’re already on the team
- “Feels like a fit” with our team and culture
These are the proxies we’ve been evaluating for decades. And just like the five-tool framework in baseball, they feel comprehensive. They feel like they should work.
But Billy Beane was a five-tool prospect. He looked the part. He said the right things. He had every physical attribute scouts valued. And he hit .219.
How many .219 hitters are leading our schools right now? Not because they aren’t talented, but because we put them in roles that our evidence-free process told us were a match?
The Scott Hatteberg Problem
Scott Hatteberg was a catcher with nerve damage in his throwing arm. Traditional scouts saw a broken player. By every conventional measure, he was heading out of baseball.
But when Beane looked at Hatteberg’s data, he saw something scouts had completely ignored: an extraordinary ability to get on base. The metric that actually predicted runs was elite. He just didn’t look the part. Beane signed him, and Hatteberg hit the walk-off home run that clinched Oakland’s record winning streak.
That school leader I spoke with? They’re Scott Hatteberg in reverse. The system can see their surface skills but not their deeper fit. And the candidates who never made it past the resume screen at that superintendent’s school, the ones whose career paths didn’t fit the usual template? They were Hatteberg too. Talent that the eye test couldn’t see, performing at the highest level once someone finally measured what mattered.
The Superintendent Who Became Billy Beane
That superintendent didn’t just have a hunch that the process was too narrow. They tested it. They brought in behavioral simulations, blind candidate profiles that stripped away pedigree markers, and structured evaluations designed to measure how candidates actually think and lead.
What they found was exactly what Beane found: the filtering mechanism was removing the very talent the school needed most. Candidates who never would have survived the resume screen performed at the top of the evidence-based assessments. They were hired. The school now has a stronger, more capable, more diverse leadership team. Not because the superintendent lowered the bar. Because they finally measured what the bar should have been measuring all along.
That’s Moneyball. You find the talent everyone else is missing because you’re measuring what actually predicts success.
”But I Know a Good Candidate When I See One”
This is the hardest conversation. Because the people who say this are not wrong about their intentions. They care deeply. They’ve hired good people before. Their experience is real.
But Billy Beane had experience too. So did every scout in baseball. They had decades of pattern recognition, trusted networks, and genuine expertise. And they were systematically wrong. Not about everything, but about enough.
The question isn’t whether your instincts have value. They do. The question is whether your instincts alone are enough for the stakes involved. A principal hire affects hundreds of students for years. A superintendent shapes an entire system. These are high-stakes decisions built on low-validity tools.
The Choice
In 2002, every baseball team had a choice: keep scouting the way they’d always scouted, or start measuring what actually predicted winning. The teams that resisted eventually had to change anyway. By 2015, every MLB team had a full analytics department. What was once radical became standard practice.
Education is at that inflection point. The research is settled. The tools exist. The early results are in. The districts and schools that adopt evidence-based hiring now will build stronger, more effective talent systems while others are still debating whether the eye test is enough.
Billy Beane didn’t eliminate scouts. He didn’t throw away interviews or ignore experience. He gave his organization better information so they could make better decisions. That’s all evidence-based hiring does. It doesn’t replace your judgment. It gives your judgment better inputs.
The question for every school leader reading this is the same question Billy Beane asked in 2002:
Are we measuring what actually predicts success? Or are we just measuring what we’ve always measured?
Rich Boerner is the CEO of TruFit Talent, where schools and districts use behavioral simulations and evidence-based assessment to see how candidates actually think, lead, and perform before the first interview.