Go Back
BLOG

Interviews as Evidence-Gathering Missions: A Smarter Approach to Hiring

Interviews as Evidence-Gathering Missions: A Smarter Approach to Hiring

Discover why gut feelings aren't a hiring strategy. Learn how treating interviews as evidence-gathering missions leads to better, unbiased hiring decisions. We believe interviews need a complete overhaul. Too often, hiring decisions are made based on gut feelings or first impressions, and that's a problem. In our latest article, we explain why we need to treat interviews as evidence-gathering missions—focused on extracting real, tangible data about a candidate's behaviors and potential. We explore how using AI-driven rubrics can help reduce bias and increase consistency, ensuring we make decisions based on solid evidence rather than fleeting intuition. Gut feelings are unreliable; interviews should be about gathering the right data to make informed, fair, and impactful hiring choices.

AI Recruiting
AI Recruiting
Lyndsay & ThoughtfulTeam

Lyndsay & ThoughtfulTeam

Date
October 2, 2024
Read
5 min
Share

Interviews Are Evidence-Gathering Missions—Not Gut Checks

Interviews are broken. We’ve all seen it happen—someone gets hired because they made a good impression or the interviewer just had a “good feeling” about them. But that’s exactly the problem. Too often, interviews are treated like casual conversations, where decisions are made based on intuition rather than real, structured data.

It’s like interviewing a ghost—you’re sitting across from a nebulous, intangible feeling with no real substance, and yet you’re trying to make one of the most crucial decisions for your team based on it. If we want to hire the best talent, interviews need to be treated like what they should be: evidence-gathering missions.

Gut Feeling Is Not a Hiring Strategy

Let’s get real. How many times have you heard someone say, “I just knew they’d be a good fit” or “I don’t think they’d work well here,” with zero substantial evidence to back it up? These gut feelings are often more about personal bias than candidate potential.

Hiring based on gut feelings is like trying to gather information from a ghost—something vague, fleeting, and impossible to pin down. We can’t afford to let something as critical as hiring—the backbone of our business growth—be decided by hunches or charisma. It’s time to rethink the interview from the ground up. And that starts with seeing interviews as data-driven investigations, where we gather specific evidence about a candidate’s behaviors, skills, and mindset before jumping to any conclusions.

Step 1: Extract Evidence First, Judge Later

The first step in this evidence-based approach is simple: stop making snap judgments. Before forming any conclusions about a candidate, focus on extracting evidence.

When we conduct interviews, our role is to dig for data—to understand how a person behaves in the face of challenges, how they think through problems, and how they interact with others. This isn’t about surface-level answers or charming anecdotes; it’s about collecting observable behaviors that demonstrate their real ability to do the job.

Questions like:

  • “Tell me about a time when you faced a setback and how you handled it.”
  • “Walk me through the most challenging problem you've solved recently.”

These are designed to get past the polished, rehearsed responses and uncover how a candidate actually operates. Not “What did you do?” but “How did you do it?” Not just the outcome, but the mindset and process that got them there. That’s the kind of evidence that predicts whether someone will succeed—not where they went to school or whether they had a fancy job title.

Step 2: Use AI to Enforce Rigor and Consistency

Let’s face it: humans are inconsistent. One interviewer might love a candidate’s confidence, while another might find it off-putting. These inconsistencies mean we’re often missing great talent or hiring people who look good on the surface but lack substance.

This is where AI and structured rubrics come in. AI doesn’t get tired, and it doesn’t have personal biases. It evaluates each candidate against the same criteria, providing a consistent, unbiased assessment of their responses. AI-powered rubrics can evaluate critical attributes:

  • Problem-Solving Ability: Does the candidate show logical thinking, adaptability, and creativity?
  • Behavior Under Pressure: Do they keep their cool, pivot effectively, and solve the challenge?
  • Collaboration: How do they engage with others, influence, or lead?

AI helps us focus on real, tangible behaviors—the kind of evidence that drives success in the workplace—not just a good first impression. If we want top performers, we need to be disciplined about gathering the right evidence during interviews.

Step 3: Form a Hypothesis About Fit

Now, and only now, can we begin to form a hypothesis about whether this candidate is a good fit. Notice, we’re not making an absolute decision just yet—we’re forming a hypothesis based on the evidence gathered.

This hypothesis should consider:

  • Skill Fit: Does the evidence show that this person has the skills to do the job well?
  • Behavior Fit: Are they resilient, adaptable, and resourceful?
  • Values Fit: Are they aligned with the company’s values in a meaningful way?

We’re treating this like a scientific process. We gather the data, form a hypothesis, and then, if we need more evidence—maybe another round of interviews or a skills assessment—we get it. We don’t rush to judgment based on first impressions or intuition.

The Consequences of Not Gathering Evidence

When interviews aren’t treated like evidence-gathering missions, we end up with bad hires—people who might have impressed us during a 45-minute conversation but who lack the substance to actually perform. Worse still, we pass over incredible talent because they didn’t fit into the interviewer’s mental model of a “perfect candidate.”

This old-school way of interviewing costs us time, money, and most importantly, the opportunity to work with the best people. It’s a process designed to perpetuate bias and mediocrity. We need a new approach.

Why Evidence-Based Interviews Are the Future

  1. Eliminating Bias: By focusing on structured evidence, we reduce the influence of personal bias. AI can analyze language, structure, and content without the distraction of subjective impressions, creating a fairer process.
  2. Consistent Quality: Structured rubrics and AI assessments mean we’re evaluating everyone by the same standards. No more inconsistency between interviewers; no more missed talent due to one person’s skewed perspective.
  3. Better Hiring Decisions: It’s about predictive validity—gathering the kind of evidence that’s actually predictive of success on the job. We know that what someone has done in the past isn’t always predictive of what they’re capable of in a new environment. But how they think, how they solve problems, how they deal with failure? That’s where the real signals lie.
  4. Empowering Candidates: This approach also benefits candidates. Evidence-based interviewing provides clarity—if a candidate isn’t selected, they receive constructive feedback based on real data, helping them understand where they can improve. It’s about respect and empowerment, making the hiring process more human, even as we leverage AI.

The Takeaway: Stop Hiring Based on Vibes

The truth is, hiring based on gut feelings and vibes doesn’t cut it anymore. It’s unfair, inconsistent, and leads to bad outcomes. Interviews should be about gathering evidence—real data that tells us who this person is, what they’ve done, and how they’ll likely perform in the future.

No more interviewing ghosts. We need to start interviewing like scientists—curious, disciplined, and driven by evidence. Only then can we make decisions that are data-driven, fair, and built on the substance of a candidate’s actual capabilities.

That’s how we build a workforce of impact. No more guesses, no more gut feelings—just the truth about who’s truly capable of moving our companies forward.

October 7, 2024
AI in Work
AI in Work
Work Velocity: Stop Measuring Meetings and Start Measuring Momentum

Discover why analyzing work velocity is better than focusing on single meetings. Learn how AI can track progress across meetings to reveal true team momentum, patterns, and roadblocks. We believe that true progress in teams isn't captured by analyzing a single meeting—it's about understanding Work Velocity across a series of meetings. In our latest article, we explore how work velocity measures the momentum of projects, helping us see patterns, roadblocks, and systemic issues that hold teams back. By using AI-powered coaching and tracking meetings over time, we can identify whether we're actually moving forward or just spinning our wheels. AI can provide real evidence, uncovering insights that humans might instinctively sense but can't measure precisely. It's time to stop relying on snapshots of individual meetings and start measuring the bigger picture: team momentum and value creation.

The Black Box of Interviews: We Don’t Know What’s Happening, and That’s a Problem

Discover why interviews are often a black box and how interviewer quality impacts hiring. Learn how calibration, AI-driven coaching, and transparency can unlock better hiring decisions. We need to address the reality that interviews today are often a black box—a mysterious process where we can't be sure of what’s actually happening. Are interviewers extracting meaningful insights, or are they relying on gut feelings? This uncertainty poses a serious risk to hiring quality. In our latest blog, we explore how to bring transparency, accountability, and real-time feedback to the interview process. By transcribing interviews, providing candidates with artifacts, and using AI coaching to assess interviewers, we can ensure every interview is a meaningful, high-quality experience. It’s time to crack open the black box and elevate the quality of interviewers for better, fairer hiring outcomes.

The Resume Is Dead: Why It's Time to Rethink How We Hire

This article argues that traditional resumes are flawed and perpetuate bias, making them a poor tool for hiring decisions. Instead, it advocates for a resumeless hiring process using 3-5 free response application questions evaluated by AI rubrics. By focusing on a candidate's thought process, problem-solving skills, and adaptability, companies can better assess potential and fit, while reducing bias and improving fairness. The AI-driven approach offers higher predictive validity for long-term employee success, making hiring more human and inclusive. Discover why resumes are obsolete and how a new AI-powered approach can build a better hiring future.