Rarely is hiring somebody a single decision, but one made from a number of smaller decisions along a journey to a final one. As recruitment has become more sophisticated as an industry, so has our understanding of what can be flawed about the decisions humans make including the bias and subjectivity we bring when screening and interviewing candidates. These are essentially human traits that even the most well-intentioned of us cannot escape.
This does not mean we have to eliminate humans from hiring decisions to make it fairer – that would be problematic too – but rather that we have to use technology at strategic moments in hiring to improve our decision making. Our tendency to be biased is often related to the pressure we are under to make faster decisions. Again, this is human. When looking at thousands of CVs for example, our brains create shortcuts for us to process information that, quite frankly, we are unable to absorb. So we start scanning things based on our own biases in an unconscious way picking out schools that appeal to us, experiences that sound similar, names that feel familiar and people who ‘seem’ like others that we know.
Predictive tools that parse and score CVs, and help hiring managers assess potential candidates are unfortunately not helpful here, because they too, learn from us to favour certain characteristics that we do from CV data. Ultimately using CV data replicates institutional and historical biases, amplifying disadvantages lurking in data points like what university was attended, what gender someone is, how old they are or even what recreational clubs they belong to. A well publicised example of this was when Amazon tried to build a recruiting engine based on observing patterns in resumes submitted to the company over a 10-year period. Most of them were men, a reflection of male dominance across the tech industry. The result: the input data informed the machine learning that it didn’t like women.
The better approach is to use objective data and bias mitigating technology at the right moments in a recruiting process. It’s a way of letting the algorithms do the hard work of delving into the details that humans miss when making decisions under time pressure using biased mental shortcuts. This way we can build better accuracy than if humans alone were making decisions on their own, particularly in the early decision making or top of the funnel recruiting, with much higher efficiency given the speed of algorithms. We still need to test constantly for bias in these hiring algorithms, but by utilising them at the right moment we can help hiring managers make better – more human – decisions.
“When making decisions, think of options as if they were candidates. Break them up into dimensions and evaluate each dimension separately. Then – Delay forming an intuition too quickly. Instead, focus on the separate points, and when you have the full profile, then you can develop an intuition.”
Daniel Kahneman
Psychologist & Nobel Laureate[1]
How do we help humans make better hiring decisions at Sapia?
- We use objective data
The ability to assess someone’s suitability to do a job is not made using CV data, but rather from information we gather from answering five open-ended questions via a text chat that is ‘blind’ i.e. no identifying information is given to the hiring manager. In this model everyone gets an interview. Using advanced Natural Language Processing (NLP), we can determine a lot about someone from analysing their text answers. While a standard Myers-Briggs assessment identifies 16 personality types, based on essentially answering repeated questions, this new way of looking at language can account for 400+ personality types and counting. There is no way a human brain could distinguish these differences in people. This means we can truly identify job fit for all the candidates we screen – without bias – based on what hiring managers have identified as the skills deemed necessary in their ideal candidates. These skills and abilities cannot be uncovered in any other way.
See our product in action here.
- We constantly test for bias
Being aware that bias can exist in any data is not enough, you need to constantly test your algorithms for any emerging patterns that mimic human bias. Using a number of tests we are continually looking at our results to make sure that we are not amplifying bias in any way. Our results have shown that it is possible to mitigate bias using algorithms for better hiring outcomes. A recent piece of research looking at the hiring of Aboriginal and Torres Strait Islander peoples, the Indigenous peoples of Australia showed that we can elevate marginalised groups. Other research we have done has also proved we create a fair outcome for people who have English as a Second Language
See our approach to Ai here
- We help you calibrate team hiring decisions
Ultimately, final hiring decisions do fall back on humans, but this is also where technology can also be used to guide and calibrate scoring that hiring managers make when interviewing candidates. Decisions backed by data minimises the risk of bias, making hiring conversations more robust, and less subjective. Using standardised scoring that is live, the impression a candidate makes on a hiring manager is ranked against other assessors, as the interview is being conducted. It’s not about replacing human decision makers, but elevating their ability to make smarter, more transparent decisions, we cannot make without the help of technology.
See how we can help humans interview. - Continuous learning via feedbackHuman decision making is unscalable. The more people you add to scale decisions, the more inconsistencies and biases you will be adding to the process. Moreover, humans are limited in their capacity to learn from objective feedback data such as which profiles of people work well in a given environment. This is where data-driven approaches like machine learning are far superior. Machine learning models are able to learn continuously from large amounts of feedback data, which candidate profiles are more likely to succeed than others. This ability to retain knowledge and then be able to explain how it arrives at a decision helps organisations to truly learn from their bad hires and keep nudging the hiring outcomes towards growth. Working together, recruiters and hiring managers can benefit from the learnings of AI in challenging their views and making the right hiring decisions.
- An interaction that is familiarText chat is how we truly communicate asynchronously, i.e. on your own time – we all do it everyday with our friends and family. It needs no acting; It is blind to how you look and sound. We all know how to chat. Candidates feel comfortable using chat, as they are in a familiar setting, unlike playing a neuroscience game, a one-way video recording or a psychometric test etc which are unfamiliar or artificial experiences. Many don’t enjoy them as they are made to behave in ways they usually don’t. This high engagement, which we capture via post interview feedback, is also a driving factor in capturing authentic data as candidate’s reflect and express in their own way.
____________________
We cover this and so much more in our report: Hiring for Equality.
____________________
[1] https://podcastnotes.org/2019/10/18/daniel-kahneman-decision-making/
Related
Blog
New Research Proves the Value of AI Hiring
A new study has just confirmed what many in HR have long suspected: traditional psychometric tests are no longer the gold standard for hiring.
Published in Frontiers in Psychology, the research compared AI-powered, chat-based interviews to traditional assessments, finding that structured, conversational AI interviews significantly reduce social desirability bias, deliver a better candidate experience, and offer a fairer path to talent discovery.
We’ve always believed hiring should be about understanding people and their potential, rather than reducing them to static scores. This latest research validates that approach, signalling to employers what modern, fair and inclusive hiring should look like.
The problem with traditional psychometric tests
While used for many decades in the absence of a more candidate-first approach, psychometric testing has some fatal flaws.
For starters, these tests rely heavily on self-reporting. Candidates are expected to assess their own traits. Could you truly and honestly rate how conscientious you are, how well you manage stress, or how likely you are to follow rules? Human beings are nuanced, and in high-stakes situations like job applications, most people are answering to impress, which can lead to less-than-honest self-evaluations.
This is known as social desirability bias: a tendency to respond in ways that are perceived as more favourable or acceptable, even if they don’t reflect reality. In other words, traditional assessments often capture a version of the candidate that’s curated for the test, not the person who will show up to work.
Worse still, these assessments can feel cold, transactional, even intimidating. They do little to surface communication skills, adaptability, or real-world problem solving, the things that make someone great at a job. And for many candidates, especially those from underrepresented backgrounds, the format itself can feel exclusionary.
The Rise of Chat-Based Interviews
Enter conversational AI.
Organisations have been using chat-based interviews to assess talent since before 2018, and they offer a distinctly different approach.
Rather than asking candidates to rate themselves on abstract traits, they invite them into a structured, open-ended conversation. This creates space for candidates to share stories, explain their thinking, and demonstrate how they communicate and solve problems.
The format reduces stress and pressure because it feels more like messaging than testing. Candidates can be more authentic, and their responses have been proven to reveal personality traits, values, and competencies in a context that mirrors honest workplace communication.
Importantly, every candidate receives the same questions, evaluated against the same objective, explainable framework. These interviews are structured by design, evaluated by AI models like Sapia.ai’s InterviewBERT, and built on deep language analysis. That means better data, richer insights, and a process that works at scale without compromising fairness.
Key Findings from the Latest Research
The new study, published in Frontiers in Psychology, put AI-powered, chat-based interviews head-to-head with traditional psychometric assessments, and the results were striking.
One of the most significant takeaways was that candidates are less likely to “fake good” in chat interviews. The study found that AI-led conversations reduce social desirability bias, giving a more honest, unfiltered view of how people think and express themselves. That’s because, unlike multiple-choice questionnaires, chat-based assessments don’t offer obvious “right” answers – it’s on the candidate to express themselves authentically and not guess teh answer they think they would be rewarded for.
The research also confirmed what our candidate feedback has shown for years: people actually enjoy this kind of assessment. Participants rated the chat interviews as more engaging, less stressful, and more respectful of their individuality. In a hiring landscape where candidate experience is make-or-break, this matters.
And while traditional psychometric tests still show higher predictive validity in isolated lab conditions, the researchers were clear: real-world hiring decisions can’t be reduced to prediction alone. Fairness, transparency, and experience matter just as much, often more, when building trust and attracting top talent.
Sapia.ai was spotlighted in the study as a leader in this space, with our InterviewBERT model recognised for its ability to interpret candidate responses in a way that’s explainable, responsible, and grounded in science.
Why Trust and Candidate Agency Win
Today, hiring has to be about earning trust and empowering candidates to show up as their full selves, and having a voice in the process.
Traditional assessments often strip candidates of agency. They’re asked to conform, perform, and second-guess what the “right” answer might be. Chat-based interviews flip that dynamic. By inviting candidates into an open conversation, they offer something rare in hiring: autonomy. Candidates can tell their story, explain their thinking, and share how they approach real-world challenges, all in their own words.
This signals respect from the employer. It says: We trust you to show us who you are.
Hiring should be a two-way street – a long-held belief we’ve had, now backed by peer-reviewed science. The new research confirms that AI-led interviews can reduce bias, enhance fairness, and give candidates control over how they’re seen and evaluated.
Blog
AI Maturity in the Enterprise
Barb Hyman, CEO & Founder, Sapia.ai
It’s time for a new way to map progress in AI adoption, and pilots are not it.
Over the past year, I’ve been lucky enough to see inside dozens of enterprise AI programs. As a CEO, founder, and recently, judge in the inaugural Australian Financial Review AI Awards.
And here’s what struck me:
Despite the hype, we still don’t have a shared language for AI maturity in business.
Some companies are racing ahead. Others are still building slide decks. But the real issue is that even the orgs that are “doing AI” often don’t know what good looks like.
You don’t need more pilots. You need a maturity model.
The most successful AI adoption strategy does not have you buying the hottest Gen AI tool or spinning up a chatbot to solve one use case. What it should do is build organisational capability in AI ethics, AI governance, data, design, and most of all, leadership.
It’s time we introduced a real AI Maturity Model. Not a checklist. A considered progression model. Something that recognises where your organisation is today and what needs to evolve next, safely, responsibly, and strategically.
Here’s an early sketch based on what I’ve seen:
The 5 Stages of AI Maturity (for real enterprises)
- Curious
- Awareness is growing across leadership
- Experimentation led by innovation teams
- Risk is unclear, appetite is cautious
- AI is seen as “tech”
- Reactive
- Gen AI introduced via vendors or tools (e.g., copilots, agents)
- Some pilots show promise, but with limited scale or guardrails
- Data privacy and sovereignty questions begin to surface
- Risk is siloed in legal/IT
- Capable
- Clear policies on privacy, bias, and governance
- Dedicated AI leads or councils exist
- Internal use cases scale (e.g., summarisation, scoring, chat)
- LLMs integrated with guardrails, safety reviewed
- Strategic
- AI embedded in workflows, not layered on
- LLM/data infrastructure is regionally compliant
- AI outcomes measured (accuracy, equity, productivity)
- Teams restructured around AI capability — not just tech enablement
- AI-Native
- AI informs and transforms core decisions (hiring, pricing, customer service)
- Enterprise builds proprietary intelligence
- FAIR™/RAI principles deeply operationalised
- Talent, systems, and leadership are aligned around an intelligent operating model
Why this matters for enterprise leaders
AI is a capability.And like any capability, it needs time, structure, investment, and a map.
If you’re an HR leader, CIO, or enterprise buyer, and you’re trying to separate the real from the theatre, maturity thinking is your edge.
Let’s stop asking, “Who’s using AI?”
And start asking: “How mature is our AI practice and what’s the next step?”
I’m working on a more complete model now, based on what I’ve seen in Australia, the UK, and across our customer base. If you’re thinking about this too, I’d love to hear from you.
Blog
Beyond the Black Box: Why Transparency in AI Hiring Matters More Than Ever
For too long, AI in hiring has been a black box. It promises speed, fairness, and efficiency, but rarely shows its work.
That era is ending.
“AI hiring should never feel like a mystery. Transparency builds trust, and trust drives adoption.”
At Sapia.ai, we’ve always worked to provide transparency to our customers. Whether with explainable scores, understandable AI models, or by sharing ROI data regularly, it’s a founding principle on which we build all of our products.
Now, with Discover Insights, transparency is embedded into our user experience. And it’s giving TA leaders the clarity to lead with confidence.
Transparency Is the New Talent Advantage
Candidates expect fairness. Executives demand ROI. Boards want compliance. Transparency delivers all three.
Even visionary Talent Leaders can find it difficult to move beyond managing processes to driving strategy without the right data. Discover Insights changes that.
“When talent leaders can see what’s working (and why) they can stop defending their strategy and start owning it.”
Metrics That Make Transparency Real (and Actionable)
🕒 Time to Hire
What it is: The median time between application and hire.
Why it matters: This is your speedometer. A sharp view of how long hiring takes and how that varies by cohort, role, or team helps you identify delays and prove efficiency gains to leadership.
Faster time to hire = faster access to revenue-driving talent.
💬 Candidate Sentiment, Advocacy & Verbatim Feedback
What it is: Satisfaction scores, brand advocacy measures, and unfiltered candidate comments.
Why it matters: Many platforms track satisfaction. Sapia.ai’s Discover Insights takes it further, measuring whether that satisfaction translates into employer and consumer brand advocacy.
And with verbatim feedback collected at scale, talent leaders don’t have to guess how candidates feel. They can read it, learn from it, and take action.
You don’t just measure experience. You understand it in the candidates’ own words.
🔍 Drop-Off Rates, Funnel Visibility & Automation That Works
What it is: The percentage of candidates who exit the hiring process at different stages, and how to spot why.
Why it matters: Understanding drop-off points lets teams fix friction quickly. Embedding automation early in the funnel reduces recruiter workload and elevates top candidates, getting them talking to your hiring teams faster.
Assessment completion benchmarks in volume hiring range between 60–80%, but with a mobile-first, chat-based format like Sapia.ai’s, clients often exceed that.
Optimising your funnel isn’t about doing more. It’s about doing smarter, with less effort and better outcomes.
📈 Hiring Yield (Hired / Applied)
What it is: The percentage of completed applications that result in a hire.
Why it matters: This is your funnel efficiency score. A high yield means your sourcing, screening, and selection are aligned. A low one? There’s leakage, misfit, or missed opportunity.
Hiring yield signals funnel health, recruiter performance, and candidate-process fit.
🧠 AI Effectiveness: Score Distribution & Answer Originality
What it is: Insights into how candidate scores are distributed, and whether responses appear copied or AI-generated.
Why it matters: In high-volume hiring, a normal distribution of scores suggests your assessment is calibrated fairly. If it’s skewed too far left or right, it could be too hard or too easy, and that affects trust.
Add in answer originality, and you can track engagement integrity, protecting both your process and your brand.
From Metrics to Momentum
To effectively lead, you need more than simply tracking; you need insights enabling action.
When you can see how AI impacts every part of your hiring, from recruiter productivity to candidate sentiment to untapped talent, you lead with insight, not assumption. And that’s how TA earns a seat at the strategy table.