Back

Ai is only as good as the experts behind it

Ai ethics in recruitment | Sapia Ai recruitment software
There has been some negative media attention lately surrounding the use of Artificial Intelligence (AI) in the recruitment space with warnings ranging from the fact that AI produces a shallow candidate pool to more serious things like amplification of bias.
There are many instances of AI being used in a way that has harmful outcomes, but it is important to clarify that this is about how AI is being implemented and not an issue with the use of AI itself.

When AI is used appropriately, responsibly, and following regulatory guidelines it is an incredibly powerful tool that can create fair outcomes for candidates who are selected without bias – in a way that no other tool at our disposal can.
This is why we think it’s worthwhile that more people better understand AI and some of the differences in the way it is used and implemented.

There is no unified Ai

Most media articles refer to AI as if it represents a singular master algorithm and fail to identify how varied the implementations of it are. Almost all AI we have today falls into the category of “narrow AI”, in other words algorithms, mostly machine learning, built to solve a specific problem. E.g. classify sentiment, detect spam, label images, parse resumes. These purpose built AI are highly dependent on the nature of the underlying training data and the expertise of the developers in making the right assumptions and tests of validity of their models. When built in the right way and used responsibly, AI has the ability to empower humans. This is why at Sapia.ai we have made various conscious design choices and adhered to a framework called FAIR™ that tests for bias, validity, explainability and inclusivity of our AI based tools.

Text over video

The biggest cause for alarm is when AI is applied to analysing video, which can lead to irrelevant inputs like clothing, background, and lighting being used as predictors of personality and job-fit. Video and speech patterns also make it nearly impossible to remove demographic information like race and gender as inputs.

Additionally, analyzing facial expressions is problematic, especially when evaluating certain candidates like those with Autism Spectrum Disorder or other forms of neurodiversity.

This is why Sapia.ai does not, and will not, use AI scoring for video interviews or even voice transcriptions from videos or audio given the word error rate introduced in transcribing speech. Instead, we opt for text – which we implement in a friendly no pressure environment that feels like you are texting a friend.

It’s worth noting that no data other than the answers given by the candidate are used in the ‘fit score’ calculation – that is, we never use demographic data, social media, CV or resume data (which also contain demographic signals, even when de-identified), or behavioral metrics such as time to complete.

Even a candidate’s raw text itself contains gender and ethnicity signals that can introduce bias, if not mitigated. This is why we only use feature scores (e.g., personality, behavioral competencies, and communication skills) derived according to a clearly defined rubric in our scoring algorithms, which our extensive research shows contain significantly less gender and ethnicity information than raw text.

Aim to uncover hidden talent while measuring potential

Another common concern is that AI will result in more uniformity rather than diversity in the workforce as algorithms narrow the pool in order to search out an employer’s ideal candidate. There are several things worth noting here.

First, identifying what the ideal candidate is – that is, what knowledge, skills, abilities, and other characteristics are important for success in the role – is what a job analysis is for and should, legally, be what your selection tool is designed to measure.

This is also not specific to AI, as all selection systems are designed to identify which candidates have a profile of traits and characteristics that indicate they will likely be successful in the role. This doesn’t automatically mean that every hire is going to be exactly the same, though. When you focus on the traits and characteristics that will set someone up to be successful, considering potential more than background or pedigree, you’re more likely to uncover hidden talent and hire more successful people from a broader, more diverse range.

Relying solely on past data to build your model also runs the risk of introducing historical data biases. This is actually why it is so important to consider the ideal candidate profile and use that to inform your scoring model. We strongly believe in keeping the human in the loop, which is why our scoring models are centred around the human-determined (via job analysis) ideal candidate profile and then optimized to ensure all bias constraints (e.g., 4/5ths rule and effect sizes) are met.

Using this approach, Sapia has helped clients achieve their DEI goals and increase their diversity hires, including impressive statistics like hiring 3x more ethnic minorities, 1.5x more women, and 2x more LGBTQ+ candidates in just 3 months.

Keep Ai processes transparent

Lastly, it’s worth acknowledging that there is often a “black box” mystery of how AI recruitment tools work. People don’t trust what they don’t understand. While we don’t expect everyone to be an expert in AI or Natural Language Processing, we do strongly believe in building trust through transparency and work hard to make sure that our models are easily understood and open to scrutiny. From third-party audits to detailed model cards to in-depth dashboarding and reporting, we aim to maximize transparency, explainability, and fairness.

We believe a fairer future can only be achieved when AI is used responsibly. AI is not the enemy, rather it’s the experience and motivation behind those promoting it that can make the difference between what is good AI and what is harmful AI.


Blog

Neuroinclusion by design. Not by exception.

Why neuroinclusion can’t be a retrofit and how Sapia.ai is building a better experience for every candidate.

In the past, if you were neurodivergent and applying for a job, you were often asked to disclose your diagnosis to get a basic accommodation – extra time on a test, maybe the option to skip a task. That disclosure often came with risk: of judgment, of stigma, or just being seen as different.

This wasn’t inclusion. It was bureaucracy. And it made neurodiverse candidates carry the burden of fitting in.

We’ve come a long way, but we’re not there yet.

Shifting from retrofits to inclusive-by-design

Over the last two decades, hiring practices have slowly moved away from reactive accommodations toward proactive, human-centric design. Leading employers began experimenting with:

  • Sharing interview questions in advance

  • Replacing group exercises with structured simulations

  • Offering a variety of assessment formats

  • Co-designing assessments with neurodiverse candidates

But even these advances have often been limited in scope, applied to special hiring programs or specific roles. Neurodiverse talent still encounters systems built for neurotypical profiles, with limited flexibility and a heavy dose of social performance pressure.

Hiring needs to look different.

Insight 1: The next frontier of hiring equity is universal design

Truly inclusive hiring doesn’t rely on diagnosis or disclosure. It doesn’t just give a select few special treatment. It’s about removing friction for everyone, especially those who’ve historically been excluded.

That’s why Sapia.ai was built with universal design principles from day one.

Here’s what that looks like in practice:

  • No time limits — Candidates answer at their own pace
  • No pressure to perform — It’s a conversation, not a spotlight
  • No video, no group tasks — Just structured, 1:1 chat-based interviews
  • Built-in coaching — Everyone gets personalised feedback

It’s not a workaround. It’s a rework.

Insight 2: Not all “friendly” methods are inclusive

We tend to assume that social or “casual” interview formats make people comfortable. But for many neurodiverse individuals, icebreakers, group exercises, and informal chats are the problem, not the solution.

When we asked 6,000 neurodiverse candidates about their experience using Sapia.ai’s chat-based interview, they told us:

“It felt very 1:1 and trustworthy… I had time to fully think about my answers.”

“It was less anxiety-inducing than video interviews.”

“I like that all applicants get initial interviews which ensures an unbiased and fair way to weigh-up candidates.”

Insight 3: Prediction ≠ Inclusion

Some AI systems claim to infer skills or fit from resumes or behavioural data. But if the training data is biased or the experience itself is exclusionary, you’re just replicating the same inequity with more speed and scale.

Inclusion means seeing people for who they are, not who they resemble in your data set.

At Sapia.ai, every interaction is transparent, explainable, and scientifically validated. We use structured, fair assessments that work for all brains, not just neurotypical ones.

Where to from here?

Neurodiversity is rising in both awareness and representation. However, inclusion won’t scale unless the systems behind hiring change as well.

That’s why we built a platform that:

  • Doesn’t rely on disclosure

  • Removes ambiguity and pressure

  • Creates space for everyone to shine

  • Measures what matters, fairly

Sapia.ai is already powering inclusive, structured, and scalable hiring for global employers like BT Group, Costa Coffee and Concentrix. Want to see how your hiring process can be more inclusive for neurodivergent individuals? Let’s chat. 

Read Online
Blog

Skills Measurement vs Skills Inference – What’s the Difference and Why Does It Matter?

There’s growing interest in AI-driven tools that infer skills from CVs, LinkedIn profiles, and other passive data sources. These systems claim to map someone’s capability based on the words they use, the jobs they’ve held, and patterns derived from millions of similar profiles. In theory, it’s efficient. But when inference becomes the primary basis for hiring or promotion, we need to scrutinise what’s actually being measured and what’s not.

Let’s be clear: the technology isn’t the problem. Modern inference engines use advanced natural language processing, embeddings, and knowledge graphs. The science behind them is genuinely impressive. And when they’re used alongside richer sources of data, such as internal project contributions, validated assessments, or behavioural evidence, they can offer valuable insight for workforce planning and development.

But we need to separate the two ideas:

  • Skills Measurement: Directly observing or quantifying a skill based on evidence of actual performance. 
  • Skills Inference: Estimating the likelihood that someone has a skill, based on indirect signals or patterns in their data. 

The risk lies in conflating the two.

The Problem Isn’t Inference of Skills. It’s the Data Feeding It

CVs and LinkedIn profiles are riddled with bias, inconsistency, and omission. They’re self-authored, unverified, and often written strategically – for example, to enhance certain experiences or downplay others in response to a job ad. 

And different groups represent themselves in different ways. Ahuja (2024) showed, for example, that male MBA graduates in India tend to self-promote more than their female peers. Something as simple as a longer LinkedIn ‘About’ section becomes a proxy for perceived competence.

Job titles are vague. Skill descriptions vary. Proficiency is rarely signposted. Even where systems draw on internal performance data, the quality is often questionable. Ratings tend to cluster (remember the year everyone got a ‘3’ at your org?) and can often reflect manager bias or company culture more than actual output.

Sophisticated ≠ Objective

The most advanced skill inference platforms use layered data: open web sources like job ads and bios, public databases like O*NET and ESCO, internal frameworks, even anonymised behavioural signals from platform users. This breadth gives a more complete picture, and the models powering it are undeniably sophisticated.

But sophistication doesn’t equal accuracy.

These systems rely heavily on proxies and correlations, rather than observed behaviour. They estimate presence, not proficiency. And when used in high-stakes decisions, that distinction matters.

Transparency (or Lack Thereof)

In many inference systems, it’s hard to trace where a skill came from. Was it picked up from a keyword? Assumed from a job title? Correlated with others in similar roles? The logic is rarely visible, and that’s a problem, especially when decisions based on these inferences affect access to jobs, development, or promotion.

Presence ≠ Proficiency

Inferred skills suggest someone might have a capability. But hiring isn’t about possibility. It’s about evidence of capability. Saying you’ve led a team isn’t the same as doing it well. Collecting or observing actual examples of behaviour allows you to evaluate someone’s true competence at a claimed skill. 

Some platforms try to infer proficiency, too, but this is still inference, not measurement. No matter how smart the model, it’s still drawing conclusions from indirect data.

By contrast, validated assessments like structured interviews, simulations, and psychometric tools are designed to measure. They observe behaviour against defined criteria, use consistent scoring frameworks (like Behaviourally Anchored Rating Scales, or BARS), and provide a transparent, defensible basis for decision-making. In doing this, the level or proficiency of a skill can be placed on a properly calibrated scale. 

But here’s the thing: we don’t have to choose one over the other.

A Smarter Way Forward: The Hybrid Model

The real opportunity lies in combining the rigour of measurement with the scalability of inference.

Start with measurement
Define the skills that matter. Use structured tools to capture behavioural evidence. Set a clear standard for what good looks like. For example, define Behaviourally Anchored Rating Scales (BARS) when assessing interviews for skills. Using a framework like Sapia.ai’s Competency Framework is critical for defining what you want to measure. 

Layer in inference
Apply AI to scale scoring, add contextual nuance, and detect deeper patterns that human assessors might miss, especially when reviewing large volumes of data.

Anchor the whole system in transparency and validation
Ensure people understand how inferences are made by providing clear explanations. Continuously test for fairness. Keep human oversight in the loop, especially where the stakes are high. More information on ensuring AI systems are transparent can be found in this paper.

This hybrid model respects the strengths and limits of both approaches. It recognises that AI can’t replace human judgement, but it can enhance it. That inference can extend reach, but only measurement can give you higher confidence in the results.

The Bottom Line

Inference can support and guide, but only measurement can prove. And when people’s futures are on the line, proof should always win.

References

Ahuja, A. (2024). LinkedIn profile analysis reveals gender-based differences in self-presentation among Indian MBA graduates. Journal of Business and Psychology.

 

Read Online
Blog

Making Healthcare Hiring Human with Ethical AI

Hiring for care is unlike any other sector. Recruiters are looking for people who can bring empathy, resilience, and energy to the most demanding human roles. Whether it’s dental care, mental health, or aged care, new hires are charged with looking after others when they’re most vulnerable. The stakes are high. 

Hiring for care is exactly where leveraging ethical AI can make the biggest impact.

Hiring for the traits that matter

The best carers don’t always have the best CVs.

That’s why our chat-based AI interview doesn’t screen for qualifications. It screens for the the skills that matter when caring for others. The traits that define a brilliant care worker, things like:

Empathy, Self-awareness, Accountability, Teamwork, and Energy. 

The best way to uncover these traits is through structured behavioural science, delivered through an experience that allows candidates to open up. Giving candidates space to give real-life, open-text answers. With no time pressure or video stress. Then, our AI picks up the signals that matter, free from any demographic data or bias-inducing signals.

Candidates’ answers to our structured interview questions aren’t simply ticking boxes. They’re a window into how someone shows up under pressure. And they’re helping leading care organisations hire people who belong in care and those who stay.

Inclusion, built in

Inclusivity should be a core foundation of any talent assessment, and it’s a fundamental requirement for hirers in the care industry. 

When healthcare hirers use chat-based AI interviews, designed to be inclusive for all groups, candidates complete their interviews when and where they choose, without the bias traps of face-to-face or phone screening. There are no accents to judge, no assumptions, just their words and their story.

And it works:

  • 91.8% of carer candidates complete their interviews
  • Carer candidates report 9/10 Candidate Satisfaction with their interview experience 
  • 80% of candidates would recommend others to apply 
  • Every candidate receives personalised feedback, regardless of the outcome

Drop-offs are reduced, and engagement & employer brand advocacy go up. Building a brand that candidates want to work for includes providing a hiring experience that candidates want to complete. 

Real outcomes in care hiring

Our smart chat already works for some of the most respected names in healthcare and community services. Here’s a sample of the outcomes that are possible by leveraging ethical AI, a validated scientific assessment, wrapped in an experience that candidates love: 

Anglicare – a leading provider of aged care services
  • Time-to-offer dropped from 40+ days to just 14
  • Candidate pool grew by 30%
  • Turnover dropped by 63%
Abano Healthcare – Australasia’s largest dental support organisation
  • 1,213 recruiter hours saved  in the first month (67 hours per individual hiring team member) 
  • $25,000 saved in screening and interviewing time
Berry Street – a not for profit family & child services organisation
  • Time-to-hire down from 22 to 7 days
  • 95.4% of candidates completed their chat interviews

A smarter way to hire

The case study tells the full story of how Sapia.ai helped Anglicare, Abano Healthcare, and Berry Street transform their hiring processes by scaling up, reducing burnout, and hiring with heart. 

Download it here:

Read Online