An AI hiring firm says it can predict job-hopping based on your interviews. The idea of “bias-free” hiring, already highly misleading, is being used by companies to shirk greater scrutiny for their tools’ labor issues beyond discrimination.
Since the onset of the pandemic, a growing number of companies have turned to AI to assist with their hiring.
The most common systems involve using face-scanning algorithms, games or other evaluations to help determine which candidates to interview.
Activists and scholars warn that these screening tools can perpetuate discrimination. However, the makers themselves argue that algorithmic hiring helps correct for human biases.
Algorithms can be tested and tweaked, whereas human biases are much harder to correct—or so the thinking goes.
In a December 2019 paper, researchers at Cornell reviewed the landscape of algorithmic screening companies to analyze their claims and practices. Of the 18 they identified with English-language websites, the majority marketed as a fairer alternative to human-based hiring. Thus suggesting that they were latching onto the heightened concern around these issues to tout their tools’ benefits and get more customers.
But discrimination isn’t the only concern with algorithmic hiring. Some scholars worry that marketing language that focuses on bias lets companies off the hook on other issues, such as workers’ rights. A new preprint from one of these firms serves as an important reminder. “We should not let the attention that people have begun to pay to bias/discrimination crowd other issues,” says Solon Barocas, an assistant professor at Cornell University and principal researcher at Microsoft Research, who studies algorithmic fairness and accountability.
The firm in question is Australia-based Sapia (Formerly PredictiveHire), founded in October 2013.
It offers a chatbot that asks candidates a series of open-ended questions. It then analyses their responses to assess job-related personality traits like “drive,” “initiative,” and “resilience.”
According to the firm’s CEO, Barbara Hyman, its clients are employers that must manage large numbers of applications, such as those in retail, sales, call centers, and health care.
As the Cornell study found, it also actively uses promises of fairer hiring in its marketing language. On its home page, it boldly advertises: “Meet Smart Interviewer – Your co-pilot in hiring. Making interviews super fast, inclusive and bias free.
As we’ve written before, the idea of “bias-free” algorithms is highly misleading. But Sapia’s latest research is troubling for a different reason. It is focused on building a new machine-learning model that seeks to predict a candidate’s likelihood of job-hopping. That is the practice of changing jobs more frequently than an employer desires. The work follows the company’s recent peer-reviewed research that looked at how open-ended interview questions correlate with personality.
The study used the free-text responses from 45,899 candidates who had used Sapia’s chatbot.
Applicants had originally been asked five to seven open-ended questions and self-rating questions about their past experience and situational judgment.
These included questions meant to tease out traits that studies have previously shown to correlate strongly with job-hopping tendencies, such as being more open to experience, less practical, and less down to earth. The company researchers claim the model was able to predict job hopping with statistical significance. Sapia’s website is already advertising this work as a “flight risk” assessment that is “coming soon.” Sapia’s new work is a prime example of what Nathan Newman argues is one of the biggest adverse impacts of big data on labor.
Machine learning for the win!
Machine-learning-based personality tests, for example, are increasingly being used in hiring to screen. This is to out potential employees who have a higher likelihood of agitating for increased wages or supporting unionisation. Employers are increasingly monitoring employees’ emails, chats, and data to assess which might leave and calculate the minimum pay increase to make them stay.
None of these examples should be surprising, Newman argued. They are simply a modern manifestation of what employers have historically done to suppress wages by targeting and breaking up union activities. The use of personality assessments in hiring, which dates back to the 1930s in the US, in fact began as a mechanism to weed out people most likely to become labor organizers. The tests became particularly popular in the 1960s and ’70s once organizational psychologists had refined them to assess workers for their union sympathies.
In this context, Sapia’s fight-risk assessment is just another example of this trend. “Job hopping, or the threat of job hopping,” points out Barocas, “is one of the main ways that workers are able to increase their income.” The company even built its assessment on personality screenings designed by organizational psychologists.
Barocas doesn’t necessarily advocate tossing out the tools altogether. He believes the goal of making hiring work better for everyone is a noble one and could be achieved if regulators mandate greater transparency.
By Karen Haoa, July 24, 2020, MIT Technology Review | https://www.technologyreview.com/
Join the movement
To keep up to date on all things “Hiring with Ai” subscribe to our blog!
Finally, you can try out Sapia’s Chat Interview right now, or leave us your details here to get a personalised demo.
Related
Blog
Mirrored diversity: why retail teams should look like their customers
Walk into any store this festive season and you’ll see it instantly. The lights, the displays, the products are all crafted to draw people in. Retailers spend millions on campaigns to bring customers through the door.
But the real moment of truth isn’t the emotional TV ad, or the shimmering window display. It’s the human standing behind the counter. That person is the brand.
The missing link in retail hiring
Most retailers know this, yet their hiring processes tell a different story. Candidates are often screened by rigid CV reviews or psychometric tests that force them into boxes. Neurodiverse candidates, career changers, and people from different cultural or educational backgrounds are often the ones who fall through the cracks.
And yet, these are the very people who may best understand your customers. If your store colleagues don’t reflect the diversity of the communities you serve, you create distance where there should be connection. You lose loyalty. You lose growth.
We call this gap the diversity mirror.
What mirrored diversity looks like
When retailers achieve mirrored diversity, their teams look like their customers:
- A grocery store team that reflects the cultural mix of its neighbourhood.
- A fashion store with colleagues who understand both style and accessibility.
- A beauty retailer whose teams reflect every skin tone, gender, and background that walks through the door.
Customers buy where they feel seen – making this a commercial imperative.
How to recruit seasonal employees with mirrored diversity
The challenge for HR leaders is that most hiring systems are biased by design. CVs privilege pedigree over potential. Multiple-choice tests reduce people to stereotypes. And rushed festive hiring campaigns only compound the problem.
That’s where Sapia.ai changes the equation: Every candidate is interviewed automatically, fairly, and in their own words.
- Bias is measured and monitored using Sapia.ai’s FAIR™ framework.
- Outcomes are validated at scale: 7+ million candidates, 52 countries, average candidate satisfaction 9.2/10.
- Diversity can be measured: with the Diversity Dashboard, you can track DEI capture rates, candidate engagement, and diversity hiring outcomes across every stage of the funnel.
With the right HR hiring tools, mirrored diversity becomes a data point you can track, prove, and deliver on. It’s no longer just a slogan.
Retail recruiting strategies in action: the David Jones example
David Jones, Australia’s premium department store, put this into practice:
- 40,000 festive applicants screened automatically
- 80% of final hires recommended by Sapia.ai
- Recruiters freed up 4,000 hours in screening time
- Candidate experience rated 9.1/10
The result? Store teams that belong with the brand and reflect the customers they serve.
Read the David Jones Case Study here 👇
Recruiting ideas for retail leaders this festive season
As you prepare for festive hiring in the UK and Europe, ask yourself:
- How much will you spend on marketing this Christmas?
- And how much will you invest in ensuring the colleagues who deliver that brand promise reflect the people you want in your stores?
Because when your colleagues mirror your customers, you achieve growth, and by design, you’ll achieve inclusion.
See how Sapia.ai can help you achieve mirrored diversity this festive season. Book a demo with our team here.
FAQs on retail recruitment and mirrored diversity
What is mirrored diversity in retail?
Mirrored diversity means that store teams reflect the diversity of their customer base, helping create stronger connections and loyalty.
Why is diversity important in seasonal retail hiring?
Seasonal employees often provide the first impression of a brand. Inclusive teams make customers feel seen, improving both experience and sales.
How can retailers improve their hiring strategies?
Adopting tools like AI structured interviews, bias monitoring, and data dashboards helps retailers hire fairly, reduce screening time, and build more diverse teams.
Blog
The Diversity Dashboard: Proving your DEI strategy is working
Why measuring diversity matters
Organisations invest heavily in their employer brand, career sites, and EVP campaigns, especially to attract underrepresented talent. But without the right data, it’s impossible to know if that investment is paying off.
Representation often varies across functions, locations, and stages of the hiring process. Blind spots allow bias to creep in, meaning underrepresented groups may drop out long before offer.
Collecting demographic data is only step one. Turning it into insight you can act on is where real change and better hiring outcomes happen.
What is the Diversity Dashboard?
The Diversity Dashboard in Discover Insights, Sapia.ai’s analytics tool, gives you real-time visibility into representation, inclusion, and fairness at every stage of your talent funnel. It helps you connect the dots between your attraction strategies and actual hiring outcomes.
Key features include:
- Demographic filters – Switch between gender, ethnicity, English as an additional language, First Nations status, disability, and veteran status. View age and ethnicity in standard or alternative formats to match regional reporting needs.
- Representation highlights – Identify the top five represented sub-groups for each demographic, plus the three fastest-growing among underrepresented groups.
- Track trends over time – See month-by-month changes in representation over the past 12 months, compare to earlier periods, and connect the data back to your EVP and attraction spend.
- Candidate experience metrics – Measure CSAT (satisfaction) and engagement rates by demographic to ensure your hiring process works for everyone. Inclusion is measurable.
- Hiring fairness – Compare representation in your applied, recommended, and hired pools to spot drop-offs. Understand not just who applies, but who progresses — and why.
From insight to action
With the Diversity Dashboard, you can pinpoint where inclusion is thriving and where it’s falling short.
- See if your EASL candidates are applying in high numbers but not progressing to live interview.
- Spot if candidates with a disability report high satisfaction but have lower offer rates.
- Track the impact of targeted campaigns month-by-month and adjust quickly when something isn’t working.
It’s also a powerful tool to tell your success story. Celebrate wins by showing which underrepresented groups are making the biggest gains, and share that progress with boards, executives, and regulators.
Built on science, backed by trust
Powered by explainable AI and the world’s largest structured interview dataset, your insights are fair, auditable, and evidence-based.
Measuring diversity is the first step. Using that data to take action is where you close the Diversity Gap. With the Diversity Dashboard, you can prove your strategy is working and make the changes where it isn’t.
Book a demo to see the Diversity Dashboard in action.
Blog
Neuroinclusion by design. Not by exception.
Why neuroinclusion can’t be a retrofit and how Sapia.ai is building a better experience for every candidate.
In the past, if you were neurodivergent and applying for a job, you were often asked to disclose your diagnosis to get a basic accommodation – extra time on a test, maybe the option to skip a task. That disclosure often came with risk: of judgment, of stigma, or just being seen as different.
This wasn’t inclusion. It was bureaucracy. And it made neurodiverse candidates carry the burden of fitting in.
We’ve come a long way, but we’re not there yet.
Shifting from retrofits to inclusive-by-design
Over the last two decades, hiring practices have slowly moved away from reactive accommodations toward proactive, human-centric design. Leading employers began experimenting with:
- Sharing interview questions in advance
- Replacing group exercises with structured simulations
- Offering a variety of assessment formats
- Co-designing assessments with neurodiverse candidates
But even these advances have often been limited in scope, applied to special hiring programs or specific roles. Neurodiverse talent still encounters systems built for neurotypical profiles, with limited flexibility and a heavy dose of social performance pressure.
Hiring needs to look different.
Insight 1: The next frontier of hiring equity is universal design
Truly inclusive hiring doesn’t rely on diagnosis or disclosure. It doesn’t just give a select few special treatment. It’s about removing friction for everyone, especially those who’ve historically been excluded.
That’s why Sapia.ai was built with universal design principles from day one.
Here’s what that looks like in practice:
- No time limits — Candidates answer at their own pace
- No pressure to perform — It’s a conversation, not a spotlight
- No video, no group tasks — Just structured, 1:1 chat-based interviews
- Built-in coaching — Everyone gets personalised feedback
It’s not a workaround. It’s a rework.
Insight 2: Not all “friendly” methods are inclusive
We tend to assume that social or “casual” interview formats make people comfortable. But for many neurodiverse individuals, icebreakers, group exercises, and informal chats are the problem, not the solution.
When we asked 6,000 neurodiverse candidates about their experience using Sapia.ai’s chat-based interview, they told us:
“It felt very 1:1 and trustworthy… I had time to fully think about my answers.”
“It was less anxiety-inducing than video interviews.”
“I like that all applicants get initial interviews which ensures an unbiased and fair way to weigh-up candidates.”
Insight 3: Prediction ≠ Inclusion
Some AI systems claim to infer skills or fit from resumes or behavioural data. But if the training data is biased or the experience itself is exclusionary, you’re just replicating the same inequity with more speed and scale.
Inclusion means seeing people for who they are, not who they resemble in your data set.
At Sapia.ai, every interaction is transparent, explainable, and scientifically validated. We use structured, fair assessments that work for all brains, not just neurotypical ones.
Where to from here?
Neurodiversity is rising in both awareness and representation. However, inclusion won’t scale unless the systems behind hiring change as well.
That’s why we built a platform that:
- Doesn’t rely on disclosure
- Removes ambiguity and pressure
- Creates space for everyone to shine
- Measures what matters, fairly
Sapia.ai is already powering inclusive, structured, and scalable hiring for global employers like BT Group, Costa Coffee and Concentrix. Want to see how your hiring process can be more inclusive for neurodivergent individuals? Let’s chat.