The good people at SuccessFactors have created an HR software system to help you deliver business strategy alignment, team execution, and maximum people performance. They’re passionate about helping you empower your workforce. And with Sapia, you can now take full advantage of SuccessFactors ATS to get ahead of your competitors by integrating Sapia’s interview automation for faster, fairer and better hiring results.
From attracting candidates of diverse backgrounds and delivering an exceptional candidate experience, you’re expected to do a lot! All whilst you’re selecting from thousands of applicants…
The good news is that technology has advanced to support recruiters. Integrating Sapia artificial intelligence technology with the powerful SuccessFactors ATS facilitates a fast, fair, efficient recruitment process that candidates love.
You can now:
Gone are the days of screening CVs, followed by phone screens to find the best talent. The number of people applying for each job has grown 5-10 times in size recently. Reading each CV is simply no longer an option. In any case, the attributes that are markers of a high performer often aren’t in CVs and the risk of increasing bias is high.
You can now streamline your SuccessFactors process by integrating Sapia’s interview automation with SuccessFactors.
By sending out one simple interview link, you nail speed, quality and candidate experience in one hit.
Sapia’s award-winning chat Ai is available to all SuccessFactors users. You can automate interviewing, screening, ranking and more, with a minimum of effort! Save time, reduce bias and deliver an outstanding candidate experience.
As unemployment rates rise, it’s more important than ever to show empathy for candidates and add value when we can. Using Sapia, every single candidate gets a FirstInterview through an engaging text experience on their mobile device, whenever it suits them. Every candidate receives personalised MyInsights feedback, with helpful coaching tips which candidates love.
“I have never had an interview like this in my life and it was really good to be able to speak without fear of judgment and have the freedom to do so.
The feedback is also great. This is a great way to interview people as it helps an individual to be themselves.
The response back is written with a good sense of understanding and compassion.
I don’t know if it is a human or a robot answering me, but if it is a robot then technology is quite amazing.”
Take it for a 2-minute test drive here >
Recruiters love the TalentInsights Sapia surface in SuccessFactors as soon as each candidate finishes their interview.
See Recruiter Reviews here >
Well-intentioned organisations have been trying to shift the needle on the bias that impacts diversity and inclusion for many years, without significant results.
Competition for candidates today is fierce. COVID, border closures, BREXIT, the last two years have created a global candidate shortage that’s hitting large organisations hard.
That’s why in today’s market, candidate experience is king. The consistent theme in all of my conversations with CHROs globally is how to improve candidate experience and get an edge on the competition.
However, the bottom line is ever present, especially in industries that are now in recovery mode. How can recruitment teams and hiring managers be expected to deliver a world-class, personalised and interactive candidate experience when they’re already stretched too thin?
The answer lies in human-centred technology with an experience that makes candidates feel valued and heard, while automating the components of the process that suck time out of your team’s day and extend the time to offer, losing candidates in the process.
Why Australia’s largest private employer turned to automation
With close to 1 million candidates annually, and a video interview experience that was sub-par for candidates and frustrating for hiring managers, Woolworths needed to drastically re-imagine their recruitment experience, making it more efficient and engaging.
How Sapia re-invigorated and streamlined Woolworth’s recruitment process
With a completely automated interview process, every retail candidate is interviewed by Smart Interviewer with Sapia’s Chat Interview chat. The automatically shortlisted candidates progress directly to VideoInterview – a chat based video interview that is reviewed by hiring managers who can then move straight to offer. It’s a seamless process that’s designed to be fair and human-centred.
The results are simply fantastic
Candidate satisfaction has blown the team away – 9.2/10 for FirstInterview and an unprecedented 9.0/10 for VideoInterview. Yes, you read that right – 9/10 for a video interview, from almost 9,000 candidates.
Completion rates for the video interview are above 75%, showing that candidates are happy to engage with a video interview that’s mobile-friendly, interactive and frankly, just works. Almost 50% of candidates complete both interviews on their mobile, making it easy for candidates to interview literally anytime, anywhere.
Here’s what Woolworths candidates had to say about their VideoInterview experience:
“The chat makes you feel like you’re in a safe space – it gives everyone an equal opportunity instead of in person interview as people can get extremely nervous”
“I found the process to be reflective and I liked how they wanted to know about me”
“everything was amazing! by far the best interview system i’ve encountered! it allowed me be comfortable and be myself, it really allowed me to take my time with my responses rather than stutter over my words”
“It was great. I like the potential to retake videos and how quick you’ve responded. ”
“I felt really calm during this interview. Which I definitely would not be in physical interviews. I was able to really sort out my thoughts and express myself to the fullest. I really love this format of interviewing !”
Automating the end to end experience has given time back to extremely time-poor hiring managers, who no longer need to manage shortlisting or scheduling and can simply review the video responses of the top candidates as they come in. Smart Interviewer has video interviewed almost 9,000 candidates,
In some cases, candidates have moved from ad to offer in 24 hours – giving Woolworths an edge as they can move quickly to capture candidates who otherwise might have accepted offers elsewhere.
If you’d like to have a candidate experience as good as Woolworths, get in touch here for a product demo.
We hope that the debate over the value of diverse teams is now over. There is plenty of evidence that diverse teams lead to better decisions and therefore, business outcomes for any organisation.
This means that CHROs today are being charged with interrupting the bias in their people decisions and expected to manage bias as closely as the CFO manages the financials.
But the use of Ai tools in hiring and promotion requires careful consideration to ensure the technology does not inadvertently introduce bias or amplify any existing biases.
To assist HR decision-makers to navigate these decisions confidently, we invite you to consider these 8 critical questions when selecting your Ai technology.
You will find not only the key questions to ask when testing the tools but why these are critical questions to ask and how to differentiate between the answers you are given.
Another way to ask this is: what data do you use to assess someone’s fit for a role?
First up- why is this an important question to ask …
Machine-learning algorithms use statistics to find and apply patterns in data. Data can be anything that can be measured or recorded, e.g. numbers, words, images, clicks etc. If it can be digitally stored, it can be fed into a machine-
The process is quite basic: find the pattern, apply the pattern.
This is why the data you use to build a predictive model, called training data, is so critical to understand.
In HR, the kinds of data that could be used to build predictive models for hiring and promotion are:
If you consider the range of data that can be used in training data, not all data sources are equal, and on its surface, you can certainly see how some carry the risk of amplifying existing bases and the risk of alienating your candidates.
Using data that is invisible to the candidate may impact your employer brand. And relying on behavioural data such as how quickly a candidate completes the assessment, social data or any data that is invisible to the candidate might expose you to not only brand risk but also a legal risk. Will your candidates trust an assessment that uses data that is invisible to them, scraped about them or which can’t be readily explained?
Increasingly companies are measuring the business cost from poor hiring processes that contribute to customer churn. 65% of candidates with a positive experience would be a customer again even if they were not hired and 81% will share their positive experience with family, friends and peers (Source: Talent Board).
Visibility of the data used to generate recommendations is also linked to explainability which is a common attribute now demanded by both governments and organisations in the responsible use of Ai.
Video Ai tools have been legally challenged on the basis that they fail to comply with baseline standards for AI decision-making, such as the OECD AI Principles and the Universal Guidelines for AI.
Or that they perpetuate societal biases and could end up penalising nonnative speakers, visibly nervous interviewees or anyone else who doesn’t fit the model for look and speech.
If you are keen to attract and retain applicants through your recruitment pipeline, you may also care about how explainable and trustworthy your assessment is. When the candidate can see the data that is used about them and knows that only the data they consent to give is being used, they may be more likely to apply and complete the process. Think about how your own trust in a recruitment process could be affected by different assessment types.
1st party data is data such as the interview responses written by a candidate to answer an interview question. It is given openly, consensually and knowingly. There is full awareness about what this data is going to be used for and it’s typically data that is gathered for that reason only.
3rd party data is data that is drawn from or acquired through public sources about a candidate such as their Twitter profile. It could be your social media profile. It is data that is not created for the specific use case of interviewing for a job, but which is scraped and extracted and applied for a different purpose. It is self-evident that an Ai tool that combines visible data and 1st party data is likely to be both more accurate in the application for recruitment and have outcomes more likely to be trusted by the candidate and the recruiter.
At PredictiveHire, we are committed to building ethical and engaging assessments. This is why we have taken the path of a text chat with no time pressure. We allow candidates to take their own time, reflect and submit answers in text format.
We strictly do not use any information other than the candidate responses to the interview questions (i.e. fairness through unawareness – algorithm knows nothing about sensitive attributes).
For example, no explicit use of race, age, name, location etc, candidate behavioural data such as how long they take to complete, how fast they type, how many corrections they make, information scraped from the internet etc. While these signals may carry information, we do not use any such data.
Another way to ask this is – Can you explain how your algorithm works? and does your solution use deep learning models?
This is an interesting question especially given that we humans typically obfuscate our reasons for rejecting a candidate behind the catch-all explanation of “Susie was not a cultural fit”.
For some reason, we humans have a higher-order need and expectation to unpack how an algorithm arrived at a recommendation. Perhaps because there is not much to say to a phone call that tells you were rejected for cultural fit.
This is probably the most important aspect to consider, especially if you are the change leader in this area. It is fair to expect that if an algorithm affects someone’s life, you need to see how that algorithm works.
Transparency and explainability are fundamental ingredients of trust, and there is plenty of research to show that high trust relationships create the most productive relationships and cultures.
This is also one substantial benefit of using AI at the top of the funnel to screen candidates. Subject to what kind of Ai you use, it enables you to explain why a candidate was screened in or out.
This means recruitment decisions become consistent and fairer with AI screening tools.
But if Ai solutions are not clear why some inputs (called “features” in machine learning jargon) are used and how they contribute to the outcome, explainability becomes impossible.
For example, when deep learning models are used, you are sacrificing explainability for accuracy. Because no one can explain how a particular data feature contributed to the recommendation. This can further erode candidate trust and impact your brand.
The most important thing is that you know what data is being used and then ultimately, it’s your choice as to whether you feel comfortable to explain the algorithm’s recommendations to both your people and the candidate.
Assessment should be underpinned by validated scientific methods and like all science, the proof is in the research that underpins that methodology.
This raises another question for anyone looking to rely on AI tools for human decision making – where is the published and peer-reviewed research that ensures you can have confidence that a) it works and b) it’s fair.
This is an important question given the novelty of AI methods and the pace at which they advance.
At PredictiveHire, we have published our research to ensure that anyone can investigate for themselves the science that underpins our AI solution.
We continuously analyse the data used to train models for latent patterns that reveal insights for our customers as well as inform us of improving the outcomes.
It’s probably self-evident why this is an important question to ask. You can’t have much confidence in the algorithm being fair for your candidates if no one is testing that regularly.
Many assessments report on studies they have conducted on testing for bias. While this is useful, it does not guarantee that the assessment may not demonstrate biases in new candidate cohorts it’s applied on.
The notion of “data drift” discussed in machine learning highlights how changing patterns in data can cause models to behave differently than expected, especially when the new data is significantly different from the training data.
Therefore on-going monitoring of models is critical in identifying and mitigating risks of bias.
Potential biases in data can be tested for and measured.
These include all assumed biases such as between gender and race groups that can be added to a suite of tests. These tests can be extended to include other groups of interest where those group attributes are available like English As Second Language (EASL) users.
On bias testing, look out for at least these 3 tests and ask to see the tech manual and an example bias testing report.
At PredictiveHire, we conduct all the above tests. We conduct statistical tests to check for significant differences between groups of feature values, model outcomes and recommendations. Tests such as t-tests, effect sizes, ANOVA, 4/5th, Chi-Squared etc. are used for this. We consider this standard practice.
We go beyond the above standard proportional and distribution tests on fairness and adhere to stricter fairness considerations, especially at the model training stage on the error rates. These include following guidelines set by IBM’s AI Fairness 360 Open Source Toolkit. Reference: https://aif360.mybluemix.net/) and the Aequitas project at the Centre for Data Science and Public Policy at the University of Chicago
We continuously analyse the data used to train models for latent patterns that reveal insights for our customers as well as inform us of improving the outcomes.
We all know that despite best intentions, we cannot be trained out of our biases. Especially the unconscious biases.
This is another reason why using data-driven methods to screen candidates is fairer than using humans.
Biases can occur in many different forms. Algorithms and Ai learn according to the profile of the data we feed it. If the data it learns from is taken from a CV, it’s only going to amplify our existing biases. Only clean data, like the answers to specific job-related questions, can give us a true bias-free outcome.
If any biases are discovered, the vendor should be able to investigate and highlight the cause of the bias (e.g. a feature or definition of fitness) and take corrective measure to mitigate it.
If you care about inclusivity, then you want every candidate to have an equal and fair opportunity at participating in the recruitment process.
This means taking account of minority groups such as those with autism, dyslexia and English as a second language (EASL), as well as the obvious need to ensure the approach is inclusive for different ethnic groups, ages and genders.
At PredictiveHire, we test the algorithms for bias on gender and race. Tests can be conducted for almost any group in which the customer is interested. For example, we run tests on “English As a Second Language” (EASL) vs. native speakers.
If one motivation for you introducing Ai tools to your recruitment process is to deliver more diverse hiring outcomes, it’s natural you should expect the provider to have demonstrated this kind of impact in its customers.
If you don’t measure it, you probably won’t improve it. At PredictiveHire, we provide you with tools to measure equality. Multiple dimensions are measured through the pipeline from those who applied, were recommended and then who was ultimately hired.
8. What is the composition of the team building this technology?
Thankfully, HR decision-makers are much more aware of how human bias can creep into technology design. Think of how the dominance of one trait in the human designers and builders have created an inadvertent unfair outcome.
In 2012, YouTube noticed something odd.
About 10% of the videos being uploaded were upside down.
When designers investigated the problem, they found something unexpected: Left-handed people picked up their phones differently, rotating them 180 degrees, which lead to upside-down videos being uploaded,
The issue here was a lack of diversity in the design process. The engineers and designers who created the YouTube app were all right-handed, and none had considered that some people might pick up their phones differently.
In our team at PredictiveHire, from the top down, we look for diversity in its broadest definition.
Gender, race, age, education, immigrant vs native-born, personality traits, work experience. It all adds up to ensure that we minimise our collective blind spots and create a candidate and user experience that works for the greatest number of people and minimises bias.
What other questions have you used to validate the fairness and integrity of the Ai tools you have selected to augment your hiring and promotion processes?
We’d love to know!
You can try out PredictiveHire’s FirstInterview right now, or leave us your details to get a personalised demo
Sadly, neither notion holds particularly true. Discrimination is still very much alive. And new employees continue to leave their companies at an alarming rate. A hiring firm seeks to eliminate both issues — through AI-based tech.
From the outside looking in, Sapia’s promises nearly sound too good to be true. Founded in Melbourne Australia in 2013, they describe themselves as a combined effort of data scientists, engineers, HR professionals, programmers — and rock climbers. They have based their business around the idea of empowerment of all parties — all for the greater good of fair decisions. “We believe that using data, and ideally actual performance data, is the best way to deliver fairness and better decision-making”, they say.
“Smart Interviewer is the only conversational interview platform with 99% candidate satisfaction feedback.”
Their ideas come together in their newest invention: a chatbot called Smart. Rather than you spending countless of hours on initial candidate interviews, Smart Interviewer will do the top-of-funnel interviews for you. According to Smart Interviewer’s parents, it is the only conversational interview platform with 99% candidate satisfaction feedback. Moreover, the company reports a 95% completion rate.
It’s no surprise that humans are prone to unconscious bias, and that’s what the company wants to tackle with Smart Interviewer. “When a recruiter first screens a resume, they do so for +/- 6 seconds. So what is it that they are seeking?”, they ask. Their answer to the unconscious bias is simple: data. “Only clean data, like the answers to specific job-related questions, can give us a true bias-free outcome.”
While Sapia has been shortlisted for several tech and AI-based awards, there have been some critical notes too. MIT Technology Review writer Karen Hao labelled the hiring firm’s initiatives as ‘misleading’, ‘troubling’ and ‘causing greater scrutiny for their tools’ labour issues beyond discrimination’.
“Job hopping, or the threat of job hopping is one of the main things that workers are able to increase their income.”
Hao quotes Solon Barocas, an assistant professor at Cornell University and principal researcher at Microsoft Research. Barocas, an expert at algorithmic fairness and accountability, does raise a valid point in Hao’s article. The fact that Smart Interviewer asks job hopping-related questions, isn’t a good thing for candidates. “Job hopping or the threat of job-hopping is one of the main things that workers are able to increase their income.”
While AI-based systems are designed to eliminate bias, there have been multiple cases where bias can actually creep into algorithms. Amazon stopped using a hiring algorithm after finding out it favoured applicants based on words such as ‘executed’ and ‘captured’, which were far more common in men’s resumes. It proves that even though when gender, race or sexual orientation are no longer part of the process, there are still ways for AI systems to discriminate.
The answer may lie in mandated transparency, according to Barocas. “If firms were more forthcoming about their practices and submitted their tools for such validation, it could help hold them accountable”, he says.
At the end of the day, and we’ve got ourselves to thank for this: AI bias may be an easier fix than human bias.
Meanwhile, it’s easy to forget why Sapia came up with Smart Interviewer in the first place. The same way it is easy to be overly critical of organisations who are trying their best to really bridge a gap when it comes to discrimination in the forms of a lack of diversity and inclusion with regards to hiring. At the end of the day, and we’ve got ourselves to thank for this: AI bias may be an easier fix than human bias.
By Jasper Spanjaart, ToTalent, 29/07/2020
To get the Research Paper:
Finally, you can try out Sapia’s Chat Interview right now, or leave us your details here to get a personalised demo.