ChatGPT is more extroverted, conscientious, and more open to experiences than the average working age human, new research from Sapia.ai, the world’s only smart chat platform powered by AI, has found.
If these generative AI models were job candidates responding to interview questions, what kind of personality would they project in their natural form? ChatGPT (based on GPT-3.5) and more recently GPT-4 are built using a process that includes “reinforcement learning from human feedback (RLHF)” to produce responses which are less likely to make up facts, be toxic or harmful in their sentiment compared to the earlier GPT-2. Could this friendliness and politeness be verified through the personality these models project? These were some of the questions Sapia Labs team set out to answer.
“We all know ChatGPT can be prompted to respond in different ways and, as AI models, personality is not directly applicable to them. However, given these models generate responses similar to humans, we wanted to better understand the personality projected by these models when they are not prompted to be a certain personality, or in its natural form, and be able to distinguish its responses from that of a human,” Sapia.ai’s Chief Data Scientist Dr. Buddhi Jayatilleke said.
The study, a first of its kind, analysed over 6,000 responses from GPT-2, ChatGPT (GPT-3.5) and GPT-4, and cross-examined them with Sapia.ai’s dataset of over 2.5 million candidates across 47 countries with over 1 billion words shared by job candidates. Sapia Labs used their industry-leading personality inference models based on InterviewBERT, a fine tuned version of Google’s BERT large language model to infer the personality dimensions similar to the well known HEXACO model of personality.
Their findings provide fascinating insights into the nature of these generative models. Both ChatGPT and GPT-4 scored significantly higher on the dimensions of honesty/humility, agreeableness, and consciousness compared to GPT-2. These results align well with OpenAI’s description of how ChatGPT models differ from earlier GPT models. The higher honesty/humility and agreeableness is consistent with modesty, politeness, and friendly responses. Additionally, the greater likelihood to follow directions and provide accurate information aligns with ChatGPT’s higher conscientiousness. But the most interesting finding is that both ChatGPT and GPT-4 showed significantly higher levels of extroversion, conscientiousness, and open to experience compared to the human benchmark dataset. In other words the newer GPT models trained with human-in-the-loop project a more sociable, open minded and diligent personality.
Global brands including Woolworths Group, Qantas and Spark NZ trust Sapia.ai to accelerate and enhance their recruitment and promotion processes. A conversational, Natural Language Processing (NLP) based AI chat interview, assesses and screens for the best talent at scale via an easy to use messaging platform.
In addition to improving diversity outcomes by eliminating unconscious bias, it also allows companies to re-allocate thousands of hours spent screening talent towards higher value tasks.
In the candidate short market we’re in, it’s absolutely critical to keep talent engaged throughout the entire application process. You simply cannot afford to lose the talent that you’ve spent time and money attracting.
This sounds obvious, of course, but abandonment is a key problem – and few companies know where, when, and why it is happening.
Let’s start with the metric, and then talk about how we apply it to your wider talent acquisition journey.
Overall candidate abandonment rate = number of candidates still in the process at shortlist stage, minus the total number of candidates who landed on your careers page, divided by that total number again. Or:
At the very minimum, this is the metric you need to start tracking, because it is a generalized diagnostic for the health of your recruitment process.
If you know that you had 100 visitors to your careers (or job ad) page, but your shortlist has only 10 candidates in it, you’ve lost 90% of your possible talent pool at one stage or another.
Simple math, yes, but in our experience, many recruiters and talent acquisition managers don’t look at what their starting pool of candidate interest was – and therefore, what their theoretical talent pool might have been – and look only at actual applicants.
This poses another, related question: How do I know what my abandonment rate is at each stage of the application process?
Let’s say, like the example above, that you had 100 visitors to your careers (or job ad) page, and 20 of them completed the first-step application form on that page. You’ve lost 80% of your possible pool right there.
Not great, but at least you know – now you can examine that page to uncover possible issues preventing conversion.
Without examining stage progression in isolation, you might never know why people aren’t sticking around.
To reiterate: As well as an overall abandonment rate, you need to measure the drop out rates at each of the stages of your talent acquisition journey. The next section can help show you what to focus on.
Conventional wisdom tells us that the longer your application and interview process goes on, the higher your dropout rate will be.
But that’s a generalized issue – it tells you nothing about how to fix the problem, beyond simply making it shorter. You need specific, localized data to diagnose and fix your leakage spots.
Data from a 2022 Aptitude Research report on key interviewing trends found that candidates tend to drop out at the following stages, in the following proportions:
Good to know, right? If you audit your own journey, looking at these stages and using these numbers as benchmarks, you can quickly identify your weak areas.
For example: You might be proud of your four-step culture-building interview process, in which candidates have a coffee meet-and-greet with the team they’re hoping to join.
But if it’s cumbersome for the applicant and relies on several stakeholders to orchestrate, it may be dragging your process out unnecessarily, and doing more harm than good.
25% of candidates drop out here. Shouldn’t really be a surprise, should it? Job interviews are long, numerous, and in many cases, ineffective. According to Aptitude Research, 33% of companies aren’t confident in how they interview; 50% believe they’ve lost talent due to poor interviewing.
When asked about their top interviewing challenges, surveyed HR and TA leaders responded:
Let’s focus on that second-last challenge: lack of objective data. Almost a third of companies are approaching their interview and application process with assumptions and gut feelings; and half of them believe their interview process is too long.
Despite this, 68% of companies say they have not made any improvements surrounding candidate experience this year. How many, then, are looking seriously at their entire talent acquisition journey to see where it’s failing?
This is why we’re focusing on candidate abandonment rate in this post: It is a simple metric to show the health of your application process, easier to measure than many of the other recruitment metrics for which you’re responsible (the ever-nebulous quality-of-hire being a prime example). As the saying goes, what gets measured, gets managed.
Start here today, and see what you learn.
(P.S. Sapia’s Ai Smart Chat Interviewer combines the first four stages of your process – application, screening, interviewing, and assessment – together, resulting in an application process that can secure top talent in as little as 24 hours.
Because it’s a chat-based interview with a smart little AI, your team doesn’t need to do anything – everyone who applies gets an interview, immediately. That maximizes your talent pool right from the get-go.
What’s more, our candidate dropout rate is just 15%, on average. That means that 85% of your starting talent pool will stick around.
Why do our candidates stick around? More than 90% of them love the experience. See how we can help you here, today.)
See how leaders, including Sapia’s CEO Barbara Hyman, reacted to the Treasurer’s 2020 Federal Budget, and their comments on how it will impact Australian businesses.
Featured in Business Daily Media | Wed 7th October 2020
“The R&D incentives initiative is a game changer for us because it provides the very thing that all start up businesses want – certainty. These changes are strongly supported because it means we can, as a business, confidently invest in more people to deliver innovative solutions and provide material outcomes for economic growth.”
“ACS is delighted to see the recognition of the importance of technology professionals in Australia’s recovery from the COVID-19 downturn with the emphasis on IT and cybersecurity in this year’s budget.
The 50,000 new higher education short courses which include IT subjects is an important part of addressing skill shortages across the Australian economy.
Coupled with this, the announcement of $240m to support female cadetships and apprenticeships in science, technology, engineering and mathematics will go some way to address the under-representation of women in the ICT sector.
Along with the measures announced in last week’s advanced manufacturing and Digital Business plans, the budget lays firm foundations for a tech led recovery.”
“I welcome the Treasurer’s announcement that the government will provide $231m over four years to support economic recovery by employing more women in the workforce. The funding to increase the number of co-funded grants to women-founded start-ups, and to establish the women in STEM industry cadetship program is a fantastic step in the right direction.
As a female tech founder of an emerging RegTech provider of a digital product governance platform, these initiatives are refreshing and will certainly drive growth in our digital economy.
Australia has over 80 emerging RegTech providers supported by the RegTech Association, and if each of them plans to create around ten new jobs in next 12 months, we are well on the way to not only supporting modern manufacturing and the broad range of Australian industries (clean energy, MedTech, IoT, retail) but also to building a global RegTech export sector.
There is a substantial opportunity for high export potential of RegTech right at the time when our country needs it most. Global RegTech spending is predicted to exceed USD $127 billion.
I would however encourage the government to go harder on looking at initiatives to promote commercialisation. In Australia, a gap exists in commercialisation – after R&D when a start-up needs to find product-market fit and scale-up. Australia needs more effective incentives for this ‘cliff’ to ensure commercialisation and that jobs of the future stay in Australia.”
“I highly commend the government’s decision to double the number of Medicare funded psychological services through the Better Access Initiative. We’ve seen a huge spike in mental health related problems since the outbreak of COVID-19, and this is projected to get worse. Better Access funds telehealth mental health consultations, and thus enables equitable access for all Australians.
But there are more challenges than just mental health. I would have liked to have seen a broader approach to the digitalisation of healthcare. The global pandemic has accelerated digital transformation in healthcare. However, the Federal Budget was missing any concrete indication from the government to properly see this through; the digitalisation of our system starts with a long-term pledge to the reimbursement of telehealth items.
Healthcare businesses aren’t going to invest in the necessary training, hardware and infrastructure setup for digital transformation if there is no long-term government commitment.
We all want to live in a country where quality healthcare is accessible to all. However, it’s going to take more support from the government to get there. I’m hopeful that it won’t take us another pandemic to realise this.”
“While the JobMaker Hiring Credit and the $1.2bn investment to support apprenticeships and trainees are strong initiatives to boost employment, neither of these measures holistically address employment with thousands of Australian white collar workers looking for work who could be utilised more effectively now to help further stimulate the economy. The JobMaker Hiring Credit will be paid at a rate too low to seriously help any business pay the wage of a skilled worker, of which there is high demand for amongst small to medium businesses and this ranges from everything from tech engineers, accountants, marketeers, IT and business professionals.
“To get Australians back to work we need to get more creative in how we view people’s skill sets. The JobTrainer package announced earlier this year is a step in the right direction for helping upskill Australians, but we need more investment in the learning and development space for programs to help job seekers transfer their skills into new industries. The job market is down, but the reality is that there’s still a lot of businesses operating. When they are hiring, they need to be able to screen applications for transferable skill set. All this while making the right hires quickly.”
“It is positive to see reinforced support for mental health initiatives, but this focus needs to be on preventative measures that can help support the wellbeing of Australians before it reaches crisis level. While support for organisations like Beyond Blue is necessary, we also need long term investment for mental health in the learning and development space to create initiatives that can be delivered at a workplace level to support the wellbeing and resilience of Australians as an ongoing priority.”
The expanded First Home Loan Deposit Scheme is a fantastic step in the right direction – too many people living in expensive cities have been missing out for for too long. Increasing the caps on the price of homes that can be purchased to as much as $950,000 will go a long way towards helping to kick start the building boom which is absolutely critical to our economy.
However, it is a shame the HomeBuilder scheme was not extended. This would have been a fantastic way to rejuvenate the property market.
“The Federal Budget is rightly looking to stimulate the economy. It is pleasing to see that more funding for medicines is being injected into the Modern Manufacturing plan. Unfortunately, the breakthroughs we need to overcome the current pandemic will, and are coming from, the smaller companies like Aegros.
To date, we have not seen any targeted support for Australian innovation sectors. This plus the cut in innovation company grants has really cut into Australia’s innovation engine. It may well explain the decrease we have seen in Australia’s productivity over the last 10 years.
Despite this, the Government still hasn’t considered reactivating the SME company R&D commercial project grants,. Those grants provided up to 50% funding to cover the cost of bridging the death valley between prototypes and a commercial product. There’s still much to learn for the Australian government, particularly from Israel, whereby this model of funding has been used to have successful companies repay sales grants. The beauty of this approach is the funds have to be spent first before the Government co-funds. Ensuring only worthwhile projects are supported and ensuring the funds are spent and not used to pay down debts.”
“It is comforting and critical that the government has recognised the important need to invest in thIs younger generation. They are both the worst-affected as a group by COVID in the short term. They are also likely to beat a larger cost of the impact of COVID on the economy and employment opportunities for the next 5 to 10 years.
Despite this, the investment in training only pays off if the individual has a good idea of what jobs they are best suited to. And we all know that career counselling from school and beyond is pretty much non-existent.
The more understanding for the kind of role and environment that brings out the best in an 18 or 25-year-old and the deeper self-awareness they have about their strengths, the more ROI both the government and the individual will get from this massive investment. Scaleable career discovery should really be a part of this and the R&D backing in this year’s budget should be used. This technology is here now through AI-led personalised scaleable career coaching. Perfect for the scale of the challenge we face in a world where face-to-face contact is becoming less necessary.”
“While any increase in funding is welcomed for the aged care sector in crisis, it seems the Government’s 2020-21 budget comes without fundamental structural changes.
The government mentioned an increase in-home care packages alone – and when we already have an average of nearly $8,000 per person unspent, and over 100,000 on the waiting list (almost as many as the 136,000 receiving a package), it does feel a bit like putting a bandaid on a shark bite.
Care providers are already overworked and understaffed, and Australia needs to be spending the money more effectively and efficiently. The aged care sector is clearly in crisis. Thus, instead of adding more funding or policies to what we are already doing, we need to stop the bleeding at the source and become preventative rather than reactive. The government should be enabling families to take charge of their own care to relieve the over-stressing and this could be achieved through technology.
The first contact is via general practitioners and the existing healthcare network. We need to make assistive technology MBS approved and put the power back into the hands of the individual, and save on higher cost services that are, simply put, too little too late.”
“It’s encouraging to see $2 billion injection in R&D incentives. The mortgage broking and the mortgage sector overall is rapidly digitising and this program will only help support its disruption and drive efficiency in the mortgage market. However, there’s still no support for software-based R&D activities which is going to drive the next phase of growth for Australia. AI will be the key for driving productivity of Australians and companies like Effi will be investing heavily in R&D to develop right AI solutions and compete at a global level – but this is only possible if companies like Effi can access R&D incentives easily.
On the other hand, tax support for businesses and incentives for hiring are also good, as they are also needed to help businesses sustain growth.”
“The federal government’s move to invest $28.5 million in expanding Australia’s world-leading Consumer Data Right is an excellent move forward that will help Australia move closer towards realising its open banking transition. The Consumer Data Right and Open Banking is an important initiative that serves up plenty of advantages for Australian customers. It will allow fintech entrants to provide new and improved products by offering data-driven insights and more compelling, tailored and personalised offerings for Australians, all of which will drive economic growth and improved customer outcomes.
At Seed Space, we believe that collaboration is a key driver of success and the $9.6 million proposed by the government to expand the Fintech Bridge program is a welcome initiative that builds on the government’s ongoing multilateral fintech expansion initiatives that are all aimed at helping Australian fintechs grow and scale into key offshore markets such as Europe and the UK, as well as learning from international counterparts to ensure our home grown fintechs are at the operating in line with global best practice.
We also strongly believe the $11.4 million for Australian regtech companies to help ease regulatory burdens is an important initiative. The government is also making available $6.9 million in funding for two blockchain pilots to test how the technology could be used to reduce regulatory compliance burden for businesses. These pilots will complement the National Blockchain Roadmap and will allow the development of successful use cases in how blockchain can help reduce frictions and pain points right across industry verticals.”
“The federal government has stepped up to the plate and provided critical funding support that would allow local manufacturers to continue to innovate, particularly in critical export sectors like retail and health and wellness.
The R&D initiatives will be most welcome to Australian emerging companies seeking to grow and realise their export potential. With regards to this, EVE are currently working on new product development with our honey and tea tree and the development of strains of probiotic that work synergistically to maximise the gut health benefit to consumers. R&D assistance from the government in this process would enable innovation by bringing these products to market much quicker and into the hands of everyday Australians.
Support will also be given to manufacturers to upgrade and improve manufacturing equipment to expand production. At EVE, we are firmly focused on identifying new opportunities for scale, and dovetails nicely with our expansion plans for new export markets and the need to increase our manufacturing capacity. It also is a critical step in providing new employment opportunities for Australian businesses in manufacturing.”
“The budget saw the federal government go much further in recognising what is going to be leading the engine room of the Australian economy both now and in the months ahead: small business.
Many SME businesses across Australia have been left ill-equipped to respond to COVID-19 and we must provide these businesses with a clear path for recovery and getting back to operating very quickly. With over 2 million SMBs across the country, accounting for more than 97 per cent of all Australian businesses by employee size, this business segment is the beating heart of this country.
What we would have liked to see more is additional consideration for helping businesses in regional areas, particularly those looking to adjust to operating in a new normal and supporting their digital footprints. The message is clear: if you’re in any business, you’ve got to be investing in digital resilience.”
“I’m happy to see that this year’s budget includes a number of great outcomes for the startup community. In particular, we welcome the $2bn boost for R&D as this is the lifeline of the tech sector and will provide greater certainty for investment and help support the development of novel technologies within Australia.
The investment in the 5G network and infrastructure is another win for us as better internet means improved connectivity for startups with their employees, customers, partners and networks, ultimately speeding up growth capability.
The $9.6M investment for fintechs will enhance support for businesses to expand internationally and encourage foreign investment and job creation in Australia. The investment in blockchain technology will also help support the fintech community through encouraging broader uptake of blockchain by these businesses which can help improve transparency and rescue regulatory compliance costs.
We welcome news of the personal income tax cuts which will be of great support to many founders who are working full time to support their side hustles. Tax relief will lower the cost of living and allow founders longer runways.
Investment in measures to improve STEM gender equity in Australia is another positive outcome for startups as this will see startups have access to larger talent pools and new perspectives which previously impacted startups having ‘male blinkers’.”
Source: Staff Writer at Business Daily Media, October 7 2020
In his book Influence: The Psychology of Persuasion, author Bob Cialdini explains how the contrast principle can unfairly distort our perceptions of quality and value. By comparing a really good thing to something that is just okay, we tend to judge the latter as far worse than it is. It works the other way, too: when presented with a host of bad options, the best of the bunch – the lesser of all the evils – looks disproportionately attractive.
Cialdini gives us myriad examples: Realtors who show you a couple of dingy properties to make the target property look better, and retail salespeople who suggest a really expensive coat to get you to settle for the cheaper belt. The principle also turned a series of bad management decisions into the Watergate incident, if you can believe that.
It doesn’t stop there, however. The contrast principle is a natural and inextricable part of the traditional face-to-face interview.
Janie is bright, exuberant, and chatty. The interview starts strongly. She strides proudly into your office, hand outstretched, smiling warmly. Her clothes are fashionable. Her resume is colourful and well-designed. You like her right away, as does everyone, because she’s a ray of sunshine. She probably plays the harp and makes her own muesli.
The interview goes well. Janie knows what to say, and because she is extraverted, she knows how to deftly circumvent tricky technical questions. There’s a slight concern in the back of your mind that she is not sufficiently experienced, but you figure that her outgoing, can-do attitude will more than make up for that (and you might be right).
Alice is your next appointment. She’s a lot quieter than Janie. She speaks a lot less, too. Her smile is genuine, and she is perfectly well spoken, but Alice is clearly nervous. Her manner is cautious, full of apprehension.
You notice that her resume is excellent. Ticks all the right boxes. She’s a veteran in the field. But there’s something amiss: She’s just not like Janie. As a result, you’re probably not going to call her back for a second interview.
This is one of the most common ways the contrast principle plays out: If the second candidate does not match the energy of the first, if her presence does not illicit the same rise in dopamine, then we are likely to favour the first candidate. Objectivity quickly goes out the window.
There are many suggestions out there for mitigating or removing the contrast principle, but the truth is this: If humans do your face-to-face interviews, you cannot prevent the potential for contrast bias. Even conducting what’s called a ‘blind resume review’ will not help. Yes, you can assess resumes stripped of identifying characteristics, like race or gender, but you cannot account for the fact that the details themselves are easily doctored and falsified. Don’t forget that 78% of people lie.
The bottom line is this: You need a blind, non-human smart interviewer to do your first-round interviewing for you. It’s the only way to be free of biases, compromise hires, and the intractable likeability factor. We can help with that.