Reinventing the Competency Framework: A Data-Driven Approach for the AI Era

We can’t hide from reality anymore. Talent needs are shifting overnight, and AI is redefining what it means to work. Traditional talent frameworks are no longer fit for purpose. At Sapia.ai, we believe the future of talent strategy lies in a smarter, fairer, and more adaptive way of defining what great looks like. 

Our AI hiring platform is built on the largest proprietary dataset of interview answers globally – we’re a data company at heart, and we’ve seen the power of data-driven people methodology in transforming how organisations hire and retain good talent.  

So, when it came to building a new Competency Framework that could be leveraged globally for hiring for any role at any scale, of course, we used a ground-up, data-led methodology that bridges the gap between organisational psychology and AI.

Why Rethink Competency Frameworks?

Conventional frameworks are typically crafted through expert interviews and focus groups. While valuable, they tend to be subjective, static, and too slow to keep pace with evolving job demands. As roles become more fluid and technology augments or replaces task-based skills, organisations need a new way to understand the human capabilities that genuinely matter for performance.

We wanted to identify enduring, job-agnostic competencies that reflect what drives success in a modern workplace – capabilities like adaptability, resilience, learning agility, and customer orientation.

(Why competencies and not just skills? Read why here.)

Our Approach: Where AI Meets I/O Psychology

Sapia.ai’s methodology is rooted in the science of human behaviour but powered by cutting-edge AI. We asked two core questions:

  1. Can we make competency discovery agile, scalable, and evidence-based?
  2. Can we use AI to automate the process without losing the rigour of traditional psychology?

The answer to both: yes.

We began with a rich dataset of over 37,000 job descriptions across industries and role types. Using large language models (LLMs) and advanced NLP techniques, we extracted over 200,000 behavioural descriptors. These were distilled down through a four-step process:

  1. Behavioural Descriptor Extraction
  2. Clustering and Labeling
  3. Cluster Analysis by I/O Psychologists
  4. Thematic Categorisation and Definition of Competencies

This resulted in a refined list of 25 human-centric competencies, each with clear behavioural indicators and practical relevance across a wide range of roles.

Built to Scale. Built to Adapt.

Our framework is intelligent, but importantly, it’s adaptive. Organisations can apply this methodology to their own job descriptions to discover custom competencies. This bottom-up, role-data-led approach ensures alignment to real work, not just theoretical models.

And because the framework integrates directly with our AI-powered hiring tools, you get a connected system that brings your talent strategy to life. 

Our framework comes to life in the following tools: 

  • Job Analyser – Starting with a job description, it creates a unique competency profile for each role to build tailored structured interviews in seconds.
  • Structured Chat-based Interviews that assess candidates’ responses according to the competency profile for consistent candidate assessment.
  • Talent Insights Reports from every interview with deep reasoning and explainability for fair and objective hiring decisions.
  • Phai Career Coach for internal mobility and employee growth that considers their competency strengths and career aspirations.

The Future of Talent Acquisition & Development is Competency-First

Skills alone cannot predict success. Competencies do. As AI continues transforming how we work, Sapia.ai’s Competency Framework offers a scalable, scientific, and fair foundation for hiring and developing the talent of tomorrow.

Want to see how it works? Download the full framework.


 

About Author

Get started with Sapia.ai today

Hire brilliant with the talent intelligence platform powered by ethical AI
Speak To Our Sales Team