DEV Community

Nesnyx
Nesnyx

Posted on

Building an AI-Powered CV Screening System with Explainable Scoring

Website Demo : https://hireco.intelix.fun/
Github : https://github.com/nesnyx/Hireco-AI

Currently i joined Hackthon and i build this app.

Building an AI Scoring System for Smarter and More Transparent CV Screening

Recruitment can be exhausting โ€” hundreds of CVs come in, and HR teams have to manually scan each one just to find a few strong candidates.
As a developer fascinated by how AI can augment human decision-making, I asked myself:

โ€œCan an AI objectively evaluate CVs based on job criteria โ€” and still explain its reasoning transparently?โ€

That question became the foundation for my latest project:
๐ŸŽฏ AI Scoring CV Screening System โ€” an intelligent engine that can:

Analyze CVs (PDF/Text)

  • Score candidates against custom job criteria
  • Explain the reasoning behind each score
  • Store results in a structured database
  • Allow candidate comparison within the same job posting

System Architecture Overview

The system is designed with modular and scalable components:

  1. Frontend (Reactjs Vite) โ€” user interface for uploading CVs and viewing AI results
  2. Backend (FastAPI) โ€” handles upload, analysis pipeline, and LLM integration
  3. LLM Engine (GeminiAI / Local Model) โ€” interprets CVs contextually based on job descriptions
  4. Vector Database (ChromaDB) โ€” stores semantic embeddings for similarity search and clustering
  5. Relational Database (SQLite / Postgres) โ€” keeps structured analysis results and scoring logs

๐Ÿ” Before sending data to the LLM, an embedding-based pre-filter reduces unnecessary API calls โ€” saving both cost and time.

Top 3 Improvement Priorities:

  1. Add customizable scoring criteria (e.g., weight for skills, experience, presentation).
  2. Enable candidate comparison dashboards per job posting.
  3. Implement bias and fairness monitoring for ethical scoring.

๐Ÿ’ก Lessons Learned

  1. AI is not just about accuracy โ€” itโ€™s about interpretability.
  2. HR users value why a score was given, not just the number.
  3. Efficiency matters.
  4. Embedding pre-filters cut inference costs by up to 70%.
  5. Deployment gotchas teach real lessons.
  6. The infamous attempt to write a readonly database error taught me to handle Docker file permissions carefully.
  7. Human + AI collaboration works best.
  8. The goal isnโ€™t replacing HR โ€” itโ€™s empowering them with better insights.

๐Ÿ› ๏ธ Tech Stack

  • Backend: FastAPI + Celery (for async jobs)
  • AI Engine: LangChain / LLM (Gemini or local model)
  • Databases: SQLite/PostgreSQL + ChromaDB
  • Deployment: Docker Compose

๐ŸŒ Next Steps: Toward an HR-AI Platform

  • The roadmap ahead focuses on scaling and usability:
  • Add criteria templates for HR teams
  • Provide candidate comparison visualization
  • Offer LLM explainability reports for audit transparency
  • Integrate with job portals via API

๐Ÿงฉ Reflection

This project isnโ€™t just about automation โ€” itโ€™s about rethinking how AI can assist decision-making.
An explainable scoring system gives HR teams confidence that AI isnโ€™t a โ€œblack box,โ€ but a partner in fair evaluation.

๐Ÿง  AI should not replace human judgment โ€” it should strengthen it.

๐Ÿ’ฌ Letโ€™s Connect
If youโ€™re working on:

AI explainability
LLM applications in HR or recruitment
Human-AI collaboration design

Top comments (0)