DEV Community

Cover image for Multimodal LLMs: five student project ideas beyond 'chat with a PDF'
PRANJUL RATHOUR
PRANJUL RATHOUR

Posted on Originally published at pranjulrathour.scult.in

Multimodal LLMs: five student project ideas beyond 'chat with a PDF'

#multimodal #studentprojects #portfolio #vision

Every third portfolio I review has a PDF chatbot. It is a fine first project and a weak fifth one. Multimodal models — text, images, audio — open up problems that are harder, more interesting and far less crowded. Here are five I would be glad to see from a student, each with the part that will actually be difficult.

1. Lecture-to-notes with slide alignment

Record a lecture, transcribe it live (see real-time speech-to-text architecture), OCR the slides, and align transcript segments to the slide being shown. The hard part is alignment; the payoff is searchable notes with the slide beside every paragraph.

2. Receipt and expense auditor

Photograph receipts, extract fields into a strict schema, validate the arithmetic, and flag anomalies. The hard part is the validation layer, exactly as in document AI for invoices. Evaluate on field-level accuracy, not on "looks right".

3. Accessibility describer for campus notices

Photos of notice boards become structured announcements with dates and venues, read aloud on request. The hard part is handling handwritten and skewed text; the value is real for visually impaired students.

4. Privacy-preserving attendance

Browser-side face detection and embedding with liveness, embeddings-only storage, no photos retained — the FaceVision pattern. The hard part is the threshold and bias measurement across your actual classmates. Document the error rates; that is what makes it a serious project.

5. Voice-first assistant for a regional language

Speech in, retrieval over a small document set, speech out — the shape of Krishi Gyan, the agribot that won Changethon 2025 at IIT Roorkee. The hard part is evaluation in a language you may not have benchmarks for; build a small test set with native speakers.

How to make any of these count

  • Ship a working demo, not a notebook.
  • Publish the evaluation numbers, including failures.
  • Write a two-page README that a recruiter can read in three minutes.

Pick the one whose hard part you find interesting. That is the one you will finish.

About Pranjul Rathour

Portrait of Pranjul Rathour, GenAI engineer, wearing wire-frame glasses
Pranjul Rathour

Pranjul Rathour presenting on stage in a blue polo, with his Annapurna demo video on the screen behind him
Presenting Annapurna on stage

Pranjul Rathour giving a talk titled 'How and what I do', with demo videos of his products Vaidya and Annapurna on screen
Talking through the products he has shipped

Pranjul Rathour in a black t-shirt holding a microphone in front of a chequered wall
On the mic

Pranjul Rathour pitching with a microphone in front of a projector slide at CSJMU, Kanpur
Pitching at CSJMU, Kanpur

Pranjul Rathour is a GenAI engineer from Kanpur, India, and CTO at SCULT INDIA, currently shipping production RAG,
fine-tuning and agentic AI systems, mentoring 200+ students through TechVerse Enclave, and judging and speaking at
student hackathons across India. Updated 2026-09-06.

Reach out if you want to talk GenAI, book a campus session, or invite him to judge:

Pranjul Rathour · GenAI engineer, 3x hackathon winner, campus mentor. Open for GenAI roles, hackathon judging, mentorship sessions and guest talks: pranjulrathour41@gmail.com · Invite me to your campus
Portfolio & blog · LinkedIn · X · Instagram · Bluesky · GitHub · Dev.to

Top comments (0)