The latest articles on DEV Community by Fady Hannah-Shmouni (@fadhsc). https://dev.to/fadhsc https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4208939%2F6a6e4f25-3f60-4da5-8c91-38713eeba1ac.png https://dev.to/fadhsc en Fady Hannah-Shmouni Mon, 26 Oct 2026 14:20:27 +0000 https://dev.to/fadhsc/building-an-ai-tutor-that-is-allowed-to-say-i-dont-know-lessons-from-medical-education-5m3 https://dev.to/fadhsc/building-an-ai-tutor-that-is-allowed-to-say-i-dont-know-lessons-from-medical-education-5m3 <p>In most AI products a confident answer is a feature. In medical education it is a liability. A tutor that invents a dosing threshold or a guideline that does not exist teaches the wrong thing to someone who will act on it.</p> <p>That constraint shaped how we built Perceptors, an applied AI platform for health education. Three design decisions did most of the work.</p> <ol> <li><p>The source package comes first. Every course starts from an institution's approved material: guidelines, protocols, lectures, papers. The system maps each learning outcome to evidence in that package before anything is drafted. A claim with no source is flagged, not written around.</p></li> <li><p>AI drafts, people approve. We split the work into specialist steps (evidence, curriculum, assessment, localization, quality) and put a named human reviewer at each stage gate. The system can move fast because it never publishes on its own. Reviewers edit drafts instead of writing from a blank page, which is where the time savings come from.</p></li> <li><p>The learner guide is grounded and allowed to decline. The tutor answers only from the approved sources of the course, cites them, and declines or escalates questions outside them. Saying "this isn't covered in your course material, ask your faculty" turned out to be one of the most trusted behaviours in the product.</p></li> </ol> <p>What we learned:</p> <ul> <li>Retrieval quality matters more than model choice. Most bad answers trace back to a poorly chunked or outdated source, not the model.</li> <li>Assessment items need rationales. Writing why each distractor is wrong catches more errors than reviewing the correct answer alone.</li> <li>Translation is a governance problem, not only a language one. A translated module goes back through review like any other release.</li> </ul> <p>Perceptors is now used by over 30 academic centres, including programmes in Saudi Arabia and the UAE. If you are building grounded AI for a regulated domain, I'd be glad to compare notes in the comments.</p> <p>Fady Hannah-Shmouni, MD FRCPC, co-founder, Perceptors AI (perceptors.ai)</p> ai edtech healthcare llm