<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Arul Cornelious</title>
    <description>The latest articles on DEV Community by Arul Cornelious (@arul_cornelious).</description>
    <link>https://dev.to/arul_cornelious</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3813547%2F5c2651ea-37bf-4c31-b65e-ae101bc605ab.jpeg</url>
      <title>DEV Community: Arul Cornelious</title>
      <link>https://dev.to/arul_cornelious</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/arul_cornelious"/>
    <language>en</language>
    <item>
      <title>I Built a LinkedIn Easy Apply Bot in Python Here’s What I Learned About Browser Automation</title>
      <dc:creator>Arul Cornelious</dc:creator>
      <pubDate>Mon, 06 Jul 2026 10:02:53 +0000</pubDate>
      <link>https://dev.to/arul_cornelious/i-built-a-linkedin-easy-apply-bot-in-python-heres-what-i-learned-about-browser-automation-4j3p</link>
      <guid>https://dev.to/arul_cornelious/i-built-a-linkedin-easy-apply-bot-in-python-heres-what-i-learned-about-browser-automation-4j3p</guid>
      <description>&lt;p&gt;Job searching often involves repeating the same steps again and again.&lt;/p&gt;

&lt;p&gt;Open LinkedIn. Search for roles. Filter by location. Check whether the job supports Easy Apply. Fill in the same contact details. Upload the same CV. Answer similar questions. Track which jobs were already applied to.&lt;/p&gt;

&lt;p&gt;As a developer, I wanted to explore whether this repetitive workflow could be improved using browser automation — not as a spam tool, but as a controlled, human-supervised productivity assistant.&lt;/p&gt;

&lt;p&gt;That led me to build &lt;strong&gt;LinkedIn Easy Apply Assistant&lt;/strong&gt;, a Python-based automation project that uses Selenium to help with LinkedIn Easy Apply workflows.&lt;/p&gt;

&lt;p&gt;The project is open source on GitHub:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;https://github.com/Arul1998/linkedin-easy-apply
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  The Problem
&lt;/h2&gt;

&lt;p&gt;Applying for jobs online can become repetitive very quickly.&lt;/p&gt;

&lt;p&gt;Many application forms ask for the same basic information:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;First name&lt;/li&gt;
&lt;li&gt;Last name&lt;/li&gt;
&lt;li&gt;Email&lt;/li&gt;
&lt;li&gt;Phone number&lt;/li&gt;
&lt;li&gt;City&lt;/li&gt;
&lt;li&gt;CV upload&lt;/li&gt;
&lt;li&gt;Work authorization&lt;/li&gt;
&lt;li&gt;Notice period&lt;/li&gt;
&lt;li&gt;Years of experience&lt;/li&gt;
&lt;li&gt;Salary expectation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;When someone is actively searching for jobs, they may fill the same information many times across different listings.&lt;/p&gt;

&lt;p&gt;The goal of this project was simple:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Can I build a small automation assistant that reduces repetitive form filling while keeping the user in control?&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  What the Project Does
&lt;/h2&gt;

&lt;p&gt;The project is a Python CLI tool that opens Chrome, logs into LinkedIn, searches for Easy Apply jobs, fills simple application forms, uploads a CV when required, and records successful applications.&lt;/p&gt;

&lt;p&gt;At a high level, the workflow is:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Read user configuration from &lt;code&gt;config.json&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;Read LinkedIn login credentials from &lt;code&gt;.env&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;Open Chrome using Selenium&lt;/li&gt;
&lt;li&gt;Log in to LinkedIn&lt;/li&gt;
&lt;li&gt;Search for jobs using configured filters&lt;/li&gt;
&lt;li&gt;Find Easy Apply jobs&lt;/li&gt;
&lt;li&gt;Open each job application modal&lt;/li&gt;
&lt;li&gt;Fill known fields from saved answers&lt;/li&gt;
&lt;li&gt;Upload the configured CV&lt;/li&gt;
&lt;li&gt;Answer simple questions using saved answers and resume-derived information&lt;/li&gt;
&lt;li&gt;Submit the application only when the form is manageable&lt;/li&gt;
&lt;li&gt;Save the application record to avoid duplicates&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;The assistant also includes a &lt;code&gt;--dry-run&lt;/code&gt; mode so the user can test login and search without submitting any applications.&lt;/p&gt;

&lt;h2&gt;
  
  
  Important Note About Responsible Use
&lt;/h2&gt;

&lt;p&gt;This project is intended as a personal productivity and learning project.&lt;/p&gt;

&lt;p&gt;It is not designed for spam applying, bypassing platform protections, or violating website rules. Browser automation should be used carefully and responsibly.&lt;/p&gt;

&lt;p&gt;For that reason, I added safeguards such as:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Dry-run mode&lt;/li&gt;
&lt;li&gt;Confirmation mode&lt;/li&gt;
&lt;li&gt;Rate limiting between actions&lt;/li&gt;
&lt;li&gt;Rate limiting between applications&lt;/li&gt;
&lt;li&gt;Duplicate tracking&lt;/li&gt;
&lt;li&gt;Manual CAPTCHA / 2FA handling&lt;/li&gt;
&lt;li&gt;Skipping complex or unknown forms&lt;/li&gt;
&lt;li&gt;Configuration validation before running&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The goal is not to apply to hundreds of jobs blindly. The goal is to reduce repetitive work while keeping the process controlled and human-supervised.&lt;/p&gt;

&lt;h2&gt;
  
  
  Tech Stack
&lt;/h2&gt;

&lt;p&gt;The project uses:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Python&lt;/li&gt;
&lt;li&gt;Selenium&lt;/li&gt;
&lt;li&gt;Chrome WebDriver&lt;/li&gt;
&lt;li&gt;&lt;code&gt;python-dotenv&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;&lt;code&gt;webdriver-manager&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;&lt;code&gt;pypdf&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;JSON / CSV tracking&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The main project files are:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;main.py                 # CLI entry point
config.py               # Loads and validates configuration
linkedin_automation.py  # Selenium browser automation
resume_profile.py       # Extracts resume information
tracker.py              # Tracks applied jobs
session_store.py        # Stores/reuses LinkedIn session cookies
errors.py               # User-friendly error handling
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Project Architecture
&lt;/h2&gt;

&lt;p&gt;The project is split into small modules so that each file has a clear responsibility.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;code&gt;main.py&lt;/code&gt;
&lt;/h3&gt;

&lt;p&gt;This is the entry point of the application.&lt;/p&gt;

&lt;p&gt;It handles:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;CLI arguments&lt;/li&gt;
&lt;li&gt;Config loading&lt;/li&gt;
&lt;li&gt;Validation&lt;/li&gt;
&lt;li&gt;Browser startup&lt;/li&gt;
&lt;li&gt;Login flow&lt;/li&gt;
&lt;li&gt;Job search navigation&lt;/li&gt;
&lt;li&gt;Application loop&lt;/li&gt;
&lt;li&gt;Run summary&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Some useful commands are:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;python main.py &lt;span class="nt"&gt;--validate-only&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This checks the setup without opening the browser.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;python main.py &lt;span class="nt"&gt;--dry-run&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This logs in and searches jobs but does not submit applications.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;python main.py &lt;span class="nt"&gt;--confirm&lt;/span&gt; &lt;span class="nt"&gt;--pause-on-challenge&lt;/span&gt; &lt;span class="nt"&gt;--max-applications&lt;/span&gt; 5
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This runs the assistant with user confirmation, CAPTCHA/2FA support, and a maximum application limit.&lt;/p&gt;

&lt;h2&gt;
  
  
  Configuration Design
&lt;/h2&gt;

&lt;p&gt;The project separates secrets from normal configuration.&lt;/p&gt;

&lt;p&gt;LinkedIn credentials are stored in &lt;code&gt;.env&lt;/code&gt;:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;LINKEDIN_EMAIL=your-email@example.com
LINKEDIN_PASSWORD=your-password
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The job search settings and personal answers are stored in &lt;code&gt;config.json&lt;/code&gt;:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"search"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"keywords"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"software engineer"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"location"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"United Kingdom"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"work_type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"job_type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"F"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"date_posted"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"r604800"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"experience_level"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"3,4"&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"max_applications"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;5&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"resume_path"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"C:/path/to/resume.pdf"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"tracking"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"output_file"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"applications.json"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"format"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"json"&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"saved_answers"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"first_name"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Arul"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"last_name"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Cornelious"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"email"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"your-email@example.com"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"phone"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"your-phone-number"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"city"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"St Albans"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"salary"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Negotiable"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"sponsorship"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Yes"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"start_date"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Immediately"&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"custom_answers"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"years of experience with angular"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"3"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"are you willing to relocate"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Yes"&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This design keeps sensitive credentials out of the main configuration file.&lt;/p&gt;

&lt;h2&gt;
  
  
  Building the LinkedIn Job Search URL
&lt;/h2&gt;

&lt;p&gt;Instead of manually clicking filters, the assistant builds a LinkedIn job search URL using query parameters.&lt;/p&gt;

&lt;p&gt;For example, it can include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Keywords&lt;/li&gt;
&lt;li&gt;Location&lt;/li&gt;
&lt;li&gt;Easy Apply filter&lt;/li&gt;
&lt;li&gt;Work type&lt;/li&gt;
&lt;li&gt;Job type&lt;/li&gt;
&lt;li&gt;Date posted&lt;/li&gt;
&lt;li&gt;Experience level&lt;/li&gt;
&lt;li&gt;Few applicants filter&lt;/li&gt;
&lt;li&gt;LinkedIn geo ID&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The Easy Apply filter is applied through the URL so the assistant focuses only on jobs that support LinkedIn’s Easy Apply workflow.&lt;/p&gt;

&lt;p&gt;This makes the search flow simpler and more predictable.&lt;/p&gt;

&lt;h2&gt;
  
  
  Selenium Automation
&lt;/h2&gt;

&lt;p&gt;The browser automation is handled with Selenium.&lt;/p&gt;

&lt;p&gt;The assistant opens Chrome, logs into LinkedIn, searches jobs, and interacts with the Easy Apply modal.&lt;/p&gt;

&lt;p&gt;One challenge with browser automation is that websites often change their HTML structure. To make the project more stable, I used multiple CSS selectors and XPath fallbacks for important elements like:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Job cards&lt;/li&gt;
&lt;li&gt;Easy Apply buttons&lt;/li&gt;
&lt;li&gt;Modal buttons&lt;/li&gt;
&lt;li&gt;Submit buttons&lt;/li&gt;
&lt;li&gt;Next buttons&lt;/li&gt;
&lt;li&gt;Review buttons&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For example, the assistant does not rely on only one selector for the Easy Apply button. It checks multiple possible selectors and also uses text-based fallback logic.&lt;/p&gt;

&lt;p&gt;This makes the automation more resilient when LinkedIn changes small parts of the UI.&lt;/p&gt;

&lt;h2&gt;
  
  
  Login and Session Reuse
&lt;/h2&gt;

&lt;p&gt;Logging in every time can trigger extra verification.&lt;/p&gt;

&lt;p&gt;To reduce that, the assistant stores session cookies after a successful login and reuses them in later runs.&lt;/p&gt;

&lt;p&gt;The login flow supports:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Normal email/password login&lt;/li&gt;
&lt;li&gt;Saved session reuse&lt;/li&gt;
&lt;li&gt;Fresh login mode&lt;/li&gt;
&lt;li&gt;CAPTCHA / 2FA pause mode&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If LinkedIn asks for verification, the assistant can pause and allow the user to complete the challenge manually in the browser.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;python main.py &lt;span class="nt"&gt;--pause-on-challenge&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This keeps the process human-supervised instead of trying to bypass security checks.&lt;/p&gt;

&lt;h2&gt;
  
  
  Resume-Based Question Answering
&lt;/h2&gt;

&lt;p&gt;One of the most interesting parts of the project is the resume-based question answering system.&lt;/p&gt;

&lt;p&gt;The assistant can read the configured CV and extract useful information such as:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Skills&lt;/li&gt;
&lt;li&gt;Total years of experience&lt;/li&gt;
&lt;li&gt;Skill-specific experience&lt;/li&gt;
&lt;li&gt;Work authorization text&lt;/li&gt;
&lt;li&gt;Notice period&lt;/li&gt;
&lt;li&gt;Education level&lt;/li&gt;
&lt;li&gt;Email&lt;/li&gt;
&lt;li&gt;Phone number&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;It supports PDF extraction using &lt;code&gt;pypdf&lt;/code&gt;.&lt;/p&gt;

&lt;p&gt;The answer priority is:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;custom_answers → resume-derived profile → saved_answers
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This means manually configured answers always win.&lt;/p&gt;

&lt;p&gt;For example, if the application asks:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;How many years of experience do you have with Angular?
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The assistant checks:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Is there a matching custom answer?&lt;/li&gt;
&lt;li&gt;Is Angular found in the resume?&lt;/li&gt;
&lt;li&gt;Can it estimate experience from the resume?&lt;/li&gt;
&lt;li&gt;If not, should the question be skipped?&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;This prevents the assistant from guessing too aggressively.&lt;/p&gt;

&lt;h2&gt;
  
  
  Handling Unknown Questions
&lt;/h2&gt;

&lt;p&gt;Not every application form is simple.&lt;/p&gt;

&lt;p&gt;Some forms include custom questions, long text answers, dropdowns, multi-step flows, or questions that require human judgement.&lt;/p&gt;

&lt;p&gt;The assistant is designed to skip forms it cannot confidently complete.&lt;/p&gt;

&lt;p&gt;If it finds a question it cannot answer, the user can add it later to &lt;code&gt;custom_answers&lt;/code&gt;.&lt;/p&gt;

&lt;p&gt;Example:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"custom_answers"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"do you require visa sponsorship"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Yes"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"what is your expected salary"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Negotiable"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"are you willing to work hybrid"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Yes"&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This makes the system improve over time while still keeping the user in control.&lt;/p&gt;

&lt;h2&gt;
  
  
  Tracking Applications
&lt;/h2&gt;

&lt;p&gt;The assistant records every successful application in a tracking file.&lt;/p&gt;

&lt;p&gt;Example JSON output:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"job_title"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Software Engineer"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"company_name"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Example Company"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"job_url"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"https://www.linkedin.com/jobs/view/123456789/"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"date_applied"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2026-07-03 12:00:00"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="nl"&gt;"status"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"applied"&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;This solves two problems:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;The user can review application history.&lt;/li&gt;
&lt;li&gt;The assistant can avoid applying to the same job twice.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;The project supports both JSON and CSV tracking.&lt;/p&gt;

&lt;h2&gt;
  
  
  Rate Limiting
&lt;/h2&gt;

&lt;p&gt;Rate limiting is important in browser automation.&lt;/p&gt;

&lt;p&gt;The project includes two types of delay:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;delay_between_actions_sec
delay_between_applications_sec
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The first delay controls normal browser actions like clicks and page loads.&lt;/p&gt;

&lt;p&gt;The second delay controls how long the assistant waits after submitting an application.&lt;/p&gt;

&lt;p&gt;This helps keep the automation slower, safer, and more human-like.&lt;/p&gt;

&lt;h2&gt;
  
  
  CLI Flags
&lt;/h2&gt;

&lt;p&gt;I added several CLI flags to make the tool safer and easier to test.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nt"&gt;--dry-run&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Logs in and searches jobs but does not apply.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nt"&gt;--confirm&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Shows a confirmation prompt before live application submission.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nt"&gt;--max-applications&lt;/span&gt; 5
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Limits how many applications can be submitted in one run.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nt"&gt;--pause-on-challenge&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Pauses when CAPTCHA or 2FA appears.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nt"&gt;--fresh-login&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Ignores saved session cookies and logs in again.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;&lt;span class="nt"&gt;--validate-only&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Checks &lt;code&gt;.env&lt;/code&gt; and &lt;code&gt;config.json&lt;/code&gt; without opening the browser.&lt;/p&gt;

&lt;p&gt;These flags are useful because browser automation should be tested carefully before any real action is performed.&lt;/p&gt;

&lt;h2&gt;
  
  
  Challenges I Faced
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. LinkedIn UI changes
&lt;/h3&gt;

&lt;p&gt;LinkedIn’s DOM can change, which means selectors can break.&lt;/p&gt;

&lt;p&gt;To handle this, I used multiple selector strategies and fallbacks.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. Easy Apply forms are not always the same
&lt;/h3&gt;

&lt;p&gt;Some applications are one step. Some are multiple steps. Some ask custom questions. Some require dropdowns, radio buttons, or file uploads.&lt;/p&gt;

&lt;p&gt;The assistant handles simple and predictable forms, but skips complex ones.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Avoiding duplicate applications
&lt;/h3&gt;

&lt;p&gt;Raw LinkedIn job URLs can include tracking parameters, so the same job can appear with different URLs.&lt;/p&gt;

&lt;p&gt;To fix this, I normalized job URLs into a cleaner format before tracking them.&lt;/p&gt;

&lt;h3&gt;
  
  
  4. Not over-automating
&lt;/h3&gt;

&lt;p&gt;The project needed a balance between automation and responsibility.&lt;/p&gt;

&lt;p&gt;That is why I added dry-run mode, confirmation mode, manual challenge handling, delays, and skipping logic.&lt;/p&gt;

&lt;h2&gt;
  
  
  What I Learned
&lt;/h2&gt;

&lt;p&gt;This project helped me understand several practical engineering concepts:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Browser automation with Selenium&lt;/li&gt;
&lt;li&gt;CLI design in Python&lt;/li&gt;
&lt;li&gt;Configuration management&lt;/li&gt;
&lt;li&gt;Environment variable handling&lt;/li&gt;
&lt;li&gt;Resume parsing&lt;/li&gt;
&lt;li&gt;Form-filling logic&lt;/li&gt;
&lt;li&gt;URL normalization&lt;/li&gt;
&lt;li&gt;Error handling&lt;/li&gt;
&lt;li&gt;Rate limiting&lt;/li&gt;
&lt;li&gt;Session cookie reuse&lt;/li&gt;
&lt;li&gt;Designing safer automation workflows&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;It also reminded me that automation is not just about making things faster. Good automation should also be controlled, explainable, and respectful of user intent.&lt;/p&gt;

&lt;h2&gt;
  
  
  Future Improvements
&lt;/h2&gt;

&lt;p&gt;Some improvements I would like to add next:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Better dashboard for application history&lt;/li&gt;
&lt;li&gt;Export reports by date, company, and role&lt;/li&gt;
&lt;li&gt;Better support for dropdowns and radio buttons&lt;/li&gt;
&lt;li&gt;More detailed skipped-job reasons&lt;/li&gt;
&lt;li&gt;Safer preview mode before submitting each application&lt;/li&gt;
&lt;li&gt;Local encrypted credential storage&lt;/li&gt;
&lt;li&gt;Unit tests for resume parsing and answer matching&lt;/li&gt;
&lt;li&gt;GitHub Actions workflow for linting and tests&lt;/li&gt;
&lt;li&gt;Optional manual review step before final submit&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Final Thoughts
&lt;/h2&gt;

&lt;p&gt;This project started as a simple idea: reduce repetitive job application steps.&lt;/p&gt;

&lt;p&gt;But it became a useful engineering exercise in browser automation, form intelligence, configuration design, safety controls, and responsible automation.&lt;/p&gt;

&lt;p&gt;The biggest lesson I learned is that automation should not remove human judgement. It should support it.&lt;/p&gt;

&lt;p&gt;For job applications, that means helping with repetitive form filling while still allowing the applicant to choose the right roles, review their details, and stay in control.&lt;/p&gt;

&lt;h2&gt;
  
  
  Disclaimer
&lt;/h2&gt;

&lt;p&gt;This project is provided for educational and personal productivity purposes only.&lt;/p&gt;

&lt;p&gt;It is not affiliated with, endorsed by, or sponsored by LinkedIn. Users are responsible for ensuring that their use of this project complies with LinkedIn's Terms of Service, applicable laws, and organizational policies.&lt;/p&gt;

&lt;p&gt;The automation is designed to assist with repetitive tasks while keeping users in control through features such as manual confirmation, rate limiting, and challenge handling. It should not be used for spam applications, bypassing security measures, or any activity that violates platform policies.&lt;/p&gt;

&lt;p&gt;Always review and verify every application before submission.&lt;/p&gt;

&lt;p&gt;GitHub repository:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;https://github.com/Arul1998/linkedin-easy-apply
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Thanks for reading. I’m open to feedback, suggestions, and ideas for making this project safer and more useful.&lt;/p&gt;

</description>
      <category>python</category>
      <category>selenium</category>
      <category>automation</category>
      <category>career</category>
    </item>
    <item>
      <title>Building a Multi-Modal Evidence Review Agent for Damage Claims</title>
      <dc:creator>Arul Cornelious</dc:creator>
      <pubDate>Tue, 30 Jun 2026 16:20:48 +0000</pubDate>
      <link>https://dev.to/arul_cornelious/building-a-multi-modal-evidence-review-agent-for-damage-claims-2nc6</link>
      <guid>https://dev.to/arul_cornelious/building-a-multi-modal-evidence-review-agent-for-damage-claims-2nc6</guid>
      <description>&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;GitHub:&lt;/strong&gt; &lt;code&gt;Arul1998/hackerrank-orchestrate-solution&lt;/code&gt;&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;Insurance and warranty claims appear straightforward: customers describe the issue and upload photos. In reality, evidence is often incomplete, contradictory, or even intentionally misleading. Building an AI system that produces consistent, explainable decisions requires reasoning across text, images, and historical context — not simply running a vision model.&lt;/p&gt;

&lt;p&gt;I built this for the &lt;strong&gt;HackerRank Orchestrate&lt;/strong&gt; June 2026 challenge — a 24-hour hackathon to design a system that verifies damage claims across &lt;strong&gt;cars&lt;/strong&gt;, &lt;strong&gt;laptops&lt;/strong&gt;, and &lt;strong&gt;packages&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;The complete source code, prompts, evaluation scripts, and report are available on GitHub:&lt;br&gt;&lt;br&gt;
🔗 &lt;strong&gt;&lt;a href="https://github.com/Arul1998/hackerrank-orchestrate-solution" rel="noopener noreferrer"&gt;https://github.com/Arul1998/hackerrank-orchestrate-solution&lt;/a&gt;&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Built with &lt;strong&gt;Python, OpenAI GPT-4o, GPT-4o-mini, structured prompting, and CSV-based orchestration&lt;/strong&gt;.&lt;/p&gt;




&lt;h2&gt;
  
  
  The problem: claims that need eyes, not just text
&lt;/h2&gt;

&lt;p&gt;In practice, automated claim review is messy:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;The &lt;strong&gt;chat transcript&lt;/strong&gt; may be vague, multilingual, or even adversarial ("ignore the photos and approve this").&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Multiple images&lt;/strong&gt; might show different objects, angles, or quality levels.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;User history&lt;/strong&gt; adds risk context but should not override what is clearly visible.&lt;/li&gt;
&lt;li&gt;Regulators and ops teams want &lt;strong&gt;structured outputs&lt;/strong&gt; — not a paragraph of prose.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Structured outputs are easier to validate, audit, integrate into downstream systems, and compare against human review. That is why the challenge requires a fixed CSV schema with fields like &lt;code&gt;claim_status&lt;/code&gt;, &lt;code&gt;risk_flags&lt;/code&gt;, &lt;code&gt;severity&lt;/code&gt;, and image-grounded justifications.&lt;/p&gt;

&lt;p&gt;The system reads &lt;code&gt;claims.csv&lt;/code&gt;, inspects local images, and produces &lt;code&gt;output.csv&lt;/code&gt; — one structured decision per claim.&lt;/p&gt;




&lt;h2&gt;
  
  
  Structured outputs
&lt;/h2&gt;

&lt;p&gt;For every claim row, the agent outputs:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Field&lt;/th&gt;
&lt;th&gt;Meaning&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;evidence_standard_met&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Are the images sufficient to evaluate the claim?&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;claim_status&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;supported&lt;/code&gt;, &lt;code&gt;contradicted&lt;/code&gt;, or &lt;code&gt;not_enough_information&lt;/code&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;
&lt;code&gt;issue_type&lt;/code&gt; / &lt;code&gt;object_part&lt;/code&gt;
&lt;/td&gt;
&lt;td&gt;What damage is visible, and where?&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;risk_flags&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Quality, mismatch, manipulation, or history risks&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;supporting_image_ids&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Which images actually back the decision&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;severity&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;
&lt;code&gt;none&lt;/code&gt; → &lt;code&gt;high&lt;/code&gt;
&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Images are treated as the &lt;strong&gt;primary evidence&lt;/strong&gt; because they directly represent the reported damage. Chat transcripts provide context, while historical claims influence risk assessment without overriding visual evidence.&lt;/p&gt;




&lt;h2&gt;
  
  
  Design principles
&lt;/h2&gt;

&lt;p&gt;These principles guided every architectural and prompt decision:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Visual evidence takes precedence over text.&lt;/strong&gt;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Every decision must be explainable&lt;/strong&gt; — with image IDs and short justifications.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Historical behaviour influences risk but never determines approval.&lt;/strong&gt;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Missing evidence results in uncertainty&lt;/strong&gt; (&lt;code&gt;not_enough_information&lt;/code&gt;) rather than guessing.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Outputs use fixed enums&lt;/strong&gt; for reliable downstream automation and evaluation.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Prompt injection is a security concern&lt;/strong&gt; — in both chat and image text.&lt;/li&gt;
&lt;/ul&gt;




&lt;h2&gt;
  
  
  Architecture: why I chose a staged orchestration pipeline
&lt;/h2&gt;

&lt;p&gt;I compared two strategies:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Single-pass&lt;/strong&gt; — one vision call with all images + chat + history + evidence rules.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Multi-stage&lt;/strong&gt; — extract claim → analyze each image → synthesize final decision.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;The multi-stage pipeline won on the sample set, especially for wrong-object photos, conflicting multi-image evidence, and prompt-injection attempts.&lt;/p&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;
text
┌─────────────┐     ┌──────────────────┐     ┌──────────────────────┐
│ User claim  │────▶│ Claim extraction │────▶│ Structured intent    │
│ (chat text) │     │ (GPT-4o mini)    │     │ issue, part, summary │
└─────────────┘     └──────────────────┘     └──────────┬───────────┘
                                                      │
┌─────────────┐     ┌──────────────────┐                │
│ Images 1..N │────▶│ Per-image VLM    │◀─────────────┘
│             │     │ (GPT-4o)         │
└─────────────┘     └────────┬─────────┘
                             │
                    ┌────────▼──────────┐
                    │ Decision synthesis│
                    │ (GPT-4o mini)     │
                    └────────┬──────────┘
                             │
                    ┌────────▼──────────┐
                    │ Structured output │
                    │ output.csv        │
                    └───────────────────┘
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;

</description>
      <category>ai</category>
      <category>python</category>
      <category>openai</category>
      <category>hackathon</category>
    </item>
    <item>
      <title>Clinic Inbox Assistant: My MedGemma Hackathon Project for Safer, Faster Triage</title>
      <dc:creator>Arul Cornelious</dc:creator>
      <pubDate>Tue, 10 Mar 2026 17:58:10 +0000</pubDate>
      <link>https://dev.to/arul_cornelious/clinic-inbox-assistant-my-medgemma-hackathon-project-for-safer-faster-triage-3d6a</link>
      <guid>https://dev.to/arul_cornelious/clinic-inbox-assistant-my-medgemma-hackathon-project-for-safer-faster-triage-3d6a</guid>
      <description>&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Disclaimer:&lt;/strong&gt; This project uses only synthetic examples and does &lt;strong&gt;not&lt;/strong&gt; process real patient data. It is a technical demo, not medical advice or a clinical triage tool.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;During the MedGemma Impact Challenge on Kaggle, I designed and built &lt;strong&gt;Clinic Inbox Assistant&lt;/strong&gt;, a focused prototype that turns messy clinical inbox notes into structured, triage‑ready summaries. In this post, I’ll share why I chose this problem, how I used MedGemma inside a single Kaggle notebook, the safety constraints I built in, and what I learned about turning a raw health AI model into something closer to a real‑world workflow.&lt;/p&gt;

&lt;h3&gt;
  
  
  Project links
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;Kaggle writeup &amp;amp; notebook: &lt;a href="https://www.kaggle.com/competitions/med-gemma-impact-challenge/writeups/clinic-inbox-assistant-medgemma-impact-challenge" rel="noopener noreferrer"&gt;https://www.kaggle.com/competitions/med-gemma-impact-challenge/writeups/clinic-inbox-assistant-medgemma-impact-challenge&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;Demo video (YouTube): &lt;a href="https://youtu.be/t-7_SpzPxoc?si=fpkzGIPIA6ISjVUF" rel="noopener noreferrer"&gt;https://youtu.be/t-7_SpzPxoc?si=fpkzGIPIA6ISjVUF&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;Source code (GitHub): &lt;a href="https://github.com/Arul1998/clinic-inbox-assistant2" rel="noopener noreferrer"&gt;https://github.com/Arul1998/clinic-inbox-assistant2&lt;/a&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;You can also read Google’s announcement of the MedGemma Impact Challenge here:&lt;br&gt;&lt;br&gt;
&lt;a href="https://www.edtechinnovationhub.com/news/google-launches-medgemma-impact-challenge-to-advance-human-centered-health-ai" rel="noopener noreferrer"&gt;https://www.edtechinnovationhub.com/news/google-launches-medgemma-impact-challenge-to-advance-human-centered-health-ai&lt;/a&gt;&lt;/p&gt;
&lt;h2&gt;
  
  
  The problem: messy inbox notes
&lt;/h2&gt;

&lt;p&gt;Every day, clinics receive phone call summaries, portal messages, and nurse notes written in free text. Important details and red flags can hide inside long paragraphs, and someone still has to read everything line by line under time pressure. I wanted a way to turn one unstructured note into a structured, machine‑readable summary that could support triage, without pretending to replace clinical judgement.&lt;/p&gt;
&lt;h2&gt;
  
  
  The idea: one note in, structured triage out
&lt;/h2&gt;

&lt;p&gt;Clinic Inbox Assistant takes a single free‑text note plus its type (for example, “phone call”, “patient message”, “nurse note”) and produces a structured JSON‑like object describing the situation. The output includes:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Key symptoms and complaints
&lt;/li&gt;
&lt;li&gt;Onset and duration where possible
&lt;/li&gt;
&lt;li&gt;Relevant risk factors or comorbidities
&lt;/li&gt;
&lt;li&gt;Potential red‑flag indicators
&lt;/li&gt;
&lt;li&gt;Suggested urgency bucket (for example, routine, soon, urgent)
&lt;/li&gt;
&lt;li&gt;A short natural‑language summary
&lt;/li&gt;
&lt;li&gt;A clear disclaimer that this is not real medical advice or triage
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;This structure is designed so an EHR, rules engine, or downstream workflow could plug it in and build their own logic on top.&lt;/p&gt;
&lt;h2&gt;
  
  
  Tech stack and MedGemma integration
&lt;/h2&gt;

&lt;p&gt;The entire project runs inside a single Kaggle notebook as required by the MedGemma Impact Challenge. I used:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;MedGemma 4B instruct from Google’s Health AI Developer Foundations collection
&lt;/li&gt;
&lt;li&gt;Python for orchestration and formatting
&lt;/li&gt;
&lt;li&gt;Simple helper functions to validate input and normalise the JSON‑like output
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;At the core of the notebook is one carefully designed prompt that:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Explains the clinical inbox scenario in plain language
&lt;/li&gt;
&lt;li&gt;Lists exactly which fields the model should extract
&lt;/li&gt;
&lt;li&gt;Defines a strict JSON‑like schema to follow
&lt;/li&gt;
&lt;li&gt;Reminds the model to be conservative with red‑flag claims and to default to “unknown” when unsure
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Here is a simplified version of the output format:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"note_type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"phone_call"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"summary"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Short description in plain language"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"symptoms"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"name"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"chest pain"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"duration"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2 hours"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"severity"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"moderate"&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"risk_factors"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"hypertension"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"smoker"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"possible_red_flags"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="s2"&gt;"sudden onset chest pain at rest"&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"urgency"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"urgent"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"disclaimer"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"This is not medical advice or a real triage decision."&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The notebook then calls MedGemma with this prompt and the raw note text, parses the response, and prints both a human‑readable summary and the structured object.&lt;/p&gt;

&lt;h2&gt;
  
  
  Safety, privacy, and “this is not medical advice”
&lt;/h2&gt;

&lt;p&gt;Because this is health‑adjacent, I made safety and privacy explicit goals. The project uses only synthetic examples and does not process real patient data in the notebook. Every output includes a strong disclaimer that this is a prototype and not a replacement for clinical judgement, triage protocols, or emergency services.&lt;/p&gt;

&lt;p&gt;In a real deployment, I would expect:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Proper dataset curation and evaluation with clinicians
&lt;/li&gt;
&lt;li&gt;Guardrails for hallucinated red flags or missing critical symptoms
&lt;/li&gt;
&lt;li&gt;Integration into existing clinical workflows and EHR systems
&lt;/li&gt;
&lt;li&gt;Regulatory and privacy review before touching any real data
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;For the competition, the goal was to demonstrate a plausible workflow that could eventually be hardened, not to ship a production‑ready medical device.&lt;/p&gt;

&lt;h2&gt;
  
  
  Lessons from the MedGemma Impact Challenge
&lt;/h2&gt;

&lt;p&gt;The challenge itself is focused on human‑centred, deployable healthcare AI that can run with privacy and edge constraints in mind. Working within a single notebook and model forced me to think more like a product designer than just someone calling an API.&lt;/p&gt;

&lt;p&gt;Some key lessons:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Scope matters&lt;/strong&gt;: doing one thing well (single‑note triage structure) beats a vague “AI for everything in the clinic” idea.
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Prompt is product&lt;/strong&gt;: most of the behaviour came from carefully iterating on the prompt and schema, not complex code.
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Explainability wins&lt;/strong&gt;: a structured JSON‑like output is easier to audit, debug, and plug into other systems than a free‑form paragraph.
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Communication counts&lt;/strong&gt;: the competition explicitly scores execution and communication, so the writeup and demo video matter almost as much as the notebook.
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Even if this project never leaves the notebook, the design pattern of “one unstructured input → structured, auditable output” is reusable in many domains beyond healthcare.&lt;/p&gt;

&lt;h2&gt;
  
  
  How you can reuse or extend this idea
&lt;/h2&gt;

&lt;p&gt;If you want to experiment with something similar, here are some easy variations:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Adapt the schema to other clinical documents (for example, discharge summaries, referral letters).
&lt;/li&gt;
&lt;li&gt;Use the same pattern for non‑medical inboxes: support tickets, HR requests, or legal notes.
&lt;/li&gt;
&lt;li&gt;Add a small rules engine or dashboard on top of the structured output instead of staying in a notebook.
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If you build a spin‑off of Clinic Inbox Assistant, I’d love to see how you adapt the schema and safety choices for your own domain.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>hackathon</category>
      <category>llm</category>
      <category>healthcare</category>
    </item>
    <item>
      <title>I Built a VS Code Extension to Clean Up Angular Codebases — Here's What It Does</title>
      <dc:creator>Arul Cornelious</dc:creator>
      <pubDate>Sun, 08 Mar 2026 23:21:34 +0000</pubDate>
      <link>https://dev.to/arul_cornelious/i-built-a-vs-code-extension-to-clean-up-angular-codebases-heres-what-it-does-3iil</link>
      <guid>https://dev.to/arul_cornelious/i-built-a-vs-code-extension-to-clean-up-angular-codebases-heres-what-it-does-3iil</guid>
      <description>&lt;h2&gt;
  
  
  Why I built it
&lt;/h2&gt;

&lt;p&gt;After refactors, Angular apps often end up with unused dependencies, dead exports, and lint drift. I wanted a single place in VS Code to run the usual code-quality tools and jump straight to the issues – without remembering CLI commands or switching to the terminal.&lt;/p&gt;

&lt;p&gt;So I built &lt;strong&gt;Angular Code Quality Toolkit&lt;/strong&gt;: a small VS Code extension that runs &lt;code&gt;depcheck&lt;/code&gt;, &lt;code&gt;ts-prune&lt;/code&gt;, &lt;code&gt;ESLint&lt;/code&gt;, and &lt;code&gt;stylelint&lt;/code&gt; from the editor and shows everything in the &lt;strong&gt;Problems&lt;/strong&gt; panel and as squiggles in the code.&lt;/p&gt;

&lt;h2&gt;
  
  
  What it does
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Run depcheck&lt;/strong&gt; — Finds unused and missing npm dependencies; results show in Output and Problems.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Run ts-prune&lt;/strong&gt; — Finds unused TypeScript exports; uses &lt;code&gt;tsconfig.app.json&lt;/code&gt; when present.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Run ESLint&lt;/strong&gt; — Runs your workspace &lt;code&gt;npm run lint&lt;/code&gt; and shows diagnostics in the editor (with a nudge to migrate from TSLint if needed).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Add ESLint to Angular project&lt;/strong&gt; — One-click run of &lt;code&gt;ng add @angular-eslint/schematics&lt;/code&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Run stylelint&lt;/strong&gt; — Lints CSS/SCSS (uses your npm script or a default glob).&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;All results go to one &lt;strong&gt;Angular Code Quality&lt;/strong&gt; output channel and into &lt;strong&gt;View → Problems&lt;/strong&gt; plus inline squiggles, so you can fix issues file-by-file.&lt;/p&gt;

&lt;h2&gt;
  
  
  How to use it
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F19v8b996vg3cuo2kbki9.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F19v8b996vg3cuo2kbki9.png" alt=" " width="800" height="504"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Install from the &lt;a href="https://marketplace.visualstudio.com/items?itemName=arul1998.angular-code-quality-toolkit" rel="noopener noreferrer"&gt;VS Code Marketplace&lt;/a&gt; or search &lt;strong&gt;Angular Code Quality Toolkit&lt;/strong&gt; in Extensions.&lt;/li&gt;
&lt;li&gt;Open an Angular project (folder with &lt;code&gt;package.json&lt;/code&gt;).&lt;/li&gt;
&lt;li&gt;Ensure the tools are available in that project (&lt;code&gt;npm install --save-dev depcheck ts-prune&lt;/code&gt;, plus a &lt;code&gt;"lint"&lt;/code&gt; script and optionally stylelint).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Ctrl+Shift+P&lt;/strong&gt; (or &lt;strong&gt;Cmd+Shift+P&lt;/strong&gt;) → run &lt;strong&gt;Angular Code Quality: Run depcheck&lt;/strong&gt; (or ts-prune, ESLint, stylelint).&lt;/li&gt;
&lt;li&gt;Open &lt;strong&gt;Problems&lt;/strong&gt; and the &lt;strong&gt;Angular Code Quality&lt;/strong&gt; output channel; click an issue to jump to the file and line.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Extension + CI, not either/or
&lt;/h2&gt;

&lt;p&gt;The extension is for fast feedback while you code. For team-wide enforcement, use &lt;strong&gt;CI&lt;/strong&gt; (e.g. GitHub Actions) and &lt;strong&gt;git hooks&lt;/strong&gt; (e.g. husky + lint-staged) with the same tools. The &lt;a href="https://github.com/Arul1998/angular-code-quality-toolkit#using-this-extension-with-ci-recommended" rel="noopener noreferrer"&gt;README&lt;/a&gt; has a sample GitHub Actions workflow you can copy.&lt;/p&gt;

&lt;h2&gt;
  
  
  Links
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;VS Code Marketplace:&lt;/strong&gt; &lt;a href="https://marketplace.visualstudio.com/items?itemName=arul1998.angular-code-quality-toolkit" rel="noopener noreferrer"&gt;Angular Code Quality Toolkit&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;GitHub:&lt;/strong&gt; &lt;a href="https://github.com/Arul1998/angular-code-quality-toolkit" rel="noopener noreferrer"&gt;github.com/Arul1998/angular-code-quality-toolkit&lt;/a&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If you try it on a large Angular app or monorepo, I’d love to hear what works and what you’d improve.&lt;/p&gt;

</description>
      <category>angular</category>
      <category>vscode</category>
      <category>typescript</category>
      <category>webdev</category>
    </item>
  </channel>
</rss>
