DEV Community

Onyedikachi Onwurah
Onyedikachi Onwurah

Posted on

Building AI to Assess Medication Administration Technique

Medication safety systems often focus on prescription data, dosage calculations, interactions and adverse drug events.

But there is another practical challenge: patients may not administer their medication correctly, even when they understand the instructions.

This creates an opportunity for computer vision and multimodal AI.

  1. Defining the problem

Medication administration can involve several physical steps. Inhalers require device-specific inhalation techniques. Insulin pens involve preparation and injection procedures. Eye drops require appropriate positioning and administration.

An AI system designed for this purpose must understand the expected procedure for the specific device.

It should not treat all medication delivery systems as interchangeable.

  1. Potential technical architecture

A possible system could combine a device-specific knowledge base, a visual assessment model and a clinically constrained feedback component.

The visual model could identify observable actions during a patient's demonstration. A rules-based or validated clinical layer could compare those actions with the expected procedure.

A language model could then translate the identified issues into accessible educational feedback.

The architecture should distinguish observed actions from inferred actions. If the camera cannot establish whether a step was completed correctly, the system should report uncertainty rather than assume success.

  1. Example workflow

A patient demonstrates how they use an inhaler.

The system identifies the device type and retrieves the relevant approved administration guidance.

The visual assessment component examines observable steps and identifies possible deviations.

The feedback component explains the potential issue using accessible language.

Where the assessment is uncertain or a clinically important error is identified, the system recommends pharmacist or clinician review.

  1. Safety and governance

The system must be validated for each relevant device type and intended use.

Patient video data should be protected through appropriate consent, privacy controls and secure processing.

The AI should not independently modify medication doses or recommend a different device. Its function is to support technique education and professional assessment.

  1. Evaluation metrics

Useful evaluation measures include sensitivity and specificity for identifying administration errors, agreement with expert assessments, false reassurance rates, patient usability, improvement in demonstrated technique and successful escalation of uncertain cases.

Researchers should also examine performance across age groups, physical abilities, lighting conditions and different environments.

Conclusion

Medication administration is a practical skill, not simply an information-processing task.

Computer vision and multimodal AI could help identify technique difficulties and make medication education more responsive.

However, clinical validation, accessibility and professional oversight must remain central.

If you are developing computer vision, digital therapeutics or medication safety applications, consider medication administration technique as an important area for healthcare AI innovation.

Top comments (0)