PromptMRG: Diagnosis-Driven Prompts for Medical Report Generation

Medical report generationに関する論文
第一著者はHaibo JinでHKUSTのグループ．Hao Chen

Abst
With X-ray images, this method generates the medical report automatically.
Medical report generation is more challenging because the sentence is long.

Related works
Medical report generation
Prompt as guidance
プロンプトエンジニアえんジニアリングしたってことですかね？

Proposed method
Self-adaptive disease-balanced learning
Diagnosis is composed in this architecture, such as blank, positive, negative, and uncertain.
This diagnosis is incorporated into the loss function called logit-adjusted loss, which is formulated as:

Experiment, conclusion
MIMIC-CXR MRG dataset with chest X-ray images.
IU X-Ray: Dataset for MRG evaluation

Metrics, BLEU, CE, METEOR

感想
Diagnosisを導入したのはおもろい