The Evolution of Radiology Image Annotation in the Era of Large Language Models.

TitleThe Evolution of Radiology Image Annotation in the Era of Large Language Models.
Publication TypeJournal Article
Year of Publication2025
AuthorsFlanders AE, Wang X, Wu CC, Kitamura FC, Shih G, Mongan J, Peng Y
JournalRadiol Artif Intell
Volume7
Issue4
Paginatione240631
Date Published2025 Jul
ISSN2638-6100
KeywordsArtificial Intelligence, Data Curation, Humans, Large Language Models, Natural Language Processing, Radiology, Radiology Information Systems
Abstract

Although there are relatively few diverse, high-quality medical imaging datasets on which to train computer vision artificial intelligence models, even fewer datasets contain expertly classified observations that can be repurposed to train or test such models. The traditional annotation process is laborious and time-consuming. Repurposing annotations and consolidating similar types of annotations from disparate sources has never been practical. Until recently, the use of natural language processing to convert a clinical radiology report into labels required custom training of a language model for each use case. Newer technologies such as large language models have made it possible to generate accurate and normalized labels at scale, using only clinical reports and specific prompt engineering. The combination of automatically generated labels extracted and normalized from reports in conjunction with foundational image models provides a means to create labels for model training. This article provides a short history and review of the annotation and labeling process of medical images, from the traditional manual methods to the newest semiautomated methods that provide a more scalable solution for creating useful models more efficiently. Keywords: Feature Detection, Diagnosis, Semi-supervised Learning © RSNA, 2025.

DOI10.1148/ryai.240631
Alternate JournalRadiol Artif Intell
PubMed ID40304582