Submitted by yip4002 on January 1, 2024 - 12:31pm
Title | How Good Is ChatGPT for Medication Evidence Synthesis? |
Publication Type | Journal Article |
Year of Publication | 2023 |
Authors | Liu H, Peng Y, Weng C |
Journal | Stud Health Technol Inform |
Volume | 302 |
Pagination | 1062-1066 |
Date Published | 2023 May 18 |
ISSN | 1879-8365 |
Keywords | Artificial Intelligence, Software |
Abstract | With its seeming competence to mimic human responses, ChatGPT, an emerging AI-powered chatbot, has spurred great interest. This study aims to explore the role of ChatGPT in synthesizing medication literature and compare it with a hybrid summarization system. We tested ten medications' effectiveness with reference to their definitions and descriptions extracted from DrugBank. ChatGPT could generate coherent summaries that are not backed by evidence. In contrast, our approach can provide a highly structured and concise synthesis of related evidence, but the resulting summary is not as fluent and convincing as ChatGPT. Therefore, we recommend integrating both techniques to achieve the best performance. |
DOI | 10.3233/SHTI230347 |
Alternate Journal | Stud Health Technol Inform |
PubMed ID | 37203581 |