Jimmy Daza 1, Lucas Soares Bezerra 1, Laura Santamaría 2, Roberto Rueda-Esteban 2, Heike Bantel 3, Marcos Girala 4, Matthias Ebert 5, Florian Van Bömmel 6, Andreas Geier 7, Andres Gomez Aldana 8, Kevin Yau 9, Mario Alvares-da-Silva 10, Markus Peck-Radosavljevic 11, Ezequiel Ridruejo 12, Arndt Weinmann 13, Andreas Teufel 14
Affiliations
- Department of Medicine II, Division of Hepatology, Division of Clinical Bioinformatics, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
- Universidad de Los Andes School of Medicine, Bogotá, Colombia.
- Department of Gastroenterology, Hepatology, Infectious Diseases and Endocrinology, Hannover Medical School, Hannover, Germany.
- Department of Gastroenterology, Hospital de Clínicas, Universidad Nacional de Asunción, Asunción, Paraguay.
- Department of Medicine II, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
- Department of Medicine II, Clinic of Gastroenterology, Hepatology, Infectious Diseases and Pneumology, Leipzig University Medical Center, Leipzig, Germany.
- Department of Internal Medicine II, Division of Hepatology, University Hospital Würzburg, Würzburg, Germany.
- Texas Liver Institute, University of Texas Health Science Center, San Antonio, United States.
- Division of Nephrology, Department of Medicine, University of Toronto, Toronto, Ontario, Canada.
- Department of Gastroenterology, Hospital de Clinicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, Brazil.
- Internal Medicine and Gastroenterology (IMuG), Clinic Klagenfurt am Woerthersee, Klagenfurt, Austria.
- Department of Medicine, Section of Hepatology, Centro de Educación Médica e Investigaciones Clínicas Norberto Quirno „CEMIC“, Buenos Aires, Argentina.
- Department of Internal Medicine I, University Medical Center of the Johannes Gutenberg-University Mainz, Mainz, Germany.
- Department of Medicine II, Division of Hepatology, Division of Clinical Bioinformatics, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany. Electronic address: andreas.teufel@medma.uni-heidelberg.de.
Autoimmune liver diseases (AILDs) are rare and challenging to evaluate, prompting the exploration of chatbots as clinical decision support tools. This study involved ten liver specialists who systematically assessed four chatbots—ChatGPT 3.5, Claude, Microsoft Copilot, and Google Bard—using a 56-question survey focused on AILDs. Claude received the highest rating, followed by ChatGPT, with Microsoft Copilot and Google Bard trailing. Common chatbot deficiencies included general information over specific advice, limited dosing options, inaccuracies for pregnant patients, outdated data, over-reliance on imaging, and inadequate discussion of off-label treatments. The study highlights the potential of chatbots in AILD management but emphasizes the need for improvements in providing specific, accurate, and up-to-date information to enhance their effectiveness as clinical decision-support tools.
PMID: 39147133
DOI: 10.1016/j.aohep.2024.101537