Dataset Information

Accuracy of ChatGPT3.5 in answering clinical questions on guidelines for severe acute pancreatitis.

ABSTRACT:

Background

Guidelines must be interpreted comprehensively and correctly to standardize the clinical process. However, this process is challenging and requires interpreters to have a medical background and qualifications. In this study, the accuracy of ChatGPT3.5 in answering clinical questions related to the 2019 guidelines for severe acute pancreatitis was evaluated.

Methods and results

An observational study was conducted using the 2019 guidelines for severe acute pancreatitis. The study compared the accuracy of ChatGPT3.5 in English versus Chinese and found that it was more accurate in English (71%) than in Chinese (59%) (P value: 0.203). Additionally, the study assessed the accuracy of ChatGPT3.5 in answering short-answer questions versus true/false questions and found that it was more accurate in answering short-answer questions (76%) than in answering true/false questions (60%) (P value: 0.405).

Conclusions

For clinicians managing severe acute pancreatitis, ChatGPT3.5 may have potential value. However, it should not be relied upon excessively for clinical decision making.

SUBMITTER: Qiu J

PROVIDER: S-EPMC11318168 | biostudies-literature | 2024 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Accuracy of ChatGPT3.5 in answering clinical questions on guidelines for severe acute pancreatitis.

Qiu Jun J Luo Li L Zhou YouLian Y

BMC gastroenterology 20240812 1

<h4>Background</h4>Guidelines must be interpreted comprehensively and correctly to standardize the clinical process. However, this process is challenging and requires interpreters to have a medical background and qualifications. In this study, the accuracy of ChatGPT3.5 in answering clinical questions related to the 2019 guidelines for severe acute pancreatitis was evaluated.<h4>Methods and results</h4>An observational study was conducted using the 2019 guidelines for severe acute pancreatitis. ...[more]

PMID: 39134952

Similar Datasets

Project description:The currently used diagnostic criteria for acute pancreatitis in Japan are presentation with at least two of the following three manifestations: (1) acute abdominal pain and tenderness in the upper abdomen; (2) elevated levels of pancreatic enzyme in the blood, urine, or ascitic fluid; and (3) abnormal imaging findings in the pancreas associated with acute pancreatitis. When a diagnosis is made on this basis, other pancreatic diseases and acute abdomen can be ruled out. The purpose of this article is to review the conventional criteria and, in particular, the various methods of diagnosis based on pancreatic enzyme values, with the aim of improving the quality of diagnosis of acute pancreatitis and formulating common internationally agreed criteria. The review considers the following recommendations: Better even than the total blood amylase level, the blood lipase level is the best pancreatic enzyme for the diagnosis of acute pancreatitis and its differentiation from other diseases. A pivotal factor in the diagnosis of acute pancreatitis is identifying an increase in pancreatic enzymes in the blood. Ultrasonography (US) is also one of the procedures that should be performed in all patients with suspected acute pancreatitis. Magnetic resonance imaging (MRI) is one of the most important imaging procedures for diagnosing acute pancreatitis and its intraperitoneal complications. Computed tomography (CT) is also one of the most important imaging procedures for diagnosing acute pancreatitis and its intraabdominal complications. CT should be performed when a diagnosis of acute pancreatitis cannot be established on the basis of the clinical findings, results of blood and urine tests, or US, or when the etiology of the pancreatitis is unknown. When acute pancreatitis is suspected, chest and abdominal X-ray examinations should be performed to determine whether any abnormal findings caused by acute pancreatitis are present. Because the etiology of acute pancreatitis can have a crucial influence on both the treatment policy and severity assessment, it should be evaluated promptly and accurately. It is particularly important to differentiate between gallstone-induced acute pancreatitis, which requires treatment of the biliary system, and alcohol-induced acute pancreatitis, which requires a different form of treatment.

Dataset Information

Accuracy of ChatGPT3.5 in answering clinical questions on guidelines for severe acute pancreatitis.

Background

Methods and results

Conclusions

Publications

Accuracy of ChatGPT3.5 in answering clinical questions on guidelines for severe acute pancreatitis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets