Abstract:
OBJECTIVE To explore the application prospect of ChatGPT in medication consultant for digestive diseases, and provide reference for ChatGPT in pharmaceutical care.
METHODS A question database was constructed based on the Standardization Manual of Medication Consultant for Digestive Diseases, and the answers from ChatGPT were evaluated and analyzed by two-person check, and the differences between ChatGPT 3.5 and 4.0 were compared.
RESULTS The correct rate of ChatGPT 3.5 was 35.41%, incomplete rate was 33.3%, and error rate was 31.25%. The correct rate of ChatGPT4 was 77.1%, incomplete rate was 8.3%, and error rate was 14.6%. The accuracy of ChatGPT 4.0 was higher than ChatGPT 3.5. Among the answers of different disease types, the highest correct rate of ChatGPT 3.5 was 62.5% for diarrhea medication consultation and the lowest correct rate was 22.2% for indigestion medication consultation. The highest accuracy of ChatGPT 4.0 was 100% for diarrhea and other medication consultation, and the lowest accuracy was 55.6% for indigestion medication consultation. Among the answers of different questions, the highest correct rate of ChatGPT 3.5 was 66.7% for indication consultant and the lowest correct rate was 13.3% for usage and dosage consultant. The accuracy of ChatGPT 4.0 was 100% for consultant on course of treatment, treatment plan, interaction and precautions, and the accuracy of consultant on adverse reactions was the lowest (62.5%).
CONCLUSION ChatGPT has the potential to be used in medication consultant for digestive diseases. ChatGPT 4.0 is better than 3.5, but its accuracy still needs to be further strengthened. The benefits and risks of applying ChatGPT to other pharmaceutical care work need to be further evaluated.