Evaluation of the feasibility of artificial intelligence models as patient information advisors for human papillomavirus vaccines
Küçük Resim Yok
Tarih
2025
Dergi Başlığı
Dergi ISSN
Cilt Başlığı
Yayıncı
Assoc Medica Brasileira
Erişim Hakkı
info:eu-repo/semantics/openAccess
Özet
OBJECTIVE: Artificial intelligence chatbots are increasingly used to disseminate health information. The aim of this study was to evaluate the accuracy, reliability, quality, and readabilityof responses generated byfour artificial intelligence chatbots regarding human papillomavirus vaccination. METHODS: Frequently asked questions about human papillomavirus vaccination were identified using a Google search tool, and these questions were posed to the ChatGPT-3.5, Gemini, Copilot artificial intelligence, and ChatGPT-4 models. Responses were assessed for accuracy (five-point Likert scale), reliability (modified DISCERN scale), quality (Global Quality Scale), and readability (Flesch Reading Ease Score). Interobserver agreement was evaluated bythe intraclass correlation coefficient. The results were evaluated at a significance level of p<0.05. SPSS 23.0 package programme was used in the analyses. RESULTS: There were significant differences between chatbots in terms of accuracy (p=0.001), reliability (p<0.001), and quality (p<0.001), but no significant difference in readability (p=0.497). ChatGPT-4 demonstrated the highest accuracy and quality, while Copilot artificial intelligence demonstrated superior reliability. All models produced responses thatwere moderately difficultto read. The intraclass correlation coefficientvalues for inter-rater reliability ranged from 0.034 to 0.512. CONCLUSION: Artificial intelligence chatbots show promising potential for use as patient information counsellors regarding human papillomavirus vaccination. However, improvements in readability and consistent evidence-based content generation are required before widespread clinical application.
Açıklama
Anahtar Kelimeler
Artificial Intelligence, Hpv Vaccine, Patient Education, Chatbots, Health Communication
Kaynak
Revista Da Associacao Medica Brasileira
WoS Q Değeri
Q2
Scopus Q Değeri
Q2
Cilt
71
Sayı
11
