Evaluation of the feasibility of artificial intelligence models as patient information advisors for human papillomavirus vaccines

dc.contributor.authorKaya, Abdulkadir
dc.contributor.authorKucukdag, Huseyin Nejat
dc.contributor.authorKeyif, Betul
dc.date.accessioned2026-07-01T11:39:32Z
dc.date.available2026-07-01T11:39:32Z
dc.date.issued2025
dc.departmentDüzce Üniversitesi
dc.description.abstractOBJECTIVE: Artificial intelligence chatbots are increasingly used to disseminate health information. The aim of this study was to evaluate the accuracy, reliability, quality, and readabilityof responses generated byfour artificial intelligence chatbots regarding human papillomavirus vaccination. METHODS: Frequently asked questions about human papillomavirus vaccination were identified using a Google search tool, and these questions were posed to the ChatGPT-3.5, Gemini, Copilot artificial intelligence, and ChatGPT-4 models. Responses were assessed for accuracy (five-point Likert scale), reliability (modified DISCERN scale), quality (Global Quality Scale), and readability (Flesch Reading Ease Score). Interobserver agreement was evaluated bythe intraclass correlation coefficient. The results were evaluated at a significance level of p<0.05. SPSS 23.0 package programme was used in the analyses. RESULTS: There were significant differences between chatbots in terms of accuracy (p=0.001), reliability (p<0.001), and quality (p<0.001), but no significant difference in readability (p=0.497). ChatGPT-4 demonstrated the highest accuracy and quality, while Copilot artificial intelligence demonstrated superior reliability. All models produced responses thatwere moderately difficultto read. The intraclass correlation coefficientvalues for inter-rater reliability ranged from 0.034 to 0.512. CONCLUSION: Artificial intelligence chatbots show promising potential for use as patient information counsellors regarding human papillomavirus vaccination. However, improvements in readability and consistent evidence-based content generation are required before widespread clinical application.
dc.identifier.doi10.1590/1806-9282.20250809
dc.identifier.issn0104-4230
dc.identifier.issn1806-9282
dc.identifier.issue11
dc.identifier.orcid0000-0003-1725-1220
dc.identifier.orcid0000-0002-7472-551X
dc.identifier.orcid0000-0003-1803-7701
dc.identifier.pmid41370489
dc.identifier.scopus2-s2.0-105024655986
dc.identifier.scopusqualityQ2
dc.identifier.urihttps://doi.org/10.1590/1806-9282.20250809
dc.identifier.urihttps://hdl.handle.net/20.500.12684/23349
dc.identifier.volume71
dc.identifier.wosWOS:001639190200001
dc.identifier.wosqualityQ2
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakScopus
dc.indekslendigikaynakPubMed
dc.language.isoen
dc.publisherAssoc Medica Brasileira
dc.relation.ispartofRevista Da Associacao Medica Brasileira
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_WOS_20260623
dc.subjectArtificial Intelligence
dc.subjectHpv Vaccine
dc.subjectPatient Education
dc.subjectChatbots
dc.subjectHealth Communication
dc.titleEvaluation of the feasibility of artificial intelligence models as patient information advisors for human papillomavirus vaccines
dc.typeArticle

Dosyalar