Analyzing the performance of ChatGPT in answering inquiries about cervical cancer

dc.authoridyurtcu, engin/0000-0002-1517-3823
dc.authoridOZVURAL, SEYFETTIN/0000-0002-7085-5982
dc.contributor.authorYurtcu, Engin
dc.contributor.authorOzvural, Seyfettin
dc.contributor.authorKeyif, Betul
dc.date.accessioned2025-10-11T20:48:49Z
dc.date.available2025-10-11T20:48:49Z
dc.date.issued2025
dc.departmentDüzce Üniversitesien_US
dc.description.abstractObjective: To analyze the knowledge of ChatGPT about cervical cancer (CC). Methods: Official websites of professional health institutes, and websites created by patients and charities underwent strict screening. Using CC-related keywords, common inquiries by the public and comments about CC were searched in social media applications with these data, a list of frequently asked questions (FAQs) was prepared. When preparing question about CC, the European Society of Gynecological Oncology (ESGO), European Society for Radiotherapy and Oncology (ESTRO), and European Society of Pathology (ESP) guidelines were used. The answers given by ChatGPT were scored according to the Global Quality Score (GQS). Results: When all ChatGPT answers to FAQs about CC were evaluated with regard to GQS, 68 ChatGPT answers were classified as score 5, and none of ChatGPT answers for FAQs were scored as 2 or 1. Moreover, ChatGPT answered 33 of 53 (62.3%) CC-related questions based on ESGO, ESTRO, and ESP guidelines with completely accurate and satisfactory responses (GQS 5). In addition, eight answers (15.1%), seven answers (13.2%), four answers (7.5%), and one answer (1.9%) were categorized as GQS 4, GQS 3, GQS 2, and GQS 1, respectively. The reproducibility rate of ChatGPT answers about CC-related FAQs and responses about those guideline-based questions was 93.2% and 88.7%, respectively. Conclusion: ChatGPT had an accurate and satisfactory response rate for FAQs about CC with regards to GQS. However, the accuracy and quality of ChatGPT answers significantly decreased for questions based on guidelines.en_US
dc.identifier.doi10.1002/ijgo.15861
dc.identifier.endpage507en_US
dc.identifier.issn0020-7292
dc.identifier.issn1879-3479
dc.identifier.issue2en_US
dc.identifier.pmid39148482en_US
dc.identifier.scopus2-s2.0-85201322515en_US
dc.identifier.scopusqualityQ1en_US
dc.identifier.startpage502en_US
dc.identifier.urihttps://doi.org/10.1002/ijgo.15861
dc.identifier.urihttps://hdl.handle.net/20.500.12684/22123
dc.identifier.volume168en_US
dc.identifier.wosWOS:001292100200001en_US
dc.identifier.wosqualityQ2en_US
dc.indekslendigikaynakWeb of Scienceen_US
dc.indekslendigikaynakScopusen_US
dc.indekslendigikaynakPubMeden_US
dc.language.isoenen_US
dc.publisherWileyen_US
dc.relation.ispartofInternational Journal of Gynecology & Obstetricsen_US
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanıen_US
dc.rightsinfo:eu-repo/semantics/openAccessen_US
dc.snmzKA_WOS_20250911
dc.subjectartificial intelligenceen_US
dc.subjectcervical canceren_US
dc.subjectChatGPTen_US
dc.subjectguidelineen_US
dc.titleAnalyzing the performance of ChatGPT in answering inquiries about cervical canceren_US
dc.typeArticleen_US

Dosyalar