User-Level Depression Detection Using Long-Context Transformers and Behavioral Data

dc.contributor.authorCan, Hakan
dc.contributor.authorYucedag, Ibrahim
dc.date.accessioned2026-07-01T11:39:49Z
dc.date.available2026-07-01T11:39:49Z
dc.date.issued2026
dc.departmentDüzce Üniversitesi
dc.description.abstractDepression poses a major global health challenge, while most computational detection approaches remain constrained by the 512-token input limit of standard Transformer models, restricting their ability to capture longitudinal user behavior. Moreover, aggressive text preprocessing may remove expressive cues that are informative for mental health assessment. This study presents a controlled user-level benchmarking framework for depression detection from social media text, examining the effects of preprocessing strategy, behavioral metadata integration, and context length. A two-stage experimental design is adopted: first, Aggressive Cleaning (AC) and Selective Cleaning (SC) are compared across four 512-token Transformer backbones (BERT, RoBERTa, DistilBERT, and MentalBERT), with and without metadata; second, Longformer and BigBird are evaluated at both 512 and 4096 tokens under the SC setting. The results show that SC provides a more favorable context-preserving preprocessing strategy, while long-context modeling yields the strongest overall gains. The best-performing configuration, Longformer with 4096-token input and behavioral metadata fusion, achieves 90.36% accuracy, 87.15% F1, and 0.9667 AUROC. Additional t-SNE and SHAP analyses indicate that extended context improves the organization of user-level representations, while behavioral metadata provides a complementary rather than dominant contribution, with night posting ratio emerging as one of the most influential features. Overall, the findings show that context-preserving preprocessing and long-context sequence modeling are decisive factors for improving large-scale, text-centered social media-based depression detection.
dc.identifier.doi10.1109/ACCESS.2026.3689467
dc.identifier.endpage73645
dc.identifier.issn2169-3536
dc.identifier.scopus2-s2.0-105037812824
dc.identifier.scopusqualityQ1
dc.identifier.startpage73621
dc.identifier.urihttps://doi.org/10.1109/ACCESS.2026.3689467
dc.identifier.urihttps://hdl.handle.net/20.500.12684/23462
dc.identifier.volume14
dc.identifier.wosWOS:001771131900046
dc.identifier.wosqualityQ2
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakScopus
dc.language.isoen
dc.publisherIeee-Inst Electrical Electronics Engineers Inc
dc.relation.ispartofIeee Access
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.snmzKA_WOS_20260623
dc.subject[Keyword Not Available]
dc.titleUser-Level Depression Detection Using Long-Context Transformers and Behavioral Data
dc.typeArticle

Dosyalar