Reddit signals slightly improve email spam detection for rare domains
Reddit Community Signals as a Supplementary Domain-Reputation Feature in Spam Classification: A Conservative Controlled Evaluation
Cryptography and Security
Summary
Spam emails are hard to spot, especially when they come from new or uncommon senders. The authors tested if information from Reddit discussions could help better identify spam by adding clues about how often certain domains appear in the community. They found that including these Reddit-based signals improved spam detection accuracy a little bit for less common domains but didn’t make a big difference overall. The study shows this extra information could be useful but needs more testing before it’s reliable enough to use in real-time spam filtering.
What this means in practice
- •For email security teams: Incorporate Reddit-derived domain signals as an additional feature to potentially improve spam filtering for rare or new email domains.
- •For online community managers: Use community discussion indicators to help identify suspicious domains linked to spam or phishing shared within forums.
Tested on one dataset.
Authors
Fatima Salcedo, Jide Edu
Abstract
Email spam and phishing remain persistent threats, and purely algorithmic classifiers may struggle with unfamiliar senders, evolving message content, and cold-start domains. This study evaluates whether Reddit-derived community signals can serve as a supplementary domain-reputation feature in email spam classification. We use a preprocessed SpamAssassin-derived corpus of 5,582 emails and compare three feature configurations: (1) a baseline using TF-IDF and structural features; (2) a traditional-enhanced configuration adding urgency and action scores; and (3) a Reddit-enhanced configuration adding a binary discussion-presence indicator, a keyword-based Reddit score, and an urgency-Reddit interaction term. We train Logistic Regression, Random Forest, and Support Vector Machine models. In the preliminary single-split evaluation, the Random Forest model with Reddit-enhanced features achieves 97.94% accuracy, a 0.55 percentage-point improvement over the baseline, although the improvement is not statistically significant in the primary test split. Logistic Regression performance declines when additional features are introduced, and the SVM performs poorly and is treated as a negative control. Reddit signals appear most informative for rare domains, but approximately 70% of emails receive no Reddit-derived signal. Because the Reddit data are temporally later than the email corpus, we do not interpret the results as evidence of real-time detection. Instead, the study provides a conservative evaluation of community-derived signals as a supplementary, asynchronous domain-reputation feature and identifies the additional validation required before production deployment, including domain-grouped validation, temporally aligned contemporary data, and adversarial robustness testing.