Machine learning made fair and simple for non-programmers

EasyClassifier: Honest, Reproducible Machine-Learning Classification for Researchers Who Do Not Program

Machine LearningArtificial Intelligence

Summary

Machine learning is used by many researchers who do not write code, but they often make mistakes that give overly optimistic results. The authors created EasyClassifier, a tool that anyone can use without programming, which follows the right steps to avoid these mistakes. EasyClassifier checks its work with solid testing and provides clear reports ready for publication. It was tested on multiple real datasets and showed much smaller errors than common practices. This helps make machine learning results more honest and reproducible for users from various fields.

What this means in practice

  • For medical data analysts: Use EasyClassifier to get reliable machine learning results from clinical datasets without needing coding skills.
  • For social science survey teams: Run classification analyses on survey data with correct validation steps automatically handled, improving result accuracy.

Authors

Ahmad B. A. Hassanat, Ghada A. Altarawneh

Abstract

Machine-learning classification is now used across medicine, the social sciences, economics, education and engineering, very often by researchers who do not program. Two errors recur in such work: preprocessing learned on all rows before cross-validation (data leakage), and reporting the cross-validation score of the classifier that won a comparison (selection bias). Both make published scores optimistic. We present EasyClassifier, an open-source Python package that guides a user from a CSV or Excel file to a finished analysis through a sequence of plain-language, multiple-choice questions, with no code. It makes the correct procedure the default rather than an option: every preprocessing step is learned inside each training fold; the selected classifier receives a separate final score from nested cross-validation (up to 2,000 rows), or an untouched 20% test set; classifiers run with fixed default parameters and fixed random seeds; and every run writes a report with a ready-to-adapt Methods paragraph, the references to cite, and figures prepared for publication. On ten public datasets from seven fields and a random-label control, split in half so that one half served as an untouched external test, the common practice overstated balanced accuracy by 2.9 percentage points on average (up to 9.9 on small data), whereas the score EasyClassifier reports had a mean signed bias of +0.7 points and a mean absolute error of 2.3 points (one-sided Wilcoxon p = 3.2 x 10^{-4}, 30 runs). On random labels it reported 48.8% balanced accuracy against a chance level of 50%. EasyClassifier is available under the MIT license from PyPI (pip install easyclassifier), GitHub, and Zenodo.