AI summaryⓘ
The authors present a classification method that first preprocesses data using a technique called Equiangular Tight Frame (ETF), then applies a tabular model that works across different data types like images, audio, text, and more. They tested this method on 95 datasets and found it generally performs about as well as strong existing approaches that use the same features but runs much faster, sometimes hundreds of times faster. The paper also explains how to use this method in practice, including ways to keep its confidence estimates reliable. The authors note that while it isn’t always the absolute best for every task, it offers a good balance of speed and accuracy, and they provide guidance on when it may not be suitable.
Equiangular Tight Frame (ETF)Tabular Foundation ModelIn-Context LearningFrozen FeaturesClassification PipelineModel CalibrationLightweight TuningConfidence-Gated DeploymentMultimodal DataPost-Hoc Rescaling
Abstract
We present a single classification pipeline that combines an Equiangular Tight Frame (ETF) preprocessing stage with a tabular foundation model for in-context inference, applied identically across modalities once data is mapped to fixed vector representations. We evaluate it on 95 datasets spanning seven signal modalities -- vision, audio, speech, text, molecular, time-series, and tabular. The main methodological contribution is to fix the comparison object: throughout the paper, performance is judged against the strongest lightweight tuned baseline on the same frozen features, while oracle selection, deployed selection, and specialized fine-tuning are reported separately. The pipeline is broadly competitive with strong lightweight tuned baselines on the same frozen features. It does not match the very best specialized models or heavily tuned pipelines on every task, but it stays close, and it runs much faster -- typically 4 to 200 times faster than full backbone fine-tuning, often at comparable quality. We describe how to deploy the pipeline in practice: when to apply ETF preprocessing, how to stop its training without a validation split, how to set up the in-context classifier, and how to calibrate the resulting probabilities. The calibration step is non-cosmetic: TabICL produces well-calibrated probabilities by construction, ETF preprocessing initially disrupts that calibration, and the post-hoc rescaling restores it -- yielding a per-prediction confidence signal that practitioners can use as a trust threshold for confidence-gated deployment. We also report where the pipeline should not be expected to help, and how to identify those cases in advance.