Papers for

natural language system developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

System one models continuously monitor and guide system two reasoning

SOMA: Continuous Monitoring and Intervention for System Two Reasoning with System One Models

Abstract: Reasoning models often run into problems without noticing them, even when symptoms are visible in their own text. In humans, metacognition separates monitoring from control: fast, intuitive signals keep watch while slow, deliberate reasoning unfolds and help decide whether to continue, change course, or stop. System One (S1) decision models, such as Jev, are a natural candidate for this role: they return a calibrated probability for a natural-language question about a text in one fast call, yet they are used only as gates before reasoning. We introduce SOMA (System One Metacognitive Awareness), in which an S1 model continuously monitors a System Two (S2) reasoning model and intervenes when needed. SOMA has three layers: a scenario layer states each objective in natural language with predefined actions, an awareness layer lets S1 judge whether the described behavior appears, and a control layer accumulates these judgments, first reminds S2, and takes over only if the behavior persists. Sharing one S1 model and one controller across tasks, without training, SOMA addresses two different failures on two reasoning models: on overthinking, it cuts reasoning tokens by up to 36\% while improving average accuracy, and on unanswerable questions, it raises abstention from 70.5\% to 87.2\%.

Mon 19 OctArtificial Intelligence
The gist
Sometimes computer reasoning systems think too much or give answers when they shouldn't. The authors created a way for a fast, simple model (system one) to watch a slower, careful model (system two) as it works. This watcher can remind the slower model to stop or adjust if it sees mistakes or thinking going on too long. This method cuts down unnecessary thinking and makes answers more accurate or lets the system wisely say it doesn't know.
Open → 2610.26793v1