Hybrid reasoning method improves accuracy with shorter steps

Learning When to Think Aloud in Latent Reasoning

Machine Learning

Summary

Some computer programs solve tricky problems by thinking step-by-step out loud, but this can be slow, or by thinking silently inside their minds, which can lose accuracy. The authors created VITAL, a way for programs to decide when to say their thoughts out loud and when to keep them secret. This approach helps the program be more accurate on math problems while not taking too long. They tested VITAL on different AI models and found it works better and faster than other methods that either think all out loud or all quietly.

What this means in practice

  • For ai system engineers: Integrate selective verbalization techniques to improve reasoning accuracy and efficiency in large language model-based applications.
  • For automated tutoring developers: Design smarter math tutoring systems that combine silent computation with explicit reasoning steps for better student explanations.

Authors

Zhehao Zhou, Tongrui Su, Shengyu Zhu, Da Li, Zeyu Liu, Jun Zhu, Xueqi Cheng

Abstract

Latent Chain-of-Thought (CoT) reasoning improves efficiency by shifting intermediate computation into continuous hidden states. However, fully latent methods often struggle on precision-critical tasks such as mathematical reasoning, while existing hybrid approaches retain substantial token-generation overhead. We introduce VITAL, an importance-guided hybrid reasoning framework that selectively verbalizes informative tokens as reasoning anchors while keeping most computation latent. A lightweight gating head dynamically selects between explicit token generation and direct hidden-state feedback. VITAL constructs hybrid trajectories from explicit CoT using token- importance estimation and trains the model through curriculum-based supervised training, followed by reinforcement learning with a reward that balances correctness and conciseness. Experiments show that VITAL consistently out- performs existing fully latent reasoning methods, achieving relative average accuracy gains of 9.6% on GPT-2 and 5.1% on Llama-3.2-1B at comparable reasoning lengths. Compared with hybrid baselines, VITAL achieves higher reasoning accuracy with substantially shorter reasoning trajectories on Qwen3-1.7B.