Activation steering changes large language model discourse style unexpectedly

When Steering Shifts Discourse: Identifying and Intervening on Discourse-Level Changes due to Activation Steering in LLMs

Computation and LanguageArtificial Intelligence

Summary

Controlling large language models by adjusting their internal activity can change the style of the text they generate in ways people did not intend. The authors found that this method often alters things like how formal the text sounds or how clearly it presents evidence. They designed a way to fix these unintended changes by adding a second adjustment that targets the unwanted effects, keeping the main control effect mostly intact.

What this means in practice

  • For ai application developers: Maintain desired discourse style in language model outputs while applying behavior steering controls for better user experience.
  • For content moderation teams: Control tone and safety in generated content without causing unintended changes in formality or clarity.

Authors

Shivam Adarsh, Hetianyu Huang, Lau Safin, Maria Maistro, Christina Lioma

Abstract

Activation steering is an inference-time technique used to control or modify the behavior, tone, or safety properties of a large language model (LLM) without retraining the model's weights or editing its input prompt, but simply by adding a vector to its residual-stream activations. However, activation steering also changes the generated text in unintended ways, unrelated to intended behavior change, that are not well understood. Prior work has measured these changes only through coarse signals such as perplexity. In this work, we show that steering systematically produces significant changes in discourse dimensions of the generated text, such as its formality, use of evidence, and ambiguity. We present a way of countering this by adding a second, complementary vector that targets the affected discourse dimension. This intervention restores about 78% of the unintended discourse changes while preserving the intended steering behavior in about 93% of the generations.