Large language models show persistent personality traits that affect tasks
More Than Just Style: Benchmarking Personality Influence in Large Language Models
Computation and Language
Summary
Large language models (LLMs) don't just follow instructions and prompts—they also have built-in personality-like traits that influence how they respond and solve problems. The authors created a special test called SPACE to measure these personality influences separately from the models' skills and prompts. Their experiments found that even when directed otherwise, LLMs keep their own personality tendencies, which can change how well they do certain tasks. This shows personality plays a real role in how LLMs work and should be considered more carefully.
What this means in practice
- •For ai model developers: Evaluate and separate personality tendencies from capabilities to improve language model design and fine-tuning.
- •For chatbot engineers: Adjust and predict how built-in personality traits in language models influence user interactions and task results.
Authors
Yuhao Liu, Mengyu Wang, Xiao Chen, Lu Liu
Abstract
In addition to the effects of explicit input prompts and instructions, large language model outputs are influenced by underlying behavioral preferences similar to human personality tendencies. These tendencies can affect how models interpret situations and make decisions. However, their influence is difficult to disentangle from the effects of model capabilities and instructions. Therefore, we introduce SPACE, a benchmark framework combining a controlled evaluation protocol with complementary datasets for personality verification, capability assessment, and hierarchical situational tasks. Controlled comparisons across guidance conditions help distinguish personality influence from measured capability changes and immediate instruction effects. Experimental results demonstrate that although prompting can shift generation style, models' internal personality tendencies are persistent and not readily overridden by opposing instructions. Furthermore, these underlying tendencies have an observable influence on LLM task performance, highlighting the need for greater attention to these characteristics and potential applications. Training code and SPACE benchmark specifications are available at https://github.com/Niklauseik/SPACE-training.