Papers for

behavioral economists

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Stated-preference economics offers new way to judge language model answers

Validity Without Ground Truth: What Stated-Preference Economics Offers the Evaluation of Language Models

Abstract: Many of the questions now put to large language models have no correct answer to score against: what a policy is worth, which option a user should choose, how to weigh competing values. Stated-preference economics has faced this problem for decades. It judges survey responses without knowing the true value, through a framework of validity and related concepts: content, construct, and criterion validity, reliability, incentive compatibility, and consequentiality. We argue that this framework is a general method for evaluating language models, and we set out what each concept means for LLM evaluation. We demonstrate the approach using a published water-quality stated preference economic valuation survey (Vossler et al. 2023) administered to six models. In this economic application, the validity tests take the form of predictions from economic theory: demand should slope down, and willingness to pay should respond to the scope of the good and to income. The tests separate the models sharply. Two older models fail the most basic test at a household income level of \$75,000, and the two newest pass every test of theoretical validity we can score, but diverge on convergent validity. Passing validity tests shows that a model's answers are coherent, not that they are correct.

Wed 7 OctArtificial IntelligenceComputation and Language
The gist
Many questions asked to language models have no clear right answer, like deciding the best choice or value of something. The authors show how methods from stated-preference economics, which assess people's survey answers without knowing a true answer, can help evaluate language models. They tested six language models using economic theory rules, finding that newer models behave more consistently with theory than older ones. This approach checks if model answers make sense together, but it does not guarantee they are correct.
Open → 2610.10506v1

Behavioral history improves synthetic personas predicting individual choices

Behavioral History Outperforms Descriptions of the Person for LLM Synthetic Personas

Abstract: Large language models (LLMs) are increasingly used as synthetic personas representing survey respondents. Their validity as substitutes for particular respondents depends on whether they reproduce individuals' decisions. We examine what information helps synthetic respondents predict each individual's later choices, using five conditions that add progressively richer information: no personal information, demographics, personality traits, cognitive scores, and finally the respondent's earlier survey choices as behavioral history. We use a two-wave panel of 845 US adults who completed measures of 14 behavioral biases (spanning risk, time preferences, overconfidence, and reasoning), so each respondent's earlier answers provide a human test-retest benchmark; in the behavioral-history condition, all items that score the target bias are withheld. At the population level, the average number of biases per respondent in every condition is close to the human average (7.1-8.1 biases, against 7.1 for humans). This aggregate similarity masks differences in variance: persona descriptions recover only 53-67% of human between-person variation, whereas adding behavioral history restores it to approximately the human level. At the individual level, description-based personas achieve only 7-12% of the informedness observed in human test-retest responses, while adding behavioral history raises this to 28%. The condition including behavioral history has the highest estimated informedness in all 17 demographic groups, whereas description-based conditions provide little or no information for some groups. Synthetic responses also exhibit stronger education- and income-related differences than human responses. For LLM synthetic personas, a respondent's past answers add more to individual-level prediction than a description of who they are.

Fri 2 OctArtificial IntelligenceComputation and LanguageComputers and Society
The gist
Large language models can act like pretend people to guess what real people might do in surveys. The study finds that knowing what a person did before – their behavioral history – helps these models predict that person’s future answers better than just knowing descriptions like demographics or personality. The researchers tested this on 845 US adults with different behavioral biases and found that past actions give much clearer clues about future choices than general personality details. This means models should focus more on past behavior to better represent individuals.
Open → 2610.03998v1

Polynomial-time method tests peak-oriented preference rationality

A Polynomial-Time Test for Peak-Oriented Rationalizability

Abstract: We study the computational complexity of peak-oriented rationalizability, a survey based revealed-preference test introduced by Seror (2026). We provide a polynomial-time algorithm for testing rationalizability and recovering a utility function, establishing that peak-oriented preference elicitation is computationally tractable. In contrast, we show that computing the peak-oriented Houtman-Maks index is NP-hard. These results delineate the precise computational boundaries of peak-oriented revealed-preference analysis.

Thu 24 SeptComputational Complexity
The gist
Understanding how people choose things can be studied by looking at their most preferred options, or peaks. The authors found a way to quickly check if such peak preferences make sense under a certain theory, and to figure out the ratings behind them. However, another measure related to these preferences is much harder to compute. Their work clarifies exactly which parts of this analysis can be done easily and which cannot.
Open → 2609.30042v1

Emotions influence decision chaos in interacting biological networks

Emotions as intrinsic colored noise in biological systems

Abstract: The idea that emotions in biological systems are analogous to intrinsic colored noise is advanced and justified. A model describing the dynamics of operation of biological networks under the influence of colored noise is suggested. The agents of a biological network can be represented either by biological species, such as humans and animals, or by neurons of the brain, or by the nodes of a neural network. Operational actions, or decisions, in a biological noisy network are based not only on the evaluation of utility of alternatives, but also on the agents emotions. The model is probabilistic, with the choice of alternatives characterized by the related probabilities. At the initial step, the agents make decisions individually and then start exchanging information with each other and imitating the actions of other agents, thus forming a biological network of interacting agents. Numerical simulations are accomplished for a heterogeneous society consisting of three groups of agents, one group possessing long-range memory, the other group, short-range memory, and the third group of super-rational agents acting strictly on the basis of utility, being deprived of emotions. Dynamics of opinions in different groups can be smooth, oscillatory, or chaotic. Altogether, eight types of operation are found, depending on the dynamics of group decisions. Under strong imitation effect, there appears chaotic motion in the evolution of decision choice. It is shown how the Ellsberg paradox can be resolved and how the exchange of information influences the dynamics of this paradox.

Tue 22 SeptSocial and Information Networks
The gist
The paper explores how emotions can be thought of as a kind of intrinsic 'colored noise' influencing decisions in living systems, like humans or neurons. It presents a probabilistic model where individuals choose actions based on both utility and emotions and then share information and imitate others, forming a network. This interaction can lead to smooth, oscillating, or chaotic opinion patterns in groups with different memory types or rationality levels. The model also helps explain a famous puzzle about decision-making under uncertainty, known as the Ellsberg paradox.
Open → 2609.25970v1

Large language models show different decision paths despite similar choices

The Internal Anatomy of Strategic Choice in Large Language Models

Abstract: Large language models act as strategic agents and models of human choice, yet choosing like a strategic agent does not mean computing like one. We recorded activations from four open-weight models --- dense and mixture-of-experts, including a matched base--instruct pair --- in one-shot play of 144 strict ordinal $2\times2$ games. We followed a prespecified incentive from prompt, through activations, to choice. Dense models mirrored the unadjusted human decline with game complexity. Incentive and choice were detectable in every model, but models differed in whether incentive reached the choice, aligned with it and, where tested, whether strengthening it shifted preference. The base and instruction-tuned Qwen2.5 models chose almost identically at baseline yet differed in whether incentive reached choice. Fixed decision cues were distinguishable internally but changed choices selectively. Similar behaviour can rest on different computation; post-training can reshape the path from represented incentive to decision while leaving behaviour and decodable information largely intact.

Mon 7 SeptArtificial IntelligenceComputer Science and Game Theory
The gist
Sometimes large language models make decisions like humans do, but how they process information inside their 'brains' can be quite different. The researchers looked at how these models play simple games and found that while the end choices looked alike, the steps inside the models varied. Changing how the models were trained affected how information about incentives moved inside but didn’t always change the final decisions. This means similar behaviors in AI can come from very different internal thinking.
Open → 2609.07478v1