Forecast augmented policy improves portfolio trading decisions
Foresee to Trade: Forecast-Augmented Policy Optimization for Portfolio Management
Machine Learning
Summary
Investment services need to pick the best trades for different user accounts even when market opportunities look the same. The authors introduce a method that teaches trading policies by combining predictions about future asset returns and comparing different trading decisions along the same market path. Their approach helps improve decision-making by using extra training signals related to both asset prospects and trading outcomes. The method was tested on multiple stock portfolios and consistently achieved higher returns than other techniques. It shows that training with future market information and outcome comparisons leads to better trading policies.
What this means in practice
- •For financial engineers: Design trading algorithms that improve returns by jointly learning from forecasts and actual trade outcomes.
- •For quantitative traders: Develop portfolio management systems that adapt trading strategies using integrated asset forecast supervision.
Authors
Zeyu Liu, Xuanzhi Feng, Haoran Xu, Lai Sing Kwong, Yang Li, Hualei Zhang, Hao Chen, Jie Zhang, Xiaoyi Pang, Song Guo
Abstract
Online investment services must translate asset opportunities into investment outcomes for users' accounts, yet the same market opportunity can warrant different account actions. We study how supervision from future asset opportunities can strengthen account-level trading decisions and propose Forecast-Augmented Relative Policy Optimization (FRPO). FRPO separately supervises asset opportunities and account decisions through a jointly learned representation: a Financial State Head (FSH) learns future relative-return targets to provide asset-level opportunity supervision, while Same-Path Group-Relative Optimization compares trading trajectories under the same market path and initial account to provide account-level relative-outcome supervision. An Adaptive Gate coordinates auxiliary supervision using predictive variance and gradient alignment. FSH is used only during training; inference uses the encoder and policy for trading. Across DJIA30, TOPIX Core30, and three investment-style portfolios, ten-seed evaluations show that FRPO achieves the highest mean cumulative and annualized returns among the compared methods in all five settings. These results support strengthening investment agents' trading decisions through joint supervision from asset opportunities and trading outcomes.