Multiarmed bandit improves lte and wifi network sharing performance

A Multiarmed Bandit Approach for LTE-U/Wi-Fi Coexistence in a Multicell Scenario

Networking and Internet Architecture

Summary

Balancing wireless data traffic between LTE networks and Wi-Fi in shared spaces can be tricky because fixed settings often don’t work well as demand changes. The authors showed before that a learning method could adjust these settings to improve overall speeds. In this paper, they use a simpler learning algorithm called multiarmed bandit to better tune how often LTE uses the shared channel. Their approach keeps data speeds fair between LTE and Wi-Fi users and gives better overall network performance, including much better service for users who usually get the slowest connections.

What this means in practice

  • For network schedulers: Use a multiarmed bandit algorithm to dynamically adjust LTE duty cycling for fair and improved throughput sharing with Wi-Fi in unlicensed bands.
  • For wireless system engineers: Design LTE-U systems that adapt transmission time to varying traffic conditions, ensuring better overall performance and user experience.

Authors

Iago Diógenes do Rego, José M. de Castro Neto, Sildolfo F. G. Neto, Pedro M. de Santana, Vicente A. de Sousa, Dario Vieira, Augusto Venâncio Neto

Abstract

Recent studies and literature reviews have shown promising results for 3GPP system solutions in unlicensed bands when coexisting with Wi-Fi, either by using the duty cycle (DC) approach or licensed-assisted access (LAA). However, it is widely known that general performance in these coexistence scenarios is dependent on traffic and how the duty cycle is adjusted. Most DC solutions configure their parameters statically, which can result in performance losses when the scenario experiences changes on the offered data. In our previous works, we demonstrated that reinforcement learning (RL) techniques can be used to adjust DC parameters. We showed that a Q-learning (QL) solution that adapts the LTE DC ratio to the transmitted data rate can maximize the Wi-Fi/LTE-Unlicensed (LTE-U) aggregated throughput. In this paper, we extend our previous solution by implementing a simpler and more efficient algorithm based on multiarmed bandit (MAB) theory. We evaluate its performance and compare it with the previous one in different traffic scenarios. The results demonstrate that our new solution offers improved balance in throughput, providing similar results for LTE and Wi-Fi, while still showing a substantial system gain. Moreover, in one of the scenarios, our solution outperforms the previous approach by 6% in system throughput. In terms of user throughput, it achieves more than 100% gain for the users at the 10th percentile of performance, while the old solution only achieves a 10% gain.