Published August 26, 2024 | Version v1
Conference paper Open

Optimistic Online Non-stochastic Control via FTRL

  • 1. ROR icon Delft University of Technology

Description

This paper brings the concept of “optimism” to the new and promising framework of online Non-stochastic Control (NSC). Namely, we study how NSC can benefit from a prediction oracle of unknown quality responsible for forecasting future costs. The posed problem is first reduced to an optimistic learning with delayed feedback problem, which is handled through the Optimistic Follow the Regularized Leader (OFTRL) algorithmic family. This reduction enables the design of OptFTRL-C, the first Disturbance Action Controller (DAC) with optimistic policy regret bounds. These new bounds are commensurate with the oracle’s accuracy, ranging from O(1) for perfect predictions to the order-optimal O( √ T) even when all predictions fail. By addressing the challenge of incorporating untrusted predictions into online control, this work contributes to the advancement of the NSC framework and paves the way toward effective and robust learning-based controllers.

Files

2404.03309v2.pdf

Files (1.6 MB)

Name Size Download all
md5:8dacf101f20c74f0fb3f87fc5f4992e2
1.6 MB Preview Download

Additional details

Funding

ORIGAMI – Optimized resource integration and global architecture for mobile infrastructure for 6G 101139270
European Commission