Communication Dans Un Congrès Année : 2024

Reinforcement Learning with Lookahead Information

Résumé

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including transactions, navigation and more. When the environment is known, previous work shows that this lookahead information can drastically increase the collected reward. However, outside of specific applications, existing approaches for interacting with unknown environments are not well-adapted to these observations. In this work, we close this gap and design provably-efficient learning algorithms able to incorporate lookahead information. To achieve this, we perform planning using the empirical distribution of the reward and transition observations, in contrast to vanilla approaches that only rely on estimated expectations. We prove that our algorithms achieve tight regret versus a baseline that also has access to lookahead information - linearly increasing the amount of collected reward compared to agents that cannot handle lookahead information.
Fichier principal
Vignette du fichier
Reinforcement_Learning_with_Lookahead_Information.pdf (681.07 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04894082 , version 1 (17-01-2025)

Licence

Identifiants

Citer

Nadav Merlis. Reinforcement Learning with Lookahead Information. NeurIPS 2024 - 38th Conference on Neural Information Processing Systems, Dec 2024, Vancouver, Canada. ⟨hal-04894082⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More