Skip to content. | Skip to navigation

Personal tools
Log in
Sections
You are here: Home Papers Bayesian Reinforcement Learning with Behavioral Feedback

Teakgyu Hong, Jongmin Lee, Kee-Eung Kim, Pedro A. Ortega, and Daniel Lee (2016)

Bayesian Reinforcement Learning with Behavioral Feedback

In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pp. 1571-1577.

In the standard reinforcement learning setting, the agent learns optimal policy solely from state transitions and rewards from the environment. We consider an extended setting where a trainer additionally provides feedback on the actions executed by the agent. This requires appropriately incorporating the feedback, even when the feedback is not necessarily accurate. In this paper, we present a Bayesian approach to this extended reinforcement learning setting. Specifically, we extend Kalman Temporal Difference learning to compute the posterior distribution over Q-values given the state transitions and rewards from the environment as well as the feedback from the trainer. Through experiments on standard reinforcement learning tasks, we show that learning performance can be significantly improved even with inaccurate feedback.