Contextual Markov Decision Processes

Assaf Hallak, Dotan Di Castro, Shie Mannor

Type: Preprint

Publication Date: 2015-01-01

Citations: 78

DOI: https://doi.org/10.48550/arxiv.1502.02259

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Reinforcement Learning with History-Dependent Dynamic Contexts	2023	Guy Tennenholtz Nadav Merlis Lior Shani Martin Mladenov Craig Boutilier
+	Contextual Markov Decision Processes using Generalized Linear Models	2019	Aditya Modi Ambuj Tewari
+	Markov Decision Processes with Continuous Side Information	2017	Aditya Modi Nan Jiang Satinder Singh Ambuj Tewari
+	Markov Decision Processes with Continuous Side Information	2017	Aditya Modi Nan Jiang Satinder Singh Ambuj Tewari
+ PDF Chat	Learning in Constrained Markov Decision Processes	2023	Rahul Singh Abhishek Gupta Ness B. Shroff
+ PDF Chat	Sample Complexity Characterization for Linear Contextual MDPs	2024	Junze Deng Yuan Cheng Shaofeng Zou Yingbin Liang
+	Stochastic Bandits with Context Distributions	2019	Johannes Kirschner Andreas Krause
+	Stochastic Bandits with Context Distributions	2019	Johannes Kirschner Andreas Krause
+	Learning in Markov Decision Processes under Constraints	2020	Rahul Singh Abhishek Gupta Ness B. Shroff
+	No-regret Exploration in Contextual Reinforcement Learning	2019	Aditya Modi Ambuj Tewari
+	No-regret Exploration in Contextual Reinforcement Learning	2019	Aditya Modi Ambuj Tewari
+	Optimism in Face of a Context: Regret Guarantees for Stochastic Contextual MDP	2022	Orin Levy Yishay Mansour
+	Learning in Markov Decision Processes under Constraints.	2020	Rahul Singh Abhishek Gupta Ness B. Shroff
+ PDF Chat	Stochastic Bilevel Optimization with Lower-Level Contextual Markov Decision Processes	2024	Vinzenz Thoma Barna Pásztor Andreas Krause Giorgia Ramponi Yifan Hu
+ PDF Chat	Optimism in Face of a Context:Regret Guarantees for Stochastic Contextual MDP	2023	Orin Levy Yishay Mansour
+ PDF Chat	Learning Adversarial MDPs with Stochastic Hard Constraints	2024	Francesco Emanuele Stradi Matteo Castiglioni Alberto Marchesi Nicola Gatti
+	Corrupted Contextual Bandits with Action Order Constraints.	2020	Alexander Galozy Sławomir Nowaczyk Mattias Ohlsson
+ PDF Chat	Monitored Markov Decision Processes	2024	Simone Parisi Montaser Mohammedalamen Alireza Kazemipour Matthew E. Taylor Michael Bowling
+ PDF Chat	Offline Oracle-Efficient Learning for Contextual MDPs via Layerwise Exploration-Exploitation Tradeoff	2024	Jian Zhong Qian Haichen Hu David Simchi‐Levi
+ PDF Chat	Structural Estimation of Markov Decision Processes in High-Dimensional State Space with Finite-Time Guarantees	2024	Siliang Zeng Mingyi Hong Alfredo García

Works That Cite This (60)

Action	Title	Year	Authors
+	Transfer Reinforcement Learning under Unobserved Contextual Information	2020	Yan Zhang Michael M. Zavlanos
+ PDF Chat	A Survey of Reinforcement Learning Algorithms for Dynamically Varying Environments	2021	Sindhu Padakandla
+	Learning and Planning with a Semantic Model	2018	Yi Wu Yuxin Wu Aviv Tamar Stuart Russell Georgia Gkioxari Yuandong Tian
+	Augmented World Models Facilitate Zero-Shot Dynamics Generalization From a Single Offline Environment	2021	Philip Ball Cong Lu Jack Parker-Holder Stephen Roberts
+	CARL: A Benchmark for Contextual and Adaptive Reinforcement Learning.	2021	Carolin Benjamins Theresa Eimer Frederik Schubert André Biedenkapp Bodo Rosenhahn Frank Hutter Marius Lindauer
+	Offline Meta Learning of Exploration	2020	Ron Dorfman Idan Shenfeld Aviv Tamar
+	RecSim: A Configurable Simulation Platform for Recommender Systems	2019	Eugene Ie Chih‐Wei Hsu Martin Mladenov Vihan Jain Sanmit Narvekar Jing Wang Rui Wu Craig Boutilier
+	TempoRL: Learning When to Act	2021	André Biedenkapp Raghu Rajan Frank Hutter Marius Lindauer
+	Block Contextual MDPs for Continual Learning	2021	Shagun Sodhani Franziska Meier Joëlle Pineau Amy Zhang
+	Heteroscedastic Bandits with Reneging.	2018	Ping-Chun Hsieh Xi Liu Anirban Bhattacharya P. R. Kumar

Works Cited by This (4)

Action	Title	Year	Authors
+ PDF Chat	<i>Mathematical Methods in the Physical Sciences</i>	1967	Mary L. Boas Jacques E. Romain
+ PDF Chat	Robust Markov Decision Processes	2012	Wolfram Wiesemann Daniel Kühn Berç Rüstem
+	Selecting the State-Representation in Reinforcement Learning	2013	Odalric-Ambrym Maillard Daniil Ryabko Rémi Munos
+	Learning Multiple Models via Regularized Weighting	2013	Daniel Vainsencher Shie Mannor Huan Xu