Qualitative Analysis of Partially-Observable Markov Decision Processes

Krishnendu Chatterjee, Laurent Doyen, Thomas A. Henzinger

Type: Book-Chapter

Publication Date: 2010-01-01

Citations: 64

DOI: https://doi.org/10.1007/978-3-642-15155-2_24

View Publication

Download PDF

Locations

Lecture notes in computer science - View
arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	PARTIALLY OBSERVABLE MARKOV PROCESSES.	1964	Jan Krämer
+ PDF Chat	Verification of Markov Decision Processes Using Learning Algorithms	2014	Tomǎš Brázdil Krishnendu Chatterjee Martin Chmelík Vojtěch Forejt Jan Křetínský Marta Kwiatkowska David Parker Mateusz Ujma
+	A Partially Observable Markov Decision Process with Lagged Information	1987	Soung Hie Kim Byung Ho Jeong
+	Qualitative MDPs and POMDPs: An Order-Of-Magnitude Approximation	2013	Blai Bonet Judea Pearl
+	Evaluating Hierarchies through A Partially Observable Markov Decision Processes Methodology.	2019	Wěipéng Huáng Guangyuan Piao R. Moreno Neil Hurley
+	Qualitative MDPs and POMDPs: an order-of-magnitude approximation	2002	Blai Bonet Judea Pearl
+ PDF Chat	Continuous-Time Markov Decisions Based on Partial Exploration	2018	Pranav Ashok Yuliya Butkova Holger Hermanns Jan Křetínský
+	A primer on partially observable Markov processes	1982	Joseph A Amram
+ PDF Chat	Optimal Control of Logically Constrained Partially Observable and Multi-Agent Markov Decision Processes	2024	Krishna C. Kalagarla Dhruva Kartik Dong‐Ming Shen Rahul Jain Ashutosh Nayyar Pierluigi Nuzzo
+	Markov Decision Processes	2020	Tor Lattimore Csaba Szepesvári
+	ELIMINATION OF NON-OPTIMAL ACTIONS IN MARKOV DECISION PROCESSES	1978	D. J. White
+ PDF Chat	An evidential Markov decision making model	2018	Zichang He Wen Jiang
+ PDF Chat	Probabilistic Hyperproperties of Markov Decision Processes	2020	Rayna Dimitrova Bernd Finkbeiner Hazem Torfah
+ PDF Chat	Scalable Verification of Markov Decision Processes	2015	Axel Legay Sean Sedwards Louis‐Marie Traonouez
+ PDF Chat	Qualitative Reachability for Open Interval Markov Chains	2018	Jeremy Sproston
+	On a sequential Markovian decision procedure with incomplete information	1976	Sylvain Ehrenfeld
+	Approximating Markov decision processes using expected state transitions	1985	D. J. White
+ PDF Chat	Rethinking formal models of partially observable multiagent decision making	2021	Vojtěch Kovařík Martin Schmid Neil Burch Michael Bowling Viliam Lisý
+ PDF Chat	SOS: Safe, Optimal and Small Strategies for Hybrid Markov Decision Processes	2019	Pranav Ashok Jan Křetínský Kim G. Larsen Adrien Le Coënt Jakob Haahr Taankvist Maximilian Weininger
+	Quantitative model-checking of controlled discrete-time Markov processes	2016	Ilya Tkachev Alexandru Mereacre Joost-Pieter Katoen Alessandro Abate

Works That Cite This (33)

Action	Title	Year	Authors
+	What is Decidable about Partially Observable Markov Decision Processes with {\omega}-Regular Objectives	2013	Krishnendu Chatterjee Martin Chmelík Mathieu Tracol
+	Probabilistic Bisimulation: Naturally on Distributions	2014	Holger Hermanns Jan Krčál Jan Křetínský
+	Model and Objective Separation with Conditional Lower Bounds: Disjunction is Harder than Conjunction	2016	Krishnendu Chatterjee Wolfgang Dvořák Monika Henzinger Veronika Loitzenbauer
+	Reachability analysis of quantum Markov decision processes	2018	Shenggang Ying Mingsheng Ying
+	Reachability Analysis of Quantum Markov Decision Processes	2014	Shenggang Ying Mingsheng Ying
+ PDF Chat	Probabilistic opacity for Markov decision processes	2014	Béatrice Bérard Krishnendu Chatterjee Nathalie Sznajder
+ PDF Chat	Further improvements of determinization methods for fuzzy finite automata	2015	Zorana Jančić Ivana Mičić Jelena Ignjatović Miroslav Ćirić
+	POMDPs under probabilistic semantics	2015	Krishnendu Chatterjee Martin Chmelík
+ PDF Chat	Probabilistic Weighted Automata	2009	Krishnendu Chatterjee Laurent Doyen Thomas A. Henzinger
+ PDF Chat	On Almost-Sure Intention Deception Planning that Exploits Imperfect Observers	2023	Jie Fu

Works Cited by This (5)

Action	Title	Year	Authors
+	Algorithms for Stochastic Parity Games	2005	Krishnendu Chatterjee Thomas A. Henzinger
+ PDF Chat	Qualitative Concurrent Stochastic Games with Imperfect Information	2009	Vincent Gripon Olivier Serre
+ PDF Chat	Algorithms for Omega-Regular Games with Imperfect Information	2007	Krishnendu Chatterjee Laurent Doyen Thomas A. Henzinger Jean-François Raskin
+ PDF Chat	Power of Randomization in Automata on Infinite Strings	2009	Rohit Chadha A. Prasad Sistla Mahesh Viswanathan
+ PDF Chat	Randomness for Free	2010	Krishnendu Chatterjee Laurent Doyen Hugo Gimbert Thomas A. Henzinger