The computation of the mean first passage times for Markov chains

Jeffrey J. Hunter

Type: Article

Publication Date: 2018-03-12

Citations: 27

DOI: https://doi.org/10.1016/j.laa.2018.03.010

View Publication

Locations

Linear Algebra and its Applications - View
arXiv (Cornell University) - View - PDF
Tuwhera (Auckland University of Technology) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	An iterative algorithm for computing mean first passage times of Markov chains	2014	Jianhong Xu
+ PDF Chat	Bounding Mean First Passage Times in Population Continuous-Time Markov Chains	2020	Michael Backenköhler Luca Bortolussi Verena Wolf
+ PDF Chat	The First-Passage Moments and the Invariant Measure of a Markov Chain	1960	John Lamperti
+	A characterization of first passage time distributions for random walks	1991	Lennart Bondesson
+	Entropy and divergence rates for Markov chains	2015	Vlad Ștefan Barbu Alex Karagrigoriou
+	Entropy and divergence rates for Markov chains	2016	Vlad Ștefan Barbu Alex Karagrigoriou
+ PDF Chat	Efficient Computation of First Passage Times in Kou’s Jump-diffusion Model	2017	Abdel Belkaid Frederic Utzet
+	The Long Run Behavior of Markov Chains	1994	Howard M. Taylor Samuel Karlin
+ PDF Chat	First Passage Times of a Generalized Random Walk	1961	John R. Kinney
+	Stochastic dynamics and passage times for diffusion approximations	2008	P. R. Vittal T. Jagadesan V. Muralidhar
+	Mean and variance of first passage time in Markov chains with unknown parameters	2019	Carlos Hernández-Suárez
+	First-passage times in a critical stochastic model	1992	P.‐M. Binder
+	The Diffusion Approximation for Markov Processes	1982	N. G. van Kappen
+	Expected first passage time of a distant point for countable Markov chains	2013	А. А. Лыков
+	First-passage times and related moments for continuous-time birth–death chains	2018	Virginia Giorno A. G. Nobile
+	Appendix A. Calculation of the Markov chain dispersion process.	2016	Merel B. Soons Gerrit W. Heil Ran Nathan Gabriel G. Katul
+ PDF Chat	Translated Poisson Approximation for Markov Chains	2006	A. D. Barbour Torgny Lindvall
+	Hitting Times of Rare Events in Markov Chains	2013	O. Benois Cláudio Landim Mustapha Mourragui
+ PDF Chat	Large deviations for Markov chains	2015	Firas Rassoul‐Agha Timo Seppäläinen
+	LARGE DEVIATIONS FOR MARKOV CHAINS	1990	Mu-Fa Chen Yun Gang Lu

Works That Cite This (13)

Action	Title	Year	Authors
+	GTH Algorithm, Censored Markov Chains, and $RG$-Factorization	2021	Yiqiang Q. Zhao
+	Reachable Space Characterization of Markov Decision Processes with Time Variability	2019	Junhong Xu Kai Yin Lantao Liu
+ PDF Chat	Optimal dimensionality reduction of Markov chains using graph transformation	2020	Deepti Kannan Daniel Sharpe Thomas D. Swinburne David J. Wales
+ PDF Chat	Performance and stability of direct methods for computing generalized inverses of the graph Laplacian	2020	Michele Benzi Paraskevi Fika Marilena Mitrouli
+	Linear least square method for the computation of the mean first passage times of ergodic markov chains	2018	Yaming Chen
+ PDF Chat	Slack reactants: A state-space truncation framework to estimate quantitative behavior of the chemical master equation	2020	Jinsu Kim Jason Dark Germán Enciso Suzanne Sindi
+ PDF Chat	Susceptible-Exposed-Infectious Model Using Markov Chains	2024	Faruque Md. Omar M. A. Sohaly H. El-Metwally
+	Disabling External Influence in Social Networks via Edge Recommendation	2017	Victor Amelkin Ambuj K. Singh
+	Reachable Space Characterization of Markov Decision Processes with Time Variability	2019	Junhong Xu Kai Yin Lantao Liu
+ PDF Chat	Graph transformation and shortest paths algorithms for finite Markov chains	2021	Daniel Sharpe David J. Wales

Works Cited by This (16)

Action	Title	Year	Authors
+	Numerical Methods for Structured Markov Chains	2005	Dario A. Bini Guy Latouche Beatrice Meini
+	Means and Variances in Markov Reward Systems	1993	Winfried K. Grassmann
+	Technical Note—A Markov Chain Partitioning Algorithm for Computing Steady State Probabilities	1985	Theodore J. Sheskin
+	Generalized inverses and their application to applied probability problems	1982	Jeffrey J. Hunter
+	Characterizations of generalized inverses associated with Markovian kernels	1988	Jeffrey J. Hunter
+ PDF Chat	On the moments of Markov renewal processes	1969	Jeffrey J. Hunter
+	Generalized inverses of Markovian kernels in terms of properties of the Markov chain	2013	Jeffrey J. Hunter
+	The Role of the Group Generalized Inverse in the Theory of Finite Markov Chains	1975	Carl D. Meyer
+	Comparison of Some Direct Methods for Computing Stationary Distributions of Markov Chains	1984	William J. Harrod Robert J. Plemmons
+	Further Comparisons of Direct Methods for Computing Stationary Distributions of Markov Chains	1987	Daniel P. Heyman