Mathematics Statistics and Probability

Markov Chains and Monte Carlo Methods

Description

This cluster of papers focuses on the application of Bayesian Monte Carlo methods, such as Markov Chain Monte Carlo (MCMC), Approximate Bayesian Computation, and Hamiltonian Monte Carlo, in scientific inference for inverse problems, model selection, and statistical estimation. It also explores adaptive MCMC algorithms and stochastic gradient Langevin dynamics for efficient parameter inference and approximation algorithms.

Keywords

Bayesian Monte Carlo; Markov Chain; Approximate Bayesian Computation; Adaptive MCMC; Hamiltonian Monte Carlo; Stochastic Gradient Langevin Dynamics; Inverse Problems; Model Selection; Statistical Inference; Approximation Algorithms

Most Cited Works

Action Title Date Authors
Particle Markov Chain Monte Carlo Methods 2010-05-20 Christophe Andrieu Arnaud Doucet Roman Holenstein
Introduction to the Numerical Solution of Markov Chains 1995-12-31 William J. Stewart
+
Dirichlet Forms and Symmetric Markov Processes 2010-12-13 Masatoshi Fukushima Yôichi Ôshima Masayoshi Takeda
Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods 2011-03-01 Mark Girolami Ben Calderhead
+
Collective Monte Carlo Updating for Spin Systems 1989-01-23 Ulli Wolff
Simulated Tempering: A New Monte Carlo Scheme 1992-07-15 Enzo Marinari Giorgio Parisi
Monte Carlo Statistical Methods 2000-11-01 Hoon Kim Christian P. Robert George Casella
Nested sampling for general Bayesian computation 2006-12-01 John Skilling
+
Robust Stochastic Approximation Approach to Stochastic Programming 2009-01-01 Arkadi Nemirovski Anatoli Juditsky Guanghui Lan Alexander Shapiro
An Adaptive Metropolis Algorithm 2001-04-01 Heikki Haario Eero Saksman J. Tamminen
+
Critical Exponents in 3.99 Dimensions 1972-01-24 Kenneth G. Wilson Michael E. Fisher
+
The complexity of computing the permanent 1979-01-01 Leslie G. Valiant
+
Statistical Theory of Equations of State and Phase Transitions. II. Lattice Gas and Ising Model 1952-08-01 T. D. Lee Chongming Yang
+
Bayesian Computation Via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods 1993-09-01 A. F. M. Smith Gareth O. Roberts
Weak convergence and optimal scaling of random walk Metropolis algorithms 1997-02-01 Susan A. Gelman Walter R. Gilks Gareth O. Roberts
Optimization flow control. I. Basic algorithm and convergence 1999-01-01 Steven H. Low D.E. Lapsely
+
A Learning Algorithm for Boltzmann Machines* 1985-01-01 David H. Ackley Geoffrey E. Hinton Terrence J. Sejnowski
+
Practical Markov Chain Monte Carlo 1992-11-01 Charles J. Geyer
+
Optimized Monte Carlo data analysis 1989-09-18 Alan M. Ferrenberg Robert H. Swendsen
A well-conditioned estimator for large-dimensional covariance matrices 2003-07-16 Olivier Ledoit Michael Wolf
+
Sequential Monte Carlo Methods for Dynamic Systems 1998-09-01 Jun S. Liu Rong Chen
Some Asymptotic Theory for the Bootstrap 1981-11-01 Peter J. Bickel David A. Freedman
+
DRAM: Efficient adaptive MCMC 2006-10-12 Heikki Haario Marko Laine Antonietta Mira Eero Saksman
+
Gibbs Sampling Methods for Stick-Breaking Priors 2001-03-01 Hemant Ishwaran Lancelot F. James
A Markovian Decision Process 1957-01-01 Richard Bellman
+
Adapted solution of a backward stochastic differential equation 1990-01-01 Étienne Pardoux Shigē Péng
+
Markov Chain Sampling Methods for Dirichlet Process Mixture Models 2000-06-01 Radford M. Neal
General Methods for Monitoring Convergence of Iterative Simulations 1998-12-01 Stephen P. Brooks Andrew Gelman
+
A new algorithm for Monte Carlo simulation of Ising spin systems 1975-01-01 Alfred B. Bortz M. H. Kalos Joel L. Lebowitz
Ensemble samplers with affine invariance 2010-01-31 Jonathan Goodman Jonathan Weare
+
Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review 1996-06-01 Mary Kathryn Cowles Bradley P. Carlin
+
Reversible jump Markov chain Monte Carlo computation and Bayesian model determination 1995-01-01 Peter J. Green
+
Understanding the Metropolis-Hastings Algorithm 1995-11-01 Siddhartha Chib Edward Greenberg
+
The Complexity of Enumeration and Reliability Problems 1979-08-01 Leslie G. Valiant
Random sampling with a reservoir 1985-03-01 Jeffrey Scott Vitter
+
On Gibbs sampling for state space models 1994-01-01 Chris Carter Robert Kohn
+
Partition function of the Eight-Vertex lattice model 1972-03-01 R. J. Baxter
Markov Chains for Exploring Posterior Distributions 1994-12-01 Luke Tierney
+
Monte Carlo sampling methods using Markov chains and their applications 1970-04-01 W. Keith Hastings
Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems 2008-07-09 Tina Toni David Welch Natalja Strelkowa Andreas Ipsen Michael P. H. Stumpf
+
Statistics of the Two-Dimensional Ferromagnet. Part I 1941-08-01 H. A. Kramers Gregory H. Wannier
Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation 2013-01-01 Yoshua Bengio Nicholas Léonard Aaron Courville
+
Maximum matching and a polyhedron with 0,1-vertices 1965-01-01 Jack Edmonds
+
Spatial Point Processes 2011-05-10 Mark Huber
+
Exchangeability and related topics 1985-01-01 David Aldous
MCMC Using Hamiltonian Dynamics 2011-05-10 Radford M. Neal
The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo 2014-01-01 Matthew D. Homan Andrew Gelman
+
Monte Carlo Methods 1964-01-01 J. M. Hammersley D. C. Handscomb
+
Markov Chain Monte Carlo in Practice 1997-08-01 Mauro Gasparini W. R. Gilks Sylvia Richardson D. J. Spiegelhalter
Handbook of Markov Chain Monte Carlo 2011-05-10 Steve Brooks Andrew Gelman Galin L. Jones Xiao‐Li Meng

Most Recent Works

Action Title Date Authors
+
Explicit solutions for some two-step kinetics problems involving reversible isomerization 2025-04-12 Alejandro Pérez Paz
Taste breaking in the minimally doubled Karsten-Wilczek action and its tree-level improvement 2025-04-15 Szabolcs Borsányi Simone Capitani Zoltán Fodor Daniel Godzieba Paolo Parotto R. A. Vig Chik Him Wong
+
Optimal transport on gas networks 2025-04-16 Ariane Fazeny Martin Burger Jan‐Frederik Pietschmann
+
Brief Introduction to Markov Chain Monte Carlo and Its Algorithms 2025-04-17 Qiu‐Yan Liu
+
Computation of First Passage of Markov Additive Processes 2025-04-19 Changli Liu Jungong Xue J. Andrew Zhang
+
Restart Perturbations for Reversible Markov Chains: Trichotomy and Pre‐Cutoff Equivalence 2025-04-21 Daniel Vial Vijay Subramanian
+
Resonances in reflective Hamiltonian Monte Carlo 2025-04-22 Namu Kroupa Gábor Cśanyi Will Handley
+
Malle’s conjecture for fair counting functions 2025-04-22 Peter Koymans Carlo Pagano
+
Multilane bidirectional traffic in a strongly coupled exclusion model with constraint resources 2025-04-22 Apporva Kumar Pandey Ankita Gupta Arvind Kumar Gupta
+
Accounting for contact network uncertainty in epidemic inferences with Approximate Bayesian Computation 2025-04-22 Maxwell H. Wang Jukka‐Pekka Onnela
+
Bayesian Nonparametric Inference in Elliptic PDEs: Convergence Rates and Implementation 2025-04-23 Matteo Giordano
+
Limit Theorems for Transient and Null Recurrent Markov Chains with Drift Proportional to 1/x 2025-04-24
+
Markov Chains with Asymptotically Non-Zero Drift in Cramér Case 2025-04-24
+
Asymptotics for Renewal Measure for Transient Markov Chain via Martingale Approach 2025-04-24
+
Tail Analysis for Positive Recurrent Markov Chains with Drift Going to Zero More Slowly Than 1/x 2025-04-24
+
Tail Analysis for Recurrent Markov Chains with Drift Proportional to 1/x 2025-04-24
+
Limit Theorems for Transient Markov Chains with Drift Decreasing More Slowly Than 1/x 2025-04-24
+
Two problems on Laplacian ratios of trees 2025-04-23 Tingzeng Wu Xiaolei Dong Hong‐Jian Lai
+
Exponential speed up in Monte Carlo sampling through Radial Updates 2025-04-24 Johann Ostmeyer
+
Reversible-jump Markov chain Monte Carlo and Shamos-Hoey algorithms for two-dimensional gravity inversion 2025-04-24 E. Restrepo Juan Carlos Botero Jorge Enrique Tóbon Gómez Gustavo Gámez
+
Boundary statistics for the six‐vertex model with DWBC 2025-04-24 Vadim Gorin Karl Liechty
+
Towards black-box parameter estimation 2025-04-25 Amanda Lenzi Håvard Rue
+
Fast interpolation grids for the Drell–Yan process 2025-04-25 Juan Cruz–Martinez Alexander Huss Christopher Schwan
+
Asymptotics of the Transitional Probabilities of the Semi-Markov Process 2025-04-26 Oksana Yarova
On Fock covariance for product systems and the reduced Hao–Ng isomorphism problem by discrete actions 2025-04-28 Evgenios T. A. Kakariadis Ioannis Apollon Paraskevas
Covering One Point Process with Another 2025-04-29 Frankie Higgs Mathew D. Penrose Xiaochuan Yang
+
Kolmogorov Capacity with Overlap 2025-04-27 Anshuka Rangi Massimo Franceschetti
+
Gradient boosting for generalised additive mixed models 2025-04-29 Lars Knieper Torsten Hothorn Elisabeth Bergherr Colin Griesbach
+
Weak convergence of adaptive Markov chain Monte Carlo 2025-04-30 Austin Brown Jeffrey S. Rosenthal
+
Simulating Sparse Hamiltonians on 2D Lattices 2025-05-01 Harriet Apel Nouédyn Baspin
+
Connected size Ramsey numbers of matchings versus a small path or cycle 2025-04-28 Sha Wang Ruyu Song Yixin Zhang Yanbo Zhang
+
On a class of critical Markov branching processes with non-homogeneous Poisson immigration 2025-04-30 Kosto V. Mitov Nikolay M. Yanev
+
Ergodicity of Inhomogeneous Markov Processes Under General Criteria 2025-05-02 Zhenxin Liu Di Lu
+
Data-Scientific Study of Kronecker Coefficients 2025-05-01 Kyu‐Hwan Lee
+
Misspecification-robust likelihood-free inference in high dimensions 2025-05-03 Owen Thomas Raquel Sá‐Leão Hermı́nia de Lencastre Samuel Kaski Jukka Corander Henri Pesonen
+
<tt>glabcmcmc</tt> : a Python package for ABC-MCMC with local and global moves 2025-05-05 Xuefei Cao Shijia Wang Yongdao Zhou
+
Partition function zeros for the Blume–Capel model on a complete graph 2025-05-01 Yulian Honchar Mariana Krasnytska Bertrand Berche Yurij Holovatch Ralph Kenna
+
A New Condition for Ergodicity of Markov Chains with a General State Space 2025-05-01 A. Y. Golubin
+
Pruning, cut trees, and the reconstruction problem 2025-05-01 Nicolas Broutin Hui He Minmin Wang
+
Geometric foundation of nonequilibrium transport: A Minkowski embedding of Markov dynamics 2025-05-06 David Andrieux
+
On the Nonconvexity of Push-Forward Constraints and Its Consequences in Machine Learning 2025-05-06 Lucas de Lara Mathis Deronzier Alberto González-Sanz Virgile Foy
Sampling from Mixture Distributions Based on Regime-Switching Diffusions 2025-05-06 M. V. Tretyakov
+
Entropy of Axial Products on $$\mathbb {N}^d$$ and Trees 2025-05-07 Jung-Chao Ban Wen-Guei Hu Guan-Yu Lai
+
The Uniform Even Subgraph and Its Connection to Phase Transitions of Graphical Representations of the Ising Model 2025-05-07 Ulrik Thinggaard Hansen Boris Kjær Frederik Ravn Klausen
+
Large-Deviation Analysis for Canonical Gibbs Measures 2025-05-07 Christian Hirsch Martina Petráková
+
Asymptotic Nash Equilibria of Finite-State Ergodic Markovian Mean Field Games 2025-05-09 Asaf Cohen Ethan Zell
+
Unifying Non-Markovian Characterization with an Efficient and Self-Consistent Framework 2025-05-09 Gregory A. L. White Petar Jurcevic C. D. Hill Kavan Modi
Diagrammatic Monte Carlo for Finite Systems at Zero Temperature 2025-05-09 Stefano Brolli C. Barbieri E. Vigezzi
A new criterion for recurrence of Markov chains with an infinitely countable set of states 2025-05-09 Vyacheslav M. Abramov
+
The Extinction Rate of a Branching Random Walk with a Barrier in a Time-Inhomogeneous Random Environment 2025-05-10 You Lv