Performance comparison of optimization methods on variational quantum algorithms

Type: Article

Publication Date: 2023-03-07

Citations: 50

DOI: https://doi.org/10.1103/physreva.107.032407

View Chat PDF

Abstract

Variational quantum algorithms (VQAs) offer a promising path toward using near-term quantum hardware for applications in academic and industrial research. These algorithms aim to find approximate solutions to quantum problems by optimizing a parametrized quantum circuit using a classical optimization algorithm. A successful VQA requires fast and reliable classical optimization algorithms. Understanding and optimizing how off-the-shelf optimization methods perform in this context is important for the future of the field. In this work, we study the performance of four commonly used gradient-free optimization methods: SLSQP, COBYLA, CMA-ES, and SPSA, at finding ground-state energies of a range of small chemistry and material science problems. We test a telescoping sampling scheme (where the accuracy of the cost-function estimate provided to the optimizer is increased as the optimization converges) on all methods, demonstrating mixed results across our range of optimizers and problems chosen. We further hyperparameter tune two of the four optimizers (CMA-ES and SPSA) across a large range of models and demonstrate that with appropriate hyperparameter tuning, CMA-ES is competitive with and sometimes outperforms SPSA (which is not observed in the absence of hyperparameter tuning). Finally, we investigate the ability of an optimizer to beat the `sampling noise floor' given by the sampling noise on each cost-function estimate provided to the optimizer. Our results demonstrate the necessity for tailoring and hyperparameter-tuning known optimization techniques for inherently-noisy variational quantum algorithms and that the variational landscape that one finds in a VQA is highly problem- and system-dependent. This provides guidance for future implementations of these algorithms in the experiment.

Locations

  • Physical review. A/Physical review, A - View
  • arXiv (Cornell University) - View - PDF
  • Leiden Repository (Leiden University) - View - PDF
  • HAL (Le Centre pour la Communication Scientifique Directe) - View - PDF
  • DataCite API - View

Similar Works

Action Title Year Authors
+ PDF Chat Performance comparison of optimization methods on variational quantum algorithms 2021 Xavier Bonet-Monroig
Hao Wang
Diederick Vermetten
Bruno Senjean
Charles Moussa
Thomas BĂ€ck
Vedran Dunjko
Thomas E. O’Brien
+ An Empirical Review of Optimization Techniques for Quantum Variational Circuits 2022 Owen Lockwood
+ The Variational Quantum Eigensolver: A review of methods and best practices 2022 Jules Tilly
Hongxiang Chen
Shuxiang Cao
Dario Picozzi
Kanav Setia
Ying Li
Edward Grant
Leonard Wossnig
Ivan Rungger
George H. Booth
+ PDF Chat Quantum Approximate Optimization Algorithm: Performance, Mechanism, and Implementation on Near-Term Devices 2020 Leo Zhou
Sheng-Tao Wang
Soonwon Choi
Hannes Pichler
Mikhail D. Lukin
+ The Variational Quantum Eigensolver: a review of methods and best practices 2021 Jules Tilly
Hongxiang Chen
Shuxiang Cao
Dario Picozzi
Kanav Setia
Ying Li
Edward R. Grant
Leonard Wossnig
Ivan Rungger
George H. Booth
+ PDF Chat A Novel Noise-Aware Classical Optimizer for Variational Quantum Algorithms 2024 Jeffrey Larson
Matt Menickelly
Jiahao Shi
+ SantaQlaus: A resource-efficient method to leverage quantum shot-noise for optimization of variational quantum algorithms 2023 Kosuke Ito
Keisuke Fujii
+ A Novel Noise-Aware Classical Optimizer for Variational Quantum Algorithms 2024 Jeffrey Larson
Matt Menickelly
Jiahao Shi
+ Enhancing VQE Convergence for Optimization Problems with Problem-specific Parameterized Quantum Circuits 2020 Atsushi Matsuo
Yudai Suzuki
Ikko Hamamura
Shigeru Yamashita
+ PDF Chat Enhancing VQE Convergence for Optimization Problems with Problem-Specific Parameterized Quantum Circuits 2023 Atsushi Matsuo
Yudai Suzuki
Ikko Hamamura
Shigeru Yamashita
+ PDF Chat Using models to improve optimizers for variational quantum algorithms 2020 Kevin J. Sung
Jiahao Yao
Matthew P. Harrigan
Nicholas C. Rubin
Jiang Zhang
Lin Lin
Ryan Babbush
Jarrod R. McClean
+ Variational Benchmarks for Quantum Many-Body Problems 2023 Dian Wu
Riccardo Rossi
Filippo Vicentini
Nikita Astrakhantsev
Federico Becca
Xiaodong Cao
Juan Carrasquilla
Francesco Ferrari
Antoine Georges
Mohamed Hibat-Allah
+ Surrogate-based optimization for variational quantum algorithms 2022 Ryan Shaffer
Lucas Kocia
Mohan Sarovar
+ Variational benchmarks for quantum many-body problems 2024 Dian Wu
Riccardo Rossi
Filippo Vicentini
Nikita Astrakhantsev
Federico Becca
Xiaodong Cao
Juan Carrasquilla
Francesco Ferrari
Antoine Georges
Mohamed Hibat-Allah
+ PDF Chat Benchmarking Optimizers for Qumode State Preparation with Variational Quantum Algorithms 2024 Shuwen Kan
Miguel Palma
Zefan Du
Samuel A. Stein
Chenxu Liu
Juntao Chen
Ang Li
Ying Mao
+ PDF Chat Surrogate-based optimization for variational quantum algorithms 2023 Ryan Shaffer
Lucas Kocia
Mohan Sarovar
+ PDF Chat Benchmarking Variational Quantum Algorithms for Combinatorial Optimization in Practice 2024 Tim SchwÀgerl
Yahui Chai
Tobias Hartung
Karl Jansen
Stefan KĂŒhn
+ Optimizing Variational Quantum Algorithms with qBang: Efficiently Interweaving Metric and Momentum to Tackle Flat Energy Landscapes 2023 David Fitzek
Robert Jonsson
Werner Dobrautz
C. SchÀfer
+ Practical optimization for hybrid quantum-classical algorithms 2017 Gian Giacomo Guerreschi
Mikhail Smelyanskiy
+ PDF Chat Classical Optimizers for Noisy Intermediate-Scale Quantum Devices 2020 W. Lavrijsen
Ana Tudor
Juliane MĂŒller
Costin Iancu
Wibe A. de Jong

Cited by (23)

Action Title Year Authors
+ Solving Non-native Combinatorial Optimization Problems using Hybrid Quantum-classical Algorithms 2024 Jonathan Wurtz
Stefan Sack
Sheng-Tao Wang
+ An Empirical Comparison of Optimizers for Quantum Machine Learning with SPSA-based Gradients 2023 Marco Wiedmann
Marc Hölle
Maniraman Periyasamy
Nico Meyer
Christian Ufrecht
Daniel D. Scherer
Axel Plinge
Christopher Mutschler
+ PDF Chat Application of Quantum Tensor Networks for Protein Classification 2024 Debarshi Kundu
Archisman Ghosh
E. Srinivasan
Jian Wang
Nikolay V. Dokholyan
Swaroop Ghosh
+ PDF Chat A review on Quantum Approximate Optimization Algorithm and its variants 2024 Kostas Blekos
Dean Brand
Andrea Ceschini
Chiao-Hui Chou
Rui-Hao Li
Komal Pandya
Alessandro Summer
+ PDF Chat Surrogate-based optimization for variational quantum algorithms 2023 Ryan Shaffer
Lucas Kocia
Mohan Sarovar
+ A Review on Quantum Approximate Optimization Algorithm and its Variants 2023 Kostas Blekos
Dean Brand
Andrea Ceschini
Chiao-Hui Chou
Rui-Hao Li
Komal Pandya
Alessandro Summer
+ PDF Chat Quantum computing for solid mechanics and structural engineering – A demonstration with Variational Quantum Eigensolver 2023 Yunya Liu
Jiakun Liu
Jordan R. Raney
Pai Wang
+ Benchmarking of different optimizers in the variational quantum algorithms for applications in quantum chemistry 2023 Harshdeep Singh
Sonjoy Majumder
Sabyashachi Mishra
+ PDF Chat An Empirical Comparison of Optimizers for Quantum Machine Learning with SPSA-Based Gradients 2023 Marco Wiedmann
Marc Hölle
Maniraman Periyasamy
Nico Meyer
Christian Ufrecht
Daniel D. Scherer
Axel Plinge
Christopher Mutschler
+ PDF Chat An adjoint-based methodology for calculating manufacturing tolerances for natural laminar flow airfoils susceptible to smooth surface waviness 2023 Mohammad Moniripiri
Pedro P. C. Brito
André V. G. Cavalieri
Ney Rafael Secco
Ardeshir Hanifi
+ PDF Chat Stochastic optimization algorithms for quantum applications 2023 Jorge A. Gidi
B. Candia
A. D. Muñoz-Moller
Alejandro J. Rojas
L. Pereira
Mario Muñoz
L. Zambrano
A. Delgado
+ Circumventing traps in analog quantum machine learning algorithms through co-design 2024 Rodrigo Araiza Bravo
Jorge Garcia Ponce
Hong-Ye Hu
Susanne F. Yelin
+ PDF Chat Introduction to theoretical and experimental aspects of quantum optimal control 2024 Quentin Ansel
E Dionis
F Arrouas
Bruno Peaudecerf
S. Guérin
David Guéry-Odelin
Dominique Sugny
+ PDF Chat Distributed Evolution Strategies with Multi-Level Learning for Large-Scale Black-Box Optimization 2024 Qiqi Duan
Chang Shao
Guochen Zhou
Minghan Zhang
Qi Zhao
Yuhui Shi
+ PDF Chat Resource frugal optimizer for quantum machine learning 2023 Charles Moussa
Max Hunter Gordon
MichaƂ Bączyk
M. Cerezo
Ɓukasz Cincio
Patrick J. Coles
+ PDF Chat Mitigated barren plateaus in the time-nonlocal optimization of analog quantum-algorithm protocols 2024 Lukas Broers
Ludwig Mathey
+ Efficient and Robust Parameter Optimization of the Unitary Coupled-Cluster Ansatz 2024 Weitang Li
Yufei Ge
Shi‐Xin Zhang
Yuqin Chen
Shengyu Zhang
+ PDF Chat Fighting Noise with Noise: A Stochastic Projective Quantum Eigensolver 2024 Maria-Andreea Filip
+ PDF Chat Solving fractional differential equations on a quantum computer: A variational approach 2024 Fong Yew Leong
Dax Enshan Koh
Jian Feng Kong
Siong Thye Goh
Jun Yong Khoo
Wei-Bin Ewe
Hongying Li
Jayne Thompson
Dario Poletti
+ Application of quantum-inspired generative models to small molecular datasets 2023 C. Moussa
Hao Wang
Mauricio Araya‐Polo
Thomas BĂ€ck
Vedran Dunjko
+ Distributionally Robust Variational Quantum Algorithms With Shifted Noise 2024 Zichang He
Bo Peng
Yuri Alexeev
Zheng Zhang
+ Iteration Complexity of Variational Quantum Algorithms 2024 Vyacheslav Kungurtsev
Georgios Korpas
Jakub Mareček
Elton Yechao Zhu
+ Distributed Evolution Strategies with Multi-Level Learning for Large-Scale Black-Box Optimization 2023 Qiqi Duan
Chang Shao
Guochen Zhou
Minghan Zhang
Qi Zhao
Yuhui Shi

Citing (35)

Action Title Year Authors
+ Direct search algorithms for optimization calculations 1998 M. J. D. Powell
+ Sequential Quadratic Programming 2006 박음용
+ PDF Chat A variational eigenvalue solver on a photonic quantum processor 2014 Alberto Peruzzo
Jarrod R. McClean
Peter Shadbolt
Man‐Hong Yung
Xiaoqi Zhou
Peter J. Love
Alán Aspuru‐Guzik
Jeremy L. O’Brien
+ PDF Chat Can Single-Reference Coupled Cluster Theory Describe Static Correlation? 2015 Ireneusz W. Bulik
Thomas M. Henderson
Gustavo E. Scuseria
+ PDF Chat Progress towards practical quantum variational algorithms 2015 Dave Wecker
Matthew B. Hastings
Matthias Troyer
+ PDF Chat The theory of variational hybrid quantum-classical algorithms 2016 Jarrod R. McClean
Jonathan Romero
Ryan Babbush
Alán Aspuru‐Guzik
+ PDF Chat Proceedings of the 25th international conference on Machine learning - ICML '08 2008
+ PDF Chat Generalized Unitary Coupled Cluster Wave functions for Quantum Computation 2018 Joonho Lee
William J. Huggins
Martin Head‐Gordon
K. Birgitta Whaley
+ PDF Chat An adaptive variational algorithm for exact molecular simulations on a quantum computer 2019 Harper R. Grimsley
Sophia E. Economou
Edwin Barnes
Nicholas J. Mayhall
+ PDF Chat OpenFermion: the electronic structure package for quantum computers 2020 Jarrod R. McClean
Nicholas C. Rubin
Kevin J. Sung
Ian Kivlichan
Xavier Bonet-Monroig
Yudong Cao
Chengyu Dai
Eliot Fried
Craig Gidney
Brendan Gimby
+ PDF Chat Strategies for quantum computing molecular energies using the unitary coupled cluster ansatz 2018 Jonathan Romero
Ryan Babbush
Jarrod R. McClean
Cornelius Hempel
Peter J. Love
Alán Aspuru‐Guzik
+ PDF Chat Quantum Overlapping Tomography 2020 Jordan Cotler
Frank Wilczek
+ PDF Chat Measurement reduction in variational quantum algorithms 2020 Andrew Zhao
Andrew Tranter
William Kirby
Shu Fay Ung
Akimasa Miyake
Peter J. Love
+ PDF Chat Strategies for solving the Fermi-Hubbard model on near-term quantum computers 2020 Chris Cade
Lana Mineh
Ashley Montanaro
Stasja Stanisic
+ PDF Chat Benchmarking discrete optimization heuristics with IOHprofiler 2019 Carola Doerr
Furong Ye
Naama Horesh
Hao Wang
Ofer M. Shir
Thomas BĂ€ck
+ Is the Trotterized UCCSD Ansatz Chemically Well-Defined? 2019 Harper R. Grimsley
Daniel Claudino
Sophia E. Economou
Edwin Barnes
Nicholas J. Mayhall
+ Exact parameterization of fermionic wave functions via unitary coupled cluster theory 2019 Francesco A. Evangelista
Garnet Kin‐Lic Chan
Gustavo E. Scuseria
+ PDF Chat Using models to improve optimizers for variational quantum algorithms 2020 Kevin J. Sung
Jiahao Yao
Matthew P. Harrigan
Nicholas C. Rubin
Jiang Zhang
Lin Lin
Ryan Babbush
Jarrod R. McClean
+ PDF Chat Sequential minimal optimization for quantum-classical hybrid algorithms 2020 Ken Nakanishi
Keisuke Fujii
Synge Todo
+ Application of fermionic marginal constraints to hybrid quantum algorithms 2018 Nicholas C. Rubin
Ryan Babbush
Jarrod R. McClean
+ PDF Chat Quantum orbital-optimized unitary coupled cluster methods in the strongly correlated regime: Can quantum algorithms outperform their classical equivalents? 2020 Igor O. Sokolov
Panagiotis Kl. Barkoutsos
Pauline J. Ollitrault
Donny Greenberg
Julia E. Rice
Marco Pistoia
Ivano Tavernelli
+ PDF Chat Towards dynamic algorithm selection for numerical black-box optimization 2020 Diederick Vermetten
Hao Wang
Thomas BĂ€ck
Carola Doerr
+ PDF Chat Nearly Optimal Measurement Scheduling for Partial Tomography of Quantum States 2020 Xavier Bonet-Monroig
Ryan Babbush
Thomas E. O’Brien
+ PDF Chat A stochastic approach to unitary coupled cluster 2020 Maria-Andreea Filip
Alex J. W. Thom
+ PDF Chat Benchmarking Adaptive Variational Quantum Eigensolvers 2020 Daniel Claudino
Jerimiah Wright
Alexander McCaskey
Travis S. Humble
+ PDF Chat Generalized unitary coupled cluster excitations for multireference molecular states optimized by the variational quantum eigensolver 2020 Gabriel Greene‐Diniz
David Muñoz Ramo
+ PDF Chat Mutual information-assisted adaptive variational quantum eigensolver 2021 Zijian Zhang
Thi Ha Kyaw
Jakob S. Kottmann
Matthias Degroote
Alán Aspuru‐Guzik
+ PDF Chat Qubit-ADAPT-VQE: An Adaptive Algorithm for Constructing Hardware-Efficient AnsÀtze on a Quantum Processor 2021 Ho Lun Tang
V. O. Shkolnikov
George S. Barron
Harper R. Grimsley
Nicholas J. Mayhall
Edwin Barnes
Sophia E. Economou
+ PDF Chat An efficient adaptive variational quantum solver of the Schrödinger equation based on reduced density matrices 2021 Jie Liu
Zhenyu Li
Jinlong Yang
+ Tuning as a means of assessing the benefits of new ideas in interplay with existing algorithmic modules 2021 Jacob de Nobel
Diederick Vermetten
Hao Wang
Carola Doerr
Thomas BĂ€ck
+ Quantum Computational Advantage via 60-Qubit 24-Cycle Random Circuit Sampling 2021 Qingling Zhu
Sirui Cao
Fusheng Chen
Ming-Cheng Chen
Xiawei Chen
Tung-Hsun Chung
Hui Deng
Yajie Du
Daojin Fan
Ming Gong
+ PDF Chat Qubit-excitation-based adaptive variational quantum eigensolver 2021 Yordan S. Yordanov
V. Armaos
C. H. W. Barnes
David R. M. Arvidsson-Shukur
+ PDF Chat Quantum computational advantage via 60-qubit 24-cycle random circuit sampling 2021 Qingling Zhu
Sirui Cao
Fusheng Chen
Ming-Cheng Chen
Xiawei Chen
Tung-Hsun Chung
Huiqiu Deng
Yajie Du
Daojin Fan
Ming Gong
+ PDF Chat Analyzing the impact of undersampling on the benchmarking and configuration of evolutionary algorithms 2022 Diederick Vermetten
Hao Wang
Manuel LĂłpez‐Ibåñez
Carola Doerr
Thomas BĂ€ck
+ Performance comparison of optimization methods on variational quantum algorithms 2021 Xavier Bonet-Monroig
Hao Wang
Diederick Vermetten
Bruno Senjean
Charles Moussa
Thomas BĂ€ck
Vedran Dunjko
Thomas E. O’Brien