Ilya Loshchilov

Generating author description...

All published works

Action	Title	Year	Authors
+ PDF Chat	nGPT: Normalized Transformer with Representation Learning on the Hypersphere	2024	Ilya Loshchilov Cheng-Ping Hsieh Simeng Sun Boris Ginsburg
+	Weight Norm Control	2023	Ilya Loshchilov
+	Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari	2018	Patryk Chrabąszcz Ilya Loshchilov Frank Hutter
+	Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari	2018	Patryk Chrabąszcz Ilya Loshchilov Frank Hutter
+	Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari	2018	Patryk Chrabąszcz Ilya Loshchilov Frank Hutter
+	Decoupled Weight Decay Regularization	2017	Ilya Loshchilov Frank Hutter
+	Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization.	2017	Ilya Loshchilov Tobias Glasmachers Hans-Georg Beyer
+	A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets	2017	Patryk Chrabąszcz Ilya Loshchilov Frank Hutter
+	Decoupled Weight Decay Regularization	2017	Ilya Loshchilov Frank Hutter
+	Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization	2017	Ilya Loshchilov Tobias Glasmachers Hans-Georg Beyer
+	SGDR: Stochastic Gradient Descent with Warm Restarts	2016	Ilya Loshchilov Frank Hutter
+ PDF Chat	Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)	2016	Ilya Loshchilov Tobias Glasmachers
+	Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)	2016	Ilya Loshchilov Tobias Glasmachers
+	CMA-ES for Hyperparameter Optimization of Deep Neural Networks	2016	Ilya Loshchilov Frank Hutter
+	SGDR: Stochastic Gradient Descent with Warm Restarts	2016	Ilya Loshchilov Frank Hutter
+	Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)	2016	Ilya Loshchilov Tobias Glasmachers
+	Online Batch Selection for Faster Training of Neural Networks	2015	Ilya Loshchilov Frank Hutter
+	LM-CMA: an Alternative to L-BFGS for Large Scale Black-box Optimization	2015	Ilya Loshchilov
+	LM-CMA: An Alternative to L-BFGS for Large-Scale Black Box Optimization	2015	Ilya Loshchilov
+	Online Batch Selection for Faster Training of Neural Networks	2015	Ilya Loshchilov Frank Hutter
+	LM-CMA: an Alternative to L-BFGS for Large Scale Black-box Optimization	2015	Ilya Loshchilov
+	A computationally efficient limited memory CMA-ES for large scale optimization	2014	Ilya Loshchilov
+	A Computationally Efficient Limited Memory CMA-ES for Large Scale Optimization	2014	Ilya Loshchilov
+	Maximum Likelihood-Based Online Adaptation of Hyper-Parameters in CMA-ES	2014	Ilya Loshchilov Marc Schoenauer Michèle Sébag Nikolaus Hansen
+	A Computationally Efficient Limited Memory CMA-ES for Large Scale Optimization	2014	Ilya Loshchilov
+ PDF Chat	KL-based Control of the Learning Schedule for Surrogate Black-Box Optimization	2013	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+	KL-based Control of the Learning Schedule for Surrogate Black-Box Optimization	2013	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+ PDF Chat	Alternative Restart Strategies for CMA-ES	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+ PDF Chat	Alternative Restart Strategies for CMA-ES	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+ PDF Chat	Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+ PDF Chat	Black-box optimization benchmarking of IPOP-saACM-ES on the BBOB-2012 noisy testbed	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+ PDF Chat	Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+	Alternative Restart Strategies for CMA-ES	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+	Self-Adaptive Surrogate-Assisted Covariance Matrix Adaptation Evolution Strategy	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+	Black-box optimization benchmarking of IPOP-saACM-ES on the BBOB-2012 noisy testbed	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+	Alternative Restart Strategies for CMA-ES	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag
+	Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag

Common Coauthors

Coauthor	Papers Together
Michèle Sébag	13
Marc Schoenauer	13
Frank Hutter	11
Tobias Glasmachers	5
Patryk Chrabąszcz	4
Hans-Georg Beyer	2
Boris Ginsburg	1
Nikolaus Hansen	1
Cheng-Ping Hsieh	1
Simeng Sun	1

Commonly Cited References

Action	Title	Year	Authors	# of times referenced
+ PDF Chat	Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag	7
+ PDF Chat	Conditioning of quasi-Newton methods for function minimization	1970	David F. Shanno	6
+ PDF Chat	On the limited memory BFGS method for large scale optimization	1989	Cheng‐Di Dong Jorge Nocedal	5
+	A Linear Time Natural Evolution Strategy for Non-Separable Functions	2011	Yi Sun Faustino Gomez Tom Schaul Juergen Schmidhuber	5
+	Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles	2011	Yann Ollivier Ludovic Arnold Anne Auger Nikolaus Hansen	4
+ PDF Chat	Updating quasi-Newton matrices with limited storage	1980	Jorge Nocedal	4
+	CMA-ES for Hyperparameter Optimization of Deep Neural Networks	2016	Ilya Loshchilov Frank Hutter	3
+	ADADELTA: An Adaptive Learning Rate Method	2012	Matthew D. Zeiler	3
+	Alternative Restart Strategies for CMA-ES	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag	3
+	Evolution Strategies as a Scalable Alternative to Reinforcement Learning	2017	Tim Salimans Jonathan Ho Xi Chen Ilya Sutskever	3
+ PDF Chat	A linear time natural evolution strategy for non-separable functions	2013	Yi Sun Tom Schaul Faustino Gomez Jürgen Schmidhuber	3
+	Numerical Methods for Unconstrained Optimization and Nonlinear Equations	1996	J. E. Dennis Robert B. Schnabel	2
+	Maximum Likelihood-Based Online Adaptation of Hyper-Parameters in CMA-ES	2014	Ilya Loshchilov Marc Schoenauer Michèle Sébag Nikolaus Hansen	2
+	The BOBYQA algorithm for bound constrained optimization without derivatives	2009	M. J. D. Powell	2
+	No More Pesky Learning Rate Guessing Games.	2015	Leslie N. Smith	2
+ PDF Chat	Convergence of Mesh Adaptive Direct Search to Second‐Order Stationary Points	2006	Mark A. Abramson Charles Audet	2
+ PDF Chat	Adaptive step size random search	1968	M. Schumer K. Steiglitz	2
+	Compilation of Results on the 2005 CEC Benchmark Function Set	2005	Nikolaus Hansen	2
+	Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift	2015	Sergey Ioffe Christian Szegedy	2
+	Equilibrated adaptive learning rates for non-convex optimization	2015	Yann Dauphin Harm de Vries Yoshua Bengio	2
+	Convergence of the IGO-Flow of Isotropic Gaussian Distributions on Convex Quadratic Problems	2012	Tobias Glasmachers	2
+	Practical Bayesian Optimization of Machine Learning Algorithms	2012	Jasper Snoek Hugo Larochelle Ryan P. Adams	2
+ PDF Chat	A quasi-Newton proximal splitting method	2012	Stephen Becker Jalal Fadili	2
+ PDF Chat	A Limited Memory Algorithm for Bound Constrained Optimization	1995	Richard H. Byrd Peihuang Lu Jorge Nocedal Ciyou Zhu	2
+	Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning	2017	Felipe Petroski Such Vashisht Madhavan Edoardo Conti Joel Lehman Kenneth O. Stanley Jeff Clune	2
+	Densely Connected Convolutional Networks	2016	Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger	2
+ PDF Chat	Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed	2012	Ilya Loshchilov Marc Schoenauer Michèle Sébag	2
+	SGDR: Stochastic Gradient Descent with Warm Restarts	2016	Ilya Loshchilov Frank Hutter	2
+	Benchmarking Deep Reinforcement Learning for Continuous Control	2016	Yan Duan Xi Chen Rein Houthooft John Schulman Pieter Abbeel	2
+	Identifying and attacking the saddle point problem in high-dimensional non-convex optimization	2014	Yann Dauphin Razvan Pascanu Çaǧlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio	2
+ PDF Chat	Objective improvement in information-geometric optimization	2013	Youhei Akimoto Yann Ollivier	2
+ PDF Chat	COCO: The Experimental Procedure	2016	Nikolaus Hansen Tea Tušar Olaf Mersmann Anne Auger Dimo Brockhoff	2
+	Wide Residual Networks	2016	Sergey Zagoruyko Nikos Komodakis	2
+	A computationally efficient limited memory CMA-ES for large scale optimization	2014	Ilya Loshchilov	2
+	Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Classics in Applied Mathematics, 16)	1996	J. E. Dennis Robert B. Schnabel	2
+	Effective condition number for finite difference method	2006	Zi‐Cai Li Cheng-Sheng Chien Hung‐Tsai Huang	2
+	On the Behaviour of the (1, λ)-ES for Conically Constrained Linear Problems	2014	Dirk V. Arnold	2
+	Convergence Conditions for Ascent Methods	1969	Philip Wolfe	2
+ PDF Chat	A new approach to variable metric algorithms	1970	R. Fletcher	1
+ PDF Chat	Computing a Trust Region Step	1983	Jorge J. Morè D. C. Sorensen	1
+	Updating conjugate directions by the BFGS formula	1987	M. J. D. Powell	1
+	Non-Uniform Stochastic Average Gradient Method for Training Conditional Random Fields	2015	Mark Schmidt Reza Babanezhad Mohamed Osama Ahmed Aaron Defazio Ann Clifton Anoop Sarkar	1
+	Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)	2015	Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter	1
+	Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks	2015	Alec Radford Luke Metz Soumith Chintala	1
+	Restart procedures for the conjugate gradient method	1977	M. J. D. Powell	1
+	The Loss Surfaces of Multilayer Networks	2015	Anna Choromanska Mikael Henaff Michaël Mathieu Gérard Ben Arous Yann LeCun	1
+ PDF Chat	Linear Convergence of Comparison-based Step-size Adaptive Randomized Search via Stability of Markov Chains	2016	Anne Auger Nikolaus Hansen	1
+	Online Batch Selection for Faster Training of Neural Networks	2015	Ilya Loshchilov Frank Hutter	1
+	Predictive Entropy Search for Efficient Global Optimization of Black-box Functions	2014	José Miguel Hernández-Lobato Matthew W. Hoffman Zoubin Ghahramani	1
+ PDF Chat	Natural Evolution Strategies	2008	Daan Wierstra Tom Schaul Jan Peters Juergen Schmidhuber	1