Difference between revisions of "Ilya Loshchilov"

From Chessprogramming wiki
Jump to: navigation, search
(Created page with "'''Home * People * Ilya Loshchilov''' FILE:IlyaLoshchilov.jpg|border|right|thumb|link=http://loshchilov.com/| Ilya Loshchilov <ref>[http://loshchilov.com/...")
(No difference)

Revision as of 10:11, 13 September 2019

Home * People * Ilya Loshchilov

Ilya Loshchilov [1]

Ilya Gennadyevich Loshchilov,
a Russian computer scientist in the field of evolutionary algorithms (EA), optimization and machine learning. He worked with Marc Schoenauer and Michèle Sebag at Paris-Sud 11 University and INRIA within their TAO Project Team [2] on multi-objective optimization, adaptive coordinate descent and CMA-ES, where he defended his Ph.D. with the title Surrogate-Assisted Evolutionary Algorithms in 2013 [3]. As postdoc at University of Freiburg, he continued his research with Frank Hutter combining, evolutionary algorithms with deep learning techniques.

SGDR

Loshchilov's and Hutter's stochastic gradient descent with warm restarts (SGDR) as introduced in their 2016 paper [4], is mentioned as method for learning rate scheduling to train Leela Chess' third party network Leelenstein [5], which is combined with Allie for the AllieStein chess playing entity.

Selected Publications

[6] [7]

2010 ...

2015 ...

External Links

GitHub - loshchil/SGDR
GitHub - loshchil/AdamW-and-SGDW: Decoupled Weight Decay Regularization (ICLR 2019)

References

Up one Level