Difference between revisions of "Winter"
GerdIsenberg (talk | contribs) |
GerdIsenberg (talk | contribs) |
||
(8 intermediate revisions by the same user not shown) | |||
Line 37: | Line 37: | ||
** Minimizing the [https://en.wikipedia.org/wiki/Cross_entropy cross entropy] loss of a [[Automated Tuning#LogisticRegression|Logistic Regression]] model for each phase | ** Minimizing the [https://en.wikipedia.org/wiki/Cross_entropy cross entropy] loss of a [[Automated Tuning#LogisticRegression|Logistic Regression]] model for each phase | ||
** Training converges fast due to [https://en.wikipedia.org/wiki/Linear_model linear model] at the heart | ** Training converges fast due to [https://en.wikipedia.org/wiki/Linear_model linear model] at the heart | ||
+ | * As of '''Winter 0.6.2''', the evaluation function relies on a [[Neural Networks|neural network]] with two main parts. The first part is a non-standard [[Neural Networks#Convolutional|convolutional neural network]] which uses sparsity similarly to [[NNUE]]. This convolutional network is used to calculate [[Pawn Structure|pawn structure]] features, so the output can be reused very often as it gets stored in a separate [[Pawn Hash Table|hash table]] with a high hitrate. The second part is a fully connected network which has as input the output of the convolutional network as well as a set of handcrafted features standard to classical engines, mostly a subset of the features from before neural networks were added to Winter <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74531&start=5 Re: NNUE accessible explanation] by [[Jonathan Rosenthal]], [[CCC]], July 24, 2020</ref> | ||
==Misc== | ==Misc== | ||
* [[Perft]] | * [[Perft]] | ||
Line 42: | Line 43: | ||
=Forum Posts= | =Forum Posts= | ||
+ | ==2017 ...== | ||
* [http://www.talkchess.com/forum/viewtopic.php?t=65466&start=4 Re: Tapered Eval between 4 phases] by [[Jonathan Rosenthal]], [[CCC]], October 16, 2017 » [[Tapered Eval]] | * [http://www.talkchess.com/forum/viewtopic.php?t=65466&start=4 Re: Tapered Eval between 4 phases] by [[Jonathan Rosenthal]], [[CCC]], October 16, 2017 » [[Tapered Eval]] | ||
* [http://www.talkchess.com/forum/viewtopic.php?t=66266 Winter Released] by [[Jonathan Rosenthal]], [[CCC]], January 08, 2018 | * [http://www.talkchess.com/forum/viewtopic.php?t=66266 Winter Released] by [[Jonathan Rosenthal]], [[CCC]], January 08, 2018 | ||
: [http://www.talkchess.com/forum/viewtopic.php?t=66266&start=7 Re: Winter Released] by [[Jonathan Rosenthal]], [[CCC]], January 09, 2018 | : [http://www.talkchess.com/forum/viewtopic.php?t=66266&start=7 Re: Winter Released] by [[Jonathan Rosenthal]], [[CCC]], January 09, 2018 | ||
: [http://www.talkchess.com/forum/viewtopic.php?t=66266&start=8 Windows version released] by [[Jonathan Rosenthal]], [[CCC]], January 23, 2018 | : [http://www.talkchess.com/forum/viewtopic.php?t=66266&start=8 Windows version released] by [[Jonathan Rosenthal]], [[CCC]], January 23, 2018 | ||
− | * [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=68266 Winter 0.2 Release Overview and Select Games] by [[Jonathan Rosenthal]], [[CCC]], | + | * [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=68266 Winter 0.2 Release Overview and Select Games] by [[Jonathan Rosenthal]], [[CCC]], August 20, 2018 |
− | * [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=69288 Winter 0.3 Release Overview and Select Games] by [[Jonathan Rosenthal]], [[CCC]], December 16, 2018 | + | * [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=69288 Winter 0.3 Release Overview and Select Games] by [[Jonathan Rosenthal]], [[CCC]], December 16, 2018 » [[TCEC Season 14]] |
+ | * [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=72284 Winter NN Training Script] by [[Jonathan Rosenthal]], [[CCC]], November 09, 2019 | ||
+ | ==2020 ...== | ||
+ | * [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74531&start=5 Re: NNUE accessible explanation] by [[Jonathan Rosenthal]], [[CCC]], July 24, 2020 » [[NNUE]] | ||
+ | * [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=75301 Winter] by [[Jonathan Rosenthal]], [[CCC]], October 05, 2020 | ||
+ | : [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=75301&start=14 Re: Winter] by [[Jonathan Rosenthal]], [[CCC]], July 09, 2021 | ||
=External Links= | =External Links= | ||
==Chess Engine== | ==Chess Engine== | ||
* [https://github.com/rosenthj/Winter GitHub - rosenthj/Winter: UCI Chess Engine] | * [https://github.com/rosenthj/Winter GitHub - rosenthj/Winter: UCI Chess Engine] | ||
+ | * [http://ccrl.chessdom.com/ccrl/4040/cgi/compare_engines.cgi?family=Winter&print=Rating+list&print=Results+table&print=LOS+table&print=Ponder+hit+table&print=Eval+difference+table&print=Comopp+gamenum+table&print=Overlap+table&print=Score+with+common+opponents Winter] in [[CCRL|CCRL 40/15]] | ||
==Misc== | ==Misc== | ||
* [https://en.wikipedia.org/wiki/Winter Winter from Wikipedia] | * [https://en.wikipedia.org/wiki/Winter Winter from Wikipedia] | ||
Line 63: | Line 71: | ||
* [https://en.wikipedia.org/wiki/Edward_Winter_%28chess_historian%29 Edward Winter (chess historian) from Wikipedia] | * [https://en.wikipedia.org/wiki/Edward_Winter_%28chess_historian%29 Edward Winter (chess historian) from Wikipedia] | ||
* [[:Category:Johnny Winter|Johnny Winter]] - Winter Ballade, [https://en.wikipedia.org/wiki/Institut_national_de_l%27audiovisuel ina.fr] 1970, [https://en.wikipedia.org/wiki/YouTube YouTube] Video | * [[:Category:Johnny Winter|Johnny Winter]] - Winter Ballade, [https://en.wikipedia.org/wiki/Institut_national_de_l%27audiovisuel ina.fr] 1970, [https://en.wikipedia.org/wiki/YouTube YouTube] Video | ||
− | : feat. [ | + | : feat. [[:Category:Tommy Shannon|Tommy Shannon]] on bass and [http://yeech.altervista.org/Band/winter_band_john_turner.html Uncle John Turner] on drums |
: {{#evu:https://www.youtube.com/watch?v=8P0wdTKMDyo|alignment=left|valignment=top}} | : {{#evu:https://www.youtube.com/watch?v=8P0wdTKMDyo|alignment=left|valignment=top}} | ||
=References= | =References= | ||
<references /> | <references /> | ||
− | |||
'''[[Engines|Up one Level]]''' | '''[[Engines|Up one Level]]''' | ||
[[Category:UCI]] | [[Category:UCI]] | ||
[[Category:Open Source]] | [[Category:Open Source]] | ||
[[Category:GPL]] | [[Category:GPL]] | ||
+ | [[Category:X86]] | ||
+ | [[Category:X64]] | ||
+ | [[Category:ARM]] | ||
+ | [[Category:PC]] | ||
+ | [[Category:Android]] | ||
+ | [[Category:Linux]] | ||
+ | [[Category:Windows]] | ||
+ | [[Category:NN]] | ||
+ | [[Category:OpenBench]] | ||
[[Category:Johnny Winter]] | [[Category:Johnny Winter]] | ||
+ | [[Category:Tommy Shannon]] |
Latest revision as of 09:35, 10 July 2021
Winter,
an UCI compliant open source chess engine by Jonathan Rosenthal, written in C++, released on January 08, 2018 under the terms of GPL Version 3. Winter is inspired by machine learning techniques, as applied in move ordering and in particular in evaluation, and heavily relies on C++ templates but not on any library aside from STL as it comes with its own implementations for statistics [2] and linear algebra [3]. Winter started its life in 2016 as a group project at ETH Zurich in a course on parallel computing along with Jonas Kuratli and Jonathan Maurer - the current release with Jonathan Rosenthal as sole author has removed the parallel portion of the code [4]. It started to play on-line at HGM's Online Engine Blitz Tourneys in April 2017 [5].
Contents
Selected Features
Board Representation
Search
- Lazy SMP (Winter 0.3)
- Fail-Hard Iterative Deepening
- Alpha-Beta Principal Variation Search
- Transposition Table
- Move Ordering is based on the linear part of a Logistic Regression classifier aka cluster analysis
- The classifier is trained via temporal difference learning to predict whether a move will return beta
- Classifier considers TT move, killers, move type, from square, target square, capture target, SEE, target square of last move, check and changes between forcing and unforcing moves (a capture is more likely after another capture)
- Countermove Heuristic (Winter 0.3)
- Selectivity
Evaluation
- Non standard approach relied on a mixture model [7], and since Winter 0.3 on Fuzzy C-Means, a more direct generalization of a tapered eval with disjoint phases aka clusters [8] [9]
- Assumes positions encountered in search come from some set of k-means clusters [10]
- Model is trained via EM algorithm [11] [12] either on database games or positions sampled from search
- For each cluster, a separate evaluation function is trained. When the evaluation function is called the relative probability a position stems from each cluster is estimated, the evaluation functions are computed and the final score is returned as the weighted average - a generalization of tapered eval with game phases [13]
- Parameter weights are trained via a mixture of reinforcement (temporal difference) learning and supervised learning
- Minimizing the cross entropy loss of a Logistic Regression model for each phase
- Training converges fast due to linear model at the heart
- As of Winter 0.6.2, the evaluation function relies on a neural network with two main parts. The first part is a non-standard convolutional neural network which uses sparsity similarly to NNUE. This convolutional network is used to calculate pawn structure features, so the output can be reused very often as it gets stored in a separate hash table with a high hitrate. The second part is a fully connected network which has as input the output of the convolutional network as well as a set of handcrafted features standard to classical engines, mostly a subset of the features from before neural networks were added to Winter [14]
Misc
- Perft
- Print pretty Unicode chess boards
Forum Posts
2017 ...
- Re: Tapered Eval between 4 phases by Jonathan Rosenthal, CCC, October 16, 2017 » Tapered Eval
- Winter Released by Jonathan Rosenthal, CCC, January 08, 2018
- Re: Winter Released by Jonathan Rosenthal, CCC, January 09, 2018
- Windows version released by Jonathan Rosenthal, CCC, January 23, 2018
- Winter 0.2 Release Overview and Select Games by Jonathan Rosenthal, CCC, August 20, 2018
- Winter 0.3 Release Overview and Select Games by Jonathan Rosenthal, CCC, December 16, 2018 » TCEC Season 14
- Winter NN Training Script by Jonathan Rosenthal, CCC, November 09, 2019
2020 ...
- Re: NNUE accessible explanation by Jonathan Rosenthal, CCC, July 24, 2020 » NNUE
- Winter by Jonathan Rosenthal, CCC, October 05, 2020
- Re: Winter by Jonathan Rosenthal, CCC, July 09, 2021
External Links
Chess Engine
Misc
- Winter from Wikipedia
- Winter - Wiktionary
- winter - Wiktionary
- Winter (disambiguation) from Wikipedia
- Summer and Winter Schools | ETH Zurich
- Wintel from Wikipedia
- AI winter from Wikipedia
- Winter (surname) from Wikipedia
- Edward Winter (chess historian) from Wikipedia
- Johnny Winter - Winter Ballade, ina.fr 1970, YouTube Video
- feat. Tommy Shannon on bass and Uncle John Turner on drums
References
- ↑ Image clipped from Winter views from our floor by Bertrand Meyer, ETH Zurich, Gray moment with Zentralbibliothek and Predigerkirche in the foreground, Lake Zurich, Grossmünster, Fraumünster and St. Peter behind, in the background foothill of Uetliberg, from Bertrand Meyer's ETH home page
- ↑ Winter/statistics.h at master · rosenthj/Winter · GitHub
- ↑ Winter/linear_algebra.h at master · rosenthj/Winter · GitHub
- ↑ Winter Released by Jonathan Rosenthal, CCC, January 08, 2018
- ↑ Re: On-line engine blitz tourney April by Harm Geert Muller, CCC, April 22, 2017
- ↑ based on Winter Released by Jonathan Rosenthal, CCC, January 08, 2018
- ↑ Re: Winter Released by Jonathan Rosenthal, CCC, January 09, 2018
- ↑ Winter 0.3 Release Overview and Select Games by Jonathan Rosenthal, CCC, December 16, 2018
- ↑ James C. Bezdek, Robert Ehrlich, William Full (1984). FCM: The fuzzy c-means clustering algorithm. Computers & Geosciences, Vol. 10, Nos. 2-3, pdf
- ↑ K Means by Chris Piech
- ↑ The EM Algorithm for Gaussian Mixtures - Probabilistic Learning: Theory and Algorithms, CS 274A (pdf) University of California, Irvine
- ↑ Mixture Models & EM algorithm Lecture 21 (pdf) by David Sontag, New York University
- ↑ Re: Tapered Eval between 4 phases by Jonathan Rosenthal, CCC, October 16, 2017
- ↑ Re: NNUE accessible explanation by Jonathan Rosenthal, CCC, July 24, 2020