25,161
edits
Changes
no edit summary
During testing the engines should ideally play the same style of openings they would play in a normal tournament, so not to optimize them for different types of positions. One option is to use the engines own [[Opening Book|opening book]] or one can use [[Test-Positions#OpeningSuites|opening suites]], a set of quiet test positions. In the latter case the same opening suit would be used for each tournament conducted and furthermore each position is played a second time with colors reversed. With these measures one can try to minimize the disparity between tests caused by different openings.
==InterfacesTournament Manager== Free [[GUIUser Interface|graphical user User interfaces]] or [[CLI|command line tools]] for [[UCI]] and [[Chess Engine Communication Protocol]] compatible engines in engine-engine matches are:* mentioned under [[Amoeba#TournamentManager|Amoeba Tournament Manager]]* [[Arena]] by [[Martin Blume]] <ref>[http://www.playwitharena.com/ Free chess graphical user interface (GUI) Arena for chess engines]</ref>* [[Cute Chess]] by [[Arto Jonsson]] and [[Ilari Pihlajisto]]: [[Cutechess-cli]]* [[LittleBlitzer]] by [[Nathan Thom]] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=35249 Fast Games] by [[Manuel Diaz]], [[CCC]], July 02, 2010</ref>
==Frameworks==
'''2018'''
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=67485 Issue with self play testing] by [[Charles Roberson]], [[CCC]], May 18, 2018
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531 Basic automated testing] by Josh Odom, [[CCC]], September 28, 2018
: [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531&start=6 Re:Basic automated testing] by [[Andrew Grant]], [[CCC]], September 30, 2018 » [[OpenBench]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=69284 testing consistency] by [[Jon Dart]], [[CCC]], December 16, 2018
'''2019'''
* [http://ajonsson.kapsi.fi/cutechess.html Cute Chess]
* [https://github.com/cutechess/cutechess cutechess · GitHub]
* [https://github.com/AndyGrant/OpenBench GitHub - OpenBench a Distributed SPRT Testing Framework for Chess Engines] by [[Andrew Grant]]* [http://www.top-5000.nl/tuning.htm Testing a chess engine from the ground up] from [http://www.top-5000.nl/ Home of the Dutch Rebel] by [[Ed Schroder|Ed Schröder]] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=46759 A poor man's testing environment] by [[Ed Schroder|Ed Schröder]], [[CCC]], January 04, 2013</ref> » [[Match Statistics#SPRT|SPRT]]
* [https://en.wikipedia.org/wiki/Regression_testing Regression testing from Wikipedia]
* [http://www.sp-cc.de/index.htm SPCC] by [[Stefan Pohl]]
