25,161
edits
Changes
Created page with "'''Home * Engine Testing * OpenBench''' '''OpenBench''',<br/> an open source chess engine testing framework authored by Andrew Grant, written in Pytho..."
'''[[Main Page|Home]] * [[Engine Testing]] * OpenBench'''
'''OpenBench''',<br/>
an open source chess engine testing framework authored by [[Andrew Grant]], written in [[Python]] and licensed under the [[Free Software Foundation#GPL|GNU GPL]].
It is inspired [[Stockfish#TestingFramework|Fishtest]] and makes use of [https://en.wikipedia.org/wiki/Distributed_computing distributed computing], allowing anyone to contribute [https://en.wikipedia.org/wiki/CPU_time CPU time] to further improve the development of chess engines. OpenBench uses the [https://en.wikipedia.org/wiki/Django_(web_framework) Django Web Framework] and [[Cute Chess|Cutechess]] and applies the [[Match Statistics#SPRT|sequential probability ratio test]] in engine versus engine matches.
=See also=
* [[Stockfish#TestingFramework|Fishtest]]
* [[Match Statistics#SPRT|SPRT]]
* [[:Category:OpenBench|Engines using OpenBench]]
=Forum Posts=
* [http://www.talkchess.com/forum/viewtopic.php?t=61781 SPRT when not used for self testing] by [[Andrew Grant]], [[CCC]], October 21, 2016 » [[Match Statistics#SPRT|SPRT]]
* [http://www.talkchess.com/forum/viewtopic.php?t=62598 A question about SPRT] by [[Andrew Grant]], [[CCC]], December 25, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=64394 Testing A against B by playing a pool of others] by [[Andrew Grant]], [[CCC]], June 24, 2017 » [[Match Statistics]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531 Basic automated testing] by odomobo, [[CCC]], September 28, 2018
: [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531&start=6 Re:Basic automated testing] by [[Andrew Grant]], [[CCC]], September 30, 2018
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=70383 Any testing framwork similair to Fishtest that can be run locally ?] by [[Mahmoud Uthman]], [[CCC]], April 02, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74503&start=3 Re: Looking for automatic Engine Testing Software] by [[Jon Dart]], [[CCC]], July 19, 2020
=External Links=
==OpenBench==
* [https://github.com/AndyGrant/OpenBench GitHub - AndyGrant/OpenBench: OpenBench is a Distributed SPRT Testing Framework for Chess Engines]
* [http://chess.grantnet.us/index/ OpenBench]
==Misc==
* [https://en.wikipedia.org/wiki/Benchmark_(computing) Benchmark (computing) from Wikipedia]
=References=
<references />
'''[[Engine Testing|Up one Level]]'''
'''OpenBench''',<br/>
an open source chess engine testing framework authored by [[Andrew Grant]], written in [[Python]] and licensed under the [[Free Software Foundation#GPL|GNU GPL]].
It is inspired [[Stockfish#TestingFramework|Fishtest]] and makes use of [https://en.wikipedia.org/wiki/Distributed_computing distributed computing], allowing anyone to contribute [https://en.wikipedia.org/wiki/CPU_time CPU time] to further improve the development of chess engines. OpenBench uses the [https://en.wikipedia.org/wiki/Django_(web_framework) Django Web Framework] and [[Cute Chess|Cutechess]] and applies the [[Match Statistics#SPRT|sequential probability ratio test]] in engine versus engine matches.
=See also=
* [[Stockfish#TestingFramework|Fishtest]]
* [[Match Statistics#SPRT|SPRT]]
* [[:Category:OpenBench|Engines using OpenBench]]
=Forum Posts=
* [http://www.talkchess.com/forum/viewtopic.php?t=61781 SPRT when not used for self testing] by [[Andrew Grant]], [[CCC]], October 21, 2016 » [[Match Statistics#SPRT|SPRT]]
* [http://www.talkchess.com/forum/viewtopic.php?t=62598 A question about SPRT] by [[Andrew Grant]], [[CCC]], December 25, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=64394 Testing A against B by playing a pool of others] by [[Andrew Grant]], [[CCC]], June 24, 2017 » [[Match Statistics]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531 Basic automated testing] by odomobo, [[CCC]], September 28, 2018
: [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531&start=6 Re:Basic automated testing] by [[Andrew Grant]], [[CCC]], September 30, 2018
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=70383 Any testing framwork similair to Fishtest that can be run locally ?] by [[Mahmoud Uthman]], [[CCC]], April 02, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74503&start=3 Re: Looking for automatic Engine Testing Software] by [[Jon Dart]], [[CCC]], July 19, 2020
=External Links=
==OpenBench==
* [https://github.com/AndyGrant/OpenBench GitHub - AndyGrant/OpenBench: OpenBench is a Distributed SPRT Testing Framework for Chess Engines]
* [http://chess.grantnet.us/index/ OpenBench]
==Misc==
* [https://en.wikipedia.org/wiki/Benchmark_(computing) Benchmark (computing) from Wikipedia]
=References=
<references />
'''[[Engine Testing|Up one Level]]'''
