25,161
edits
Changes
no edit summary
'''OpenBench''',<br/>
an [[:Category:Open Source|open source chess engine ]] testing framework authored by [[Andrew Grant]], written in [[Python]] and licensed under the [[Free Software Foundation#GPL|GNU GPL]].
It is inspired [[Stockfish#TestingFramework|Fishtest]] and makes use of [https://en.wikipedia.org/wiki/Distributed_computing distributed computing],
allowing anyone to contribute [https://en.wikipedia.org/wiki/CPU_time CPU time] to further improve the development of open source chess engines.
OpenBench uses the [https://en.wikipedia.org/wiki/Django_(web_framework) Django Web Framework] and [[Cute Chess|Cutechess]] and applies the [[Match Statistics#SPRT|sequential probability ratio test]] in engine versus engine matches,
and supports [[Chess960]]. OpenBench was the primary testing framework used for the development of [[Ethereal]] <ref>[https://github.com/AndyGrant/OpenBench/blob/master/README.md OpenBench/README.md at master · AndyGrant/OpenBench · GitHub]</ref>. =Clients=OpenBench client PCs need to be [https://en.wikipedia.org/wiki/POSIX POSIX] compliant - that is [[Windows]] clients require [https://en.wikipedia.org/wiki/MinGW MinGW] <ref>[https://github.com/AndyGrant/OpenBench#setting-up-the-client-for-windows GitHub - AndyGrant/OpenBench: OpenBench is a Distributed SPRT Testing Framework for Chess Engines - Setting Up The Client For Windows]</ref> - to build chess engine binaries on the fly assuming that [https://en.wikipedia.org/wiki/GNU_Compiler_Collection gcc]/g++ and [https://en.wikipedia.org/wiki/Make_(software) make] are on the system path. To get the sources, OpenBench will pull down a [https://en.wikipedia.org/wiki/ZIP_(file_format) zip file] from [https://en.wikipedia.org/wiki/GitHub GitHub].Further, the client PC requires [[Python|Python 3]] and finally the OpenBench Client software itself <ref>[https://github.com/AndyGrant/OpenBench/blob/master/Client/Client.py OpenBench/Client.py at master · AndyGrant/OpenBench · GitHub]</ref>.The client is started with four arguments specifying the registered user name and password, the server [https://en.wikipedia.org/wiki/URL URL] and the number of [[Thread|threads]] used for engine matches <ref>[https://github.com/AndyGrant/OpenBench#running-the-client GitHub - AndyGrant/OpenBench: OpenBench is a Distributed SPRT Testing Framework for Chess Engines - Running The Client]</ref>: python3 OpenBench.py -U username -P password -S http://chess.grantnet.us/ -T 4
=See also=
* [[Ethereal]]
* [[Stockfish#TestingFramework|Fishtest]]
* [[Match Statistics#SPRT|SPRT]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=70383 Any testing framwork similair to Fishtest that can be run locally ?] by [[Mahmoud Uthman]], [[CCC]], April 02, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74503&start=3 Re: Looking for automatic Engine Testing Software] by [[Jon Dart]], [[CCC]], July 19, 2020
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=75335 Final Release of Ethereal, V12.75] by [[Andrew Grant]], [[CCC]], October 09, 2020 » [[Ethereal]]
=External Links=
==OpenBench==
* [https://github.com/AndyGrant/OpenBench GitHub - AndyGrant/OpenBench: OpenBench is a Distributed SPRT Testing Framework for Chess Engines]
* [https://github.com/AndyGrant/OpenBench/blob/master/Client/Client.py OpenBench/Client.py at master · AndyGrant/OpenBench · GitHub]
* [http://chess.grantnet.us/index/ OpenBench]
==Misc==
