Difference between revisions of "OpenBench"

From Chessprogramming wiki
Jump to: navigation, search
 
Line 23: Line 23:
  
 
=Forum Posts=
 
=Forum Posts=
 +
==2016 ...==
 
* [http://www.talkchess.com/forum/viewtopic.php?t=61781 SPRT when not used for self testing] by [[Andrew Grant]], [[CCC]], October 21, 2016 » [[Match Statistics#SPRT|SPRT]]
 
* [http://www.talkchess.com/forum/viewtopic.php?t=61781 SPRT when not used for self testing] by [[Andrew Grant]], [[CCC]], October 21, 2016 » [[Match Statistics#SPRT|SPRT]]
 
* [http://www.talkchess.com/forum/viewtopic.php?t=62598 A question about SPRT] by [[Andrew Grant]], [[CCC]], December 25, 2016  
 
* [http://www.talkchess.com/forum/viewtopic.php?t=62598 A question about SPRT] by [[Andrew Grant]], [[CCC]], December 25, 2016  
Line 29: Line 30:
 
: [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531&start=6 Re:Basic automated testing] by [[Andrew Grant]], [[CCC]], September 30, 2018
 
: [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=68531&start=6 Re:Basic automated testing] by [[Andrew Grant]], [[CCC]], September 30, 2018
 
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=70383 Any testing framwork similair to Fishtest that can be run locally ?] by [[Mahmoud Uthman]], [[CCC]], April 02, 2019
 
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=70383 Any testing framwork similair to Fishtest that can be run locally ?] by [[Mahmoud Uthman]], [[CCC]], April 02, 2019
 +
==2020 ...==
 
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74503&start=3 Re: Looking for automatic Engine Testing Software] by  [[Jon Dart]], [[CCC]], July 19, 2020
 
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=74503&start=3 Re: Looking for automatic Engine Testing Software] by  [[Jon Dart]], [[CCC]], July 19, 2020
 
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=75335 Final Release of Ethereal, V12.75] by [[Andrew Grant]], [[CCC]], October 09, 2020 » [[Ethereal]]
 
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=75335 Final Release of Ethereal, V12.75] by [[Andrew Grant]], [[CCC]], October 09, 2020 » [[Ethereal]]
 +
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=77074 OpenBench question] by [[Ed Schroder|Ed Schröder]], [[CCC]], April 13, 2021
  
 
=External Links=
 
=External Links=

Latest revision as of 07:23, 15 April 2021

Home * Engine Testing * OpenBench

OpenBench,
an open source chess engine testing framework authored by Andrew Grant, written in Python and licensed under the GNU GPL. It is inspired Fishtest and makes use of distributed computing, allowing anyone to contribute CPU time to further improve the development of open source chess engines. OpenBench uses the Django Web Framework and Cutechess and applies the sequential probability ratio test in engine versus engine matches, and supports Chess960. OpenBench was the primary testing framework used for the development of Ethereal [1].

Clients

OpenBench client PCs need to be POSIX compliant - that is Windows clients require MinGW [2] - to build chess engine binaries on the fly assuming that gcc/g++ and make are on the system path. To get the sources, OpenBench will pull down a zip file from GitHub. Further, the client PC requires Python 3 and finally the OpenBench Client software itself [3]. The client is started with four arguments specifying the registered user name and password, the server URL and the number of threads used for engine matches [4]:

python3 OpenBench.py -U username -P password -S http://chess.grantnet.us/ -T 4

See also

Forum Posts

2016 ...

Re:Basic automated testing by Andrew Grant, CCC, September 30, 2018

2020 ...

External Links

OpenBench

Misc

References

Up one Level