Difference between revisions of "Opening Book"

From Chessprogramming wiki
Jump to: navigation, search
(Purposes)
(Tags: Mobile edit, Mobile web edit)
(Types)
(Tags: Mobile edit, Mobile web edit)
Line 11: Line 11:
  
 
=Types=
 
=Types=
Opening books are typically stored in two formats:
+
Opening books are typically stored in two main formats:
 
==Text==
 
==Text==
The most advantage is that by using text form they are readable, understandable, and editable by humans without any special software. However, the main disadvantage is that they may take too much space as well as time for searching since an item may take from 50 bytes (for FEN strings) to hundreds of bytes (for PGN text). If we store openings "continuously" (all possible opening positions) both data size and searching time become too huge and become unacceptable for playing. In practice, those opening books are usually very small with some lines or positions only, they cannot be used for real game playing but for testing.
+
The most advantage by using text form is that they are readable, understandable, and editable by humans and can be viewed, edited with normal text editors. However, the main disadvantage is that they may take too much space as well as time for searching since an item may take from 50 bytes (for FEN strings) to hundreds of bytes (for PGN text). If we store openings "continuously" (all possible opening positions) both data size and searching time become too huge and unacceptable for playing. They are usually missing weight values (to compare between items to know which ones are better) either. In practice, those opening books are usually very small with some lines or positions only, they are hard to be used for real game playing but for testing.
  
 
They are stored in typical ways for games and positions:
 
They are stored in typical ways for games and positions:
Line 19: Line 19:
 
* [[PGN]]: Opening lines are stored as individual games
 
* [[PGN]]: Opening lines are stored as individual games
 
<span id="BookBuilder"></span>
 
<span id="BookBuilder"></span>
* Special formats: In 1999, [[Marc-Philippe Huget]] published a '''Book Builder''' <ref>[https://www.stmintz.com/ccc/index.php?id=44407 Web site updated and new program Book Builder] by [[Marc-Philippe Huget]], [[CCC]], February 24, 1999</ref> in conjunction with his engine [[La Dame Blanche]], a standalone open source program <ref>[http://www.quarkchess.de/ladameblanche/ Book Bilder of La Dame Blanche] by [[Marc-Philippe Huget]], hosted by [[Thomas Mayer]]</ref> to convert a [[Portable Game Notation|PGN file]] into an opening book of the format proposed by [[Kathe Spracklen]] <ref>[[Kathe Spracklen]] ('''1983'''). ''Tutorial: Representation of an Opening Tree''. [[ICGA Journal#6_1|ICCA Newsletter, Vol. 6, No. 1]]</ref>:
+
* Special text formats: In 1999, [[Marc-Philippe Huget]] published a '''Book Builder''' <ref>[https://www.stmintz.com/ccc/index.php?id=44407 Web site updated and new program Book Builder] by [[Marc-Philippe Huget]], [[CCC]], February 24, 1999</ref> in conjunction with his engine [[La Dame Blanche]], a standalone open source program <ref>[http://www.quarkchess.de/ladameblanche/ Book Bilder of La Dame Blanche] by [[Marc-Philippe Huget]], hosted by [[Thomas Mayer]]</ref> to convert a [[Portable Game Notation|PGN file]] into an opening book of the format proposed by [[Kathe Spracklen]] <ref>[[Kathe Spracklen]] ('''1983'''). ''Tutorial: Representation of an Opening Tree''. [[ICGA Journal#6_1|ICCA Newsletter, Vol. 6, No. 1]]</ref>:
 
<pre>
 
<pre>
 
(e4(e5)(c5))(d4d5)) etc.
 
(e4(e5)(c5))(d4d5)) etc.
Line 25: Line 25:
  
 
==Binary==
 
==Binary==
Binary books have some important advantages, especially for computer chess engines. Opening databases built on all positions are usually more space-efficient and overcome the problem of [[Transposition|transpositions]]. Often these positions are stored as hash values to allow fast access. Some opening database formats store with each position as well as some information about it. (e.g. number of times occurred, number of games won by white/black / drawn with this position, average/maximum Elo of players playing to this opening position, chess program's success with the position). So when a chess program has to decide on a move, it will look up all positions that could arise after moving in the database and then make a decision upon the information given with each position. Depends on designs, an item may take 10 - 16 bytes. To build and/or edit those opening books, users need to use special software.
+
Binary books have some important advantages, especially for computer chess engines: space-efficient, fast on accessing and searching, more useful information. At the most simple form, they are just a conversion of above text-opening books into binary. However, the major number of binary books is built and worked with hash values from [[Transposition|transpositions]]. Often these positions are stored as hash values to allow fast access. Some opening database formats store with each position as well as some information about it. (e.g. number of times occurred, number of games won by white/black / drawn with this position, average/maximum Elo of players playing to this opening position, chess program's success with the position). So when a chess program has to decide on a move, it will look up all positions that could arise after moving in the database and then make a decision upon the information given with each position. Depends on designs, an item may take 10 - 16 bytes. To build and/or edit those opening books, users need to use special software.
  
 
The most popular format is [[PolyGlot]].
 
The most popular format is [[PolyGlot]].

Revision as of 01:35, 27 June 2021

Home * Knowledge * Opening Book

Chess programs often look up the positions at the beginning of the game in an Opening Book. The opening database can then be used as long as the opponent plays a new move from the database, so usually more common opening lines will be stored to a much higher depth than the uncommon ones. As soon as the program is "out of book" it has to continue using the normal search routines.

Purposes

  • Save time: Chess programs could use search from the beginning and look through all possible continuations in detail to find the best next move, but as this is quite time-consuming. In contrast, opening books can play opening moves almost instantly without searching nor heavy computing and help to save time.
  • Provide a higher quality of play: Searching even with large depths can't see deep tactics, strategy, compensation. It may lose temporarily material for long term advantage.
  • Provide variety: there already exists a lot of literature about different opening lines. As book moves are usually chosen randomly, whereas searches are more or less deterministic.

Types

Opening books are typically stored in two main formats:

Text

The most advantage by using text form is that they are readable, understandable, and editable by humans and can be viewed, edited with normal text editors. However, the main disadvantage is that they may take too much space as well as time for searching since an item may take from 50 bytes (for FEN strings) to hundreds of bytes (for PGN text). If we store openings "continuously" (all possible opening positions) both data size and searching time become too huge and unacceptable for playing. They are usually missing weight values (to compare between items to know which ones are better) either. In practice, those opening books are usually very small with some lines or positions only, they are hard to be used for real game playing but for testing.

They are stored in typical ways for games and positions:

  • EPD: They are the last positions of opening lines
  • PGN: Opening lines are stored as individual games

(e4(e5)(c5))(d4d5)) etc.

Binary

Binary books have some important advantages, especially for computer chess engines: space-efficient, fast on accessing and searching, more useful information. At the most simple form, they are just a conversion of above text-opening books into binary. However, the major number of binary books is built and worked with hash values from transpositions. Often these positions are stored as hash values to allow fast access. Some opening database formats store with each position as well as some information about it. (e.g. number of times occurred, number of games won by white/black / drawn with this position, average/maximum Elo of players playing to this opening position, chess program's success with the position). So when a chess program has to decide on a move, it will look up all positions that could arise after moving in the database and then make a decision upon the information given with each position. Depends on designs, an item may take 10 - 16 bytes. To build and/or edit those opening books, users need to use special software.

The most popular format is PolyGlot.

Generation

All in all the information stored in an opening database should guide the chess game into a type of middle game in which the chess program proves itself most successful. But to achieve this there are two main ways.

Handcrafted

If the opening database designer has some special preference of a certain opening line, he might create it fully manually. This is often the case if a chess program is about to play an important game against a grandmaster. Then the opening style will probably be chosen to be difficult and dangerous for the opponent. Another option is to first automatically generate a database and then fine-tune it manually.

From game collection

Another option is to select a number of games (the type of which will affect the openings played: e.g. drawn games only, GM games only, etc) and then up to a certain depth store all positions in the opening database. It is true that by using this way of database generation some severe errors might by copied as well, but usually the chess programs are set to stop playing according to the book if a position occurred less than a certain number times before.

By computing

Chess engines can be used to evaluate positions in a book opening tree to rank them, and/or decide to stop or expand.

Book Building Tools

Quotes

Jonathan Schaeffer in One Jump Ahead [5] :

To solve the opening problems of his chess machine, Belle, Ken Thompson typed in opening lines from the Encyclopedia of Chess Openings (in five thick volumes). Religiously, he dedicated one hour a day for almost three years (!) to the tedious pursuit of entering lines of play from the books and having his Belle computer verify them. The result was an opening library of roughly three-hundred thousand moves. The results were immediate and obvious: Belle became a much stronger chess program, and Ken probably aged prematurely. Later Ken developed a program to automatically read the Encyclopedia, allowing him to do in a few days what had taken him three years to do manually. [6] 

Formats

Classification of Chess Openings

Book Issues

See also

Selected Publications

1974 ...

Я.Ю. Гольфанд, А.Л. Футер (1974). Реализация дебютной справочной для шахматной программы./ Сб. Проблемы кибернетики №29, стр. 201-210

1980 ...

1990 ...

2000 ...

2005 ...

2010 ...

2015 ...

Forum Posts

1990 ...

1995 ...

2000 ...

2005 ...

Re: Opening books format by Jury Osipov, CCC, April 15, 2008 » ABK
Re: Opening books format by Richard Pijl, CCC, April 15, 2008
Re: Opening books format by Dann Corbit, CCC, April 15, 2008

2010 ...

2013

Re: 2 Moves Engine Book by Miguel A. Ballicora, CCC, December 08, 2013 » Ruby

2014

2015 ...

2016

2017

2018

2019

2020 ...

2021

External Links

Engine Books

Online Opening Tree

Misc

References

Up one level