25,161
edits
Changes
Created page with "'''Home * Engines * Similarity''' [[FILE:Phylogenetic tree.svg|border|right|thumb| A [https://en.wikipedia.org/wiki/Dendrogram dendrogram] of the [https://e..."
'''[[Main Page|Home]] * [[Engines]] * Similarity'''
[[FILE:Phylogenetic tree.svg|border|right|thumb| A [https://en.wikipedia.org/wiki/Dendrogram dendrogram] of the [https://en.wikipedia.org/wiki/Tree_of_life Tree of Life] <ref>
A [https://en.wikipedia.org/wiki/Phylogenetic_tree phylogenetic tree] of [https://en.wikipedia.org/wiki/Life living things], based on [https://en.wikipedia.org/wiki/RNA RNA] data and proposed by [https://en.wikipedia.org/wiki/Carl_Woese Carl Woese],
showing the separation of [https://en.wikipedia.org/wiki/Bacteria bacteria], [https://en.wikipedia.org/wiki/Archaea archaea], and [https://en.wikipedia.org/wiki/Eukaryote eukaryotes].
Trees constructed with other genes are generally similar, although they may place some early-branching groups very differently, thanks to [https://en.wikipedia.org/wiki/Long_branch_attraction long branch attraction]. The exact relationships of the three domains are still being debated, as is the position of the root of the tree. It has also been suggested that due to [https://en.wikipedia.org/wiki/Horizontal_gene_transfer lateral gene transfer], a tree may not be the best representation of the genetic relationships of all organisms. For instance some genetic evidence suggests that eukaryotes evolved from the union of some bacteria and archaea (one becoming an [https://en.wikipedia.org/wiki/Organelle organelle] and the other the main [https://en.wikipedia.org/wiki/Cell_(biology) cell]).
Autor: Eric Gaba, September 2006, [https://en.wikipedia.org/wiki/Wikimedia_Commons Wikimedia Commons]</ref> ]]
'''Engine Similarity''',<br/>
a loosely defined relation between (two) chess engines concerning their positional playing style, therefor mostly dependent on their [[Evaluation|evaluation]] features and weights.
One approach to assess engine similarity is to [https://en.wikipedia.org/wiki/Similarity_measure count] how often these engines agree with the same move after a shallow [[Search|search]]
over a set of carefully selected, quiet [[Test-Positions|test positions]] with apparently several possible best moves - another, in '''k-best''' mode, how often they propose the same ranking of k moves.
A relative high similarity measure between two engines <ref>i.e. > 65% in SIM03></ref> could be a symptom of using similar evaluation ideas, features and weights, along with [[Automated Tuning|automated tuning]] (or trainig), or even code copying aka [[:Category:Clone|cloning]].
Similarity testing is intended as first automated "[https://en.wikipedia.org/wiki/Screening_(medicine) screening]" to trigger further investigations in case moves are too similar.
=Similarity Testers=
In December 2010, [[Don Dailey]] published '''SIM03''' to test the similary with a set of [[UCI]] compliant engines with '''8238''' in-build positions - still freely available from the [[Komodo]] site <ref>[https://komodochess.com/downloads.htm Komodo Chess Engine - Official Site] with Similary tester version 03 download</ref>.
A pair of different chess engines could then be compared for similarity by matching up and counting the number of positions for which each engine chose the same move.
'''SIMEX''' is a more user friendly successor by [[Ed Schroder|Ed Schröder]] <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71709 SIMEX 2.1] provided by [[Ed Schroder|Ed Schröder]], [[CCC]], September 01, 2019</ref> using external [[Extended Position Description|EPD]]-files.
Overall similarity of multiple engines may be visualized as [https://en.wikipedia.org/wiki/Hierarchical_clustering hierarchical clustering] [https://en.wikipedia.org/wiki/Dendrogram dendrogram] <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70390 How to measure overall similarity] by [[Ferdinand Mosca]], [[CCC]], April 02, 2019</ref>.
=See also=
* [[:Category:Clone|Category:Clone]]
* [[:Category:Derivative|Category:Derivative]]
* [[ICGA Investigations]]
* [[Engine Testing]]
* [[Match Statistics]]
* [[Playing Strength]]
=Publications=
* [[Ingo Althöfer]] ('''1997'''). ''On the k-best Mode in Computer Chess: Measuring the Similarity of Move Proposals.'' [[ICGA Journal#20_3|ICCA Journal, Vol. 20, No. 3]]
* [[Mark Levene]], [[Judit Bar-Ilan]] ('''2005'''). ''[https://www.researchgate.net/publication/220174440_Comparing_Move_Choices_of_Chess_Search_Engines Comparing Move Choices of Chess Search Engines]''. [[ICGA Journal#28_2|ICGA Journal, Vol. 28, No. 2]], [http://www.dcs.bbk.ac.uk/~mark/download/fritz_junior_icga.pdf pdf]
* [[Paolo Ciancarini]], [[Gian Piero Favini]] ('''2009'''). ''[https://www.sciencedirect.com/science/article/pii/S1875952109000020 Detecting clones in game-playing software]''. [http://www.journals.elsevier.com/entertainment-computing/ Entertainment Computing], Vol. 1, No. 1
* [[Don Dailey]], [[Adam Hair]], [[Mark Watkins]] ('''2014'''). ''[http://www.sciencedirect.com/science/article/pii/S1875952113000177 Move Similarity Analysis in Chess Programs]''. [http://www.journals.elsevier.com/entertainment-computing/ Entertainment Computing], Vol. 5, No. 3, [http://magma.maths.usyd.edu.au/~watkins/papers/DHW.pdf preprint as pdf] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=38772 Pairwise Analysis of Chess Engine Move Selections] by [[Adam Hair]], [[CCC]], April 17, 2011</ref>
=Forum Posts=
==1999==
* [https://www.stmintz.com/ccc/index.php?id=40708 Chess program similarity experiment] by [[Bruce Moreland]], [[CCC]], January 24, 1999
* [https://www.stmintz.com/ccc/index.php?id=40940 This test is not scientific!] by [[Don Dailey]], [[CCC]], January 26, 1999
: [https://www.stmintz.com/ccc/index.php?id=40948 Re: This test is not scientific!] by [[Don Dailey]], [[CCC]], January 26, 1999
==2000 ...==
* [http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?tid=6772 question to vas on similarity of rybka 1.0 to fruit] by duncan, [[Computer Chess Forums|Rybka Forum]], August 25, 2008
==2010 ...==
* [http://www.talkchess.com/forum/viewtopic.php?t=37308 Similarity Detector Available] by [[Don Dailey]], [[CCC]], December 26, 2010
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=37381 Cluster analysis of similarity test] by [[Miguel A. Ballicora]], [[CCC]], December 31, 2010
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=38086 Similarity testing for source code] by [[Mark Lefler]], [[CCC]], February 16, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=38772 Pairwise Analysis of Chess Engine Move Selections] by [[Adam Hair]], [[CCC]], April 17, 2011
* [http://www.talkchess.com/forum3/viewtopic.php?f=10&t=40795 Fritz and Naum shown as Rybka/Strelka clones] by [[Kai Laskos]], [[CCC]] (Engine Origins), October 17, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=42737 Pairwise Analysis of Chess Engine Move Selections Revisited] by [[Adam Hair]], [[CCC]], March 04, 2012
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=44874 Similarity tool myth - debunked] by [[Don Dailey]], [[CCC]], August 23, 2012
* [http://www.open-chess.org/viewtopic.php?f=5&t=2531 Fritz 11] by [[Ed Schroder|Rebel]], [[Computer Chess Forums|OpenChess Forum]], December 10, 2013
==2015 ...==
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=55066 Similarity test] by [[Martin Sedlak]], [[CCC]], January 24, 2015 » [[Cheng]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=60012 Similarity test for Capivara > version 0.0.8 available?] by [[Günther Simon]], [[CCC]], May 01, 2016 » [[Capivara]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=62364 New Similarity Dendrogram] by [[Kai Laskos]], [[CCC]], December 03, 2016 (Images broken links)
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70197 Experiment 11 - Similarity between the top engines back then and now] by [[Ed Schroder|Ed Schröder]], [[CCC]], March 14, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70390 How to measure overall similarity] by [[Ferdinand Mosca]], [[CCC]], April 02, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70633 Why all Lc0 runs result in such similarity of quiet moves selection?] by [[Kai Laskos]], [[CCC]], May 01, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71497 Similarity tester - 2nd generation - BETA] by [[Ed Schroder|Ed Schröder]], [[CCC]], August 09, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=71610 What the heck happens here?] by [[Kai Laskos]], [[CCC]], August 20, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71709 SIMEX 2.1] by [[Ed Schroder|Ed Schröder]], [[CCC]], September 01, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71892 Similarity Report 2019] by [[Ed Schroder|Ed Schröder]], [[CCC]] (Engine Origins), September 23, 2019
=External Links=
==Chess Engines==
* [https://komodochess.com/downloads.htm Komodo Chess Engine - Official Site] with Similary tester version 03 download
* [http://rebel13.nl/misc/simex.html Similary tester 2nd generation] (SIMEX) by [[Ed Schroder|Ed Schröder]]
* [http://rebel13.nl/misc/sim2019.html Similarity Report 2019] by [[Ed Schroder|Ed Schröder]]
==Misc==
* [https://en.wikipedia.org/wiki/Similarity Similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Similarity_(geometry) Similarity (geometry) from Wikipedia]
* [https://en.wikipedia.org/wiki/Lexical_similarity Lexical similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Semantic_similarity Semantic similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Structural_similarity Structural similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Similarity_measure Similarity measure from Wikipedia]
* [https://en.wikipedia.org/wiki/Dendrogram Dendrogram from Wikipedia]
* [https://en.wikipedia.org/wiki/Hierarchical_clustering Hierarchical clustering from Wikipedia]
=References=
<references />
'''[[Engines|Up one Level]]'''
[[FILE:Phylogenetic tree.svg|border|right|thumb| A [https://en.wikipedia.org/wiki/Dendrogram dendrogram] of the [https://en.wikipedia.org/wiki/Tree_of_life Tree of Life] <ref>
A [https://en.wikipedia.org/wiki/Phylogenetic_tree phylogenetic tree] of [https://en.wikipedia.org/wiki/Life living things], based on [https://en.wikipedia.org/wiki/RNA RNA] data and proposed by [https://en.wikipedia.org/wiki/Carl_Woese Carl Woese],
showing the separation of [https://en.wikipedia.org/wiki/Bacteria bacteria], [https://en.wikipedia.org/wiki/Archaea archaea], and [https://en.wikipedia.org/wiki/Eukaryote eukaryotes].
Trees constructed with other genes are generally similar, although they may place some early-branching groups very differently, thanks to [https://en.wikipedia.org/wiki/Long_branch_attraction long branch attraction]. The exact relationships of the three domains are still being debated, as is the position of the root of the tree. It has also been suggested that due to [https://en.wikipedia.org/wiki/Horizontal_gene_transfer lateral gene transfer], a tree may not be the best representation of the genetic relationships of all organisms. For instance some genetic evidence suggests that eukaryotes evolved from the union of some bacteria and archaea (one becoming an [https://en.wikipedia.org/wiki/Organelle organelle] and the other the main [https://en.wikipedia.org/wiki/Cell_(biology) cell]).
Autor: Eric Gaba, September 2006, [https://en.wikipedia.org/wiki/Wikimedia_Commons Wikimedia Commons]</ref> ]]
'''Engine Similarity''',<br/>
a loosely defined relation between (two) chess engines concerning their positional playing style, therefor mostly dependent on their [[Evaluation|evaluation]] features and weights.
One approach to assess engine similarity is to [https://en.wikipedia.org/wiki/Similarity_measure count] how often these engines agree with the same move after a shallow [[Search|search]]
over a set of carefully selected, quiet [[Test-Positions|test positions]] with apparently several possible best moves - another, in '''k-best''' mode, how often they propose the same ranking of k moves.
A relative high similarity measure between two engines <ref>i.e. > 65% in SIM03></ref> could be a symptom of using similar evaluation ideas, features and weights, along with [[Automated Tuning|automated tuning]] (or trainig), or even code copying aka [[:Category:Clone|cloning]].
Similarity testing is intended as first automated "[https://en.wikipedia.org/wiki/Screening_(medicine) screening]" to trigger further investigations in case moves are too similar.
=Similarity Testers=
In December 2010, [[Don Dailey]] published '''SIM03''' to test the similary with a set of [[UCI]] compliant engines with '''8238''' in-build positions - still freely available from the [[Komodo]] site <ref>[https://komodochess.com/downloads.htm Komodo Chess Engine - Official Site] with Similary tester version 03 download</ref>.
A pair of different chess engines could then be compared for similarity by matching up and counting the number of positions for which each engine chose the same move.
'''SIMEX''' is a more user friendly successor by [[Ed Schroder|Ed Schröder]] <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71709 SIMEX 2.1] provided by [[Ed Schroder|Ed Schröder]], [[CCC]], September 01, 2019</ref> using external [[Extended Position Description|EPD]]-files.
Overall similarity of multiple engines may be visualized as [https://en.wikipedia.org/wiki/Hierarchical_clustering hierarchical clustering] [https://en.wikipedia.org/wiki/Dendrogram dendrogram] <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70390 How to measure overall similarity] by [[Ferdinand Mosca]], [[CCC]], April 02, 2019</ref>.
=See also=
* [[:Category:Clone|Category:Clone]]
* [[:Category:Derivative|Category:Derivative]]
* [[ICGA Investigations]]
* [[Engine Testing]]
* [[Match Statistics]]
* [[Playing Strength]]
=Publications=
* [[Ingo Althöfer]] ('''1997'''). ''On the k-best Mode in Computer Chess: Measuring the Similarity of Move Proposals.'' [[ICGA Journal#20_3|ICCA Journal, Vol. 20, No. 3]]
* [[Mark Levene]], [[Judit Bar-Ilan]] ('''2005'''). ''[https://www.researchgate.net/publication/220174440_Comparing_Move_Choices_of_Chess_Search_Engines Comparing Move Choices of Chess Search Engines]''. [[ICGA Journal#28_2|ICGA Journal, Vol. 28, No. 2]], [http://www.dcs.bbk.ac.uk/~mark/download/fritz_junior_icga.pdf pdf]
* [[Paolo Ciancarini]], [[Gian Piero Favini]] ('''2009'''). ''[https://www.sciencedirect.com/science/article/pii/S1875952109000020 Detecting clones in game-playing software]''. [http://www.journals.elsevier.com/entertainment-computing/ Entertainment Computing], Vol. 1, No. 1
* [[Don Dailey]], [[Adam Hair]], [[Mark Watkins]] ('''2014'''). ''[http://www.sciencedirect.com/science/article/pii/S1875952113000177 Move Similarity Analysis in Chess Programs]''. [http://www.journals.elsevier.com/entertainment-computing/ Entertainment Computing], Vol. 5, No. 3, [http://magma.maths.usyd.edu.au/~watkins/papers/DHW.pdf preprint as pdf] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=38772 Pairwise Analysis of Chess Engine Move Selections] by [[Adam Hair]], [[CCC]], April 17, 2011</ref>
=Forum Posts=
==1999==
* [https://www.stmintz.com/ccc/index.php?id=40708 Chess program similarity experiment] by [[Bruce Moreland]], [[CCC]], January 24, 1999
* [https://www.stmintz.com/ccc/index.php?id=40940 This test is not scientific!] by [[Don Dailey]], [[CCC]], January 26, 1999
: [https://www.stmintz.com/ccc/index.php?id=40948 Re: This test is not scientific!] by [[Don Dailey]], [[CCC]], January 26, 1999
==2000 ...==
* [http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?tid=6772 question to vas on similarity of rybka 1.0 to fruit] by duncan, [[Computer Chess Forums|Rybka Forum]], August 25, 2008
==2010 ...==
* [http://www.talkchess.com/forum/viewtopic.php?t=37308 Similarity Detector Available] by [[Don Dailey]], [[CCC]], December 26, 2010
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=37381 Cluster analysis of similarity test] by [[Miguel A. Ballicora]], [[CCC]], December 31, 2010
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=38086 Similarity testing for source code] by [[Mark Lefler]], [[CCC]], February 16, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=38772 Pairwise Analysis of Chess Engine Move Selections] by [[Adam Hair]], [[CCC]], April 17, 2011
* [http://www.talkchess.com/forum3/viewtopic.php?f=10&t=40795 Fritz and Naum shown as Rybka/Strelka clones] by [[Kai Laskos]], [[CCC]] (Engine Origins), October 17, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=42737 Pairwise Analysis of Chess Engine Move Selections Revisited] by [[Adam Hair]], [[CCC]], March 04, 2012
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=44874 Similarity tool myth - debunked] by [[Don Dailey]], [[CCC]], August 23, 2012
* [http://www.open-chess.org/viewtopic.php?f=5&t=2531 Fritz 11] by [[Ed Schroder|Rebel]], [[Computer Chess Forums|OpenChess Forum]], December 10, 2013
==2015 ...==
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=55066 Similarity test] by [[Martin Sedlak]], [[CCC]], January 24, 2015 » [[Cheng]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=60012 Similarity test for Capivara > version 0.0.8 available?] by [[Günther Simon]], [[CCC]], May 01, 2016 » [[Capivara]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=62364 New Similarity Dendrogram] by [[Kai Laskos]], [[CCC]], December 03, 2016 (Images broken links)
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70197 Experiment 11 - Similarity between the top engines back then and now] by [[Ed Schroder|Ed Schröder]], [[CCC]], March 14, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70390 How to measure overall similarity] by [[Ferdinand Mosca]], [[CCC]], April 02, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=70633 Why all Lc0 runs result in such similarity of quiet moves selection?] by [[Kai Laskos]], [[CCC]], May 01, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71497 Similarity tester - 2nd generation - BETA] by [[Ed Schroder|Ed Schröder]], [[CCC]], August 09, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=71610 What the heck happens here?] by [[Kai Laskos]], [[CCC]], August 20, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71709 SIMEX 2.1] by [[Ed Schroder|Ed Schröder]], [[CCC]], September 01, 2019
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=71892 Similarity Report 2019] by [[Ed Schroder|Ed Schröder]], [[CCC]] (Engine Origins), September 23, 2019
=External Links=
==Chess Engines==
* [https://komodochess.com/downloads.htm Komodo Chess Engine - Official Site] with Similary tester version 03 download
* [http://rebel13.nl/misc/simex.html Similary tester 2nd generation] (SIMEX) by [[Ed Schroder|Ed Schröder]]
* [http://rebel13.nl/misc/sim2019.html Similarity Report 2019] by [[Ed Schroder|Ed Schröder]]
==Misc==
* [https://en.wikipedia.org/wiki/Similarity Similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Similarity_(geometry) Similarity (geometry) from Wikipedia]
* [https://en.wikipedia.org/wiki/Lexical_similarity Lexical similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Semantic_similarity Semantic similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Structural_similarity Structural similarity from Wikipedia]
* [https://en.wikipedia.org/wiki/Similarity_measure Similarity measure from Wikipedia]
* [https://en.wikipedia.org/wiki/Dendrogram Dendrogram from Wikipedia]
* [https://en.wikipedia.org/wiki/Hierarchical_clustering Hierarchical clustering from Wikipedia]
=References=
<references />
'''[[Engines|Up one Level]]'''
