Changes

Jump to: navigation, search

Match Statistics

5,150 bytes added, 11:53, 17 October 2019
no edit summary
</pre>
<span id="TournamentManager"></span>
=Tournament ManagerTournaments=* [[ArenaChess Server]]* [[Amoeba#TournamentManager|Amoeba Tournament ManagerEngine Rating Lists]]* [[ChessGUI]]* [[Cutechess-cliTournament Manager]]* [[LittleBlitzerTournaments and Matches]]
=See also=
* [[Automated Tuning]]
* [[Bishop versus Knight#WinningPercantages|Bishop versus Knight - Winning Percentages]]
* [[Chess Server]]
* [[Depth#DiminishingReturns|Depth | Diminishing Returns]]
* [[Draw]]
* [[Engine Rating ListsSimilarity]]
* [[LOS Table]]
* [[Pawn Advantage, Win Percentage, and Elo]]
* [[Playing Strength]]
* [[Search Statistics]]
* [[Alexander Szabo#TechnologyCurve|The Technology Curve]]
* [[Time Management#Time%20Controls|Time Controls]]
* [[Jean-Marc Alliot#WhoistheMaster|Who is the Master?]]
=Publications=
==1920 ...==
* [[Mathematician#LLThurstone|L. L. Thurstone]] ('''1927'''). ''[https://psycnet.apa.org/record/1928-00527-001 A law of comparative judgement]''. [https://en.wikipedia.org/wiki/Psychological_Review Psychological Review], Vol. 34, No. 4 <ref>[https://en.wikipedia.org/wiki/Law_of_comparative_judgment Law of comparative judgment - Wikipedia]</ref>
* [[Ernst Zermelo]] ('''1929'''). ''Die Berechnung der Turnier-Ergebnisse als ein Maximumproblem der Wahrscheinlichkeitsrechnung''. [http://gdz.sub.uni-goettingen.de/dms/load/img/?IDDOC=82727 pdf] (German)
==1940 ...==
* [[Mathematician#AWald|Abraham Wald]] ('''1945'''). ''Sequential Tests of Statistical Hypotheses''. [https://en.wikipedia.org/wiki/Annals_of_Mathematical_Statistics Annals of Mathematical Statistics], Vol. 16, No. 2, [https://en.wikipedia.org/wiki/Digital_object_identifier doi]: [http://projecteuclid.org/euclid.aoms/1177731118 10.1214/aoms/1177731118]
* [[Mathematician#AWald|Abraham Wald]] ('''1947'''). ''Sequential Analysis''. [https://en.wikipedia.org/wiki/John_Wiley_%26_Sons John Wiley and Sons], [http://www.abebooks.com/book-search/title/sequential-analysis/author/abraham-wald/ AbeBooks]
==1950 ...==* [[Mathematician#Mosteller|Frederick Mosteller]] ('''1951'''). ''[https://psycnet.apa.org/record/1951-07176-001 Remarks on the method of paired comparisons: I. The least squares solution assuming equal standard deviations and equal correlations]''. [https://en.wikipedia.org/wiki/Psychometrika Psychometrika], Vol. 16, No. 1* [[Mathematician#RABradley|Ralph A. Bradley]], [[Mathematician#METerry|Milton E. Terry]] ('''1952'''). ''[http://biomet.oxfordjournals.org/content/39/3-4/324.citation Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons]''. [https://en.wikipedia.org/wiki/Biometrika Biometrika], Vol. 39, Nos. 3/4, [https://en.wikipedia.org/wiki/Digital_object_identifier doi]: 10.2307/2334029, [http://www.jstor.org/stable/2334029?seq=1#page_scan_tab_contents JSTOR 2334029]
==1960 ...==
* [[Mathematician#WAGlenn|William A. Glenn]], [[Mathematician#HADavid|Herbert A. David]] ('''1960'''). ''[https://www.jstor.org/stable/2527957?seq=1#page_scan_tab_contents Ties in Paired-Comparison Experiments Using a Modified Thurstone-Mosteller Model]''. [https://en.wikipedia.org/wiki/Biometrics_(journal) Biometrics], Vol. 16, No. 1* [[Mathematician#FNDavid|Florence Nightingale David]] ('''1962'''). ''[http://books.google.com/books/about/Games_Gods_and_Gambling.html?id=8ddP8zNx9nQC&redir_esc=y Games, Gods & Gambling: A History of Probability and Statistical Ideas]''. [https://en.wikipedia.org/wiki/Dover_Publications Dover Publications]* [[Mathematician#PVRao|P. V. Rao]], ISBN[[Mathematician#LLKupper|L. L. Kupper]] ('''1967'''). ''[https://www.tandfonline.com/doi/abs/10.1080/01621459.1967.10482901 Ties in Paired-13Comparison Experiments: 978A Generalization of the Bradley-0486400235Terry Model]''. [https://en.wikipedia.org/wiki/Journal_of_the_American_Statistical_Association Journal of the American Statistical Association], Vol. 62, No. 317==1970 ...==* [https://www.semanticscholar.org/author/Roger-R.-Davidson/32819150 Roger R. Davidson] ('''1970'''). ''[https://www.jstor.org/stable/2283595 On Extending the Bradley-Terry Model to Accommodate Ties in Paired Comparison Experiments]''. [https://en.wikipedia.org/wiki/Journal_of_the_American_Statistical_Association Journal of the American Statistical Association], Vol. 64, No. 329* <span id="Bloss"></span>[http://what-when-how.com/earth-scientists/bloss-f-donald-earth-scientist/ F. Donald Bloss] ('''1973'''). ''[https://www.amazon.de/Rate-Your-Chess-F-Donald-Bloss/dp/0442008295 Rate your own Chess]''. Van Nostrand Reinhold Inc.
* [[Tony Marsland]], [[Paul Rushton]] ('''1973'''). ''[http://dl.acm.org/citation.cfm?id=805703 Mechanisms for Comparing Chess Programs].'' [[ACM 1973|ACM Annual Conference]], [http://webdocs.cs.ualberta.ca/~tony/OldPapers/Marsland-Rushton-ACM73 pdf]
* [[James Gillogly]] ('''1978'''). ''Performance Analysis of the Technology Chess Program''. Ph.D. Thesis. Tech. Report CMU-CS-78-189, [[Carnegie Mellon University]], [http://reports-archive.adm.cs.cmu.edu/anon/anon/usr/ftp/scan/CMU-CS-77-gillogly.pdf CMU-CS-77 pdf] » [[Tech]]
* [[David Cahlander]] ('''1979'''). ''Strength of a Chess Playing Computer''. [[ICGA Journal#2_1|ICCA Newsletter, Vol. 2, No. 1]]
* [[Jack Good]] ('''1979'''). ''On the Grading of Chess Players''. [[Personal Computing#3_3|Personal Computing, Vol. 3, No. 3]], pp. 47
* <span id="Ratliff"></span>[[Gary L. Ratliff]] ('''1979'''). ''Practical Rating Program''. [[Personal Computing#3_9|Personal Computing, Vol. 3, No. 9]], pp. 62 » [[#Bloss|Bloss]]
* [[Frieder Schwenkel]] ('''1979'''). ''Berating the ratings system''. [[Personal Computing#3_11|Personal Computing, Vol. 3, No. 11]], pp. 77 » [[#Ratliff|Ratliff]], [[#Bloss|Bloss]]
* [[John Shaposka]] ('''1979'''). ''"JS" Takes the Bloss Test''. [[Personal Computing#3_12|Personal Computing, Vol. 3, No. 12]], pp. 75 » [[#Ratliff|Ratliff]], [[#Bloss|Bloss]]
==1980 ...==
* Floyd R. Kirk ('''1980'''). ''Bloss Flunks Test''. [[Personal Computing#4_8|Personal Computing, Vol. 4, No. 8]], pp. 72 » [[#Ratliff|Ratliff]], [[#Bloss|Bloss]]
* [[John F. White]] ('''1981'''). ''[http://yourcomputeronline.wordpress.com/2010/12/10/survey-chess-games/ Survey-Chess Games]''. [[Your Computer]], [http://yourcomputeronline.wordpress.com/2010/10/31/augustseptember-1981-contents-and-editorial/ August/September 1981] <ref>[https://en.wikipedia.org/wiki/The_Master_Game The Master Game from Wikipedia]</ref>
* [[Ken Thompson]] ('''1982'''). ''Computer Chess Strength''. [[Advances in Computer Chess 3]]
==1990 ...==
* [[Hans Berliner]], [[Gordon Goetsch]], [[Murray Campbell]], [[Carl Ebeling]] ('''1990'''). ''Measuring the Performance Potential of Chess Programs.'' [https://en.wikipedia.org/wiki/Artificial_Intelligence_%28journal%29 Artificial Intelligence], Vol. 43, No. 1
* [http://www.ics.uci.edu/~sternh/ [Mathematician#HSStern|Hal Stern]] ('''1990'''). ''Are all Linear Paired Comparison Models Equivalent''. [http://www.dtic.mil/dtic/tr/fulltext/u2/a236856.pdf pdf]
* [[Eric Hallsworth]] ('''1990'''). ''Speed, Processors and Ratings''. [[Selective Search|Computer Chess News Sheet]] 25, pp 6, [http://www.chesscomputeruk.com/SS_25.pdf pdf] hosted by [[Mike Watters]]
* [[Hans Berliner]], [[Danny Kopec]], [[Ed Northam]] ('''1991'''). ''A taxonomy of concepts for evaluating chess strength: examples from two difficult categories''. [[Advances in Computer Chess 6]], [http://www.sci.brooklyn.cuny.edu/%7Ekopec/Publications/Publications/O_20_C.pdf pdf]
* [[Steve Maughan]] ('''1992'''). ''Are You Sure It's Better?'' [[Selective Search]] 40, pp. 21, [http://www.chesscomputeruk.com/SS_40.pdf pdf] hosted by [[Mike Watters]]
* [[Warren D. Smith]] ('''1993'''). ''Rating Systems for Gameplayers, and Learning''. [http://scorevoting.net/WarrenSmithPages/homepage/ratingspap.ps ps]
* [[Mark E. Glickman]] ('''1993'''). ''Paired Comparison Models with Time Varying Parameters''. Ph.D. thesis, [[Harvard University]], advisor [[Mathematician#HSStern|Hal Stern]], [http://www.glicko.net/research/thesis.pdf pdf]
* [[Mark E. Glickman]] ('''1995'''). ''A Comprehensive Guide To Chess Ratings''. [http://www.glicko.net/research/acjpaper.pdf pdf]
* [[Mark E. Glickman]], [[Christopher Chabris]] ('''1996'''). ''Using Chess Ratings as Data in Psychological Research''. [https://pdfs.semanticscholar.org/1ffd/3432f56476f0047426b37f7f433f5a6575b0.pdf pdf]
* [[Robert Hyatt]], [[Monroe Newborn]] ('''1997'''). ''CRAFTY Goes Deep''. [[ICGA Journal#20_2|ICCA Journal, Vol. 20, No. 2]] » [[Crafty]]
* [[Mark E. Glickman]], [[Mathematician#ACJones|Albyn C. Jones]] ('''1999'''). ''Rating the Chess Rating System''. [http://www.glicko.net/research/chance.pdf pdf]
==2000 ...==
* [[Ernst A. Heinz]] ('''2000'''). ''[http://link.springer.com/chapter/10.1007/3-540-45579-5_18 New Self-Play Results in Computer Chess]''. [[CG 2000]]
==2005 ...==
* [[Jan Renze Steenhuisen]] ('''2005'''). ''New Results in Deep-Search Behaviour''. [[ICGA Journal#28_4|ICGA Journal, Vol. 28, No. 4]], [http://www.st.ewi.tudelft.nl/%7Erenze/doc/ICGA_2005_4_DeepSearch.pdf pdf]
* [[Mark Levene]], [[Judit Bar-Ilan]] ('''2005'''). ''[https://www.researchgate.net/publication/220174440_Comparing_Move_Choices_of_Chess_Search_Engines Comparing Move Choices of Chess Search Engines]''. [[ICGA Journal#28_2|ICGA Journal, Vol. 28, No. 2]], [http://www.dcs.bbk.ac.uk/~mark/download/fritz_junior_icga.pdf pdf] » [[Fritz]], [[Junior]]
* [[Mark Levene]], [[Judit Bar-Ilan]] ('''2006'''). ''Comparing Typical Opening Move Choices Made by Humans and Chess Engines''. [https://arxiv.org/abs/cs/0610060 arXiv:cs/0610060]
* [[Mark Levene]], [[Judit Bar-Ilan]] ('''2007'''). ''Comparing Typical Opening Move Choices Made by Humans and Chess Engines''. [https://en.wikipedia.org/wiki/The_Computer_Journal The Computer Journal], Vol. 50, No. 5
* [[Matej Guid]], [[Ivan Bratko]] ('''2007'''). ''Factors affecting diminishing returns for searching deeper''. [[CGW 2007]] » [[Crafty]], [[Rybka]], [[Shredder]], [[Depth#DiminishingReturns|Diminishing Returns]]
* [[Jeff Rollason]] ('''2007'''). ''[http://www.aifactory.co.uk/newsletter/2007_04_stat_minefields.htm Statistical Minefields with Version Testing]''. [[AI Factory]], Winter 2007 » [[Engine Testing]]
* [[Shogo Takeuchi]], [[Tomoyuki Kaneko]], [[Kazunori Yamaguchi]], [[Satoru Kawai]] ('''2007'''). ''Visualization and Adjustment of Evaluation Functions Based on Evaluation Values and Win Probability''. [http://www.informatik.uni-trier.de/~ley/db/conf/aaai/aaai2007.html AAAI 2007], [https://www.aaai.org/Papers/AAAI/2007/AAAI07-136.pdf pdf]
* [[Rémi Coulom]] ('''2008'''). ''[http://link.springer.com/chapter/10.1007/978-3-540-87608-3_11 Whole-History Rating: A Bayesian Rating System for Players of Time-Varying Strength]''. [[CG 2008]], [http://remi.coulom.free.fr/WHR/WHR.pdf draft as pdf]
* [[Giuseppe Di Fatta]], [[Guy Haworth|Guy McCrossan Haworth]], [[Kenneth Wingate W. Regan]] ('''2009'''). ''Skill Rating by Bayesian Inference''. [http://www.informatik.uni-trier.de/~ley/db/conf/cidm/cidm2009.html CIDM 2009], [http://www.cse.buffalo.edu/~regan/papers/pdf/DFHR09.pdf pdf] <ref>[https://en.wikipedia.org/wiki/Bayesian_inference Bayesian inference from Wikipedia]</ref>* [[Guy Haworth|Guy McCrossan Haworth]], [[Kenneth Wingate W. Regan]], [[Giuseppe Di Fatta]] ('''2009'''). ''Performance and Prediction: Bayesian Modelling of Fallible Choice in Chess''. [[Advances in Computer Games 12]], [http://www.cse.buffalo.edu/faculty/regan/papers/pdf/HRdF10.pdf pdf]
==2010 ...==
* [[Diogo R. Ferreira]] ('''2010'''). ''[http://web.ist.utl.pt/diogo.ferreira/chess/ Predicting the Outcome of Chess Games based on Historical Data]''. [https://en.wikipedia.org/wiki/Instituto_Superior_T%C3%A9cnico IST] - [https://en.wikipedia.org/wiki/Technical_University_of_Lisbon Technical University of Lisbon] <ref>[http://blog.kaggle.com/2010/11/30/how-i-did-it-diogo-ferreira-on-4th-place-in-elo-chess-ratings-competition/ How I did it: Diogo Ferreira on 4th place in Elo chess ratings competition | no free hunch]</ref>
* [[Kenneth Wingate Regan|Kenneth W. Regan]], [[Guy Haworth]] ('''2011'''). ''[http://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/view/3779 Intrinsic Chess Ratings]''. [http://www.informatik.uni-trier.de/%7Eley/db/conf/aaai/aaai2011.html#ReganH11 AAAI 2011], [http://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/view/3779/3962 pdf], [http://www.cse.buffalo.edu/%7Eregan/Talks/IntrinsicRatings.pdf slides as pdf] <ref> [http://www.talkchess.com/forum/viewtopic.php?t=65772 "Intrinsic Chess Ratings" by Regan, Haworth -- seq] by Kai Middleton, [[CCC]], November 19, 2017</ref>* [[Kenneth Wingate W. Regan]], [[Bartłomiej Macieja]], [[Guy Haworth|Guy McCrossan Haworth]] ('''2011'''). ''[http://centaur.reading.ac.uk/23800/ Understanding Distributions of Chess Performances]''. [[Advances in Computer Games 13]], [http://www.cse.buffalo.edu/~regan/papers/pdf/RMH11.pdf pdf]* [[Trevor Fenner]], [[Mark Levene]], [[Mathematician#GLoizou|George Loizou]] ('''2011'''). ''A Discrete Evolutionary Model for Chess Players' Ratings''. [http://arxiv.org/list/physics.soc-ph/recent Physics and Society], [httphttps://arxiv.org/abs/1103.1530v2 1530 arXiv:1103.1530v21530]* [[Rémi Coulom]] ('''2012'''). ''Paired Comparisons with Ties: Modeling Game Outcomes in Chess''. [http://www.grappa.univ-lille3.fr/~coulom/ChessOutcomes.pdf pdf preprint] <ref>[http://www.talkchess.com/forum/viewtopic.php?topic_view=threads&p=471004&t=44180 Re: EloStat, Bayeselo and Ordo] by [[Rémi Coulom]], [[CCC]], June 25, 2012</ref>
* [[Diogo R. Ferreira]] ('''2012'''). ''Determining the Strength of Chess Players based on actual Play''. [[ICGA Journal#35_1|ICGA Journal, Vol. 35, No. 1]]
* [[Daniel Shawul]], [[Rémi Coulom]] ('''2013'''). ''Paired Comparisons with Ties: Modeling Game Outcomes in Chess''. <ref>[http://www.talkchess.com/forum/viewtopic.php?topic_view=threads&p=471004&t=44180 Re: EloStat, Bayeselo and Ordo] by [[Rémi Coulom]], [[CCC]], June 25, 2012</ref> <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=7&t=72087&start=3 Re: Understanding and Pushing the Limits of the Elo Rating Algorithm] by [[Daniel Shawul]], [[CCC]], October 15, 2019</ref>
* [[Diogo R. Ferreira]] ('''2013'''). ''The Impact of the Search Depth on Chess Playing Strength''. [[ICGA Journal#36_2|ICGA Journal, Vol. 36, No. 2]]
* [[Miguel A. Ballicora]] ('''2014'''). ''ORDO v0.9.6 Ratings for chess and other games''. September 2014, [https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxnYXZpb3RhY2hlc3NlbmdpbmV8Z3g6NmQ0NmNhNGM4YjA3YTc5ZQ pdf] » [[Ordo]] <ref>[https://sites.google.com/site/gaviotachessengine/ordo Ordo] by [[Miguel A. Ballicora]]</ref>
* [[Don Dailey]], [[Adam Hair]], [[Mark Watkins]] ('''2014'''). ''[http://www.sciencedirect.com/science/article/pii/S1875952113000177 Move Similarity Analysis in Chess Programs]''. [http://www.journals.elsevier.com/entertainment-computing/ Entertainment Computing], Vol. 5, No. 3, [http://magma.maths.usyd.edu.au/~watkins/papers/DHW.pdf preprint as pdf] <ref>[http://www.top-5000talkchess.nlcom/cloneforum/viewtopic.htm A php?t=38772 Pairwise Comparison Analysis of Chess Engine Move Selections] by [[Adam Hair]], hosted by [[Ed Schroder|Ed SchröderCCC]], April 17, 2011</ref>* [[Kenneth Wingate Regan|Kenneth W. Regan]], [[Tamal T. Biswas]], [[Jason Zhou]] ('''2014'''). ''Human and Computer Preferences at Chess''. [http://www.cse.buffalo.edu/~regan/papers/pdf/RBZ14aaai.pdf pdf]
* [[Erik Varend]] ('''2014'''). ''Quality of play in chess and methods for measuring''. [http://www.chessanalysis.ee/Quality%20of%20play%20in%20chess%20and%20methods%20for%20measuring.pdf pdf] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=54571 Questions regarding rating systems of humans and engines] by [[Erik Varend]], [[CCC]], December 06, 2014</ref> <ref>[http://www.talkchess.com/forum/viewtopic.php?t=60721 chess statistics scientific article] by Nuno Sousa, [[CCC]], July 06, 2016</ref>
==2015 ...==
* [[Tamal T. Biswas]], [[Kenneth Wingate Regan|Kenneth W. Regan]] ('''2015'''). ''Quantifying Depth and Complexity of Thinking and Knowledge''. [http://www.icaart.org/EuropeanProjectSpace.aspx?y=2015 ICAART 2015], [http://www.cse.buffalo.edu/~regan/papers/pdf/BiReICAART15CR.pdf pdf]* [[Tamal T. Biswas]], [[Kenneth Wingate Regan|Kenneth W. Regan]] ('''2015'''). ''Measuring Level-K Reasoning, Satisficing, and Human Error in Game-Play Data''. [[IEEE]] [http://www.icmla-conference.org/icmla15/ ICMLA 2015], [http://www.cse.buffalo.edu/~regan/papers/pdf/BiRe15_ICMLA2015.pdf pdf preprint]* [[Guy Haworth]], [[Tamal T. Biswas]], [[Kenneth Wingate Regan|Kenneth W. Regan]] ('''2015'''). ''[http://centaur.reading.ac.uk/39431/ A Comparative Review of Skill Assessment: Performance, Prediction and Profiling]''. [[Advances in Computer Games 14]]
* [[Shogo Takeuchi]], [[Tomoyuki Kaneko]] ('''2015'''). ''[http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7336038 Estimating Ratings of Computer Players by the Evaluation Scores and Principal Variations in Shogi]''. [http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=7335993 ACIT-CSI]
* [[Jean-Marc Alliot]] ('''2017'''). ''Who is the Master''? [[ICGA Journal#39_1|ICGA Journal, Vol. 39, No. 1]], [http://www.alliot.fr/CHESS/draft-icga-39-1.pdf draft as pdf] » [[Stockfish]], [[Jean-Marc Alliot#WhoistheMaster|Who is the Master?]] * [[Mathematician#IAdler|Ilan Adler]], [[Mathematician#YangCao|Yang Cao]], [[Richard Karp]], [[Mathematician#EAPekoz|Erol A. Peköz]], [[Mathematician#SMRoss|Sheldon M. Ross]] ('''2017'''). ''[https://pubsonline.informs.org/doi/10.1287/opre.2017.1657 Random Knockout Tournaments]''. [https://en.wikipedia.org/wiki/Operations_Research_(journal) Operations Research], Vol. 65, No. 6, [https://arxiv.org/abs/1612.04448 arXiv:1612.04448]* [[Leszek Szczecinski]], [[Aymen Djebbi]] ('''2019'''). ''Understanding and Pushing the Limits of the Elo Rating Algorithm''. [https://arxiv.org/abs/1910.06081 arXiv:1910.06081] <ref>[http://www.talkchess.com/forum3/viewtopic.php?f=7&t=72087 Understanding and Pushing the Limits of the Elo Rating Algorithm] by [[Michel Van den Bergh]], [[CCC]], October 15, 2019</ref>
=Forum & Blog Postings=
* [https://groups.google.com/d/msg/rec.games.chess.computer/GkgFc3jOl84/vWn-SG8kVboJ Theoretical chess rating question...] by Cyber Linguist, [[Computer Chess Forums|rgcc]], April 17, 1996
* [http://groups.google.com/group/rec.games.chess.computer/browse_frm/thread/3014e4ea570dbf38 Statistical validity of medium-length match results] by [[Bruce Moreland]], [[Computer Chess Forums|rgcc]], February 15, 1997
* [https://www.stmintz.com/ccc/index.php?id=24669 Small number statistics and small differences] by [[Daniel Homan]], [[CCC]], August 14, 1998
* [https://www.stmintz.com/ccc/index.php?id=24978 Re: Waltzing Matilda (was: statistics, 10 events tell us what ?] by [[Daniel Homan]], [[CCC]], August 17, 1998
* [https://www.stmintz.com/ccc/index.php?id=52542 ELO performance?] by [[Stefan Meyer-Kahlen]], [[CCC]], May 22, 1999 » [[Pawn Advantage, Win Percentage, and Elo]], [[Playing Strength]]
==2000 ...==
* [http://www.talkchess.com/forum/viewtopic.php?t=37056 SPRT and Engine testing] by [[Adam Hair]], [[CCC]], December 13, 2010 » [[Match Statistics#SPRT|SPRT]]
'''2011'''
* [http://www.talkchess.com/forum/viewtopic.php?t=38772 Pairwise Analysis of Chess Engine Move Selections] by [[Adam Hair]], [[CCC]], April 17, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=39511 Ply vs ELO] by Andriy Dzyben, [[CCC]], June 28, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=40193 One billion random games] by [[Steven Edwards]], [[CCC]], August 27, 2011
'''2012'''
* [http://www.talkchess.com/forum/viewtopic.php?t=42729 Advantage for White; Bayeselo (to Rémi Coulom)] by [[Edmund Moshammer]], [[CCC]], March 03, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=42737 Pairwise Analysis of Chess Engine Move Selections Revisited] by [[Adam Hair]], [[CCC]], March 04, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=44219 Human Elo ratings: averages and standard deviations] by [[Jesús Muñoz]], [[CCC]], March 18, 2012 <ref>[http://en.chessbase.com/post/arpad-elo-and-the-elo-rating-system Arpad Elo and the Elo Rating System] by [[Dan Ross]], [[ChessBase|ChessBase News]], December 16, 2007</ref>
* [http://www.talkchess.com/forum/viewtopic.php?t=42998 Elo uncertainties calculator] by [[Jesús Muñoz]], [[CCC]], March 24, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=43134 Elo versus speed] by [[Peter Österlund]], [[CCC]], April 02, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=43323 Pawn Advantage, Win Percentage, and Elo] by [[Adam Hair]], [[CCC]], April 15, 2012 » [[Pawn Advantage, Win Percentage, and Elo]]
* [http://www.talkchess.com/forum/viewtopic.php?t=43598 Elo Increase per Doubling] by [[Adam Hair]], [[CCC]], May 07, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=44003 Rybka odds matches and the strength of engines] by [[Kai Laskos]], [[CCC]], June 09, 2012 » [[Rybka]]
* [http://www.talkchess.com/forum/viewtopic.php?t=44147 A new way to compare chess programs] by [[Larry Kaufman]], [[CCC]], June 21, 2012 » [[Komodo]]
* [http://www.talkchess.com/forum/viewtopic.php?t=46572 A word for casual testers] by [[Don Dailey]], [[CCC]], December 25, 2012
'''2013'''
* [http://www.talkchess.com/forum/viewtopic.php?t=46759 A poor man's testing environment] by [[Ed Schroder|Ed Schröder]], [[CCC]], January 04, 2013 <ref>[http://www.top-5000.nl/tuning.htm Testing a chess engine from the ground up] from [http://www.top-5000.nl/ Home of the Dutch Rebel] by [[Ed Schroder|Ed Schröder]]</ref> » [[Engine Testing]]
* [http://www.talkchess.com/forum/viewtopic.php?t=46786 Noise in ELO estimators: a quantitative approach] by [[Marco Costalba]], [[CCC]], January 06, 2013
* [http://www.talkchess.com/forum/viewtopic.php?t=47086 Updated Dendrogram] by [[Kai Laskos]], [[CCC]], February 02, 2013
* [http://www.talkchess.com/forum/viewtopic.php?t=56095 Getting SPRT right] by [[Alexandru Mosoi]], [[CCC]], April 22, 2015 » [[Match Statistics#SPRT|SPRT]]
* [http://www.talkchess.com/forum/viewtopic.php?t=56358 SPRT questions] by [[Uri Blass]], [[CCC]], May 15, 2015 » [[Match Statistics#SPRT|SPRT]]
* [http://www.talkchess.com/forum/viewtopic.php?t=56426 Adam Hair's article on Pairwise comparison of engines] by [[Charles Roberson]], [[CCC]], May 19, 2015 <ref>[http://www.top-5000.nl/clone.htm A Pairwise Comparison of Chess Engine Move Selections] by [[Adam Hair]], hosted by [[Ed Schroder|Ed Schröder]]</ref>
* [http://www.talkchess.com/forum/viewtopic.php?t=57223 computing elo of multiple chess engines] by [[Alexandru Mosoi]], [[CCC]], August 09, 2015
* [http://www.talkchess.com/forum/viewtopic.php?t=57270 Some musings about search] by [[Ed Schroder|Ed Schröder]], [[CCC]], August 14, 2015 » [[Automated Tuning]], [[Search]]
* [http://www.talkchess.com/forum/viewtopic.php?t=57482 Name for elo without draws?] by [[Marcel van Kervinck]], [[CCC]], September 02, 2015
* [http://www.talkchess.com/forum/viewtopic.php?t=57696 The future of chess and elo ratings] by [[Larry Kaufman]], [[CCC]], September 20, 2015 » [[Opening Book]]
* [https://rjlipton.wordpress.com/2015/10/06/depth-of-satisficing/ Depth of Satisficing] by [[Kenneth Wingate W. Regan|Ken Regan]], [https://rjlipton.wordpress.com/ Gödel's Lost Letter and P=NP], October 06, 2015 » [[Depth]], [[Match Statistics]], [[Pawn Advantage, Win Percentage, and Elo]], [[Stockfish]], [[Komodo]] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=57890 Regan's latest: Depth of Satisficing] by [[Carl Lumma]], [[CCC]], October 09, 2015</ref>
* [http://www.talkchess.com/forum/viewtopic.php?t=57969 ELO error margin] by [[Fabio Gobbato]], [[CCC]], October 17, 2015
* [http://www.talkchess.com/forum/viewtopic.php?t=58067 testing multiple versions & elo calculation] by [[Folkert van Heusden]], [[CCC]], October 27, 2015
* [http://www.talkchess.com/forum/viewtopic.php?t=58600 Counting 1 win + 1 loss as 2 draws] by [[Kai Laskos]], [[CCC]], December 15, 2015
'''2016'''
* [https://rjlipton.wordpress.com/2016/01/21/a-chess-firewall-at-zero/ A Chess Firewall at Zero?] by [[Kenneth Wingate W. Regan|Ken Regan]], [https://rjlipton.wordpress.com/ Gödel's Lost Letter and P=NP], January 21, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=59038 Ordo 1.0.9 (new features for testers)] by [[Miguel A. Ballicora]], [[CCC]], January 25, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=59333 Why the errorbar is wrong ... simple example!] by [[Frank Quisinsky]], [[CCC]], February 23, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=61784 Doubling of time control] by [[Andreas Strangmüller]], [[CCC]], October 21, 2016 » [[Match Statistics#DoublingTC|Doubling TC]], [[Depth#DiminishingReturns|Diminishing Returns]], [[Playing Strength]], [[Komodo]]
* [http://www.talkchess.com/forum/viewtopic.php?t=62146 Stockfish 8 - Double time control vs. 2 threads] by [[Andreas Strangmüller]], [[CCC]], November 15, 2016 » [[Match Statistics#DoublingTC|Doubling TC]], [[Depth#DiminishingReturns|Diminishing Returns]], [[Playing Strength]], [[Stockfish]]
* [https://rjlipton.wordpress.com/2016/11/30/when-data-serves-turkey/ When Data Serves Turkey] by [[Kenneth Wingate W. Regan|Ken Regan]], [https://rjlipton.wordpress.com/ Gödel's Lost Letter and P=NP], November 30, 2016* [https://rjlipton.wordpress.com/2016/12/08/magnus-and-the-turkey-grinder/ Magnus and the Turkey Grinder] by [[Kenneth Wingate W. Regan|Ken Regan]], [https://rjlipton.wordpress.com/ Gödel's Lost Letter and P=NP], December 08, 2016 » [[Pawn Advantage, Win Percentage, and Elo]] <ref>[https://en.wikipedia.org/wiki/World_Chess_Championship_2016 World Chess Championship 2016 from Wikipedia]</ref>
* [http://www.talkchess.com/forum/viewtopic.php?t=62435 Regan's conundrum] by [[Carl Lumma]], [[CCC]], December 09, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=62438 Statistical Interpretation] by [[Dennis Sceviour]], [[CCC]], December 10, 2016
* [http://www.talkchess.com/forum/viewtopic.php?t=63875 Wilo rating properties from FGRL rating lists] by [[Kai Laskos]], [[CCC]], May 01, 2017 » [[FGRL]]
* [http://www.talkchess.com/forum/viewtopic.php?t=63888 MATCH sanity] by [[Ed Schroder]], [[CCC]], May 03, 2017 » [[Portable Game Notation]]
: [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=63888&start=2 Re: MATCH sanity] by [[Salvatore Giannotti]], [[CCC]], May 03, 2017
* [http://www.talkchess.com/forum/viewtopic.php?t=63903 Symmetric multiprocessing (SMP) scaling - SF8 and K10.4] by [[Andreas Strangmüller]], [[CCC]], May 05, 2017 » [[Lazy SMP]], [[Komodo]], [[Stockfish]]
* [http://www.talkchess.com/forum/viewtopic.php?t=63955 Symmetric multiprocessing (SMP) scaling - K10.4 Contempt=0] by [[Andreas Strangmüller]], [[CCC]], May 11, 2017 » [[SMP]], [[Komodo]], [[Contempt Factor]]
* [http://www.talkchess.com/forum/viewtopic.php?t=65764 Statistical interpretation of search and eval scores] by [[J. Wesley Cleveland]], [[CCC]], November 18, 2017 » [[Pawn Advantage, Win Percentage, and Elo]], [[Score]]
* [http://www.talkchess.com/forum/viewtopic.php?t=65772 "Intrinsic Chess Ratings" by Regan, Haworth -- seq] by Kai Middleton, [[CCC]], November 19, 2017
: [http://www.talkchess.com/forum/viewtopic.php?t=65772&start=2 Re: "Intrinsic Chess Ratings" by Regan, Haworth --] by [[Kenneth Wingate W. Regan|Kenneth Regan]], [[CCC]], November 20, 2017 » [[Jean-Marc Alliot#WhoistheMaster|Who is the Master?]]
* [http://www.talkchess.com/forum/viewtopic.php?t=66000 ELO progression measured by year] by [[Ed Schroder]], [[CCC]], December 13, 2017
'''2018'''
* [http://www.talkchess.com/forum/viewtopic.php?t=66945 LCZero: Progress and Scaling. Relation to CCRL Elo] by [[Kai Laskos]], [[CCC]], March 28, 2018 » [[Leela Chess Zero]]
* [http://www.talkchess.com/forum/viewtopic.php?t=66969 Elostat Question] by [[Michael Sherwin]], [[CCC]], March 30, 2018
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=67485 Issue with self play testing] by [[Charles Roberson]], [[CCC]], May 18, 2018 » [[Engine Testing]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=68072 Why Lc0 eval (in cp) is asymmetric against AB engines?] by [[Kai Laskos]], [[CCC]], July 25, 2018 » [[Asymmetric Evaluation]], [[Leela Chess Zero]], [[Pawn Advantage, Win Percentage, and Elo]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=69069 Are draws hard to predict?] by [[Daniel Shawul]], [[CCC]], November 27, 2018 » [[Draw]], [[Neural Networks]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=69284 testing consistency] by [[Jon Dart]], [[CCC]], December 16, 2018
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=69407 Fixed nodes games and the pentanomial model] by [[Michel Van den Bergh]], [[CCC]], December 29, 2018
'''2019'''
* [http://www.talkchess.com/forum3/viewtopic.php?f=2&t=69672 Schizophrenic rating model for Leela] by [[Kai Laskos]], [[CCC]], January 21, 2019 » [[Leela Chess Zero]]
* [http://www.talkchess.com/forum3/viewtopic.php?f=7&t=71419 best way to determine elos of a group] by [[Daniel Shawul]], [[CCC]], July 30, 2019
=External Links=
* [http://www.top-5000.nl/tuning.htm Testing a chess engine from the ground up] from [http://www.top-5000.nl/ Home of the Dutch Rebel] by [[Ed Schroder|Ed Schröder]] <ref>[http://www.talkchess.com/forum/viewtopic.php?t=46759 A poor man's testing environment] by [[Ed Schroder|Ed Schröder]], [[CCC]], January 04, 2013</ref> » [[Engine Testing]]
* [http://www.top-5000.nl/match.htm MATCH - eng-eng utility] by [[Ed Schroder|Ed Schröder]]
* [http://walkofmind.com/programming/chess/mat_stats.html Statistics of material imbalances in chess games] by [[Alessandro Scotti]] » [[Material]]
==Rating Systems==
* [https://en.wikipedia.org/wiki/Chessmetrics Chessmetrics from Wikipedia]
* [https://en.wikipedia.org/wiki/Elo_rating_system Elo rating system from Wikipedia]
* [http://en.chessbase.com/post/arpad-elo-and-the-elo-rating-system Arpad Elo and the Elo Rating System] by [[Dan Ross]], [[ChessBase|ChessBase News]], December 16, 2007
* [https://www.kaggle.com/c/chess Chess ratings - Elo versus the Rest of the World] | [https://en.wikipedia.org/wiki/Kaggle Kaggle]
* [http://wismuth.com/elo/calculator.html Elo Win Probability Calculator] by [[Mathematician#FLabelle|François Labelle]]
* [http://www.husvankempen.de/nunn/rating/tablejoseph.htm LOS Table] by [[Joseph Ciarrochi]] from [[CEGT]] <ref>[https://www.stmintz.com/ccc/index.php?id=484357 table for detecting significant difference between two engines] by [[Joseph Ciarrochi]], [[CCC]], February 03, 2006</ref>
* [https://www.khanacademy.org/math/probability/statistics-inferential/hypothesis-testing/v/type-1-errors Type 1 Errors | Hypothesis testing with one sample] | [https://en.wikipedia.org/wiki/Khan_Academy Khan Academy]
==Data Visualization==
* [http://www.top-5000.nl/clone.htm A Pairwise Comparison of Chess Engine Move Selections] by [[Adam Hair]], hosted by [[Ed Schroder|Ed Schröder]] <ref>[https://en.wikipedia.org/wiki/UPGMA UPGMA from Wikipedia]</ref> <ref>[http://www.southampton.ac.uk/~re1u06/teaching/upgma/ UPGMA Worked Example] by [http://www.southampton.ac.uk/biosci/about/staff/re1u06.page? Richard Edwards]</ref> <ref>[http://www.talkchess.com/forum/viewtopic.php?t=56426 Adam Hair's article on Pairwise comparison of engines] by [[Charles Roberson]], [[CCC]], May 19, 2015</ref> <ref>[[Don Dailey]], [[Adam Hair]], [[Mark Watkins]] ('''2014'''). ''[http://www.sciencedirect.com/science/article/pii/S1875952113000177 Move Similarity Analysis in Chess Programs]''. [http://www.journals.elsevier.com/entertainment-computing/ Entertainment Computing], Vol. 5, No. 3, [http://magma.maths.usyd.edu.au/~watkins/papers/DHW.pdf preprint as pdf]</ref>
* [https://blog.ebemunk.com/a-visual-look-at-2-million-chess-games/ A Visual Look at 2 Million Chess Games - Thinking Through the Party] by [[Buğra Fırat]], March 02, 2016 <ref>[http://www.talkchess.com/forum/viewtopic.php?t=65610 A Visual Look at 2 Million Chess Games] by Brahim Hamadicharef, [[CCC]], November 02, 2017</ref>
* [https://github.com/ebemunk/chess-dataviz GitHub - ebemunk/chess-dataviz: chess visualization library written for d3.js] by [[Buğra Fırat]] » [[JavaScript]]

Navigation menu