25,161
edits
Changes
CLOP
,Created page with "'''Home * Automated Tuning * CLOP''' '''CLOP''' for Noisy Black-Box Parameter Optimization, a program used for parameter tuning, creat..."
'''[[Main Page|Home]] * [[Automated Tuning]] * CLOP'''
'''CLOP''' for Noisy Black-Box Parameter Optimization,
a program used for [[Automated Tuning|parameter tuning]], created by [[Rémi Coulom]]. The CLOP principle, which stands for [http://en.wiktionary.org/wiki/confidence Confident] [https://en.wikipedia.org/wiki/Local_search_%28optimization%29 Local OPtimization] <ref>[http://remi.coulom.free.fr/CLOP/ CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]</ref>, is an approach to [https://en.wikipedia.org/wiki/Local_regression local regression] that overcomes problems with very [https://en.wikipedia.org/wiki/Statistical_noise noisy] outputs and nonnegative [https://en.wikipedia.org/wiki/Hessian_matrix Hessians] <ref>[https://en.wikipedia.org/wiki/Second_partial_derivative_test Second partial derivative test from Wikipedia]</ref> in a simple and efficient way. CLOP is suited to tune several parameters simultaneously, and requires polynomial [https://en.wikipedia.org/wiki/Time_complexity time] for each additional parameter to verify the tuned values, that is playing a lot of games <ref>[http://www.talkchess.com/forum/viewtopic.php?topic_view=threads&p=552257&t=50823 Re: How Do You Automatically Tune Your Evaluation Tables] by [[Jon Dart]], [[CCC]], January 31, 2014</ref>.
=See also=
* [[Match Statistics]]
* [[Cutechess-cli]]
* [[SPSA]]
=Publications=
* [[Rémi Coulom]] ('''2011'''). ''[http://remi.coulom.free.fr/CLOP/ CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]''. [[Advances in Computer Games 13]], [http://remi.coulom.free.fr/CLOP/CLOPSlides.pdf slides as pdf]
* [[Rémi Coulom]] ('''2012'''). ''[http://link.springer.com/chapter/10.1007%2F978-3-642-31866-5_13 CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]''. [http://link.springer.com/book/10.1007/978-3-642-31866-5 Advances in Computer Games], [https://en.wikipedia.org/wiki/Lecture_Notes_in_Computer_Science LNCS], Vol. 7168, [https://en.wikipedia.org/wiki/Springer_Science%2BBusiness_Media Springer]
=Forum Posts=
==2011 ...==
* [http://talkchess.com/forum/viewtopic.php?t=40237 CLOP for Noisy Black-Box Parameter Optimization] by [[Rémi Coulom]], [[CCC]], September 01, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=40687 To Ilari : CLOP + cutechess-cli] by [[Marco Costalba]], [[CCC]], October 09, 2011
'''2012'''
* [http://computer-go.org/pipermail/computer-go/2012-January/004429.html Re: win rate bias and CLOP] by [[Brian Sheppard]], [http://computer-go.org/pipermail/computer-go/ Computer-go Archives], January 03, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=41816 CLOP + cutechess cli] by [[Engin Üstün]], [[CCC]], January 05, 2012 » [[Cutechess-cli]]
* [http://www.talkchess.com/forum/viewtopic.php?t=42202 EXchess v6.10 released] by [[Dan Homan|Daniel Homan]], [[CCC]], January 29, 2012 » [[EXchess]]
* [http://www.talkchess.com/forum/viewtopic.php?p=454327 CLOP on Stockfish] by [[Gary Linscott|Gary]], [[CCC]], March 10, 2012 » [[Stockfish]]
'''2013'''
* [https://groups.google.com/d/msg/fishcooking/8zN5TZfEN8w/KIZYLnO8c08J CLOP and Stockfish] by [[Joona Kiiski]], [[Computer Chess Forums|FishCooking]], March 31, 2013 » [[Stockfish]]
* [https://groups.google.com/d/msg/fishcooking/y9maHKLrhQQ/68_yqILvcWYJ CLOP tuning] by [[Marco Costalba]], [[Computer Chess Forums|FishCooking]], May 19, 2013
* [https://groups.google.com/d/msg/fishcooking/6Jis--X-L20/QcJ7XqUZ2-EJ CLOP tests are active] by [[Gary Linscott]], [[Computer Chess Forums|FishCooking]], July 03, 2013
* [http://www.talkchess.com/forum/viewtopic.php?t=48847 Question regarding CLOP and cutechess-cli] by [[Jacob Børs Lind]], [[CCC]], August 05, 2013 » [[Cutechess-cli]]
* [http://www.talkchess.com/forum/viewtopic.php?t=49410 Clop and cutechess] by [[Alcides Schulz]], [[CCC]], September 21, 2013
* [https://groups.google.com/d/msg/fishcooking/EczR5D1BKhU/thmLRG5uBdkJ CLOP tests are active (finally)] by [[Gary Linscott]], [[Computer Chess Forums|FishCooking]], November 10, 2013
* [https://groups.google.com/d/msg/fishcooking/gmE5A05jWsg/4toIYFI6z80J CLOP overhead] by Lucas Braesch, [[Computer Chess Forums|FishCooking]], November 14, 2013
'''2014'''
* [http://www.talkchess.com/forum/viewtopic.php?t=51020 needed CLOP for cluster] by [[Daniel Shawul]], [[CCC]], January 23, 2014
* [http://www.talkchess.com/forum/viewtopic.php?t=51167 Help with CLOP] by Arjun Temurnikar, [[CCC]], February 05, 2014
* [https://groups.google.com/d/msg/fishcooking/0uRw0Zila0M/s2siUjVzFFwJ Problem with CLOP and clop-cutechess-cli.py? (long post)] by joster, [[Computer Chess Forums|FishCooking]], May 10, 2014
* [https://groups.google.com/d/msg/fishcooking/WNrxeXAJ6VI/ZkCnRv4I_qEJ Goodbye CLOP, hello SPSA)] by [[Gary Linscott]], [[Computer Chess Forums|FishCooking]], May 17, 2014
* [https://groups.google.com/d/msg/fishcooking/bW1l9oesAb8/-uMnp3Ky4UwJ Port of Coulom's CLOP algorithm to Python] by Kamyar, [[Computer Chess Forums|FishCooking]], December 03, 2014
==2015 ...==
* [http://www.talkchess.com/forum/viewtopic.php?t=55042 Working with CLOP] by [[Robert Pope]], [[CCC]], January 22, 2015
'''2016'''
* [http://www.talkchess.com/forum/viewtopic.php?t=62012 CLOP: when to stop?] by [[Erin Dame]], [[CCC]], November 07, 2016
=External Links=
* [http://remi.coulom.free.fr/CLOP/ CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]
* [https://github.com/cutechess/cutechess/blob/master/tools/clop-cutechess-cli.py cutechess-cly Python script fo CLOP]
* [https://en.wikipedia.org/wiki/Black_box Black box from Wikipedia]
* [https://en.wikipedia.org/wiki/Black_box_%28disambiguation%29 Black box (disambiguation) from Wikipedia]
* [[Videos#LesPaul|Les Paul]] - Black Box <ref>[http://www.les-paul.com/timeline/les-the-inventor/ The Inventions - Les Paul]</ref>, [https://en.wikipedia.org/wiki/YouTube YouTube] Video
: {{#evu:https://www.youtube.com/watch?v=3wIgTm2DnPg|alignment=left|valignment=top}}
=References=
<references />
'''[[Automated Tuning|Up one Level]]'''
'''CLOP''' for Noisy Black-Box Parameter Optimization,
a program used for [[Automated Tuning|parameter tuning]], created by [[Rémi Coulom]]. The CLOP principle, which stands for [http://en.wiktionary.org/wiki/confidence Confident] [https://en.wikipedia.org/wiki/Local_search_%28optimization%29 Local OPtimization] <ref>[http://remi.coulom.free.fr/CLOP/ CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]</ref>, is an approach to [https://en.wikipedia.org/wiki/Local_regression local regression] that overcomes problems with very [https://en.wikipedia.org/wiki/Statistical_noise noisy] outputs and nonnegative [https://en.wikipedia.org/wiki/Hessian_matrix Hessians] <ref>[https://en.wikipedia.org/wiki/Second_partial_derivative_test Second partial derivative test from Wikipedia]</ref> in a simple and efficient way. CLOP is suited to tune several parameters simultaneously, and requires polynomial [https://en.wikipedia.org/wiki/Time_complexity time] for each additional parameter to verify the tuned values, that is playing a lot of games <ref>[http://www.talkchess.com/forum/viewtopic.php?topic_view=threads&p=552257&t=50823 Re: How Do You Automatically Tune Your Evaluation Tables] by [[Jon Dart]], [[CCC]], January 31, 2014</ref>.
=See also=
* [[Match Statistics]]
* [[Cutechess-cli]]
* [[SPSA]]
=Publications=
* [[Rémi Coulom]] ('''2011'''). ''[http://remi.coulom.free.fr/CLOP/ CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]''. [[Advances in Computer Games 13]], [http://remi.coulom.free.fr/CLOP/CLOPSlides.pdf slides as pdf]
* [[Rémi Coulom]] ('''2012'''). ''[http://link.springer.com/chapter/10.1007%2F978-3-642-31866-5_13 CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]''. [http://link.springer.com/book/10.1007/978-3-642-31866-5 Advances in Computer Games], [https://en.wikipedia.org/wiki/Lecture_Notes_in_Computer_Science LNCS], Vol. 7168, [https://en.wikipedia.org/wiki/Springer_Science%2BBusiness_Media Springer]
=Forum Posts=
==2011 ...==
* [http://talkchess.com/forum/viewtopic.php?t=40237 CLOP for Noisy Black-Box Parameter Optimization] by [[Rémi Coulom]], [[CCC]], September 01, 2011
* [http://www.talkchess.com/forum/viewtopic.php?t=40687 To Ilari : CLOP + cutechess-cli] by [[Marco Costalba]], [[CCC]], October 09, 2011
'''2012'''
* [http://computer-go.org/pipermail/computer-go/2012-January/004429.html Re: win rate bias and CLOP] by [[Brian Sheppard]], [http://computer-go.org/pipermail/computer-go/ Computer-go Archives], January 03, 2012
* [http://www.talkchess.com/forum/viewtopic.php?t=41816 CLOP + cutechess cli] by [[Engin Üstün]], [[CCC]], January 05, 2012 » [[Cutechess-cli]]
* [http://www.talkchess.com/forum/viewtopic.php?t=42202 EXchess v6.10 released] by [[Dan Homan|Daniel Homan]], [[CCC]], January 29, 2012 » [[EXchess]]
* [http://www.talkchess.com/forum/viewtopic.php?p=454327 CLOP on Stockfish] by [[Gary Linscott|Gary]], [[CCC]], March 10, 2012 » [[Stockfish]]
'''2013'''
* [https://groups.google.com/d/msg/fishcooking/8zN5TZfEN8w/KIZYLnO8c08J CLOP and Stockfish] by [[Joona Kiiski]], [[Computer Chess Forums|FishCooking]], March 31, 2013 » [[Stockfish]]
* [https://groups.google.com/d/msg/fishcooking/y9maHKLrhQQ/68_yqILvcWYJ CLOP tuning] by [[Marco Costalba]], [[Computer Chess Forums|FishCooking]], May 19, 2013
* [https://groups.google.com/d/msg/fishcooking/6Jis--X-L20/QcJ7XqUZ2-EJ CLOP tests are active] by [[Gary Linscott]], [[Computer Chess Forums|FishCooking]], July 03, 2013
* [http://www.talkchess.com/forum/viewtopic.php?t=48847 Question regarding CLOP and cutechess-cli] by [[Jacob Børs Lind]], [[CCC]], August 05, 2013 » [[Cutechess-cli]]
* [http://www.talkchess.com/forum/viewtopic.php?t=49410 Clop and cutechess] by [[Alcides Schulz]], [[CCC]], September 21, 2013
* [https://groups.google.com/d/msg/fishcooking/EczR5D1BKhU/thmLRG5uBdkJ CLOP tests are active (finally)] by [[Gary Linscott]], [[Computer Chess Forums|FishCooking]], November 10, 2013
* [https://groups.google.com/d/msg/fishcooking/gmE5A05jWsg/4toIYFI6z80J CLOP overhead] by Lucas Braesch, [[Computer Chess Forums|FishCooking]], November 14, 2013
'''2014'''
* [http://www.talkchess.com/forum/viewtopic.php?t=51020 needed CLOP for cluster] by [[Daniel Shawul]], [[CCC]], January 23, 2014
* [http://www.talkchess.com/forum/viewtopic.php?t=51167 Help with CLOP] by Arjun Temurnikar, [[CCC]], February 05, 2014
* [https://groups.google.com/d/msg/fishcooking/0uRw0Zila0M/s2siUjVzFFwJ Problem with CLOP and clop-cutechess-cli.py? (long post)] by joster, [[Computer Chess Forums|FishCooking]], May 10, 2014
* [https://groups.google.com/d/msg/fishcooking/WNrxeXAJ6VI/ZkCnRv4I_qEJ Goodbye CLOP, hello SPSA)] by [[Gary Linscott]], [[Computer Chess Forums|FishCooking]], May 17, 2014
* [https://groups.google.com/d/msg/fishcooking/bW1l9oesAb8/-uMnp3Ky4UwJ Port of Coulom's CLOP algorithm to Python] by Kamyar, [[Computer Chess Forums|FishCooking]], December 03, 2014
==2015 ...==
* [http://www.talkchess.com/forum/viewtopic.php?t=55042 Working with CLOP] by [[Robert Pope]], [[CCC]], January 22, 2015
'''2016'''
* [http://www.talkchess.com/forum/viewtopic.php?t=62012 CLOP: when to stop?] by [[Erin Dame]], [[CCC]], November 07, 2016
=External Links=
* [http://remi.coulom.free.fr/CLOP/ CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning]
* [https://github.com/cutechess/cutechess/blob/master/tools/clop-cutechess-cli.py cutechess-cly Python script fo CLOP]
* [https://en.wikipedia.org/wiki/Black_box Black box from Wikipedia]
* [https://en.wikipedia.org/wiki/Black_box_%28disambiguation%29 Black box (disambiguation) from Wikipedia]
* [[Videos#LesPaul|Les Paul]] - Black Box <ref>[http://www.les-paul.com/timeline/les-the-inventor/ The Inventions - Les Paul]</ref>, [https://en.wikipedia.org/wiki/YouTube YouTube] Video
: {{#evu:https://www.youtube.com/watch?v=3wIgTm2DnPg|alignment=left|valignment=top}}
=References=
<references />
'''[[Automated Tuning|Up one Level]]'''
