Difference between revisions of "Ilya Sutskever"
GerdIsenberg (talk | contribs) |
GerdIsenberg (talk | contribs) |
||
| (4 intermediate revisions by the same user not shown) | |||
| Line 5: | Line 5: | ||
'''Ilya Sutskever''',<br/> | '''Ilya Sutskever''',<br/> | ||
| − | a Canadian computer scientist, and co-founder and research director of [https://en.wikipedia.org/wiki/OpenAI OpenAI], a non-profit AI research company. | + | a Canadian computer scientist, and co-founder and research director of [https://en.wikipedia.org/wiki/OpenAI OpenAI], a non-profit AI research company. Before, he was research scientist at [[Google]] [https://en.wikipedia.org/wiki/Google_Brain Brain], and co-founded [https://en.wikipedia.org/wiki/List_of_mergers_and_acquisitions_by_Google DNNresearch] <ref>[http://www.fastcompany.com/3006944/tech-forecast/google-buys-toronto-university-startup-better-voice-image-recognition Google Buys Toronto University Startup For Better Voice, Image Recognition | Fast Company | Business + Innovation] by [http://www.fastcompany.com/user/kit-eaton Kit Eaton], March 13, 2013</ref>. He was postdoc at [[Stanford University]] with [[Andrew Ng|Andrew Ng's]] group, and received his M.Sc. in 2007 <ref>[[Ilya Sutskever]] ('''2007'''). ''[http://www.cs.utoronto.ca/~ilya/MS_thesis/ Nonlinear Multilayered Sequence Models]''. Master's thesis, [[University of Toronto]]</ref> and his Ph.D. in 2013 <ref>[[Ilya Sutskever]] ('''2013'''). ''Training Recurrent Neural Networks''. Ph.D. thesis, [[University of Toronto]], [http://www.cs.utoronto.ca/~ilya/pubs/ilya_sutskever_phd_thesis.pdf pdf]</ref> from [[University of Toronto]], working with [[Mathematician#GEHinton|Geoffrey Hinton]]. His research interests include [[Learning|machine learning]] and [[Neural Networks|neural networks]], in particular [[Deep Learning|deep learning]] with [[Neural Networks#Convolutional|convolutional neural networks]] <ref>[https://en.wikipedia.org/wiki/Convolutional_neural_network Convolutional neural networks from Wikipedia]</ref> applied to [https://en.wikipedia.org/wiki/Machine_translation machine translation], [https://en.wikipedia.org/wiki/Speech_recognition voice] and [https://en.wikipedia.org/wiki/Computer_vision#Recognition image recognition], and also to the game of [[Go#CNN|Go]] <ref>[[Chris J. Maddison]], [[Shih-Chieh Huang|Aja Huang]], [[Ilya Sutskever]], [[David Silver]] ('''2014'''). ''Move Evaluation in Go Using Deep Convolutional Neural Networks''. [http://arxiv.org/abs/1412.6564v1 arXiv:1412.6564v1]</ref> . |
=Selected Publications= | =Selected Publications= | ||
| Line 15: | Line 15: | ||
* [[Ilya Sutskever]], [[Mathematician#GEHinton|Geoffrey Hinton]] ('''2010'''). ''[http://www.sciencedirect.com/science/article/pii/S0893608009002664 Temporal-Kernel Recurrent Neural Networks]''. [http://www.journals.elsevier.com/neural-networks/ Neural Networks], Vol. 23, No. 2 | * [[Ilya Sutskever]], [[Mathematician#GEHinton|Geoffrey Hinton]] ('''2010'''). ''[http://www.sciencedirect.com/science/article/pii/S0893608009002664 Temporal-Kernel Recurrent Neural Networks]''. [http://www.journals.elsevier.com/neural-networks/ Neural Networks], Vol. 23, No. 2 | ||
* [[Ilya Sutskever]] ('''2013'''). ''Training Recurrent Neural Networks''. Ph.D. thesis, [[University of Toronto]], [http://www.cs.utoronto.ca/~ilya/pubs/ilya_sutskever_phd_thesis.pdf pdf] | * [[Ilya Sutskever]] ('''2013'''). ''Training Recurrent Neural Networks''. Ph.D. thesis, [[University of Toronto]], [http://www.cs.utoronto.ca/~ilya/pubs/ilya_sutskever_phd_thesis.pdf pdf] | ||
| − | * [[Ilya Sutskever]], [ | + | * [[Ilya Sutskever]], [[Oriol Vinyals]], [[Quoc V. Le]] ('''2014'''). ''Sequence to Sequence Learning with Neural Networks''. [https://arxiv.org/abs/1409.3215 arXiv:1409.3215] |
* [[Chris J. Maddison]], [[Shih-Chieh Huang|Aja Huang]], [[Ilya Sutskever]], [[David Silver]] ('''2014'''). ''Move Evaluation in Go Using Deep Convolutional Neural Networks''. [http://arxiv.org/abs/1412.6564v1 arXiv:1412.6564v1] <ref>[http://computer-go.org/pipermail/computer-go/2014-December/007046.html Move Evaluation in Go Using Deep Convolutional Neural Networks] by [[Shih-Chieh Huang|Aja Huang]], [http://computer-go.org/pipermail/computer-go/ The Computer-go Archives], December 19, 2014</ref> » [[Go#CNN|DCNN in Go]] | * [[Chris J. Maddison]], [[Shih-Chieh Huang|Aja Huang]], [[Ilya Sutskever]], [[David Silver]] ('''2014'''). ''Move Evaluation in Go Using Deep Convolutional Neural Networks''. [http://arxiv.org/abs/1412.6564v1 arXiv:1412.6564v1] <ref>[http://computer-go.org/pipermail/computer-go/2014-December/007046.html Move Evaluation in Go Using Deep Convolutional Neural Networks] by [[Shih-Chieh Huang|Aja Huang]], [http://computer-go.org/pipermail/computer-go/ The Computer-go Archives], December 19, 2014</ref> » [[Go#CNN|DCNN in Go]] | ||
==2015 ...== | ==2015 ...== | ||
| + | * [[Arvind Neelakantan]], [[Luke Vilnis]], [[Quoc V. Le]], [[Ilya Sutskever]], [[Lukasz Kaiser]], [[Karol Kurach]], [[James Martens]] ('''2015'''). ''Adding Gradient Noise Improves Learning for Very Deep Networks''. [https://arxiv.org/abs/1511.06807 arXiv:1511.06807] | ||
* [[David Silver]], [[Shih-Chieh Huang|Aja Huang]], [[Chris J. Maddison]], [[Arthur Guez]], [[Laurent Sifre]], [[George van den Driessche]], [[Julian Schrittwieser]], [[Ioannis Antonoglou]], [[Veda Panneershelvam]], [[Marc Lanctot]], [[Sander Dieleman]], [[Dominik Grewe]], [[John Nham]], [[Nal Kalchbrenner]], [[Ilya Sutskever]], [[Timothy Lillicrap]], [[Madeleine Leach]], [[Koray Kavukcuoglu]], [[Thore Graepel]], [[Demis Hassabis]] ('''2016'''). ''[http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html Mastering the game of Go with deep neural networks and tree search]''. [https://en.wikipedia.org/wiki/Nature_%28journal%29 Nature], Vol. 529 » [[AlphaGo]] | * [[David Silver]], [[Shih-Chieh Huang|Aja Huang]], [[Chris J. Maddison]], [[Arthur Guez]], [[Laurent Sifre]], [[George van den Driessche]], [[Julian Schrittwieser]], [[Ioannis Antonoglou]], [[Veda Panneershelvam]], [[Marc Lanctot]], [[Sander Dieleman]], [[Dominik Grewe]], [[John Nham]], [[Nal Kalchbrenner]], [[Ilya Sutskever]], [[Timothy Lillicrap]], [[Madeleine Leach]], [[Koray Kavukcuoglu]], [[Thore Graepel]], [[Demis Hassabis]] ('''2016'''). ''[http://www.nature.com/nature/journal/v529/n7587/full/nature16961.html Mastering the game of Go with deep neural networks and tree search]''. [https://en.wikipedia.org/wiki/Nature_%28journal%29 Nature], Vol. 529 » [[AlphaGo]] | ||
| − | |||
| − | |||
| − | |||
=External Links= | =External Links= | ||
| Line 33: | Line 31: | ||
* [https://www.technologyreview.com/lists/innovators-under-35/2015/visionary/ilya-sutskever/ Ilya Sutskever | Innovators Under 35], [https://en.wikipedia.org/wiki/MIT_Technology_Review MIT Technology Review] | * [https://www.technologyreview.com/lists/innovators-under-35/2015/visionary/ilya-sutskever/ Ilya Sutskever | Innovators Under 35], [https://en.wikipedia.org/wiki/MIT_Technology_Review MIT Technology Review] | ||
* [https://www.nytimes.com/2018/04/19/technology/artificial-intelligence-salaries-openai.html A.I. Researchers Are Making More Than $1 Million, Even at a Nonprofit] by [https://www.nytimes.com/by/cade-metz Cade Metz], [https://en.wikipedia.org/wiki/The_New_York_Times The New York Times], April 19, 2018 | * [https://www.nytimes.com/2018/04/19/technology/artificial-intelligence-salaries-openai.html A.I. Researchers Are Making More Than $1 Million, Even at a Nonprofit] by [https://www.nytimes.com/by/cade-metz Cade Metz], [https://en.wikipedia.org/wiki/The_New_York_Times The New York Times], April 19, 2018 | ||
| + | * [[Massachusetts Institute of Technology|MIT]] [https://agi.mit.edu/ AGI] : OpenAI Meta-Learning and Self-Play by Ilya Sutskever, [https://en.wikipedia.org/wiki/YouTube YouTube] Video | ||
| + | : Introduction by [https://lexfridman.com/ Lex Fridman], April 25, 2018 | ||
| + | : {{#evu:https://www.youtube.com/watch?v=9EN_HoEk3KY|alignment=left|valignment=top}} | ||
=References= | =References= | ||
<references /> | <references /> | ||
'''[[People|Up one level]]''' | '''[[People|Up one level]]''' | ||
| + | [[Category:Researcher|Sutskever]] | ||
| + | [[Category:Videos|Sutskever]] | ||
Latest revision as of 21:09, 2 December 2021
Home * People * Ilya Sutskever
Ilya Sutskever [1]
Ilya Sutskever,
a Canadian computer scientist, and co-founder and research director of OpenAI, a non-profit AI research company. Before, he was research scientist at Google Brain, and co-founded DNNresearch [2]. He was postdoc at Stanford University with Andrew Ng's group, and received his M.Sc. in 2007 [3] and his Ph.D. in 2013 [4] from University of Toronto, working with Geoffrey Hinton. His research interests include machine learning and neural networks, in particular deep learning with convolutional neural networks [5] applied to machine translation, voice and image recognition, and also to the game of Go [6] .
Contents
Selected Publications
2007 ...
- Ilya Sutskever (2007). Nonlinear Multilayered Sequence Models. Master's thesis, University of Toronto
- Ilya Sutskever, Vinod Nair (2008). Mimicking Go Experts with Convolutional Neural Networks. ICANN 2008, pdf
2010 ...
- Ilya Sutskever, Geoffrey Hinton (2010). Temporal-Kernel Recurrent Neural Networks. Neural Networks, Vol. 23, No. 2
- Ilya Sutskever (2013). Training Recurrent Neural Networks. Ph.D. thesis, University of Toronto, pdf
- Ilya Sutskever, Oriol Vinyals, Quoc V. Le (2014). Sequence to Sequence Learning with Neural Networks. arXiv:1409.3215
- Chris J. Maddison, Aja Huang, Ilya Sutskever, David Silver (2014). Move Evaluation in Go Using Deep Convolutional Neural Networks. arXiv:1412.6564v1 [9] » DCNN in Go
2015 ...
- Arvind Neelakantan, Luke Vilnis, Quoc V. Le, Ilya Sutskever, Lukasz Kaiser, Karol Kurach, James Martens (2015). Adding Gradient Noise Improves Learning for Very Deep Networks. arXiv:1511.06807
- David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George van den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, Sander Dieleman, Dominik Grewe, John Nham, Nal Kalchbrenner, Ilya Sutskever, Timothy Lillicrap, Madeleine Leach, Koray Kavukcuoglu, Thore Graepel, Demis Hassabis (2016). Mastering the game of Go with deep neural networks and tree search. Nature, Vol. 529 » AlphaGo
External Links
- Ilya Sutskever's home page
- Ilya Sutskever from Wikipedia
- Ilya Sutskever - Google Scholar Citations
- Ilya Sutskever - The Mathematics Genealogy Project
- Neural Networks Blog by Ilya Sutskever
- A Neural Network for a New Millennium | Ilya Sutskever, Google PhD Fellowship by Jessica Leigh Johnston, University of Toronto Magazine, Winter 2011
- Talking Machines: Machine learning and magical thinking, with Ilya Sutskever, Robohub, January 15, 2015
- Ilya Sutskever | Innovators Under 35, MIT Technology Review
- A.I. Researchers Are Making More Than $1 Million, Even at a Nonprofit by Cade Metz, The New York Times, April 19, 2018
- MIT AGI : OpenAI Meta-Learning and Self-Play by Ilya Sutskever, YouTube Video
- Introduction by Lex Fridman, April 25, 2018
References
- ↑ Ilya Sutskever - Google Scholar Citations
- ↑ Google Buys Toronto University Startup For Better Voice, Image Recognition | Fast Company | Business + Innovation by Kit Eaton, March 13, 2013
- ↑ Ilya Sutskever (2007). Nonlinear Multilayered Sequence Models. Master's thesis, University of Toronto
- ↑ Ilya Sutskever (2013). Training Recurrent Neural Networks. Ph.D. thesis, University of Toronto, pdf
- ↑ Convolutional neural networks from Wikipedia
- ↑ Chris J. Maddison, Aja Huang, Ilya Sutskever, David Silver (2014). Move Evaluation in Go Using Deep Convolutional Neural Networks. arXiv:1412.6564v1
- ↑ dblp: Ilya Sutskever
- ↑ Ilya Sutskever - Publications - Papers
- ↑ Move Evaluation in Go Using Deep Convolutional Neural Networks by Aja Huang, The Computer-go Archives, December 19, 2014
