About
Geoffrey Hinton designs machine learning algorithms. His aim is to discover a learning procedure that is efficient at finding complex structure in large, high-dimensional datasets and to show that this is how the brain learns to see. He was one of the researchers who introduced the backpropagation algorithm and the first to use backpropagation for learning word embeddings. His other contributions to neural network research include Boltzmann machines, distributed representations, time-delay neural nets, mixtures of experts, variational learning, products of experts and deep belief nets. His research group in Toronto made major breakthroughs in deep learning that revolutionized speech recognition and object classification.
Geoffrey received his BA in Experimental Psychology from Cambridge in 1970 and his PhD in Artificial Intelligence from Edinburgh in 1978. He did postdoctoral work at Sussex University and the University of California San Diego and spent five years as a faculty member in the Computer Science department at Carnegie-Mellon University. He then became a fellow of the Canadian Institute for Advanced Research (CIFAR) and moved to the Department of Computer Science at the University of Toronto. From 1998 until 2001 he set up the Gatsby Computational Neuroscience Unit at University College London and then returned to the University of Toronto. From 2004 until 2013 he was the director of the program on “Neural Computation and Adaptive Perception,” funded by the Canadian Institute for Advanced Research. In 2013, Google acquired Hinton’s neural networks startup, DNNresearch, which developed out of his research at U of T.
Awards
- Nobel Prize in Physics (2024)
- Princess of Asturias Award (2022)
- Royal Medal, Royal Society (2022)
- Honda Prize (2019)
- Turing Award (2018)
- Companion of the Order of Canada (2018)
- BBVA Frontiers of Knowledge Award (2017)
- NEC C&C prize (2016)
- IEEE James Clerk Maxwell Gold medal (2016)
- IEEE Frank Rosenblatt Medal (2014)
- Killam prize for Engineering (2012)
- NSERC Herzberg Gold Medal (2010)
- David E. Rumelhart prize (2001)
Relevant Publications
- LeCun, Y., Bengio, Y. and Hinton, G., 2015. Deep Learning. Nature, 521, 436-444. http://dx.doi.org/10.1038/nature14539
- Krizhevsky, A., Sutskever, I., Hinton, G.E., 2017. ImageNet classification with deep convolutional neural networks. Communications of the ACM 60, 84–90.. https://doi.org/10.1145/3065386
- Srivastava N., Hinton, G., A Krizhevsky, A., Sutskever, I., Salakhutdinov, R., 2014. Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15 (1), 1929-1958. http://jmlr.org/papers/v15/srivastava14a.html
- Van der Maaten, L., Hinton, G., 2008. Visualizing data using t-SNE. Journal of Machine Learning Research. 9. 2579-2605. http://www.cs.toronto.edu/~hinton/absps/tsnefinal.pdf