04/01/2024
This is the best video about evolution of key ideas leading to current AI paradigm. Over the years, I have watched hundreds of videos and read numerous articles, including many original papers in AI field. In my view, this video is just on another level from everything else about these topics I have seen - so I strongly recommend it to you and your students:
https://www.youtube.com/watch?v=OFS90-FX6pg
There is a popular simplistic idea that systems such as ChatGPT only learned statistics of human language - i.e. how to predict the next world. But this is not correct. As this video carefully explains, AI systems "know" (i.e.,. can use) abstract concepts and all kinds of abilities that go well beyond correlating words.
From the video description:
"We delve into the early experiments with tiny language models in the 1980s, highlighting significant contributions by researchers like Jordan, who introduced Recurrent Neural Networks, and Elman, whose work on learning word boundaries revolutionized our understanding of language processing. It leaves us with a question: what is thought? Is simulated thought, thought? Featuring Douglas Hofstadter, Michael I. Jordan, Jeffrey Elman, Geoffrey Hinton, Ilya Sutskever, Andrej Karpathy, Yann LeCun and more.
This video explores the journey of AI language models, from their modest beginnings through the development of OpenAI's GPT models. Our journey takes us thro...