Did the technology which gave rise to AlphaGo directly lead to ChatGPT-style apps?

Can the lineage of chatGPT-style apps (such as Claude, Deepseek, Grok, Gemini) be traced back to the same technology which birthed AlphaGo in 2016? Or are these technologies independent of one another? The original Nature paper whereby Deepmind “released” alphago into the scientific community is far too advanced for someone of my dimwittedness… :persevering_face:

https://www.nature.com/articles/nature16961

My reason for asking is because it’s INCREDIBLY impressive that these tech companies were working on stuff that has profoundly changed the world in the last 1-2 years but they were able to foresee this back in the mid-2010’s? If so, that’s very impressive that tech companies foresaw the potential of neural networks. Or was the potential of neural networks speculative back then and (from a 2016 perspective) potentially a “money pit” where there might have been zero meaningful return on invested capital?

1 Like

Depends how directly you mean. They are both neural networks, but quite different architectures of them. The revolutionary paper which ushered in the world of LLMs was Attention Is All You Need - Wikipedia which came in 2017, after AlphaGo.

3 Likes

No. LLMs are mostly a different kind of neural nets. However, AlphaGo was directly relevant for Hassabis’s nobel price for protein folding research with AlphaFold2.

1 Like

(post deleted by author)