ChatGPT — The origins of this moment trace back decades earlier to Geoffrey Hinton, the...

This 17-year-old, overconfident Russian kid, insists on meeting with Hinton, and quickly makes himself useful. Hinton gave Elias some research to look over, just to see if he'd show up again. A few days later, he came back with a better-in-level insight about training neural nets. And I gave him a paper to read, which was the Nature Paper and Back Provocation. And he came back and he said, I didn't understand it. I was very disappointed. I thought he seemed like a bright guy, but it's only the chain rule. It's not that hard to understand. And he said, oh no, no, I understood that. I just don't understand why you don't give the gradient to essential, sensible function optimizer, which took us quite a few years to think about. His raw intuitions back then were always very good. Hinton had misjudged Elias a wannabe. In university, at just 17 years old, brand new to the study of neural nets. He was easily picking up concepts even Hinton's brightest student struggled with. And over the next few years, Elias would become Hinton's most valued pupil. He was taking the lead on difficult research questions and making real contributions to Hinton's most pressing problems. Lately, they've been working on Hinton's career-defining obsession to this point. Deep belief networks. Hinton's biggest problem is that it seems impossible to make a large neural network, one capable of impressive feats. At a certain network size, the model just fails.