A Conversation with One of My 8090 Co-Founders
chamath.substack.com · saved by 1 readers
I talked to Sina Sojoodi (X/LinkedIn), one of my co-founders at 8090, after we published our Deep Dive on AI last week.
I talked to Sina Sojoodi (X/LinkedIn), one of my co-founders at 8090, after we published our Deep Dive on AI last week. Let me know if this is interesting to you. Chamath: There’s this great story of how OpenAI accidentally discovered LLMs. Walk me through what happened there. Sina: LLM Grokking – this is funny. It's almost like how penicillin was discovered. OpenAI made this discovery where typically in traditional machine learning, there's a point of overfitting, where you stop training because the model is just memorizing the training set rather than learning to generalize. But OpenAI…