Feedback loops, and Google’s home-field advantage with LLMs
When I was at Pinterest leading product for the Discovery team, we started to leverage deep learning for our recommendations. It was always the case that while deep learning enabled a step-function change in the results (as measured by user engagement), the results got dramatically better once we took that user engagement data and fed it back into the model to further tune the results. We’d go from a place of discontinuous change with each step-function upgrade of the model, to a world with a compounding feedback loop.
When I was at Pinterest leading product for the Discovery team, we started to leverage deep learning for our recommendations. It was always the case that while deep learning enabled a step-function change in the results (as measured by user engagement), the results got dramatically better once we took that user engagement data and fed it back into the model to further tune the results. We’d go from a place of discontinuous change with each step-function upgrade of the model, to a world with a compounding feedback loop. This feedback loop that enables continuous improvement has been Google’s…
related reading
- Mediumsarahtavel.medium.com
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- Why Chatbots Are Not the Future of Interfaceswattenberger.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- Delip Rao e/σ on X: "Despite the amazing results I’ve experienced with ChatGPT, this is not a correct way to look at LLM vs. Google search. Since several other tweets have made this equivalence and have been eager to spell doom for Google, twitter.com
- Comparing Google and ChatGPT | Hacker Newsnews.ycombinator.com
- Natural Language Is an Unnatural Interfacevarunshenoy.substack.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com