Knowledge-Creating LLMs | Tom Cunningham – Tom Cunningham
tecunningham.github.io · 2,584 words · saved by 1 readers
Tom Cunningham blog
Knowledge-Creating LLMs | Tom Cunningham – Tom Cunningham Thanks to Zoë Hitzig & Parker Whitfill, among others, for helpful comments. It’s useful to make a distinction between two types of LLMs: Knowledge-sharing LLMs. Traditionally LLMs have been trained with human judgment as the ground truth, as a consequence they rarely exhibit superhuman performance. Their economic value mainly comes from sharing existing knowledge, and the natural business model is to sell access broadly. Knowledge-creating LLMs. Recently LLMs have been trained against the real world, as a consequence they can extend the
related reading
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- As Rocks May Think | Eric Jangevjang.com
- How to Land a Frontier Lab Jobvladfeinberg.com
- LLM Daydreaming · Gwern.netgwern.net
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Andrej Karpathy on X: "LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating" / Xx.com
- LLMs reward expertiseseangoedecke.com
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- GenAI Handbookgenai-handbook.github.io
- Things we learned about LLMs in 2024simonwillison.net
- Thoughts on AI in academiatheinfinitesimal.substack.com
- Do language models possess knowledge (soundness)? - HackMDhackmd.io