Getting creative with embeddings
In defiance of the “AI will write everything for us” narrative, I’ve been noodling on a writing app, PenPal, focused on the opposite: making us better writers. My process has involved a lot of research into how great writing instructors work. There’s one concept I find especially appealing: making the implicit explicit. Much of the work of becoming a better writer doesn’t involve writing, but instead taking a magnifying glass to others’ writing. Can PenPal make it easy to see Hemingway’s style, to compare Stephen King to John Steinbeck, or even to compare your writing style to Roald Dahl’s? This actually isn’t a completely new idea for me. After seeing a popular example of the power of diverse sentence lengths, I create an app that highlights each sentence based on its length. This was an easy add! Just loop over every sentence and map the character count to a color scale. But I remembered an essay from Robin Sloan I had squirreled away in my notes a few years ago: Week 4, ladder of ab
Getting creative with embeddings In defiance of the “AI will write everything for us” narrative, I’ve been noodling on a writing app, PenPal, focused on the opposite: making us better writers. My process has involved a lot of research into how great writing instructors work. There’s one concept I find especially appealing: making the implicit explicit. Much of the work of becoming a better writer doesn’t involve writing, but instead taking a magnifying glass to others’ writing. Can PenPal make it easy to see Hemingway’s style, to compare Stephen King to John Steinbeck, or even to compare your
related reading
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnettransformer-circuits.pub
- Embeddings: What they are and why they mattersimonwillison.net
- Dangerous Writing Appsquibler.io
- On AI writing in 2026 | Homelincolnquirk.com
- Vector embeddings | OpenAI APIplatform.openai.com
- Vector embeddings | OpenAI APIdevelopers.openai.com
- Contra Labs - Powered by Contracontralabs.com
- We build AI that works for humans - Imbueimbue.com
- trees are harlequins, words are harlequins - hydrogen jukeboxes: on the crammed poetics of...nostalgebraist.tumblr.com
- Prism: mapping interpretable concepts and features in a latent space of language | thesephist.comthesephist.com
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- Sentence Embeddings. Introduction to Sentence Embeddings – hackerllamaosanseviero.github.io