LLM Security Architecture
“Companies are not taking LLM security seriously enough, researchers got {Popular LLM} to reveal {Nothing That Sensitive}. The security industry can be really susceptible to VC trends, because for every “mind blowing new technology” comes along with it “how can we securely use mind blowing technology?” We’ve already seen millions in funding for LLM Security startups, LLM security courses, and LLM security newsletters. My position is that LLM Security fits two use cases which we’ll cover in this article: Leaking Company Data into a ChatBot Using or building an LLM API in your application Unfortunately, this use case has garnered the most attention out of the gate. My guess is that it’s been successful because it’s the easiest to sell, the easiest to make, and has the most fear/uncertainty/doubt (FUD) around it. Let’s figure out if this fear is warranted by starting with a diagram: There are three potential security issues, none of which really have to do with LLM itself. The provider is
If you want a guaranteed winner LinkedIn post, here’s a free template: “Companies are not taking LLM security seriously enough, researchers got {Popular LLM} to reveal {Nothing That Sensitive}. The security industry can be really susceptible to VC trends, because for every “mind blowing new technology” comes along with it “how can we securely use mind blowing technology?” We’ve already seen millions in funding for LLM Security startups, LLM security courses, and LLM security newsletters. My position is that LLM Security fits two use cases which we’ll cover in this article: Leaking…
related reading
- The lethal trifecta for AI agents: private data, untrusted content, and external communicationsimonwillison.net
- Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- llm-security/README.md at main · greshake/llm-securitygithub.com
- we have a year to fix security everywherejyn.dev
- My self-sovereign / local / private / secure LLM setup, April 2026vitalik.eth.limo
- Security incident disclosure — July 2026huggingface.co
- [2504.20984] ACE: A Security Architecture for LLM-Integrated App Systemsarxiv.org
- [2312.12575] LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarksarxiv.org
- Boring is good – Scott Jensonjenson.org
- Simulated Users & Sad LLMs1a3orn.com
- 2025: The year in LLMssimonwillison.net