/tags/architecture/ Recent content in Architecture on Alexander Arvidsson Hugo -- gohugo.io en Tue, 17 Mar 2026 00:00:00 +0000 /posts/nondeterminism-part-2/ Tue, 17 Mar 2026 00:00:00 +0000 /posts/nondeterminism-part-2/ Non-determinism in LLMs isn’t a bug to fix - it’s a parameter to control. But most teams are tuning the wrong things: obsessing over temperature settings while ignoring the architectural choices that actually matter. Structured outputs, deterministic skills for calculations, plan-then-execute agent patterns, retrieval logging - these are what separate systems you can trust from ones that roll dice in production. The goal was never a deterministic LLM. It was knowing exactly where randomness is allowed to live. /posts/nondeterminism-part-1/ Tue, 24 Feb 2026 00:00:00 +0000 /posts/nondeterminism-part-1/ Non-determinism in LLMs creates real operational problems: flaky tests, irreproducible bugs, compliance nightmares, and unreliable agents. Most people only know about token sampling, but randomness creeps in across six distinct layers—from floating-point variance to hidden system prompts. Temperature=0 and random seeds help less than you’d hope because they constrain token selection, not reasoning paths. The solution requires structural constraints, not parameter tuning. Until then, you’re rolling dice in production. /posts/the-tracker/ Tue, 10 Feb 2026 00:00:00 +0000 /posts/the-tracker/ Using Claude Code, I built a full-stack application to replace Microsoft Access - without being a developer or understanding React, TypeScript, or Node.js. LLM-assisted coding enables rapid prototyping and bridges the gap between business requirements and technical implementation, but like flight simulators, it doesn’t make non-developers into developers. The parallel matters: functional prototypes aren’t production-ready systems, and knowing the difference requires actual expertise. /posts/fighting-the-unfixable/ Tue, 03 Feb 2026 00:00:00 +0000 /posts/fighting-the-unfixable/ Prompt injection is architecturally unfixable in current LLMs, but defense-in-depth works. Training-time defenses like Instruction Hierarchy, inference-time techniques like Spotlighting, and architectural isolation create practical systems. Microsoft’s LLMail-Inject showed thatadaptive attacks succeed at 32% against single defenses, 0% against layered approaches. Real failures like GitHub Actions compromise prove that securing obvious surfaces isn’t enough. Like SQL injection, it’s manageable with layering. /posts/instructions-as-data/ Tue, 20 Jan 2026 00:00:00 +0000 /posts/instructions-as-data/ LLMs fundamentally cannot distinguish between instructions and data. Whether you’re building RAG systems, connecting MCP servers to your data platform, or just using AI tools with sensitive information, every retrieved document is a potential instruction override. The Wall Street Journal just proved this by watching Claude lose over $1,000 running a vending machine after journalists convinced it to give everything away for free.