MLOps
Cost Spikes from Quiet Prompt Changes: Monitoring LLM Features in Production
After deploying an LLM feature, monitoring for cost spikes from subtle prompt changes is critical. Learn how to detect and mitigate these risks in production systems.
Blog
Thoughts on AI engineering, backend, frontend, and building modern software.
AI Engineering
Practical AI Engineering Lessons from Building Production Systems
Learn real-world tradeoffs, failure modes, and design decisions from a senior engineer building AI systems at scale.