Agentic Workflows

How to Implement Cross-Tenant AI Agent Rate Limiting and Token Budget Enforcement Using API Gateway Policies Before Runaway Agentic Workflows Bankrupt Your Enterprise Cost Centers in Q3 2026

AI Agents

How to Implement Cross-Tenant AI Agent Rate Limiting and Token Budget Enforcement Using API Gateway Policies Before Runaway Agentic Workflows Bankrupt Your Enterprise Cost Centers in Q3 2026

It started with a Slack message nobody wanted to send. A platform engineering lead at a mid-sized SaaS company opened their cloud billing dashboard on a Monday morning in early 2026 and found a $340,000 LLM API invoice for a single weekend. The culprit: a newly deployed agentic workflow

By Scott Miller
Synchronous vs. Asynchronous Agentic Workflow Execution: Which Model Holds Up When Per-Tenant Task Queues Spike Beyond Foundation Model Throughput Limits

Agentic Workflows

Synchronous vs. Asynchronous Agentic Workflow Execution: Which Model Holds Up When Per-Tenant Task Queues Spike Beyond Foundation Model Throughput Limits

Here is a scenario that every platform engineering team running multi-tenant AI infrastructure has either already lived through or is about to: it's 9:07 AM on a Tuesday, three of your largest enterprise tenants simultaneously trigger high-volume agentic pipelines, and within 90 seconds your foundation model provider

By Scott Miller
How One Platform Team Discovered Their Multi-Agent Workflow Checkpointing Strategy Was Silently Corrupting Long-Running Task State During Foundation Model Failovers ,  And Rebuilt Their Recovery Architecture From Scratch

Multi-Agent Systems

How One Platform Team Discovered Their Multi-Agent Workflow Checkpointing Strategy Was Silently Corrupting Long-Running Task State During Foundation Model Failovers , And Rebuilt Their Recovery Architecture From Scratch

When the platform engineering team at a mid-sized fintech company (we will call them Meridian Financial Labs) first deployed their multi-agent orchestration layer in late 2024, everything looked fine on the surface. Pipelines completed. Dashboards were green. SLAs were being met. It was not until a routine audit of their

By Scott Miller
5 Myths Backend Engineers Believe About Per-Tenant AI Agent Schema Versioning That Are Silently Breaking Long-Running Agentic Workflows Across Foundation Model Upgrades in 2026

AI Agents

5 Myths Backend Engineers Believe About Per-Tenant AI Agent Schema Versioning That Are Silently Breaking Long-Running Agentic Workflows Across Foundation Model Upgrades in 2026

It starts as a quiet anomaly. A tenant's long-running agentic workflow, one that had been reliably orchestrating document processing, tool calls, and memory retrieval for weeks, suddenly starts producing malformed outputs. No deployment happened. No configuration changed. The only thing that shifted was a silent foundation model upgrade

By Scott Miller