#latency
2 posts tagged with "latency".
-
Compiling the Agent Loop Away: Late May's Anti-Orchestration Turn
• 6 min readThree late-May 2026 papers attack the agent loop itself — compiling it into weights, speculating through idle time, and letting agents rewrite their own source.
-
Cost and Latency Engineering for Agent Systems
• 7 min readAgents bill non-linearly. The patterns that matter — prompt caching, tiered model routing, parallel tool calls, retrieval budgets — and the dashboards that catch waste before it ships.
