#inference
2 posts tagged with "inference".
-
The Context Window Grew a Memory Manager
• 5 min readA June 2026 wave of papers shows pruning beats full context on accuracy and cost — and that eviction is becoming a deterministic, cache-aware system, not a summarize call.
-
Compiling the Agent Loop Away: Late May's Anti-Orchestration Turn
• 6 min readThree late-May 2026 papers attack the agent loop itself — compiling it into weights, speculating through idle time, and letting agents rewrite their own source.