Notes on operating inference.

Launch notes, strategy explainers, and deep-dives — written by the people who run the gateway.

One endpoint, every provider: why we built Synapass

Inference stacks accrete instead of being chosen. Synapass moves routing, failover, and cost control into one operated layer.

priority, weighted, lowest_cost, lowest_latency, highest_quality — what each strategy optimizes, and how fallback chains interact with them.

Exact, prefix, and semantic tiers with tenant isolation and scoped invalidation — plus why caching is off by default.