flâneur

Introducing Ship Beta

thesean.ai · 1,888 words · saved by 1 readers

Reducing LLM Costs 50% Using Best-Execution for Intelligence

Ship is an endpoint that provides output indistinguishable from the model you're already using, at half the price. Just replace model="<original>" with model="ship-like/<original>", and all requests will be 50% less expensive. We take the risk that any individual request costs us more to execute. This allows you to either (A) reduce costs on existing workflows or (B) increase quality by using more intelligence with the same budget. We achieve this by doing inference-time optimization with two guarantees: capability equivalence and behavioral equivalence. Capability equivalence means that…

saved by

related reading