05 · Tools
Tools
The measuring instruments, published as they get built.
Tool · 01
Inference cost calculator
Price a workload against published rates, then see what caching, batching, a smaller model, or your own hardware does to the number.
Open the calculator →
Tool · 02
Throughput bench
Measured tokens per second and cost per million at real concurrency.