
OpenAI's Decisions API: A Fast Classifier for Agent Routing, and the Calibration Test You Have to Run Yourself
OpenAI's Decisions API went into public beta on October 6. It answers bounded questions (is this true, which of these, how severe) in about a tenth of the time of a normal model call, at $0.10 per million input tokens. It is the right shape for the routing and gating steps inside an agent. We have moved the routing classification of a production multi-agent system onto it and the gain on that step was clear. Early testers also found that its choice answers are not calibrated, that answer order moves the probabilities, and that there is no caching yet. Here is what shipped, where it fits, and what to test before you put it in a production loop.



























