The 6× gap: reconciling an LLM cost log with the bill
How timed-out requests and retries left costs out of my LLM request log, and the changes I made to track them more accurately.
8 min read
All writing
How timed-out requests and retries left costs out of my LLM request log, and the changes I made to track them more accurately.
8 min read