LLM Cost Monitoring and Diagnosis
An operations conversation. The token bill tripled last month, nobody deployed anything, and finance would like an answer today.
The questions in this round
Your token spend tripled last month and nobody deployed anything. What happened?
It is not traffic. Request count is flat month over month. Now what?
You find one tenant at forty times the average cost per request. Is that a bug or a customer?