COURSE 19 OF 20
LLM Serving and Inference Economics
Find out where the latency and the money actually go, then change the number instead of guessing at it.
Builds on
Best read after 11. LLM Foundations — you can still read ahead, but some of this may lean on ideas covered there.