[{"data":1,"prerenderedAt":28},["ShallowReactive",2],{"gtags-en-token,input-tokens,output-tokens,context-window,cached-input-pricing,blended-token-price":3},[4,8,12,16,20,24],{"slug":5,"term":6,"short":7},"token","Token","The unit an LLM reads and writes. Roughly 3-4 characters of English, or about 0.75 words. Every API bill is counted in tokens.",{"slug":9,"term":10,"short":11},"input-tokens","Input tokens","The tokens you send to a model: system prompt, conversation history, retrieved context and the user message. Usually the cheaper half of the bill.",{"slug":13,"term":14,"short":15},"output-tokens","Output tokens","The tokens a model generates in its reply. Usually the expensive half of the bill - 2 to 5 times the input price - because each one requires a full forward pass.",{"slug":17,"term":18,"short":19},"context-window","Context window","The maximum number of tokens a model can consider at once - prompt plus reply combined. Common sizes range from 8K to over 1M tokens.",{"slug":21,"term":22,"short":23},"cached-input-pricing","Cached input pricing","A discount on input tokens that repeat across calls - a stable system prompt, few-shot examples, a long document. The cached prefix is billed at roughly 10-25% of the normal input rate.",{"slug":25,"term":26,"short":27},"blended-token-price","Blended token price","A single per-million-token figure that combines the input and output prices at an assumed ratio, so models can be ranked in one column. Obolith weights input 3x to output.",1793773295716]