Your team asks AI things all day: draft this email, summarize this document, write a reply to this customer. Every one of those answers has a price. It is small, it is invisible, and it adds up faster than anyone expects.
That price is counted in tokens. If you understand tokens, your AI bill stops being a mystery. This guide gets you there in five minutes, no technical background needed.
A token is a piece of a word
AI does not read whole sentences the way we do. It breaks text into small chunks called tokens. A token is roughly three-quarters of a word in English, so 100 words is about 130 tokens. Every word you send to AI gets counted, and every word it writes back gets counted too.
You pay for both directions: what goes in, and what comes out. Paste a 20-page contract and ask for a one-line summary? You paid mostly for the 20 pages going in.
Think of it like your electricity meter
You do not think about kilowatts when you turn on a light, but the meter counts them and the bill arrives monthly. Tokens work the same way. Nobody on your team sees the meter while they work - it just runs. That is exactly why AI costs creep up quietly: the meter is real, but nobody is watching it.
Why some tasks cost 100x more than others
Three things drive the price of any single AI task:
- How much text goes in and out. A short question with a short answer is cheap. Long documents, long conversations, and long reports are not.
- Which model does the work. AI comes in sizes. The biggest models can cost 10-30x more per token than the small ones. Same question, very different price.
- Conversation history. In a long chat, the tools resend earlier messages with every new question so the AI keeps context. Message 40 in a conversation quietly costs many times more than message 2.
How this shows up on your bill
Most companies pay for AI in one of two ways, and often both at once:
- Seats. A fixed monthly price per person (ChatGPT Business, Copilot, Claude for Work). Predictable, but you pay whether the seat is used or not.
- Usage. Pay-per-token through an API or platform. Scales with real activity, which means it also scales with waste.
Either way, the number on the invoice is the sum of thousands of small token counts nobody looked at. Industry research finds that 40-60% of enterprise token budgets are waste - not because AI is a scam, but because nobody was watching the meter.
What to do with this knowledge
- Find out what you actually spend per month, across all tools. Most companies cannot answer this today.
- Ask which model your team uses for everyday work. If everything runs on the premium one, you are overpaying.
- Watch for long chat sessions and huge pasted documents - they are the token hogs.
- Or skip the manual work: Optimize connects to your AI accounts and does all of this automatically.