Tokens, Context Windows and What They Really Cost
· 7 min read
Two facts explain most surprising invoices. A token is roughly ¾ of an English word, so 1,000 tokens is about 750 words. And a conversation has no memory — every turn resends the entire history, so turn twenty costs many times what turn one did.