GlossaryAI Tokens

AI Tokens

AI tokens are the small units of text, such as words, word fragments, or punctuation, that a large language model reads and writes. Models count input and output in tokens, so tokens determine how much text fits in a context window, how fast a response arrives, and how much each AI interaction costs.

Related terms

The #1 AI Agent forall your customer service