Token
A unit of text the model processes (often a subword piece). Context limits, pricing where applicable, and truncation behavior are commonly expressed in tokens rather than characters.
A unit of text the model processes (often a subword piece). Context limits, pricing where applicable, and truncation behavior are commonly expressed in tokens rather than characters.