[KongchangAI]
Conceptthinking token

Reasoning Tokens

Intermediate tokens generated by large language models with chain-of-thought reasoning capabilities during internal reasoning before producing a final answer. Even when they are not shown to the user, they consume compute and are counted toward output charges.

Timeline (last 90 days)

Oct 18

Thinking tokens are the tokens a reasoning model consumes for internal reasoning before producing an answer; they are usually not shown directly to the user but are still billed as output tokens.

Unverified50%
Oct 17

Fewer thinking tokens improve efficiency on simple tasks but may compress the exploration space on complex reasoning tasks.

Unverified50%
Oct 15

Thinking tokens are billed as output tokens just like the final answer, and are usually invisible to users or shown only in collapsed form.

Unverified50%

All Facts (3)

Source Articles