firehose> #llmops

Reasoning Effort Control

Treat a model's reasoning effort as a dial to match to the task, not a fixed maximum. Modern models expose graded effort/thinking levels (the source names low / medium / high / x-high), and higher effort means longer runs and higher cost — individual requests on hard tasks "can run for many minutes at higher effort settings" while the model gathers context, builds, and self-verifies. Effort control is the discipline of matching the level to the task's value: the source relays Anthropic's recommendation to use high as the default, x-high for the most capability-sensitive workloads, and medium/low for routine work. The corollary is model and effort selection as a cost lever — reaching for the most expensive model at max effort "for everything" is "almost 100% overkill"; the source suggests realistically needing the top model only ~5–15% of the time.

A related, adjacent habit: let the model act once it has enough rather than forcing exhaustive up-front planning. On a model that can run for minutes, endless option-surveying "just burns time and money on choices it will never use" — so "when you have enough information to act, act" is effort control applied to deliberation, not just to a setting. (This half corroborates Agentic Simplicity.)

Claims


Linked from