firehose> #llmops

Orchestrator Unknowns (Finding Your Unknowns)

Once a model is capable enough, the binding constraint on the quality of its work stops being its raw intelligence and becomes the things the orchestrator has not specified — the unknowns the human providing the instructions, plans, and prompts carries into the task. The source relays an Anthropic field guide ("A Field Guide to Fable: Finding Your Unknowns," attributed on-screen to Thariq / @trq212) whose framing is the map is not the territory: your prompt, skills, and context are the map; the codebase and real-world constraints are the territory; an "unknown" is any place the map underspecifies the territory, forcing the model to guess what you want. The field guide's claimed load-bearing line is that Fable is the first model where the quality of the work is bottlenecked by the operator's ability to clarify its unknowns, not by the model's ability.

The organizing device is a four-box matrix (the Rumsfeld quadrants applied to prompting): known knowns — what is already in your prompt; known unknowns — the gaps you can name; unknown knowns — tacit knowledge obvious to you but never written down (which even a very capable model may lack, since it does not share your life experience); and unknown unknowns — what you never thought to ask. The claim that makes this actionable: your prompt only fills the first box; you can use the capable model itself to drag the other three into the light — eliciting the questions, tacit assumptions, and unexplored territory a plan would silently paper over.

This is adjacent to but distinct from the Imagination Constraint. That concept is about what to build — the ceiling on value is the size of your list of askable things. This concept is one project down: given a task you have chosen, the ceiling on how well the model executes it is the unknowns you failed to clarify. The supply story for the tacit/unknown boxes is Tacit Capability Awareness: you only know where to probe by having hands-on touch with the model's edge.

Claims


Linked from