firehose> #llmops

Text-Space Optimization

Treat a natural-language artifact — a skill document, a prompt, a playbook — as the trainable state of a frozen model, and optimize it with the machinery of weight-space training. The model's parameters never move. What moves is markdown. SkillOpt (Microsoft Research) is the worked instance: a separate optimizer model reads scored rollouts of a target agent and emits bounded add / delete / replace edits to a single skill document, under an explicit budget the repo calls a textual learning rate, organized into epochs with a (mini-)batch size of sampled tasks. The vocabulary is not decoration — it names the specific disciplines borrowed (bounded step size, held-out validation, epoch-wise slow/meta updates, a rejected-edit buffer that functions as negative memory) and the specific one that cannot be borrowed: there is no analytic gradient, so a language model computes the update direction from trajectories instead.

The property that makes this a distinct kind of artifact rather than a training curiosity: the optimized output is a compact document that runs against the unchanged target model with zero extra inference-time model calls. All the search cost is paid offline; the deployed thing is best_skill.md. That is the inverse of most agentic quality moves (LLM-as-Judge, evaluator-optimizer in Agentic Workflow Patterns, reflection loops), which buy quality by spending inference-time calls on every request. Where those pay per-request forever, text-space optimization pays once and ships a file. The cost is moved, not removed — the search still consumes rollouts, judges, and tokens — but it moves to a place where it can be budgeted, gated, and amortized.

This is the mechanized end of a spectrum the graph already holds. Self-Improving System and Skill-Driven Loop Development improve skills through a human-driven loop; the skill gets better because a person notices and edits. Text-space optimization asks what happens when the noticing and the editing are themselves an optimizer, with Validation-Gated Update standing in for the human's judgment.

Claims

Check-worthy source claims (attributed, not adjudicated — a later grounding pass can verify):


Linked from