firehose> #llmops

STORM: A Fixed Panel of Adversarial Research Lenses, Packaged as a Skill

TL;DR

A 12-minute walkthrough (Nate Herk / AI Automation) of a free Claude skill that repackages Stanford's STORM research method into a fixed pipeline: scope the topic → run five role-typed expert lenses in parallel (practitioner, academic, skeptic, economist, historian) → map where they contradict → synthesize → adversarially peer-review its own output and verify every citation against its primary source → emit a consistent, self-contained HTML briefing. The load-bearing idea is not the skill but its shape: a single prompt is "Claude as a search box — one angle in, one confident answer out; it can't see what it can't see," so you manufacture structured disagreement across a small fixed panel and force a verification pass, rather than trusting one pass. This is the Adversarial Planning Council pattern turned from a build/kill gate toward verified research synthesis — a third independent instance of "parallel personas whose real value is the cross-review round." The source's contrast case is Claude's native Deep Research, which fanned out 100+ dynamic agents into a thin brain-dump markdown; STORM's ~12-agent fixed roster was, per the source, faster, "100% cheaper," rate-limit-safe, consistent in output shape, and judged better on six dimensions by an external Codex model — the demand side of Bounded Fan-Out over an unbounded swarm. A secondary teaching beat draws the subagent vs agent-team distinction (Agent Communication Topology): STORM uses hub-and-spoke subagents that can't talk to each other, and gets its cross-examination from an explicit hub-run contradiction+review stage instead of a mesh debate. The honest caveat is on the artifact's own face: the briefing labels its panel "author-constructed… all five lenses share one framing, so where they agree, treat it as a strong hypothesis, not independent proof."

Concepts introduced

Held, not dropped (themes touched, not yet warranting their own page):

Key claims

Check-worthy source claims (attributed, not adjudicated — a later grounding pass can verify):

Why this builds on the graph

The dominant stance is builds_on: STORM extends Adversarial Planning Council out of its original build/kill-gate frame into verified research synthesis, and it does so as a third independent instance of the same primitive already recorded there (a personal "roast" ritual and the public llm-council-skill are the first two; STORM is the third — parallel personas whose payoff is the cross-review round, not the parallel answers). Two secondary relations matter. It corroborates that concept's caution about persona-vs-model diversity, and does so from an unusually honest angle — the artifact prints on itself that its author-constructed, shared-framing panel yields correlated rather than independent judgments, which is why the trust rides on the verification pass, not on the lenses agreeing. And it supplies the demand-side case for two axes the graph named abstractly: Bounded Fan-Out (a fixed roster beating an unbounded swarm on cost/consistency/rate-limits, and — per the source's own external judge — not on quality either) and Agent Communication Topology (hub-and-spoke subagents plus an explicit review stage substituting for a mesh debate). There is no contradiction with existing pages; STORM is convergent evidence plus two new distinctions, not a tension to resolve.

Illustrated walkthrough


Linked from