firehose> #llmops

Repeated-Sampling Scaling

Trying more times reliably raises the chance a correct answer exists somewhere in the pile; finding it is a separate problem, and it is gated on having a mechanical checker. Where a checker exists, coverage converts straight into results. Where it doesn't, spend past a low ceiling buys answers nobody can identify.

The two halves, from the source's account of a Stanford 2024 repeated-sampling study (identified from a frame in the capture as the "Large Language Monkeys" work at scalingintelligence.stanford.edu/pubs/large_language_monkeys/; all figures below are the source's claims and are check-worthy — see the distillate):

The distinction this page exists to protect: attempts are not agents. Agentic Simplicity and Bounded Fan-Out hold — correctly — that more agents is not monotonically better. Repeated sampling says more attempts very nearly is, inside a verifier. These are different axes and conflating them inverts both lessons. Reading "coverage scales log-linearly" as a licence to fan out a swarm is exactly the error Bounded Fan-Out warns against; reading "more agents ≠ better" as "more attempts ≠ better" throws away the one dial that does scale. What repeated sampling actually licenses is retries against a check, which is a property of the loop, not of the roster.

The corollary the source draws, and the reason this sits at the centre of Agent-Shape Triage: checkability is not hygiene, it is the switch that decides whether spend converts at all. It is why "is checking much cheaper than producing?" earns a place among only four questions.

Claims


Linked from