Overseer Docs
← Home

OBench1

run log

Timeline

The run took 10 hours and 52 minutes. The pace was uneven: slowest from about 20:30 to 22:30 UTC, which takes in most of the provider’s throttling, and fastest in the two hours after it.

Cells finished, all five harnesses together, from the first call at 16:29 UTC to the last cell at 03:21 UTC. Where the line is steeper, cells were finishing faster.
When (UTC)What happened
5 Nov 04:01–07:30The pilot: one seed, 135 cells, scheduled just after Go’s early double-rate window. 0 infrastructure errors.
5 Nov 13:41The first three-seed run starts.
5 Nov, afternoonOverseer cost the most in the pilot and scored among the lowest, so we read its transcripts. Its shell never worked, and it drove the desktop instead. We stop the three-seed run about an hour in ($0.40 spent) and void Overseer’s pilot row.
5 Nov, afternoonThe jail gains its GUI blocks. Overseer v5.0.0-rc2 is built and pinned: 5,359 of its 5,360 tests pass, and the one failure is a load-sensitive soak test that passes on its own. The wiring check now runs every harness’s shell; all five pass it.
5 Nov 16:29This run starts: 27 tasks × 5 harnesses × 3 seeds.
5 Nov 18:45First real rate-limit burst from the provider, as five arms start together. Everyone recovers.
5 Nov 21:00–23:00Heavy throttling in bursts (see What went wrong).
6 Nov 01:00Go’s double-rate window opens; the last tasks run inside it.
6 Nov 01:50A secrets scan of the run’s files finds the provider key in pi’s transcripts (see What went wrong). Every other secret-shaped string is a fake the tasks plant, or a placeholder from a harness’s own docs.
6 Nov 03:21The last cell finishes and the runner exits cleanly: 405 cells, 7,942 model calls, $5.78 metered, 0 infrastructure errors. (12 of pi’s and dsh’s cells never got an answer from the provider; see What went wrong.)

How it was watched

A watcher read every cell’s gateway log every 30 seconds and kept log sheets: every model call (status, tokens, time to first byte, duration), every finished cell, and an events log of anything worth a look. Alerts fired on stalls (checked against the process list), real provider errors, failure streaks, sustained rate limits, any sign of Overseer’s shell failing, any mention of Terminal or Script Editor, and the runner stopping. The watcher never read grades.