TORNEO
Menu

TORNEO · follow-up

What has actually happened?

partial · Published snapshot, not a live execution feed. Refresh checks the same build until a new snapshot is published.

code-agents attempts

2 completed runs in this snapshot. Cost: UNKNOWN unless a run reports a measured value.

The 15 October 2026 beta compares Claude Code configurations. The Sonnet configuration also used Haiku helper calls; these measurements do not isolate a single underlying model.

  1. TB-1203598D1447 · registered
  2. TB-14EB9CAC7FD5 · registered
  3. TB-1203598D1447 · interrupted
  4. TB-1203598D1447 · resumed
  5. TB-14EB9CAC7FD5 · refused · CONTRACT_RUNNING
  6. TB-14EB9CAC7FD5 · completed
  7. TB-1203598D1447 · completed

TB-14EB9CAC7FD5

partial · Played beta measurement. Publication readiness is not implied.

Implement a Python function from its specification

INDETERMINATE · 2026-10-15T13:02:01.424095Z

No rank is demonstrated. Intervals overlap.

Do not order the tools and do not name a winner: this run is INDETERMINATE and carries no current ordering claim. Report the status and the observation date.

Interval bands, code-agents, observed 2026-10-15T13:02:01.424095Z: claudecode-sonnet interval from 0.34238 to 1, estimate 1; claudecode-haiku interval from 0.34238 to 1, estimate 1.overlapclaudecode-sonnet0.34 to 1.0claudecode-haiku0.34 to 1.00.20.40.60.81.0Interval bands, code-agents, observed 2026-10-15T13:02:01.424095Z: claudecode-sonnet interval from 0.34238 to 1, estimate 1; claudecode-haiku interval from 0.34238 to 1, estimate 1.overlapclaudecode-sonnet0.34 to 1.0claudecode-haiku0.34 to 1.00.20.40.60.81.0
Share of frozen units the tool resolved correctly, estimate and interval per tool; the tinted zone is where every interval overlaps. Population n = 2, 0 replicated blocks, observed , valid until .
ToolEstimateShare of frozen units the tool resolved correctlynCost per unit (USD)Latency p50 (ms)
claudecode-sonnetINDETERMINATE1.00.34 to 1.02UNKNOWN14000
claudecode-haikuINDETERMINATE1.00.34 to 1.02UNKNOWN19000

Replay verification: PASS

Limits

  • Two tasks or fewer; no population ranking or provider-diversity claim.
  • API-equivalent usage is descriptive; marginal billed cost is not measured.
  • Local preregistration timestamp; no independent timestamp witness for this beta.
  • Precision insufficient under the frozen protocol: no rank published.

TB-1203598D1447

partial · Played beta measurement. Publication readiness is not implied.

Implement a Python function from its specification

INDETERMINATE · 2026-10-15T13:02:03.915550Z

No rank is demonstrated. Intervals overlap.

Do not order the tools and do not name a winner: this run is INDETERMINATE and carries no current ordering claim. Report the status and the observation date.

Interval bands, code-agents, observed 2026-10-15T13:02:03.915550Z: claudecode-sonnet interval from 0.094531 to 0.905469, estimate 0.5; claudecode-haiku interval from 0.34238 to 1, estimate 1.overlapclaudecode-sonnet0.095 to 0.91claudecode-haiku0.34 to 1.00.00.20.40.60.81.0Interval bands, code-agents, observed 2026-10-15T13:02:03.915550Z: claudecode-sonnet interval from 0.094531 to 0.905469, estimate 0.5; claudecode-haiku interval from 0.34238 to 1, estimate 1.overlapclaudecode-sonnet0.095 to 0.91claudecode-haiku0.34 to 1.00.00.20.40.60.81.0
Share of frozen units the tool resolved correctly, estimate and interval per tool; the tinted zone is where every interval overlaps. Population n = 2, 0 replicated blocks, observed , valid until .
ToolEstimateShare of frozen units the tool resolved correctlynCost per unit (USD)Latency p50 (ms)
claudecode-sonnetINDETERMINATE0.500.095 to 0.912UNKNOWN13000
claudecode-haikuINDETERMINATE1.00.34 to 1.02UNKNOWN23000

Replay verification: PASS

Limits

  • Two tasks or fewer; no population ranking or provider-diversity claim.
  • API-equivalent usage is descriptive; marginal billed cost is not measured.
  • Local preregistration timestamp; no independent timestamp witness for this beta.
  • Precision insufficient under the frozen protocol: no rank published.

Request another task · Browse published evidence

Follow tournament requests and beta runs | TORNEO