Runs
Every evaluation run, newest first. Each is reproducible from its seed and benchmark hash.
| Run | Model | Benchmark | Score | Results | Cost | Seed | Status |
|---|---|---|---|---|---|---|---|
| sim-strong × research-judged@1.0.0 | Sim Strong | research-judged@1.0.0 | 75.8% | 6 | $0.0240 | 42 | completed |
| yuu-sim-1.2 × research-judged@1.0.0 | Yuu v1.2 (simulated) | research-judged@1.0.0 | 76.7% | 6 | $0.00872 | 42 | completed |
| yuu-sim-1.1 × research-judged@1.0.0 | Yuu v1.1 (simulated) | research-judged@1.0.0 | 75.8% | 6 | $0.00859 | 42 | completed |
| sim-strong × long-context@1.0.0 | Sim Strong | long-context@1.0.0 | 33.3% | 9 | $0.1442 | 42 | completed |
| yuu-sim-1.2 × long-context@1.0.0 | Yuu v1.2 (simulated) | long-context@1.0.0 | 22.2% | 9 | $0.00857 | 42 | completed |
| yuu-sim-1.1 × long-context@1.0.0 | Yuu v1.1 (simulated) | long-context@1.0.0 | 33.3% | 9 | $0.00853 | 42 | completed |
| sim-strong × structured-output@1.0.0 | Sim Strong | structured-output@1.0.0 | 90.0% | 9 | $0.0226 | 42 | completed |
| yuu-sim-1.2 × structured-output@1.0.0 | Yuu v1.2 (simulated) | structured-output@1.0.0 | 78.9% | 9 | $0.00028 | 42 | completed |
| yuu-sim-1.1 × structured-output@1.0.0 | Yuu v1.1 (simulated) | structured-output@1.0.0 | 70.0% | 9 | $0.00027 | 42 | completed |
| sim-strong × sql-analytics@1.0.0 | Sim Strong | sql-analytics@1.0.0 | 77.8% | 9 | $0.0221 | 42 | completed |
| yuu-sim-1.2 × sql-analytics@1.0.0 | Yuu v1.2 (simulated) | sql-analytics@1.0.0 | 66.7% | 9 | $0.00024 | 42 | completed |
| yuu-sim-1.1 × sql-analytics@1.0.0 | Yuu v1.1 (simulated) | sql-analytics@1.0.0 | 44.4% | 9 | $0.00025 | 42 | completed |
| sim-strong × coding-depth@1.0.0 | Sim Strong | coding-depth@1.0.0 | 88.9% | 9 | $0.0119 | 42 | completed |
| yuu-sim-1.2 × coding-depth@1.0.0 | Yuu v1.2 (simulated) | coding-depth@1.0.0 | 55.6% | 9 | $0.00042 | 42 | completed |
| yuu-sim-1.1 × coding-depth@1.0.0 | Yuu v1.1 (simulated) | coding-depth@1.0.0 | 55.6% | 9 | $0.00034 | 42 | completed |
| yuu-sim-1.2 × yuu-golden@1.0.0 | Yuu v1.2 (simulated) | yuu-golden@1.0.0 | 74.8% | 120 | $0.0150 | 42 | completed |
| yuu-sim-1.1 × yuu-golden@1.0.0 | Yuu v1.1 (simulated) | yuu-golden@1.0.0 | 68.7% | 120 | $0.0150 | 42 | completed |
| sim-fast-cheap × yuu-golden@1.0.0 | Sim Fast/Cheap | yuu-golden@1.0.0 | 45.2% | 120 | $0.00378 | 42 | completed |
| sim-balanced × yuu-golden@1.0.0 | Sim Balanced | yuu-golden@1.0.0 | 67.0% | 120 | $0.0366 | 42 | completed |
| sim-strong × yuu-golden@1.0.0 | Sim Strong | yuu-golden@1.0.0 | 87.8% | 120 | $0.2912 | 42 | completed |