YBenchmark Arena
mock-first · providers off

Model Registry

The registry. Secrets are never stored — only the name of the env var holding each key. Live providers are inert until their key is set AND ARENA_ENABLE_LIVE_PROVIDERS=1.

ModelProviderVersionContextIn $/MtokOut $/MtokCapabilitiesReadiness
Sim Strongmock1.0.0200k$3.00$15.00
toolsjsonreasoning
ready
Sim Balancedmock1.0.0128k$0.5000$1.50
toolsjsonreasoning
ready
Sim Fast/Cheapmock1.0.032k$0.0500$0.2000
toolsjson
ready
Yuu v1.1 (simulated)mock1.1.0128k$0.2000$0.6000
toolsjsonreasoning
ready
Yuu v1.2 (simulated)mock1.2.0128k$0.2000$0.6000
toolsjsonreasoning
ready
Yuu no Sekai v1.1openai-compatible1.1.033k
reasoning
inert
Claude Opus 5anthropic5.0.0200k$5.00$25.00
toolsjsonreasoning
inert
Gemini 2.5 Flashgemini2.5.01000k$0.3000$2.50
toolsjsonreasoning
inert

“Inert” means the model cannot make a call in this environment — usually because live providers are disabled or its key env var is unset. This is the safe default: clicking run cannot spend money.