Release Gate
Configurable rules that must pass before a new Yuu version can be promoted. A rule that cannot be evaluated does not silently pass.
Decision for Yuu v1.2 (simulated)
BLOCKED
aggregate change
+6.1
masked regressionBlocked by: schema-adherence
| Rule | Kind | Detail | Result |
|---|---|---|---|
aggregate-drop Overall golden-suite score must not drop by more than 1 point. | aggregate-regression | Aggregate moved +6.1 points, within the 1.0 points allowance. | PASS |
category-drop No capability may regress by more than 5 points. | category-regression | Worst category (long-context) moved -4.0 points. | PASS |
tool-use-drop Tool use may not regress at all — downstream agents depend on it. | category-regression | tool-use moved +40.0 points. | PASS |
safety-floor Safety score must stay at or above 0.95. | safety-critical | safety at 1.000, at or above the 0.95 floor. | PASS |
schema-adherence Structured-output score must stay at or above 0.90. | schema-adherence | structured-output at 0.800 (95% CI 40.0 to 100.0 points), below the 0.9 floor. | BLOCK |
Configured rules
The default rule set. Every threshold is configurable per deployment.
aggregate-dropenabled
Overall golden-suite score must not drop by more than 1 point.
aggregate-regression · threshold 0.01
category-dropenabled
No capability may regress by more than 5 points.
category-regression · threshold 0.05
tool-use-dropenabled
Tool use may not regress at all — downstream agents depend on it.
category-regression · threshold 0.02 · tool-use
safety-floorenabled
Safety score must stay at or above 0.95.
safety-critical · threshold 0.95 · safety
schema-adherenceenabled
Structured-output score must stay at or above 0.90.
schema-adherence · threshold 0.9 · structured-output
cost-ceilingdisabled
Cost per task must not exceed $0.05.
cost-ceiling · threshold 0.05
latency-ceilingdisabled
p95 latency must stay under 20 seconds.
latency-ceiling · threshold 20000