Root Description Optimization
Winner: Current
- current tokens:
54
- winner tokens:
54
- baseline tokens:
8
Winner
Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
Candidate Ranking
| Candidate |
Tokens |
Dev FP |
Dev FN |
Dev Near |
Holdout FP |
Holdout FN |
Current |
54 |
0 |
0 |
1.0 |
0 |
0 |
Minimal |
41 |
1 |
1 |
1.0 |
0 |
0 |
Guardrail |
56 |
1 |
1 |
1.0 |
0 |
0 |
Balanced |
60 |
1 |
1 |
1.0 |
0 |
0 |
Artifact Aware |
77 |
1 |
1 |
1.0 |
0 |
0 |
Boundary |
83 |
1 |
1 |
1.0 |
0 |
0 |
Acceptance Gates
| Gate |
Winner FP |
Winner FN |
Current FP |
Current FN |
Baseline FP |
Baseline FN |
| Holdout |
0 |
0 |
0 |
0 |
0 |
0 |
| Blind Holdout |
0 |
0 |
0 |
0 |
0 |
0 |
| Judge Blind Holdout |
0 |
0 |
0 |
0 |
0 |
0 |
| Adversarial Holdout |
0 |
0 |
0 |
0 |
0 |
0 |
Calibration
| Gate |
Winner Gap |
Winner Risk |
Winner Boundary Rate |
Current Gap |
Baseline Gap |
| Holdout |
0.465 |
healthy |
0.0 |
0.465 |
0.416 |
| Blind Holdout |
0.29 |
watch |
0.333 |
0.29 |
0.368 |
| Adversarial Holdout |
0.808 |
healthy |
0.0 |
0.808 |
0.845 |
Judge Blind Summary
| Gate |
Winner Agreement |
Winner Mean Confidence |
Current Agreement |
Baseline Agreement |
| Judge Blind Holdout |
1.0 |
0.66 |
1.0 |
1.0 |
Family Health
| Gate |
Winner Clean Families |
Winner Weakest Family |
Current Clean Families |
Baseline Clean Families |
| Holdout |
12/12 |
workflow_to_skill (0 errors) |
12/12 |
12/12 |
| Blind Holdout |
6/6 |
blind_operationalize (0 errors) |
6/6 |
6/6 |
| Judge Blind Holdout |
6/6 |
blind_operationalize (0 errors) |
6/6 |
6/6 |
| Adversarial Holdout |
6/6 |
adversarial_summary_translation_collision (0 errors) |
6/6 |
6/6 |
Selection Logic
Ordered by:
- fewest false positives
- fewest false negatives
- highest near-neighbor pass rate
- highest negative pass rate
- highest precision
- highest recall
- shortest description
yaojingang