Files
yao-meta-skill/reports/description_optimization.md
YAO 31ce04c655 Split meta skill CLI and review gates
Merge the beta-ready Yao Meta Skill architecture, report, evidence gate, and release-boundary updates.\n\nRelease boundary: beta/public testing is allowed; formal world-class, fully reviewed, or superiority claims remain blocked until the pending evidence gates are accepted.
2026-06-17 18:43:02 +08:00

2.2 KiB

Root Description Optimization

Winner: Current

  • current tokens: 53
  • winner tokens: 53
  • baseline tokens: 8

Winner

Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.

Candidate Ranking

Candidate Tokens Dev FP Dev FN Dev Near Holdout FP Holdout FN
Current 53 0 0 1.0 0 0
Minimal 41 1 1 1.0 0 0
Guardrail 56 1 1 1.0 0 0
Balanced 60 1 1 1.0 0 0
Artifact Aware 77 1 1 1.0 0 0
Boundary 83 1 1 1.0 0 0

Acceptance Gates

Gate Winner FP Winner FN Current FP Current FN Baseline FP Baseline FN
Holdout 0 0 0 0 0 0
Blind Holdout 0 0 0 0 0 0
Judge Blind Holdout 0 0 0 0 0 0
Adversarial Holdout 0 0 0 0 0 0

Calibration

Gate Winner Gap Winner Risk Winner Boundary Rate Current Gap Baseline Gap
Holdout 0.744 healthy 0.0 0.744 0.416
Blind Holdout 0.36 tight 0.167 0.36 0.368
Adversarial Holdout 1.0 healthy 0.0 1.0 0.845

Judge Blind Summary

Gate Winner Agreement Winner Mean Confidence Current Agreement Baseline Agreement
Judge Blind Holdout 1.0 0.66 1.0 1.0

Family Health

Gate Winner Clean Families Winner Weakest Family Current Clean Families Baseline Clean Families
Holdout 12/12 workflow_to_skill (0 errors) 12/12 12/12
Blind Holdout 6/6 blind_operationalize (0 errors) 6/6 6/6
Judge Blind Holdout 6/6 blind_operationalize (0 errors) 6/6 6/6
Adversarial Holdout 6/6 adversarial_summary_translation_collision (0 errors) 6/6 6/6

Selection Logic

Ordered by:

  • fewest false positives
  • fewest false negatives
  • highest near-neighbor pass rate
  • highest negative pass rate
  • highest precision
  • highest recall
  • shortest description