Files
yao-meta-skill/examples/governed-incident-command/optimization/reports/description_optimization.md
T
2026-05-01 14:27:51 +08:00

2.1 KiB

Governed Incident Description Optimization

Winner: Current

  • current tokens: 37
  • winner tokens: 37
  • baseline tokens: 93

Winner

Build governed incident command packets. Use when asked to standardize incident review, run severity assessment, or assemble incident communication.

Candidate Ranking

Candidate Tokens Dev FP Dev FN Dev Near Holdout FP Holdout FN
Current 37 0 1 1.0 0 1
Guardrail 51 0 1 1.0 1 1
Balanced 54 0 1 1.0 0 1
Boundary 78 0 1 1.0 0 1
Artifact Aware 78 0 1 1.0 0 1

Acceptance Gates

Gate Winner FP Winner FN Current FP Current FN Baseline FP Baseline FN
Holdout 0 1 0 1 0 2
Blind Holdout 0 0 0 0 0 1
Judge Blind Holdout 0 0 0 0 0 0
Adversarial Holdout 0 0 0 0 0 0

Calibration

Gate Winner Gap Winner Risk Winner Boundary Rate Current Gap Baseline Gap
Holdout 0.023 overlap 0.0 0.023 0.101
Blind Holdout 0.418 healthy 0.167 0.418 0.063
Adversarial Holdout 0.598 healthy 0.0 0.598 0.172

Judge Blind Summary

Gate Winner Agreement Winner Mean Confidence Current Agreement Baseline Agreement
Judge Blind Holdout 1.0 0.657 1.0 1.0

Family Health

Gate Winner Clean Families Winner Weakest Family Current Clean Families Baseline Clean Families
Holdout 5/6 packet_assembly (1 errors) 5/6 4/6
Blind Holdout 6/6 blind_summary_only (0 errors) 6/6 5/6
Judge Blind Holdout 6/6 blind_summary_only (0 errors) 6/6 6/6
Adversarial Holdout 6/6 adversarial_single_update_collision (0 errors) 6/6 6/6

Selection Logic

Ordered by:

  • fewest false positives
  • fewest false negatives
  • highest near-neighbor pass rate
  • highest negative pass rate
  • highest precision
  • highest recall
  • shortest description