Review Studio 2.0

# Yao Meta Skill

Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use when asked to create a skill, turn a repeated process into a reusable skill, improve an existing skill, add evals, or package a skill for team reuse.

审查结论 review Score 91/100

## 核心指标

Skill IR 2.0.0

5 targets in platform-neutral contract

Compiler 5/5

target contracts compiled from Skill IR

Output Delta 100.0

5 cases; 1 file-backed

Exec Runs 10

command 10; model 0; recorded 0

Blind A/B 5

review pairs hide baseline vs with-skill labels

Review Kit 0/5

pending 5; answer key hidden

Review A/B 0/5

adjudication decisions; pending 5

Public Claim blocked

5 blockers; local reproducible true

Blueprint 20/20

2.0 coverage; extensions partial 1, planned 0; evidence pending 4

Runtime 5/5

target conformance pass rate

Perm Probe 4/4

0 native; 4 installer-enforced

Trust 0

106 scripts scanned; secrets found

Py Compat 0

171 files scanned for Python 3.11

Arch Debt 0

886 largest lines; 34 CLI handlers

Atlas 5

12 scanned skills; route collisions

Drift low

1 metadata events; 0 missed triggers

Waivers 0

0 gates covered; human risk decisions

Intake 4/4

0 valid submissions; 0 invalid

Claim Guard 0

76 public surfaces scanned

Notes 0/0

0 open blocker annotations

Registry 1.1.0

5 targets; MIT license

Archive pass

586 zip entries; package verification

Install pass

4 adapters; 12 permissions enforced; 0 permission failures

Upgrade minor

declared minor; 0 breaking changes

## 审查闸门

通过

### 意图画布

intent confidence 100/100; Intent is clear enough to package the first routeable version.

通过

### 触发实验

13 trigger cases; 0 misroutes; 0 ambiguous

关注

### 输出实验

5/5 cases; with-skill 100.0; baseline 0.0; file-backed 1; near-neighbor 1; blind A/B 5; exec 10; command 10; model 0; recorded 0; reviewed 0/5; review pending 5

通过

### 上下文

initial load 960/1000; deferred 416415/120000; top deferred scripts 367825; resource governance governed; quality density 135.4

通过

### 运行矩阵

5 / 5 targets pass

通过

### 信任报告

0 secrets; 106 scripts; 3 network-capable scripts; 0 help smoke failures

通过

### Python 兼容

Python 3.11; 171 files; 0 compatibility issues; 0 syntax; 0 f-string 3.11 hazards

通过

### 架构维护

168 Python files; 0 hotspots; 0 blockers; largest 886 lines; 34 CLI handlers

通过

### 权限批准

3/3 permissions approved; gaps 0; required file_write, network, subprocess

通过

### 权限探针

4/4 targets probed; native 0; metadata fallback 4; installer 4; residual risks 4

通过

### 组合治理

12 skills, 1 actionable; 0 actionable route collisions; 0 actionable owner gaps; 0 actionable stale; 0 actionable drift; 24 scoped non-actionable issues

通过

### 运营回路

1 metadata events; adoption 100.0; missed 0; bad-output 0; risk low

关注

### 人工批准

0 active waivers; 1 warning gates still need reviewer decision

关注

### 世界证据

4 pending world-class evidence entries; 1 human pending; 3 external pending; source checks 7/13 pass; 6 blocked; overclaim guard true

通过

### 注册审计

yao-meta-skill 1.1.0; 6/6 compatibility entries pass; install pass with 4 adapters; installer permissions 12 enforced / 0 failures

通过

### 发布路线

0 promote; 3 keep current; 0 blocked; upgrade minor declared / minor recommended

## 阻断事项

无。

## 关注事项

- 输出实验 5/5 cases; with-skill 100.0; baseline 0.0; file-backed 1; near-neighbor 1; blind A/B 5; exec 10; command 10; model 0; recorded 0; reviewed 0/5; review pending 5
- 人工批准 0 active waivers; 1 warning gates still need reviewer decision
- 世界证据 4 pending world-class evidence entries; 1 human pending; 3 external pending; source checks 7/13 pass; 6 blocked; overclaim guard true

## 修复动作

关注

### 输出实验

补足 output eval 覆盖、execution evidence、blind A/B 和 reviewer adjudication。

没有输出质量和人工盲评证据时，Skill 只能证明会触发，不能证明输出真的更好且经得起审查。

修复位置
  evals/output/cases.jsonl + reports/output_quality_scorecard.md + reports/output_review_kit.html + reports/output_review_adjudication.md
验证命令
  `python3 scripts/adjudicate_output_review.py --write-template && python3 scripts/yao.py output-review`

- evals/output/cases.jsonl:1 output eval cases · eval
- reports/output_quality_scorecard.md:1 output scorecard · report
- reports/output_execution_runs.md:1 output execution runs · report
- reports/output_blind_review_pack.md:1 blind A/B review pack · report
- reports/output_review_kit.html:6 reviewer cockpit · report
- reports/output_review_adjudication.md:1 review adjudication · report

关注

### 人工批准

对保留的 warning 写入 reviewer、理由、范围和到期时间，或修掉 warning。

warning 可以被接受，但必须可审计、会过期，并且不能掩盖 blocker。

修复位置
  reports/review_waivers.md
验证命令
  `python3 scripts/render_review_waivers.py .`

- reports/review_waivers.md:1 waiver ledger · report
- references/review-waiver-method.md:1 waiver method · method

关注

### 世界证据

补齐 provider、真人盲评、原生权限执行和真实客户端遥测证据，或明确本次发布不声明 world-class 完成。

世界级结论必须来自已接受的外部/人工证据；计划、metadata fallback、待评审和本地命令都不能替代完成证据。

修复位置
  reports/world_class_operator_runbook.html + reports/world_class_evidence_ledger.md + reports/world_class_evidence_intake.md + reports/world_class_submission_review.md
验证命令
  `python3 scripts/yao.py world-class-runbook . --submissions-dir evidence/world_class/submissions && python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions && python3 scripts/yao.py review-studio .`

#### 证据采集

以下条目仍需真实外部或人工证据；提交文件、校验命令和阻断检查必须同时闭环。

pending · external

#### Provider Holdout

model-executed 0; token-observed 0

提交
  `evidence/world_class/submissions/provider-holdout.json`
模板
  `evidence/world_class/templates/provider-holdout.intake.json`
阻断
  2 blocked / 1 pass
下一步
  Run provider-backed holdout cases with real credentials and commit only aggregate evidence.

##### 阻断检查

- Provider model run `model_executed_count: 0 / >0` Run provider-backed output-exec with real credentials.
- Token usage observed `token_observed_count: 0 / >0` Provider execution should return non-estimated token usage.

操作命令

- 准备提交 `python3 scripts/yao.py world-class-submission-kit . --evidence-key provider-holdout --output-dir evidence/world_class/submissions`
- 校验入口 `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- 审查提交 `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- 刷新台账 `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`

首要步骤

1. YAO_OUTPUT_EVAL_MODEL=gpt-4.1-mini OPENAI_API_KEY=<redacted> python3 scripts/yao.py output-exec --provider-runner openai --timeout-seconds 60
2. python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
3. Copy evidence/world_class/templates/provider-holdout.intake.json to evidence/world_class/submissions/provider-holdout.json and fill only real evidence fields.

pending · human

#### Human Adjudication

0/5 decisions; pending 5

提交
  `evidence/world_class/submissions/human-adjudication.json`
模板
  `evidence/world_class/templates/human-adjudication.intake.json`
阻断
  2 blocked / 2 pass
下一步
  Record real A/B choices in the decision template, then regenerate adjudication.

##### 阻断检查

- No pending decisions `pending_count: 5 / ==0` Record a reviewer choice for every pair.
- Judgments complete `judgment_count: 0 / ==pair_count` Every pair needs one valid human judgment.

操作命令

- 准备提交 `python3 scripts/yao.py world-class-submission-kit . --evidence-key human-adjudication --output-dir evidence/world_class/submissions`
- 校验入口 `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- 审查提交 `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- 刷新台账 `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`

首要步骤

1. python3 scripts/yao.py output-review-kit --write-template
2. Open reports/output_review_kit.md and choose A or B for each pair without opening the answer key.
3. python3 scripts/adjudicate_output_review.py --write-template

pending · external

#### Native Permission Enforcement

native-enforced targets 0; installer-enforced targets 4

提交
  `evidence/world_class/submissions/native-permission-enforcement.json`
模板
  `evidence/world_class/templates/native-permission-enforcement.intake.json`
阻断
  1 blocked / 2 pass
下一步
  Integrate a real target-client or external installer runtime guard before claiming native permission enforcement.

##### 阻断检查

- Native enforcement `native_enforcement_count: 0 / >0` Collect real target-client or external runtime guard proof.

操作命令

- 准备提交 `python3 scripts/yao.py world-class-submission-kit . --evidence-key native-permission-enforcement --output-dir evidence/world_class/submissions`
- 校验入口 `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- 审查提交 `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- 刷新台账 `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`

首要步骤

1. Implement or connect a real target client or external installer runtime guard that blocks undeclared network, file_write, or subprocess capabilities.
2. Update the generated target adapter only when the guard is actually enforced by that target.
3. python3 scripts/yao.py package . --platform openai --platform claude --platform generic --platform vscode --output-dir dist --zip

pending · external

#### Native Client Telemetry

external source events 0; adoption samples 1

提交
  `evidence/world_class/submissions/native-client-telemetry.json`
模板
  `evidence/world_class/templates/native-client-telemetry.intake.json`
阻断
  1 blocked / 2 pass
下一步
  Install a real client against the native host and import production metadata-only events.

##### 阻断检查

- External events `external_source_events: 0 / >0` Import at least one metadata-only event from a real client.

操作命令

- 准备提交 `python3 scripts/yao.py world-class-submission-kit . --evidence-key native-client-telemetry --output-dir evidence/world_class/submissions`
- 校验入口 `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- 审查提交 `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- 刷新台账 `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`

首要步骤

1. python3 scripts/telemetry_native_host.py . --write-launcher /tmp/yao-telemetry-host.sh --write-manifest /tmp/yao-telemetry-host.json --allowed-origin chrome-extension://<extension-id>/
2. Install the generated native messaging manifest for the real client and send at least one accepted skill_activation or skill_output event.
3. python3 scripts/yao.py telemetry-import . --input-jsonl .yao/telemetry_spool/external_events.jsonl

- reports/world_class_evidence_ledger.md:1 world-class evidence ledger · report
- reports/world_class_evidence_plan.md:1 world-class evidence plan · report
- reports/world_class_evidence_intake.md:1 world-class evidence intake · report
- reports/world_class_submission_review.md:1 world-class submission review · report
- reports/world_class_claim_guard.md:1 world-class claim guard · report
- evidence/world_class/intake.schema.json:4 evidence intake schema · schema
- evidence/world_class/templates/provider-holdout.intake.json:3 provider intake template · template
- evidence/world_class/templates/human-adjudication.intake.json:3 human intake template · template
- evidence/world_class/templates/native-permission-enforcement.intake.json:3 permission intake template · template
- evidence/world_class/templates/native-client-telemetry.intake.json:3 telemetry intake template · template
- reports/skill_os2_audit.md:1 Skill OS 2.0 audit · report
- reports/output_review_decisions.json:6 human review decisions · report
- reports/runtime_permission_probes.md:1 runtime permission probes · report
- reports/adoption_drift_report.md:1 adoption drift · report

## 审查批注

当前批注：0 条批注；开放 0；阻断 0

当前没有 reviewer 批注。

## 意图画布

Turn repeated workflows, prompts, transcripts, runbooks, documents, or existing skill packages into routeable, evaluable, packageable, and governable agent skills for personal, team, library, or governed reuse. Primary output: A working skill package with lean SKILL.md, aligned agents/interface.yaml, justified references, scripts only when useful, eval evidence, reports, packaging metadata, and clear next iteration recommendations.. Exclusions: one-off writing, translation, explanation, or brainstorming requests that do not need a reusable skill, general code review or debugging unless the user is packaging that workflow as a skill, raw private material that was not intentionally supplied as skill evidence, platform-specific plugin creation when the request is not about an agent skill package.

## 证据路径

- skill_overview reports/skill-overview.html
- review_viewer reports/review-viewer.html
- output_eval reports/output_quality_scorecard.md
- output_execution reports/output_execution_runs.md
- output_blind_review reports/output_blind_review_pack.md
- output_review_kit reports/output_review_kit.md
- output_review_kit_html reports/output_review_kit.html
- output_review_decisions reports/output_review_decisions.json
- output_review_adjudication reports/output_review_adjudication.md
- benchmark_reproducibility reports/benchmark_reproducibility.md
- skill_os2_coverage reports/skill_os2_coverage.md
- runtime_conformance reports/conformance_matrix.md
- trust_report reports/security_trust_report.md
- python_compatibility reports/python_compatibility.md
- architecture_maintainability reports/architecture_maintainability.md
- permission_policy security/permission_policy.md
- runtime_permissions reports/runtime_permission_probes.md
- skill_atlas reports/skill_atlas.html
- compiled_targets reports/compiled_targets.md
- adoption_drift reports/adoption_drift_report.md
- review_waivers reports/review_waivers.md
- review_annotations reports/review_annotations.md
- world_class_evidence_plan reports/world_class_evidence_plan.md
- world_class_evidence_ledger reports/world_class_evidence_ledger.md
- world_class_evidence_intake reports/world_class_evidence_intake.md
- world_class_submission_review reports/world_class_submission_review.md
- world_class_operator_runbook reports/world_class_operator_runbook.md
- world_class_operator_runbook_html reports/world_class_operator_runbook.html
- world_class_claim_guard reports/world_class_claim_guard.md
- registry_audit reports/registry_audit.md
- package_verification reports/package_verification.md
- install_simulation reports/install_simulation.md
- upgrade_check reports/upgrade_check.md
- migration docs/migration-v2.md

## 触发实验

13 trigger cases; 0 misroutes; 0 ambiguous

## 组合治理

Skill 数
  12
纳入审查
  1
待处理冲突
  0
待处理 owner
  0
待处理过期
  0
Telemetry Report Count
  1
Actionable Drift Signal Count
  0
Drift Signal Count
  0
非行动项
  24

## 输出实验

案例数
  5
With Skill
  100
Baseline
  0
增益
  100
Gate
  是

## 执行证据

运行数
  10
命令执行
  10
模型执行
  0
记录样本
  0
计时样本
  10
估算 Token
  10

## 盲评包

Pair Count
  5
Answer Key Separate
  是
With Skill Hidden Count
  5

## 审定报告

Pair Count
  5
Judgment Count
  0
待审
  5
Agreement Count
  0
Disagreement Count
  0
Invalid Decision Count
  0
答案揭示
  0
答案隐藏
  5
Reviewer Checklist Count
  5
Reviewer Checklist Pending Count
  5

## 评审清单

先打开 reports/output_review_kit.md；每张卡片对应一个 blind A/B case，说明当前是否待判、答案是否仍隐藏、应填写的决策文件、有效字段和复跑命令。

awaiting-decision · 答案隐藏

### skill-package-contract

Reviewer has not selected A or B yet; answer key remains hidden.

盲评包
  `reports/output_blind_review_pack.json`
决策表
  `reports/output_review_decisions.json`
提示词
  Turn this repeated workflow into a reusable team skill package.

#### 操作命令

- prepare_review_kit `python3 scripts/yao.py output-review-kit`
- write_template `python3 scripts/adjudicate_output_review.py --write-template`
- adjudicate `python3 scripts/yao.py output-review`
- refresh_review_studio `python3 scripts/yao.py review-studio .`

#### 字段要求

- winner_variant A or B after reading only the blind review pack.
- confidence Optional number from 0 to 1.
- reason Short rationale; do not reveal baseline or with-skill labels before adjudication.

#### 隐私边界

- Do not paste raw private user data into the decision reason.
- Do not open the answer key before reviewer choices are recorded.
- Leave winner_variant blank when the reviewer is not ready to decide.

awaiting-decision · 答案隐藏

### output-eval-expectation

Reviewer has not selected A or B yet; answer key remains hidden.

盲评包
  `reports/output_blind_review_pack.json`
决策表
  `reports/output_review_decisions.json`
提示词
  Upgrade this production skill so we know whether the generated output is better than baseline.

#### 操作命令

- prepare_review_kit `python3 scripts/yao.py output-review-kit`
- write_template `python3 scripts/adjudicate_output_review.py --write-template`
- adjudicate `python3 scripts/yao.py output-review`
- refresh_review_studio `python3 scripts/yao.py review-studio .`

#### 字段要求

- winner_variant A or B after reading only the blind review pack.
- confidence Optional number from 0 to 1.
- reason Short rationale; do not reveal baseline or with-skill labels before adjudication.

#### 隐私边界

- Do not paste raw private user data into the decision reason.
- Do not open the answer key before reviewer choices are recorded.
- Leave winner_variant blank when the reviewer is not ready to decide.

awaiting-decision · 答案隐藏

### ir-before-packaging

Reviewer has not selected A or B yet; answer key remains hidden.

盲评包
  `reports/output_blind_review_pack.json`
决策表
  `reports/output_review_decisions.json`
提示词
  Package this skill for OpenAI, Claude, Agent Skills, and generic targets.

#### 操作命令

- prepare_review_kit `python3 scripts/yao.py output-review-kit`
- write_template `python3 scripts/adjudicate_output_review.py --write-template`
- adjudicate `python3 scripts/yao.py output-review`
- refresh_review_studio `python3 scripts/yao.py review-studio .`

#### 字段要求

- winner_variant A or B after reading only the blind review pack.
- confidence Optional number from 0 to 1.
- reason Short rationale; do not reveal baseline or with-skill labels before adjudication.

#### 隐私边界

- Do not paste raw private user data into the decision reason.
- Do not open the answer key before reviewer choices are recorded.
- Leave winner_variant blank when the reviewer is not ready to decide.

awaiting-decision · 答案隐藏

### near-neighbor-boundary

Reviewer has not selected A or B yet; answer key remains hidden.

盲评包
  `reports/output_blind_review_pack.json`
决策表
  `reports/output_review_decisions.json`
提示词
  I only need a one-off summary of these notes, not a reusable process.

#### 操作命令

- prepare_review_kit `python3 scripts/yao.py output-review-kit`
- write_template `python3 scripts/adjudicate_output_review.py --write-template`
- adjudicate `python3 scripts/yao.py output-review`
- refresh_review_studio `python3 scripts/yao.py review-studio .`

#### 字段要求

- winner_variant A or B after reading only the blind review pack.
- confidence Optional number from 0 to 1.
- reason Short rationale; do not reveal baseline or with-skill labels before adjudication.

#### 隐私边界

- Do not paste raw private user data into the decision reason.
- Do not open the answer key before reviewer choices are recorded.
- Leave winner_variant blank when the reviewer is not ready to decide.

awaiting-decision · 答案隐藏

### file-backed-governed-package

Reviewer has not selected A or B yet; answer key remains hidden.

盲评包
  `reports/output_blind_review_pack.json`
决策表
  `reports/output_review_decisions.json`
提示词
  Turn the attached release brief source into a governed skill package.

#### 操作命令

- prepare_review_kit `python3 scripts/yao.py output-review-kit`
- write_template `python3 scripts/adjudicate_output_review.py --write-template`
- adjudicate `python3 scripts/yao.py output-review`
- refresh_review_studio `python3 scripts/yao.py review-studio .`

#### 字段要求

- winner_variant A or B after reading only the blind review pack.
- confidence Optional number from 0 to 1.
- reason Short rationale; do not reveal baseline or with-skill labels before adjudication.

#### 隐私边界

- Do not paste raw private user data into the decision reason.
- Do not open the answer key before reviewer choices are recorded.
- Leave winner_variant blank when the reviewer is not ready to decide.

## 发布标准

Governed 和 Library 至少需要 5 个 output eval cases，并覆盖 file-backed、near-neighbor、boundary case、execution evidence 和 blind A/B review pack。

## 人工结论

没有 reviewer 决策时只显示 pending；只有真实决策文件会进入一致率和分歧统计。

## 评审方式

先打开 reports/output_review_kit.html 做盲评，填入 reports/output_review_decisions.json，再用 reports/output_review_adjudication.md 核对答案 key。

## 运行方式

reports/output_execution_runs.md 会标明 recorded fixture、command run 或 model run；只有 provider runner 返回 model metadata 时才算 model-executed。

## 运行矩阵

目标数
  5
通过数
  5
Fail Count
  0

## 目标编译

目标数
  5
通过数
  5
Warn Count
  0
Block Count
  0
失败数
  0

## 上下文

initial load 960/1000; deferred 416415/120000; top deferred scripts 367825; resource governance governed; quality density 135.4

## 编译证据

Review reports/compiled_targets.md before packaging to inspect target adapter modes, generated files, preserved semantics, warnings, and unsupported features.

## 信任报告

Secret
  0
脚本数
  106
网络脚本
  3
Help 失败
  0
包体哈希
  `28625ce8b3fcb3e214ef3b8ffc748d9cff551e4c5a1b78786c1a2b7d7005f679`

## 安全边界

高风险 secret、远程 inline execution、缺失依赖策略或无法解释的脚本接口应阻断 governed release。

## Python 兼容

目标 Python
  3.11
文件数
  171
问题数
  0
语法错误
  0
F-string 3.11
  0

## 解释器边界

CI 和发布审查以 Python 3.11 兼容为底线；本地更高版本允许的新语法不能绕过兼容门禁。

## 权限批准

3/3 permissions approved; gaps 0; required file_write, network, subprocess

## 批准策略

高权限能力需要 reviewer、scope、reason、expires_at 和 openai/claude/generic 目标端 enforcement 说明。

## 权限探针

4/4 targets probed; native 0; metadata fallback 4; installer 4; residual risks 4

## 运行边界

目标数
  4
通过数
  4
原生执行
  0
Metadata fallback
  4
安装拦截
  4
安装权限失败
  0
残余风险
  4
失败数
  0

## 组合治理

12 skills, 1 actionable; 0 actionable route collisions; 0 actionable owner gaps; 0 actionable stale; 0 actionable drift; 24 scoped non-actionable issues

## 下一动作

优先处理真实 portfolio 中的 duplicate names、stale skills、owner gaps，再用运营回路判断真实影响。

## 运营回路

1 metadata events; adoption 100.0; missed 0; bad-output 0; risk low

## 漂移信号

事件数
  1
采用率
  100
漏触发
  0
Bad Output Count
  0
风险带
  low

## 人工批准

warning 可以被有边界地接受，但必须写入 reviewer、理由、范围和到期时间；blocker 与 world-class 完成证据不能通过 waiver 变成通过。

## 批准概况

0 active waivers; 1 warning gates still need reviewer decision

## 批准台账

Waiver Count
  0
Active Count
  0
Expired Count
  0
Invalid Count
  0
覆盖 Gate
  0

### 批准候选

可批准 · needs-reviewer-decision

### Output Lab

review pending 5; model-executed 0; output failures 0

Gate
  `output-lab`
证据
  `reports/output_review_adjudication.md`
选项
  accepted-risk, false-positive, temporary-exception
边界
  Does not count as provider, human, or public world-class completion evidence.

#### 审查条件

- Reviewer confirms this release does not claim provider-backed or human-adjudicated output superiority.
- Reviewer names the release scope and expiry date.
- Reviewer links output_review_adjudication or output_execution evidence.

建议命令 `python3 scripts/yao.py review-waivers . --add-waiver --gate-key output-lab --reviewer "<reviewer>" --reason "Output Lab has pending human/provider evidence; accepted only for this bounded review scope." --expires-at 2027-06-13 --evidence reports/output_review_adjudication.md`
不可批准 · cannot-waive

### World-Class Evidence

4 pending evidence entries; 1 human pending; 3 external pending

Gate
  `world-class-evidence`
证据
  `reports/world_class_evidence_ledger.md`
选项
  无
边界
  Non-waivable completion boundary.

#### 审查条件

- Do not use a waiver to claim public world-class readiness.
- Either submit accepted ledger evidence or state that this release does not claim world-class completion.
- Keep claim guard active until ledger summary.ready_to_claim_world_class is true.

建议命令 `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions && python3 scripts/yao.py world-class-claim-guard .`

## 世界证据

这里列出每个 world-class 证据项的当前状态、完成定义、证据来源、隐私约束和下一步；计划、metadata fallback、待评审和本地命令不会被当成完成证据。

待补证 · external

### Provider Holdout

Collect at least one provider-backed output-eval holdout run with model, timing, and token metadata.

负责人
  operator with provider credentials
当前状态
  model-executed 0; token-observed 0
下一步
  Run provider-backed holdout cases with real credentials and commit only aggregate evidence.
观测值
  model_executed_count: 0; timing_observed_count: 10; token_observed_count: 0; accepted: False
提交态
  status: missing; path: evidence/world_class/submissions/provider-holdout.json; attested_real_evidence: False; privacy_contract_satisfied: False

#### 执行步骤

- YAO_OUTPUT_EVAL_MODEL=gpt-4.1-mini OPENAI_API_KEY=<redacted> python3 scripts/yao.py output-exec --provider-runner openai --timeout-seconds 60
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/provider-holdout.intake.json to evidence/world_class/submissions/provider-holdout.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 完成定义

- reports/output_execution_runs.json summary.model_executed_count > 0
- reports/output_execution_runs.json summary.timing_observed_count > 0
- reports/output_execution_runs.json summary.token_observed_count > 0
- reports/skill_os2_audit.json item provider-holdout status becomes pass

#### 证据来源

- reports/output_execution_runs.json
- reports/output_execution_runs.md
- reports/skill_os2_audit.json
- evidence/world_class/intake.schema.json
- evidence/world_class/templates/provider-holdout.intake.json
- reports/world_class_evidence_intake.json
- reports/world_class_evidence_intake.md

#### 隐私约束

- Do not commit provider credentials or environment dumps.
- The output execution report records output hashes and aggregate run metadata, not raw provider prompts.

#### 源证据检查

- Provider model run `model_executed_count: 0 / >0` Run provider-backed output-exec with real credentials.
- Timing observed `timing_observed_count: 10 / >0` Provider execution should record timing metadata.
- Token usage observed `token_observed_count: 0 / >0` Provider execution should return non-estimated token usage.

待补证 · human

### Human Adjudication

Record real blind A/B reviewer decisions before claiming human output review completion.

负责人
  human reviewer
当前状态
  0/5 decisions; pending 5
下一步
  Record real A/B choices in the decision template, then regenerate adjudication.
观测值
  pair_count: 5; judgment_count: 0; pending_count: 5; invalid_decision_count: 0; answer_revealed_count: 0; accepted: False
提交态
  status: missing; path: evidence/world_class/submissions/human-adjudication.json; attested_real_evidence: False; privacy_contract_satisfied: False

#### 执行步骤

- python3 scripts/yao.py output-review-kit --write-template
- Open reports/output_review_kit.md and choose A or B for each pair without opening the answer key.
- python3 scripts/adjudicate_output_review.py --write-template
- Edit reports/output_review_decisions.json with winner_variant values and reviewer metadata.
- python3 scripts/yao.py output-review
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/human-adjudication.intake.json to evidence/world_class/submissions/human-adjudication.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 完成定义

- reports/output_review_adjudication.json summary.pending_count == 0
- reports/output_review_adjudication.json summary.judgment_count == summary.pair_count
- reports/output_review_adjudication.json summary.invalid_decision_count == 0
- reports/skill_os2_audit.json item human-adjudication status becomes pass

#### 证据来源

- reports/output_blind_review_pack.md
- reports/output_review_kit.md
- reports/output_review_decisions.json
- reports/output_review_adjudication.json
- reports/output_review_adjudication.md
- evidence/world_class/intake.schema.json
- evidence/world_class/templates/human-adjudication.intake.json
- reports/world_class_evidence_intake.json
- reports/world_class_evidence_intake.md

#### 隐私约束

- Reviewer decisions should not include raw user data or private customer detail.
- Keep the answer key separate until after decisions are recorded.

#### 源证据检查

- Review pairs exist `pair_count: 5 / >0` Generate the blind A/B review pack.
- No pending decisions `pending_count: 5 / ==0` Record a reviewer choice for every pair.
- Judgments complete `judgment_count: 0 / ==pair_count` Every pair needs one valid human judgment.
- No invalid decisions `invalid_decision_count: 0 / ==0` Fix malformed winner/confidence entries.

待补证 · external

### Native Permission Enforcement

Prove at least one real target client or external installer runtime guard enforces approved high-permission capabilities.

负责人
  target client or installer integrator
当前状态
  native-enforced targets 0; installer-enforced targets 4
下一步
  Integrate a real target-client or external installer runtime guard before claiming native permission enforcement.
观测值
  native_enforcement_count: 0; metadata_fallback_count: 4; installer_enforcement_pass_count: 4; installer_permission_failure_count: 0; installer_enforcement_ready: True; residual_risk_count: 4; failure_count: 0; accepted: False
提交态
  status: missing; path: evidence/world_class/submissions/native-permission-enforcement.json; attested_real_evidence: False; privacy_contract_satisfied: False

#### 执行步骤

- Implement or connect a real target client or external installer runtime guard that blocks undeclared network, file_write, or subprocess capabilities.
- Update the generated target adapter only when the guard is actually enforced by that target.
- python3 scripts/yao.py package . --platform openai --platform claude --platform generic --platform vscode --output-dir dist --zip
- python3 scripts/yao.py install-simulate . --package-dir dist --install-root dist/install-simulation
- python3 scripts/yao.py runtime-permissions . --package-dir dist
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/native-permission-enforcement.intake.json to evidence/world_class/submissions/native-permission-enforcement.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 完成定义

- reports/runtime_permission_probes.json summary.native_enforcement_count > 0
- reports/runtime_permission_probes.json summary.failure_count == 0
- reports/runtime_permission_probes.json summary.installer_enforcement_pass_count records local installer enforcement but does not replace native evidence
- reports/skill_os2_audit.json item native-permission-enforcement status becomes pass

#### 证据来源

- dist/targets/*/adapter.json
- reports/runtime_permission_probes.json
- reports/runtime_permission_probes.md
- reports/install_simulation.json
- reports/install_simulation.md
- security/permission_policy.json
- evidence/world_class/intake.schema.json
- evidence/world_class/templates/native-permission-enforcement.intake.json
- reports/world_class_evidence_intake.json
- reports/world_class_evidence_intake.md

#### 隐私约束

- Do not mark native_enforcement true for metadata-only fallbacks.
- Keep residual risks visible for targets that still rely on operator enforcement.

#### 源证据检查

- Native enforcement `native_enforcement_count: 0 / >0` Collect real target-client or external runtime guard proof.
- Probe failures `failure_count: 0 / ==0` Runtime permission probes must stay clean.
- Installer support `installer_enforcement_ready: True / true` Installer enforcement is supporting evidence, not native proof.

待补证 · external

### Native Client Telemetry

Import production metadata-only events from a real external client into the local drift loop.

负责人
  Browser/Chrome/IDE/provider client integrator
当前状态
  external source events 0; adoption samples 1
下一步
  Install a real client against the native host and import production metadata-only events.
观测值
  external_source_events: 0; adoption_sample_count: 1; raw_content_allowed: False; risk_band: low; accepted: False
提交态
  status: missing; path: evidence/world_class/submissions/native-client-telemetry.json; attested_real_evidence: False; privacy_contract_satisfied: False

#### 执行步骤

- python3 scripts/telemetry_native_host.py . --write-launcher /tmp/yao-telemetry-host.sh --write-manifest /tmp/yao-telemetry-host.json --allowed-origin chrome-extension://<extension-id>/
- Install the generated native messaging manifest for the real client and send at least one accepted skill_activation or skill_output event.
- python3 scripts/yao.py telemetry-import . --input-jsonl .yao/telemetry_spool/external_events.jsonl
- python3 scripts/yao.py skill-atlas --workspace-root .
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/native-client-telemetry.intake.json to evidence/world_class/submissions/native-client-telemetry.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 完成定义

- reports/adoption_drift_report.json summary.source_types.external > 0
- reports/adoption_drift_report.json summary.adoption_sample_count > 0
- reports/skill_os2_audit.json item native-client-telemetry status becomes pass

#### 证据来源

- reports/adoption_drift_report.json
- reports/adoption_drift_report.md
- reports/telemetry_hook_recipes.json
- scripts/telemetry_native_host.py
- evidence/world_class/intake.schema.json
- evidence/world_class/templates/native-client-telemetry.intake.json
- reports/world_class_evidence_intake.json
- reports/world_class_evidence_intake.md

#### 隐私约束

- Telemetry must remain metadata-only and local-first.
- Do not package reports/telemetry_events.jsonl or any raw prompt, output, transcript, note, or message field.

#### 源证据检查

- External events `external_source_events: 0 / >0` Import at least one metadata-only event from a real client.
- Adoption sample `adoption_sample_count: 1 / >0` Telemetry must include adoption outcome evidence.
- Raw content blocked `raw_content_allowed: False / false` Telemetry must stay metadata-only.

## 提交清单

每张卡片给出模板、提交文件、准备命令、校验命令、收集要求、通过条件和隐私边界；只有真实 provider、真人、原生权限或真实客户端证据通过 intake 后，才进入 ledger review。

awaiting-submission · external

### Provider Holdout

No real evidence submission has been provided yet.

负责人
  operator with provider credentials
模板
  `evidence/world_class/templates/provider-holdout.intake.json`
提交
  `evidence/world_class/submissions/provider-holdout.json`
下一步
  Run provider-backed holdout cases with real credentials and commit only aggregate evidence.

#### 操作命令

- prepare_submission `python3 scripts/yao.py world-class-submission-kit . --evidence-key provider-holdout --output-dir evidence/world_class/submissions`
- validate_intake `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- submission_review `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- refresh_ledger `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`
- guard_claim `python3 scripts/yao.py world-class-claim-guard .`

#### 收集要求

- provider-backed model run
- observed timing
- observed token metadata

#### 执行步骤

- YAO_OUTPUT_EVAL_MODEL=gpt-4.1-mini OPENAI_API_KEY=<redacted> python3 scripts/yao.py output-exec --provider-runner openai --timeout-seconds 60
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/provider-holdout.intake.json to evidence/world_class/submissions/provider-holdout.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 通过条件

- reports/output_execution_runs.json summary.model_executed_count > 0
- reports/output_execution_runs.json summary.timing_observed_count > 0
- reports/output_execution_runs.json summary.token_observed_count > 0
- reports/skill_os2_audit.json item provider-holdout status becomes pass

#### 隐私边界

- Do not commit provider credentials or environment dumps.
- The output execution report records output hashes and aggregate run metadata, not raw provider prompts.

awaiting-submission · human

### Human Adjudication

No real evidence submission has been provided yet.

负责人
  human reviewer
模板
  `evidence/world_class/templates/human-adjudication.intake.json`
提交
  `evidence/world_class/submissions/human-adjudication.json`
下一步
  Record real A/B choices in the decision template, then regenerate adjudication.

#### 操作命令

- prepare_submission `python3 scripts/yao.py world-class-submission-kit . --evidence-key human-adjudication --output-dir evidence/world_class/submissions`
- validate_intake `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- submission_review `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- refresh_ledger `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`
- guard_claim `python3 scripts/yao.py world-class-claim-guard .`

#### 收集要求

- real reviewer identity
- blind A/B decisions
- answer key unopened until decisions exist

#### 执行步骤

- python3 scripts/yao.py output-review-kit --write-template
- Open reports/output_review_kit.md and choose A or B for each pair without opening the answer key.
- python3 scripts/adjudicate_output_review.py --write-template
- Edit reports/output_review_decisions.json with winner_variant values and reviewer metadata.
- python3 scripts/yao.py output-review
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/human-adjudication.intake.json to evidence/world_class/submissions/human-adjudication.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 通过条件

- reports/output_review_adjudication.json summary.pending_count == 0
- reports/output_review_adjudication.json summary.judgment_count == summary.pair_count
- reports/output_review_adjudication.json summary.invalid_decision_count == 0
- reports/skill_os2_audit.json item human-adjudication status becomes pass

#### 隐私边界

- Reviewer decisions should not include raw user data or private customer detail.
- Keep the answer key separate until after decisions are recorded.

awaiting-submission · external

### Native Permission Enforcement

No real evidence submission has been provided yet.

负责人
  target client or installer integrator
模板
  `evidence/world_class/templates/native-permission-enforcement.intake.json`
提交
  `evidence/world_class/submissions/native-permission-enforcement.json`
下一步
  Integrate a real target-client or external installer runtime guard before claiming native permission enforcement.

#### 操作命令

- prepare_submission `python3 scripts/yao.py world-class-submission-kit . --evidence-key native-permission-enforcement --output-dir evidence/world_class/submissions`
- validate_intake `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- submission_review `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- refresh_ledger `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`
- guard_claim `python3 scripts/yao.py world-class-claim-guard .`

#### 收集要求

- real target client or external installer runtime guard
- native enforcement flag or externally accepted guard proof
- residual risk retained for fallback targets

#### 执行步骤

- Implement or connect a real target client or external installer runtime guard that blocks undeclared network, file_write, or subprocess capabilities.
- Update the generated target adapter only when the guard is actually enforced by that target.
- python3 scripts/yao.py package . --platform openai --platform claude --platform generic --platform vscode --output-dir dist --zip
- python3 scripts/yao.py install-simulate . --package-dir dist --install-root dist/install-simulation
- python3 scripts/yao.py runtime-permissions . --package-dir dist
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/native-permission-enforcement.intake.json to evidence/world_class/submissions/native-permission-enforcement.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 通过条件

- reports/runtime_permission_probes.json summary.native_enforcement_count > 0
- reports/runtime_permission_probes.json summary.failure_count == 0
- reports/runtime_permission_probes.json summary.installer_enforcement_pass_count records local installer enforcement but does not replace native evidence
- reports/skill_os2_audit.json item native-permission-enforcement status becomes pass

#### 隐私边界

- Do not mark native_enforcement true for metadata-only fallbacks.
- Keep residual risks visible for targets that still rely on operator enforcement.

awaiting-submission · external

### Native Client Telemetry

No real evidence submission has been provided yet.

负责人
  Browser/Chrome/IDE/provider client integrator
模板
  `evidence/world_class/templates/native-client-telemetry.intake.json`
提交
  `evidence/world_class/submissions/native-client-telemetry.json`
下一步
  Install a real client against the native host and import production metadata-only events.

#### 操作命令

- prepare_submission `python3 scripts/yao.py world-class-submission-kit . --evidence-key native-client-telemetry --output-dir evidence/world_class/submissions`
- validate_intake `python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions`
- submission_review `python3 scripts/yao.py world-class-submission-review . --submissions-dir evidence/world_class/submissions`
- refresh_ledger `python3 scripts/yao.py world-class-ledger . --submissions-dir evidence/world_class/submissions`
- guard_claim `python3 scripts/yao.py world-class-claim-guard .`

#### 收集要求

- real external client source
- metadata-only event
- local-first import path

#### 执行步骤

- python3 scripts/telemetry_native_host.py . --write-launcher /tmp/yao-telemetry-host.sh --write-manifest /tmp/yao-telemetry-host.json --allowed-origin chrome-extension://<extension-id>/
- Install the generated native messaging manifest for the real client and send at least one accepted skill_activation or skill_output event.
- python3 scripts/yao.py telemetry-import . --input-jsonl .yao/telemetry_spool/external_events.jsonl
- python3 scripts/yao.py skill-atlas --workspace-root .
- python3 scripts/yao.py skill-os2-audit . --generated-at <YYYY-MM-DD>
- Copy evidence/world_class/templates/native-client-telemetry.intake.json to evidence/world_class/submissions/native-client-telemetry.json and fill only real evidence fields.
- python3 scripts/yao.py world-class-intake . --submissions-dir evidence/world_class/submissions

#### 通过条件

- reports/adoption_drift_report.json summary.source_types.external > 0
- reports/adoption_drift_report.json summary.adoption_sample_count > 0
- reports/skill_os2_audit.json item native-client-telemetry status becomes pass

#### 隐私边界

- Telemetry must remain metadata-only and local-first.
- Do not package reports/telemetry_events.jsonl or any raw prompt, output, transcript, note, or message field.

## 蓝图覆盖

项目数
  20
模块数
  8
建议 PR
  12
通过数
  20
Warn Count
  0
缺失数
  0
Extension Track Count
  2
Extension Covered Count
  1
Extension Partial Count
  1
Extension Planned Count
  0
Adaptive Extension Ready
  否
本地蓝图
  是
世界级
  否
待补证据
  4

## 覆盖边界

蓝图覆盖只证明 2.0 模块、建议 PR、脚本、报告和测试在本地闭环；public world-class 仍以 world-class evidence ledger 的真人和外部证据为准。

## 公开声明

本地复现
  是
发布锁
  否
可公开声明
  否
声明阻断
  5
Provider 证据
  否
人审完成
  否
世界级就绪
  否

## 声明阻断

- 阻断 release lock is not clean or commit is unavailable
- 阻断 provider-backed model holdout evidence is incomplete
- 阻断 human blind-review adjudication is incomplete
- 阻断 world-class evidence is not accepted yet (4 open gaps, 4 ledger pending)
- 阻断 world-class source checks are not all accepted (6/13 pass, 7 blocked)

## 世界证据

4 pending world-class evidence entries; 1 human pending; 3 external pending; source checks 7/13 pass; 6 blocked; overclaim guard true

## 证据台账

Ledger Entry Count
  4
Accepted Count
  0
待审
  4
Human Pending Count
  1
External Pending Count
  3
Overclaim Guard Active
  是
Ready To Claim World Class
  否

## 证据入口

Schema
  是
模板数
  4
模板通过
  4
提交数
  0
有效提交
  0
无效提交
  0
可收证据
  是
可审台账
  否
Ready To Claim World Class
  否

## 入口边界

intake 只校验证据包格式、来源、隐私和反过度声明；只有 ledger 看到真实 provider、真人、原生权限或真实客户端结果后，world-class 才能进入完成审计。

## 声明守卫

台账可声明
  否
台账待补
  4
声明面
  76
违规数
  0
Overclaim Guard Active
  是

## 声明边界

claim guard 扫描 README、docs 和 reports 中的完成态表述；ledger 未 ready 时，任何英文完成断言、true 状态声明或中文完成态都会阻断发布审查。

## 注册审计

yao-meta-skill 1.1.0; 6/6 compatibility entries pass; install pass with 4 adapters; installer permissions 12 enforced / 0 failures

## 包体元数据

名称
  yao-meta-skill
版本
  1.1.0
Maturity
  governed
Owner
  Yao Team
License
  MIT
信任级别
  local
目标平台
  openai, claude, generic, agent-skills-compatible, vscode
兼容通过
  6/6
归档哈希
  `6852cf91a74d232c32d732b7c159c971827abf23af50153987193b084ad3b5cc`

## 发布路线

0 promote; 3 keep current; 0 blocked; upgrade minor declared / minor recommended

## 包体验证

目标数
  4
Adapter
  4
归档存在
  是
Zip 条目
  586
失败数
  0
警告数
  0
归档哈希
  `6852cf91a74d232c32d732b7c159c971827abf23af50153987193b084ad3b5cc`

## 安装模拟

Archive Extracted
  是
Entrypoint Loaded
  是
Manifest Loaded
  是
Interface Loaded
  是
Adapter
  4
安装权限
  12
安装权限失败
  0
权限目标
  4
权限能力
  3
失败数
  0
警告数
  0

## 权限覆盖

安装模拟会读取解压后的 target adapter，并按 declared_capabilities 核对 security/permission_policy.json 中的有效批准、证据、过期时间和目标端 enforcement 说明。