Compare commits
8 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
 yaojingang
|
4eb11f923d | ||
|
YAO
|
c37915e4f6 | ||
|
yaojingang
|
6725a57538 | ||
|
YAO
|
8455eff29a | ||
|
yaojingang
|
24bea607a2 | ||
|
YAO
|
4eef8d8682 | ||
|
yaojingang
|
01e750dbb2 | ||
|
YAO
|
0556767dff |
@@ -8,7 +8,7 @@
|
||||
[](docs/README.fr-FR.md)
|
||||
[](docs/README.ru-RU.md)
|
||||
|
||||
`YAO` stands for `Yielding AI Outcomes` — the goal is not to generate more prompt text, but to produce reusable AI assets and real operational outcomes.
|
||||
`YAO` stands for `Yielding AI Outcomes`: the goal is not to generate more prompt text, but to produce reusable AI assets and real operational outcomes.
|
||||
|
||||
`yao-meta-skill` creates, evaluates, packages, and governs reusable agent skills. The 1.0 line focused on turning repeated workflows into installable, readable, cross-platform skill packages. The 2.0 line expands that factory into a Skill OS: a governed system for modeling a skill once, compiling it for multiple targets, testing its behavior, reviewing its release evidence, and tracking the next iteration.
|
||||
|
||||
@@ -141,6 +141,8 @@ Read it in 10 seconds:
|
||||
|
||||
This benchmark is a project-level engineering review, scored from `0-10` per dimension and weighted to `100`. GitHub stars are intentionally excluded because they measure ecosystem heat, not meta-skill engineering quality.
|
||||
|
||||
The score is local engineering evidence, not a claim of world-class readiness. Public superiority claims still depend on accepted external and human evidence in the world-class ledger.
|
||||
|
||||
Weighted score formula: `sum(score / 10 * weight)`.
|
||||
|
||||
| Meta Skill | Method Depth 15 | Context Discipline 10 | Toolchain 15 | Eval/Test Rigor 20 | Governance 15 | Portability 10 | Onboarding/Review 5 | Local Reliability 10 | Weighted Score |
|
||||
@@ -155,6 +157,20 @@ Weighted score formula: `sum(score / 10 * weight)`.
|
||||
| 2 | Anthropic Skill Creator | 67.5 | Strong methodology and iteration loop, with weaker local execution reliability and governance coverage. |
|
||||
| 3 | OpenAI Skill Creator | 50.5 | Best treated as a concise skill-writing method guide rather than a full engineering system. |
|
||||
|
||||
## Human Blind A/B Review Snapshot
|
||||
|
||||
On 2026-06-29, a single human reviewer compared `yao-meta-skill` with the bundled OpenAI `skill-creator` across five realistic skill-creation scenarios: support triage, revenue reconciliation, webinar repurposing, incident postmortems, and PR review follow-up. The reviewer confirmed decisions were completed before the answer key was opened.
|
||||
|
||||
Result: `yao-meta-skill` was selected in `5/5` cases.
|
||||
|
||||
Evidence:
|
||||
|
||||
- Review entrypoint: [reports/blind-human-review-2026-06-29/index.html](reports/blind-human-review-2026-06-29/index.html)
|
||||
- Adjudication summary: [reports/blind-human-review-2026-06-29/adjudication.md](reports/blind-human-review-2026-06-29/adjudication.md)
|
||||
- Recorded decisions: [reports/blind-human-review-2026-06-29/review-decisions.recorded.json](reports/blind-human-review-2026-06-29/review-decisions.recorded.json)
|
||||
|
||||
Boundary: this is single-reviewer blind preference evidence. It is not provider-backed independent model execution evidence, and the per-case rationale fields are still empty.
|
||||
|
||||
## Best-Fit Scenarios
|
||||
|
||||
- Choose **Yao Meta Skill** when the target is a reusable team asset with explicit boundaries, trigger evaluation, governance, packaging, portability, and local execution checks.
|
||||
@@ -164,6 +180,20 @@ Weighted score formula: `sum(score / 10 * weight)`.
|
||||
|
||||
## Quick Start
|
||||
|
||||
Install the skill globally for Codex first:
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a codex -g -y
|
||||
```
|
||||
|
||||
To install it for every supported agent, replace `-a codex` with `-a '*'`:
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a '*' -g -y
|
||||
```
|
||||
|
||||
After installation, restart the client. Then ask for tasks such as "create a skill from this workflow", "improve this existing skill", "evaluate this skill", or "add evals to this skill" to trigger `yao-meta-skill`.
|
||||
|
||||
1. Describe the workflow, prompt set, or repeated task you want to turn into a skill.
|
||||
2. Start with a short, human intent dialogue so the real job, outputs, exclusions, constraints, and standards are explicit.
|
||||
3. Let `quickstart` clarify intent first, then run silent benchmark scan and reference synthesis; it only surfaces explicit questions when intent is still unclear or when there is a real design conflict.
|
||||
@@ -372,6 +402,7 @@ Full reports: [reports/eval_suite.json](reports/eval_suite.json) and [reports/fa
|
||||
- portability score: `100/100` with neutral activation, execution, trust, and degradation metadata preserved across all exported targets
|
||||
- description optimization suite: root, team frontend review, and governed incident command pass blind and adversarial holdout gates; governed incident command still carries one visible holdout miss, and adversarial calibration plus family drift are now tracked separately
|
||||
- judge-backed blind eval: root, team frontend review, and governed incident command now pass an independent rubric judge on blind holdout prompts
|
||||
- human blind A/B snapshot: a single reviewer selected `yao-meta-skill` over the bundled OpenAI `skill-creator` in `5/5` realistic skill-creation scenarios; evidence is published in [reports/blind-human-review-2026-06-29/adjudication.md](reports/blind-human-review-2026-06-29/adjudication.md)
|
||||
- packaging failure fixtures: invalid metadata, invalid YAML, and unsupported targets fail as expected
|
||||
- failure library regressions: anti-pattern families pass automated checks
|
||||
- governance and resource-boundary checks are part of the default test path
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
---
|
||||
name: yao-meta-skill
|
||||
description: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
description: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
metadata:
|
||||
author: Yao Team
|
||||
---
|
||||
@@ -15,28 +15,28 @@ metadata:
|
||||
|
||||
## Modes
|
||||
|
||||
- `Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infrastructure. `Governed`: high-trust, policy-sensitive, or release-critical.
|
||||
- `Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infra. `Governed`: high-trust/release-critical.
|
||||
- Rules: [Method](references/skill-engineering-method.md), [Operating Modes](references/operating-modes.md), [Resource Boundaries](references/resource-boundaries.md).
|
||||
|
||||
## Compact Workflow
|
||||
|
||||
1. For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.
|
||||
2. Capture job, output, exclusions, constraints, standards, and the lightest fit.
|
||||
3. Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.
|
||||
4. Write `description` early, test route quality, then add only earned folders and gates.
|
||||
5. Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful.
|
||||
1. One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.
|
||||
2. Capture job, output, exclusions, constraints, standards, lightest fit.
|
||||
3. Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.
|
||||
4. Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.
|
||||
5. Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned.
|
||||
|
||||
Playbooks: [Method](references/skill-engineering-method.md), [Intent](references/intent-dialogue.md), [Skill IR](references/skill-ir-method.md), [Output Eval](references/output-eval-method.md), [Review Studio](references/review-studio-method.md).
|
||||
|
||||
## Skill OS 2.0 Gates
|
||||
|
||||
For production, library, governed, or team-distributed work, run Skill IR, target compiler, trigger + output eval, Skill Atlas, conformance, trust, registry/package/install, upgrade, drift, waiver, and Review Studio gates before release.
|
||||
For production/library/governed/team releases, run Skill IR, compiler, trigger/output eval, Skill Atlas, conformance, trust, registry/package/install, upgrade, drift, waiver, Review Studio.
|
||||
|
||||
## Governed Package Boundary
|
||||
|
||||
For file-backed, release-critical, or governed packages, name `input_files` as `file-backed fixture` evidence; include `owner`, `review cadence`, `input_files`, `output contract`, `rollback boundary`; require `trust report` and `reports/output_quality_scorecard.md`; mark unavailable telemetry, approvals, metrics, or benchmarks as `missing evidence`; do not fabricate evidence.
|
||||
For file-backed/release-critical/governed packages, name `input_files` as `file-backed fixture`; include `owner`, `review cadence`, `input_files`, `output contract`, `rollback boundary`; require `trust report` and `reports/output_quality_scorecard.md`; mark unavailable telemetry/approvals/metrics/benchmarks as `missing evidence`; do not fabricate evidence.
|
||||
|
||||
Preserve audit labels literally when they apply: `file-backed fixture`, `input_files`, `output contract`, `rollback boundary`, `trust report`, `reports/output_quality_scorecard.md`, `missing evidence`.
|
||||
Preserve labels literally when they apply: `file-backed fixture`, `input_files`, `output contract`, `rollback boundary`, `trust report`, `reports/output_quality_scorecard.md`, `missing evidence`.
|
||||
|
||||
## First-Turn Style
|
||||
|
||||
@@ -46,8 +46,8 @@ Preserve audit labels literally when they apply: `file-backed fixture`, `input_f
|
||||
|
||||
## Output Contract
|
||||
|
||||
Unless asked otherwise, produce `SKILL.md`, aligned `agents/interface.yaml`, justified assets, and a short summary of boundary, exclusions, gates, and next steps.
|
||||
Create/refactor/package: produce `SKILL.md`, aligned `agents/interface.yaml`, justified assets, boundary/exclusion/gate summary. Audit/evaluate-only: findings + proposed fixes; edit files only if asked. No-skill: no files.
|
||||
|
||||
## Reference Map
|
||||
|
||||
Primary: [Method](references/skill-engineering-method.md), [Artifact Design](references/artifact-design-doctrine.md), [Systems Thinking](references/systems-thinking-doctrine.md), [Governance](references/governance.md), [SkillOps Decision](references/skillops-decision-policy.md).
|
||||
Primary: [Method](references/skill-engineering-method.md), [Artifact Design](references/artifact-design-doctrine.md), [Systems](references/systems-thinking-doctrine.md), [Governance](references/governance.md), [SkillOps](references/skillops-decision-policy.md).
|
||||
|
||||
@@ -69,6 +69,20 @@ Formule du score pondéré : `sum(score / 10 * poids)`.
|
||||
|
||||
## Démarrage rapide
|
||||
|
||||
Pour utiliser cette skill directement dans Codex, installez-la d'abord dans les skills globales :
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a codex -g -y
|
||||
```
|
||||
|
||||
Pour l'installer dans tous les agents pris en charge, remplacez `-a codex` par `-a '*'` :
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a '*' -g -y
|
||||
```
|
||||
|
||||
Après l'installation, redémarrez le client. Demandez ensuite des tâches comme "create a skill from this workflow", "improve this existing skill", "evaluate this skill" ou "add evals to this skill" pour déclencher `yao-meta-skill`.
|
||||
|
||||
1. Décrivez le workflow, l'ensemble de prompts ou la tâche répétée que vous voulez transformer en skill.
|
||||
2. Commencez par un court dialogue d'intention plus humain pour clarifier le vrai travail, les sorties attendues, les exclusions, les contraintes et les standards qui comptent pour vous.
|
||||
3. Laissez d'abord `quickstart` clarifier l'intention, puis lancer silencieusement benchmark scan et reference synthesis ; des questions explicites ne remontent que si l'intention reste ambiguë ou si deux directions de conception se contredisent réellement.
|
||||
|
||||
@@ -69,6 +69,20 @@ flowchart LR
|
||||
|
||||
## クイックスタート
|
||||
|
||||
Codex でこの skill を直接使う場合は、まず global skills にインストールします。
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a codex -g -y
|
||||
```
|
||||
|
||||
対応しているすべての agent にインストールする場合は、`-a codex` を `-a '*'` に置き換えます。
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a '*' -g -y
|
||||
```
|
||||
|
||||
インストール後にクライアントを再起動してください。その後、"create a skill from this workflow"、"improve this existing skill"、"evaluate this skill"、"add evals to this skill" のような依頼で `yao-meta-skill` を起動できます。
|
||||
|
||||
1. skill 化したい workflow、prompt 集合、または反復タスクを説明します。
|
||||
2. まず短いが人間味のある intent dialogue で、実際の job、outputs、boundary、constraints、重視する品質基準を明確にします。
|
||||
3. まず `quickstart` で意図を澄ませ、その後 benchmark scan と reference synthesis を静かに実行します。意図がまだ曖昧なとき、または設計ルートに本当の衝突があるときだけ、追加確認を明示します。
|
||||
|
||||
@@ -69,6 +69,20 @@ flowchart LR
|
||||
|
||||
## Быстрый старт
|
||||
|
||||
Чтобы использовать эту skill напрямую в Codex, сначала установите ее в global skills:
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a codex -g -y
|
||||
```
|
||||
|
||||
Чтобы установить ее во все поддерживаемые agents, замените `-a codex` на `-a '*'`:
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a '*' -g -y
|
||||
```
|
||||
|
||||
После установки перезапустите клиент. Затем используйте запросы вроде "create a skill from this workflow", "improve this existing skill", "evaluate this skill" или "add evals to this skill", чтобы вызвать `yao-meta-skill`.
|
||||
|
||||
1. Опишите workflow, набор prompts или повторяющуюся задачу, которую хотите превратить в skill.
|
||||
2. Сначала проведите короткий, но более человечный intent dialogue, чтобы уточнить реальную job-to-be-done, outputs, exclusions, constraints и те стандарты качества, которые для вас важны.
|
||||
3. Сначала позвольте `quickstart` прояснить намерение, затем тихо выполнить benchmark scan и reference synthesis. Явные уточнения поднимаются только тогда, когда intent все еще неясен или между маршрутами проектирования есть реальный конфликт.
|
||||
|
||||
@@ -121,6 +121,8 @@ flowchart LR
|
||||
|
||||
下面是当前项目采用的工程质量评测模型。每个维度按 `0-10` 评分，再按权重折算到 `100` 分。GitHub stars 不计入总分，因为它反映生态热度，不直接代表元 skill 工程质量。
|
||||
|
||||
这个分数是本地工程证据，不等同于 world-class ready。公开宣称“已证明优于其他方案”仍要以 world-class ledger 中已接受的外部证据和人工证据为准。
|
||||
|
||||
加权总分公式：`sum(单项评分 / 10 * 权重)`。
|
||||
|
||||
| 元 Skill | 方法论深度 15 | 上下文纪律 10 | 工具链 15 | Eval/测试 20 | 治理 15 | 可移植 10 | 上手/评审 5 | 本地可靠性 10 | 加权总分 |
|
||||
@@ -135,6 +137,20 @@ flowchart LR
|
||||
| 2 | Anthropic Skill Creator | 67.5 | 方法论和迭代闭环强，但本地执行可靠性和治理覆盖较弱。 |
|
||||
| 3 | OpenAI Skill Creator | 50.5 | 更适合作为精简 skill 写作方法论教材，而不是完整工程系统。 |
|
||||
|
||||
## 人工盲测快照
|
||||
|
||||
2026-06-29，一位人工评审者在 5 个真实常见的 skill 创建场景里，对比了 `yao-meta-skill` 和内置的 OpenAI `skill-creator`。5 个场景分别是客服工单分诊、月度收入对账、Webinar 内容复用、故障复盘和 PR Review 跟进。评审者确认：所有选择都在揭晓来源前完成。
|
||||
|
||||
结果：`yao-meta-skill` 在 `5/5` 个案例中胜出。
|
||||
|
||||
证据：
|
||||
|
||||
- 盲测入口：[reports/blind-human-review-2026-06-29/index.html](../reports/blind-human-review-2026-06-29/index.html)
|
||||
- Adjudication 摘要：[reports/blind-human-review-2026-06-29/adjudication.md](../reports/blind-human-review-2026-06-29/adjudication.md)
|
||||
- 已记录判断：[reports/blind-human-review-2026-06-29/review-decisions.recorded.json](../reports/blind-human-review-2026-06-29/review-decisions.recorded.json)
|
||||
|
||||
边界：这是单人盲测偏好证据，不是 provider-backed 的独立模型执行证据；每个案例的逐项理由仍为空。
|
||||
|
||||
## 与其他元 Skill 的适用差异
|
||||
|
||||
- 如果你要的是**团队复用、显式边界、质量门、治理、可移植性和长期维护**，更适合 `Yao Meta Skill`。
|
||||
@@ -144,6 +160,20 @@ flowchart LR
|
||||
|
||||
## 快速开始
|
||||
|
||||
如果你想直接在 Codex 里使用这个 skill，先安装到全局 skills：
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a codex -g -y
|
||||
```
|
||||
|
||||
如果要安装到全部支持的 agent，把 `-a codex` 换成 `-a '*'`：
|
||||
|
||||
```bash
|
||||
npx -y skills add yaojingang/yao-meta-skill -a '*' -g -y
|
||||
```
|
||||
|
||||
安装完成后重启客户端，再用“创建 skill”“改进已有 skill”“评估 skill”“给 skill 增加 eval”这类任务触发 `yao-meta-skill`。
|
||||
|
||||
1. 先描述你想沉淀成 skill 的 workflow、prompt 集合或重复任务。
|
||||
2. 先做一轮简短但更有人味的意图对话，把真实任务、输出物、边界、约束和你在意的质量标准说清楚。
|
||||
3. 先让 `quickstart` 澄清意图，再静默跑 benchmark scan 和 reference synthesis；只有当意图还不清楚，或者设计路线真的冲突时，才会显式继续追问或让你拍板。
|
||||
@@ -158,6 +188,7 @@ flowchart LR
|
||||
- 中文真实表达已经纳入触发评测，覆盖“做一个 skill”“沉淀成可复用能力”“优化已有 skill”“补 trigger 评测”等常见说法
|
||||
- registry 记录的目标平台从 OpenAI、Claude、Generic 扩展到 Agent Skills 和 VS Code 相关适配
|
||||
- Review Studio 当前汇总 16 个门禁，包体验证、安装模拟、证据一致性和发布声明边界已经进入报告链路
|
||||
- 单人盲测快照中，评审者在揭晓来源前完成判断，并在 `5/5` 个真实 skill 创建场景中选择 `yao-meta-skill`；证据见 [reports/blind-human-review-2026-06-29/adjudication.md](../reports/blind-human-review-2026-06-29/adjudication.md)
|
||||
|
||||
## 当前优势
|
||||
|
||||
|
||||
@@ -1 +1 @@
|
||||
Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use when asked to create a skill, turn a repeated process into a reusable skill, improve an existing skill, add evals, or package a skill for team reuse. Also trigger on common Chinese asks such as 做一个 skill, 把流程沉淀成可复用能力, 封装成团队可复用的 skill, 优化已有 skill, 补 trigger 评测, or 收紧触发边界.
|
||||
Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
|
||||
@@ -18,12 +18,19 @@
|
||||
"turn a repeated process into a reusable skill",
|
||||
"improve an existing skill",
|
||||
"add evals",
|
||||
"add tests",
|
||||
"package a skill for team reuse",
|
||||
"migrate an existing skill",
|
||||
"prepare packaging, installation, or release",
|
||||
"govern a reusable skill",
|
||||
"做一个 skill",
|
||||
"把流程沉淀成可复用 skill",
|
||||
"优化现有 skill",
|
||||
"补 trigger 评测",
|
||||
"封装成团队可复用 skill"
|
||||
"封装成团队可复用 skill",
|
||||
"迁移 skill",
|
||||
"发布 skill",
|
||||
"打包发布检查"
|
||||
],
|
||||
"exclusions": [
|
||||
"summary-only requests",
|
||||
@@ -75,16 +82,29 @@
|
||||
"formalize this process into a reusable capability",
|
||||
"turn this playbook into an agent capability package",
|
||||
"convert this into a maintained skill",
|
||||
"agent capability",
|
||||
"reusable agent capability",
|
||||
"skill library entry",
|
||||
"skill authoring",
|
||||
"做一个 skill",
|
||||
"创建一个 skill",
|
||||
"新建一个 skill",
|
||||
"帮我做个 skill",
|
||||
"改一个 skill",
|
||||
"重构一个 skill",
|
||||
"迁移一个 skill",
|
||||
"发布一个 skill",
|
||||
"这个 skill",
|
||||
"已有 skill",
|
||||
"现有 skill",
|
||||
"做成一个 skill",
|
||||
"封装成一个 skill",
|
||||
"沉淀成一个 skill",
|
||||
"整理成一个 skill",
|
||||
"抽成一个 skill",
|
||||
"可复用 skill",
|
||||
"可执行 skill",
|
||||
"团队 skill",
|
||||
"agent 能力包",
|
||||
"能力包",
|
||||
"skill 包"
|
||||
@@ -103,19 +123,27 @@
|
||||
"existing skill draft",
|
||||
"rough notes",
|
||||
"standard operating procedure",
|
||||
"operating procedure",
|
||||
"sop",
|
||||
"playbook",
|
||||
"transcript",
|
||||
"chat transcript",
|
||||
"meeting notes",
|
||||
"workflow fragments",
|
||||
"release notes",
|
||||
"onboarding flow",
|
||||
"support escalation routine",
|
||||
"quarterly release routine",
|
||||
"scripts",
|
||||
"repeated team practice",
|
||||
"流程",
|
||||
"工作流",
|
||||
"操作流程",
|
||||
"做事流程",
|
||||
"作业流程",
|
||||
"方法",
|
||||
"经验",
|
||||
"复盘",
|
||||
"sop 文档",
|
||||
"会议纪要",
|
||||
"对话记录",
|
||||
@@ -142,14 +170,32 @@
|
||||
"ops library",
|
||||
"maintained",
|
||||
"operationalize",
|
||||
"release-ready",
|
||||
"publish",
|
||||
"release",
|
||||
"installation",
|
||||
"installable",
|
||||
"portability",
|
||||
"registry",
|
||||
"governance",
|
||||
"review gate",
|
||||
"可复用",
|
||||
"复用",
|
||||
"封装",
|
||||
"打包",
|
||||
"沉淀",
|
||||
"标准化",
|
||||
"标准化下来",
|
||||
"团队复用",
|
||||
"给团队用",
|
||||
"团队可用",
|
||||
"安装复用",
|
||||
"可安装",
|
||||
"发布",
|
||||
"上架",
|
||||
"交付",
|
||||
"治理",
|
||||
"注册表",
|
||||
"方法包",
|
||||
"团队能力包",
|
||||
"沉淀下来",
|
||||
@@ -171,16 +217,32 @@
|
||||
"false negatives",
|
||||
"stress test",
|
||||
"route boundary",
|
||||
"routing",
|
||||
"route evals",
|
||||
"trigger routing",
|
||||
"activation",
|
||||
"description optimization",
|
||||
"tests",
|
||||
"install checks",
|
||||
"release checks",
|
||||
"hardening",
|
||||
"评测",
|
||||
"补评测",
|
||||
"补 eval",
|
||||
"补测试",
|
||||
"触发测试",
|
||||
"触发词",
|
||||
"触发范围",
|
||||
"召回",
|
||||
"收紧触发边界",
|
||||
"路由边界",
|
||||
"路由评测",
|
||||
"激活",
|
||||
"误触发",
|
||||
"漏触发",
|
||||
"质量门",
|
||||
"安装验证",
|
||||
"发布检查",
|
||||
"打包检查",
|
||||
"边界测试"
|
||||
]
|
||||
@@ -198,11 +260,32 @@
|
||||
"before sharing it with the team",
|
||||
"tighten the boundary",
|
||||
"revise this skill",
|
||||
"refactor this skill",
|
||||
"migrate this skill",
|
||||
"port this skill",
|
||||
"convert this skill",
|
||||
"release this skill",
|
||||
"publish this skill",
|
||||
"make this skill release-ready",
|
||||
"codex-ready package",
|
||||
"claude skill",
|
||||
"codex format",
|
||||
"interface metadata",
|
||||
"manifest",
|
||||
"install checks",
|
||||
"draft skill",
|
||||
"harden this skill for library reuse",
|
||||
"优化这个 skill",
|
||||
"改进这个 skill",
|
||||
"重构这个 skill",
|
||||
"扩大这个 skill",
|
||||
"调整这个 skill",
|
||||
"优化触发范围",
|
||||
"扩大触发范围",
|
||||
"迁移这个 skill",
|
||||
"发布这个 skill",
|
||||
"把这个 skill 迁移",
|
||||
"让这个 skill 可发布",
|
||||
"补一下评测",
|
||||
"补 trigger 测试",
|
||||
"加强路由判断",
|
||||
@@ -351,12 +434,16 @@
|
||||
"do not convert it into a reusable capability",
|
||||
"keep it as documentation only",
|
||||
"discussion only",
|
||||
"no agent execution",
|
||||
"先不要做成 skill",
|
||||
"先不做 skill",
|
||||
"不要做成 skill",
|
||||
"不用封装",
|
||||
"不要打包",
|
||||
"不要沉淀成能力",
|
||||
"先别做成可复用能力",
|
||||
"不需要 agent 执行",
|
||||
"不做 agent 能力",
|
||||
"只做文档",
|
||||
"只做说明"
|
||||
]
|
||||
|
||||
@@ -54,6 +54,18 @@
|
||||
"text": "Add trigger evals to this skill before sharing it with the team.",
|
||||
"family": "iterate_existing_skill"
|
||||
},
|
||||
{
|
||||
"text": "Migrate this Claude skill into a Codex-ready package with interface metadata and install checks.",
|
||||
"family": "migrate_existing_skill"
|
||||
},
|
||||
{
|
||||
"text": "Make this existing skill release-ready: add manifest/interface metadata, packaging checks, and trigger evals.",
|
||||
"family": "release_packaging"
|
||||
},
|
||||
{
|
||||
"text": "Optimize the activation wording for this skill so broader skill-authoring requests are routed correctly.",
|
||||
"family": "trigger_expansion"
|
||||
},
|
||||
{
|
||||
"text": "We have a messy release runbook, export process, and a prompt history; turn all of that into one reusable skill package with evals and packaging checks.",
|
||||
"family": "complex_multi_asset"
|
||||
@@ -133,6 +145,18 @@
|
||||
{
|
||||
"text": "把这个客服升级流程标准化成一个可执行的 skill，并加上边界测试。",
|
||||
"family": "cn_eval_and_package"
|
||||
},
|
||||
{
|
||||
"text": "把这个 Claude skill 迁移成 Codex 可用的 skill 包，补 interface、manifest 和安装验证。",
|
||||
"family": "cn_migrate_existing_skill"
|
||||
},
|
||||
{
|
||||
"text": "把这套提示词和脚本整理成团队能安装复用的 skill，并做打包发布检查。",
|
||||
"family": "cn_release_packaging"
|
||||
},
|
||||
{
|
||||
"text": "扩大这个 skill 的触发范围，同时补路由评测，避免漏触发。",
|
||||
"family": "cn_trigger_expansion"
|
||||
}
|
||||
],
|
||||
"should_not_trigger": [
|
||||
@@ -239,6 +263,22 @@
|
||||
{
|
||||
"text": "先一起头脑风暴几个方向，不要封装成 skill。",
|
||||
"family": "cn_brainstorm_only"
|
||||
},
|
||||
{
|
||||
"text": "Polish this release note for publishing, but do not do any skill work.",
|
||||
"family": "document_only"
|
||||
},
|
||||
{
|
||||
"text": "Migrate this wiki article into a new docs folder; do not create an agent skill.",
|
||||
"family": "document_only"
|
||||
},
|
||||
{
|
||||
"text": "把这篇 SOP 改成知识库文档，不需要 agent 执行。",
|
||||
"family": "cn_document_only"
|
||||
},
|
||||
{
|
||||
"text": "检查安装步骤是否清楚，只做 README，不做 skill 包。",
|
||||
"family": "cn_document_only"
|
||||
}
|
||||
],
|
||||
"near_neighbor": [
|
||||
@@ -333,6 +373,18 @@
|
||||
{
|
||||
"text": "这次只给我一个一次性 prompt，不用复用成 skill。",
|
||||
"family": "cn_one_off_vs_reusable"
|
||||
},
|
||||
{
|
||||
"text": "Create a reusable onboarding template for humans, not an agent skill.",
|
||||
"family": "document_export_vs_agent_skill"
|
||||
},
|
||||
{
|
||||
"text": "Draft a release checklist for a future skill, but do not package or evaluate the skill yet.",
|
||||
"family": "future_outline_vs_build"
|
||||
},
|
||||
{
|
||||
"text": "整理成团队发布流程文档即可，不要做成 skill，也不要做触发评测。",
|
||||
"family": "cn_document_export_vs_agent_skill"
|
||||
}
|
||||
]
|
||||
}
|
||||
|
||||
+2
-2
@@ -1,6 +1,6 @@
|
||||
{
|
||||
"schema_version": "2.0",
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-06-13",
|
||||
"package_count": 1,
|
||||
"packages": [
|
||||
{
|
||||
@@ -16,7 +16,7 @@
|
||||
"vscode"
|
||||
],
|
||||
"package_metadata": "registry/packages/yao-meta-skill.json",
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
}
|
||||
]
|
||||
}
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
"schema_version": "2.0",
|
||||
"name": "yao-meta-skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"targets": [
|
||||
"openai",
|
||||
"claude",
|
||||
@@ -16,7 +16,7 @@
|
||||
"trust_level": "local",
|
||||
"license": "MIT",
|
||||
"checksums": {
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7"
|
||||
},
|
||||
"compatibility": {
|
||||
@@ -53,5 +53,5 @@
|
||||
"install_simulated": true,
|
||||
"install_simulation": "reports/install_simulation.json"
|
||||
},
|
||||
"generated_at": "2026-06-21"
|
||||
"generated_at": "2026-06-13"
|
||||
}
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-07-02T06:33:07Z",
|
||||
"skill_dir": ".",
|
||||
"source_patterns": "reports/user_patterns.json",
|
||||
"pattern_count": 5,
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Adaptation Proposals
|
||||
|
||||
- Generated at: `2026-06-21`
|
||||
- Generated at: `2026-07-02T06:33:07Z`
|
||||
- Pattern report: `reports/user_patterns.json`
|
||||
- Proposal only: `true`
|
||||
- Writes repository files: `false`
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"ok": true,
|
||||
"schema_version": "2.0",
|
||||
"generated_at": "2026-06-20T12:35:58Z",
|
||||
"generated_at": "2026-07-02T06:33:44Z",
|
||||
"skill_dir": ".",
|
||||
"privacy_contract": {
|
||||
"storage": "local-first",
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
{
|
||||
"skill_name": "yao-meta-skill-operator-ux-worktree",
|
||||
"skill_name": "yao-meta-skill-trigger-coverage-merge",
|
||||
"design_system": "metric editorial",
|
||||
"primary_artifact": {
|
||||
"key": "dashboard",
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Artifact Design Profile
|
||||
|
||||
Skill: `yao-meta-skill-operator-ux-worktree`
|
||||
Skill: `yao-meta-skill-trigger-coverage-merge`
|
||||
Design system: `metric editorial`
|
||||
|
||||
## Primary Artifact Direction
|
||||
|
||||
@@ -20,7 +20,7 @@
|
||||
"adversarial_errors": 0
|
||||
},
|
||||
"current": {
|
||||
"tokens": 53,
|
||||
"tokens": 54,
|
||||
"dev_errors": 0,
|
||||
"holdout_errors": 0,
|
||||
"blind_errors": 0,
|
||||
@@ -28,7 +28,7 @@
|
||||
"adversarial_errors": 0
|
||||
},
|
||||
"winner": {
|
||||
"tokens": 53,
|
||||
"tokens": 54,
|
||||
"dev_errors": 0,
|
||||
"holdout_errors": 0,
|
||||
"blind_errors": 0,
|
||||
|
||||
@@ -1,27 +1,47 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"commit": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"commit": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"git_status": {
|
||||
"available": true,
|
||||
"dirty": true,
|
||||
"changed_file_count": 3,
|
||||
"changed_file_count": 37,
|
||||
"generated_dirty": true,
|
||||
"generated_changed_file_count": 3,
|
||||
"source_dirty": false,
|
||||
"source_changed_file_count": 0,
|
||||
"generated_changed_file_count": 36,
|
||||
"source_dirty": true,
|
||||
"source_changed_file_count": 1,
|
||||
"sample": [
|
||||
" M SKILL.md",
|
||||
" M registry/index.json",
|
||||
" M registry/packages/yao-meta-skill.json",
|
||||
" M reports/adaptation_proposals.json",
|
||||
" M reports/adaptation_proposals.md",
|
||||
" M reports/adoption_drift_report.json",
|
||||
" M reports/benchmark_reproducibility.json",
|
||||
" M reports/benchmark_reproducibility.md",
|
||||
" M reports/compiled_targets.json",
|
||||
" M reports/context_budget.json",
|
||||
" M reports/context_budget.md",
|
||||
" M reports/context_budget_summary.json"
|
||||
],
|
||||
"source_sample": [],
|
||||
"source_sample": [
|
||||
" M SKILL.md"
|
||||
],
|
||||
"generated_sample": [
|
||||
" M registry/index.json",
|
||||
" M registry/packages/yao-meta-skill.json",
|
||||
" M reports/adaptation_proposals.json",
|
||||
" M reports/adaptation_proposals.md",
|
||||
" M reports/adoption_drift_report.json",
|
||||
" M reports/benchmark_reproducibility.json",
|
||||
" M reports/benchmark_reproducibility.md",
|
||||
" M reports/compiled_targets.json",
|
||||
" M reports/context_budget.json",
|
||||
" M reports/context_budget.md",
|
||||
" M reports/context_budget_summary.json"
|
||||
" M reports/context_budget_summary.json",
|
||||
" M reports/evidence_consistency.json"
|
||||
],
|
||||
"generated_dirty_prefixes": [
|
||||
"dist/",
|
||||
@@ -35,12 +55,12 @@
|
||||
},
|
||||
"summary": {
|
||||
"reproducibility_ready": true,
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"methodology_complete": true,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"evidence_bundle_sha256": "e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64cbe8db9ad",
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"evidence_bundle_sha256": "6c95043c2d8513102b37bc70a01647246933c84e8a27c2748cc2cae20e040158",
|
||||
"source_contract_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"output_case_count": 5,
|
||||
"failure_disclosure_count": 3,
|
||||
@@ -58,22 +78,24 @@
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3,
|
||||
"public_claim_blocker_count": 4,
|
||||
"working_tree_dirty": true,
|
||||
"changed_file_count": 3,
|
||||
"source_tree_dirty": false,
|
||||
"source_changed_file_count": 0,
|
||||
"changed_file_count": 37,
|
||||
"source_tree_dirty": true,
|
||||
"source_changed_file_count": 1,
|
||||
"generated_tree_dirty": true,
|
||||
"generated_changed_file_count": 3
|
||||
"generated_changed_file_count": 36
|
||||
},
|
||||
"beta_test_release": {
|
||||
"ready": true,
|
||||
"ready": false,
|
||||
"scope": "beta/public test release without superiority, fully-reviewed, or world-class claims",
|
||||
"blockers": [],
|
||||
"blockers": [
|
||||
"release lock is not clean or commit is unavailable"
|
||||
],
|
||||
"allowed_deferred_evidence": [
|
||||
{
|
||||
"key": "provider-holdout",
|
||||
@@ -103,6 +125,7 @@
|
||||
"ready": false,
|
||||
"scope": "public benchmark or world-class readiness claim",
|
||||
"blockers": [
|
||||
"release lock is not clean or commit is unavailable",
|
||||
"human blind-review adjudication is incomplete",
|
||||
"world-class evidence is not accepted yet (3 open gaps, 4 ledger pending)",
|
||||
"world-class source checks are not all accepted (12/19 pass, 7 blocked)"
|
||||
@@ -110,12 +133,12 @@
|
||||
"policy": "Local reproducibility can pass before public claims; public claims require provider evidence, human adjudication, clean release lock, accepted world-class evidence, and complete source checks."
|
||||
},
|
||||
"release_lock": {
|
||||
"ready": true,
|
||||
"commit": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"ready": false,
|
||||
"commit": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"status_scope": "generation-time status before this report is written",
|
||||
"source_changed_file_count": 0,
|
||||
"generated_changed_file_count": 3,
|
||||
"reason": "only generated evidence artifacts were dirty at generation time"
|
||||
"source_changed_file_count": 1,
|
||||
"generated_changed_file_count": 36,
|
||||
"reason": "source files were dirty at generation time"
|
||||
},
|
||||
"evidence_bundle": {
|
||||
"algorithm": "sha256(path,label,exists,artifact_sha256)",
|
||||
@@ -123,7 +146,7 @@
|
||||
"existing_count": 25,
|
||||
"missing_count": 0,
|
||||
"missing_paths": [],
|
||||
"sha256": "e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64cbe8db9ad"
|
||||
"sha256": "6c95043c2d8513102b37bc70a01647246933c84e8a27c2748cc2cae20e040158"
|
||||
},
|
||||
"methodology": {
|
||||
"path": "reports/benchmark_methodology.md",
|
||||
@@ -217,8 +240,8 @@
|
||||
"label": "trigger_scorecard",
|
||||
"path": "reports/route_scorecard.json",
|
||||
"exists": true,
|
||||
"bytes": 16950,
|
||||
"sha256": "a649547a7d3d5fe02262ca1b188ed4022d8f557770be425f7b7cf762aa76533a"
|
||||
"bytes": 17042,
|
||||
"sha256": "53fc22d220dc11453c1e66a17ec2d935e069f9bc936952fe4a53afdb4c71b2cc"
|
||||
},
|
||||
{
|
||||
"label": "runtime_conformance",
|
||||
@@ -232,21 +255,21 @@
|
||||
"path": "reports/security_trust_report.json",
|
||||
"exists": true,
|
||||
"bytes": 139090,
|
||||
"sha256": "2ef43f009be68b1dd1a994b841d69b89723cf0b6d7725dc6ad86670d14235135"
|
||||
"sha256": "108aee597a1f245f73d9b69454b6fa8a144545f905231a7c314364c7066541c6"
|
||||
},
|
||||
{
|
||||
"label": "python_compatibility",
|
||||
"path": "reports/python_compatibility.json",
|
||||
"exists": true,
|
||||
"bytes": 30351,
|
||||
"sha256": "7f3fc8e785bf7007755c0b7f277967fd478ea17a5800ab14b9c23de395576cda"
|
||||
"bytes": 30497,
|
||||
"sha256": "4d82942052a2ca87db7acea451096332d4b8bf6420a29fa9f5596e83464d21ea"
|
||||
},
|
||||
{
|
||||
"label": "registry_audit",
|
||||
"path": "reports/registry_audit.json",
|
||||
"exists": true,
|
||||
"bytes": 3137,
|
||||
"sha256": "03cb951dc8ba71843602bffa1148d7a40095a7e109a024193422aaa8a94ba4c7"
|
||||
"bytes": 3155,
|
||||
"sha256": "d307675d5c6c3cd2f104ce7d963b37d36113f35334e4c6895b55fbb8b255e915"
|
||||
},
|
||||
{
|
||||
"label": "package_verification",
|
||||
@@ -259,64 +282,64 @@
|
||||
"label": "install_simulation",
|
||||
"path": "reports/install_simulation.json",
|
||||
"exists": true,
|
||||
"bytes": 8793,
|
||||
"sha256": "6cf79201727352e5f92f4e1fa1697a069ab325d526065f5316ee939e84475ef5"
|
||||
"bytes": 8947,
|
||||
"sha256": "65adf51d8c4b1d5ea49edde09004f7e4bfc06127e640baf2de23af695fbe0728"
|
||||
},
|
||||
{
|
||||
"label": "skill_os2_audit",
|
||||
"path": "reports/skill_os2_audit.json",
|
||||
"exists": true,
|
||||
"bytes": 13824,
|
||||
"sha256": "1079221b5ac72e19e3e7a0f4970f133d828336f34bac82abf3fb867d18834cfa"
|
||||
"sha256": "150c0027deaa3c2dd44db5380e9a9b16f123e8a8e3ff6142c711b2b0c432f81c"
|
||||
},
|
||||
{
|
||||
"label": "world_class_evidence_plan",
|
||||
"path": "reports/world_class_evidence_plan.json",
|
||||
"exists": true,
|
||||
"bytes": 23314,
|
||||
"sha256": "374ee899a0ba5b84a95337de993439d78e5708be4fdf40dee4292766d0d2bf99"
|
||||
"sha256": "483ed2b3bd020fa2c5a888300c0d0c1a265eebaf648076581f082f2d527d3669"
|
||||
},
|
||||
{
|
||||
"label": "world_class_evidence_ledger",
|
||||
"path": "reports/world_class_evidence_ledger.json",
|
||||
"exists": true,
|
||||
"bytes": 26274,
|
||||
"sha256": "565ae80a82286e912df134c88a269566ecf635f39e55618df4ed4eac69d7c7ea"
|
||||
"sha256": "b19e7113ec463dbb1cfb87c45d3c51624151aeea1747c8d9c286b6967a385c6a"
|
||||
},
|
||||
{
|
||||
"label": "world_class_evidence_intake",
|
||||
"path": "reports/world_class_evidence_intake.json",
|
||||
"exists": true,
|
||||
"bytes": 20922,
|
||||
"sha256": "e36a7e753f4176e7ddd7a74fcc5b064769191baf73b5faa58752f80457ec58ff"
|
||||
"sha256": "885bff9c1c8546c606f583a982a2283229438dbdcd44f3c7e55aff71f858f8f4"
|
||||
},
|
||||
{
|
||||
"label": "world_class_evidence_preflight",
|
||||
"path": "reports/world_class_evidence_preflight.json",
|
||||
"exists": true,
|
||||
"bytes": 90852,
|
||||
"sha256": "9e4f0bc489ca958b5a9e2854f17b847de8ee1f081de40e8c8b86cec138afe633"
|
||||
"bytes": 90854,
|
||||
"sha256": "06e93b1c0c99107002466d9418a4910c82397bce26c3bbdd5b5cc9875eeb65b2"
|
||||
},
|
||||
{
|
||||
"label": "world_class_submission_review",
|
||||
"path": "reports/world_class_submission_review.json",
|
||||
"exists": true,
|
||||
"bytes": 17292,
|
||||
"sha256": "3c944b4bd27f61483e8e02aa3f3b6c8cdb4aba8dc986241e8cbe60ba64489123"
|
||||
"sha256": "e8df5c72ade7ad0704b6ee5dd6aedefea98f79a9a370cd4d80655401862e87f4"
|
||||
},
|
||||
{
|
||||
"label": "world_class_operator_runbook",
|
||||
"path": "reports/world_class_operator_runbook.json",
|
||||
"exists": true,
|
||||
"bytes": 83712,
|
||||
"sha256": "d8678010fcfd5fb8f28d95925478496749f5498ce13a171c80f79372b874351d"
|
||||
"sha256": "bb67813244d64f8e5e416620bb9d7856d95d85a1ec7f9581b2a97b9fed47e02e"
|
||||
},
|
||||
{
|
||||
"label": "world_class_operator_runbook_markdown",
|
||||
"path": "reports/world_class_operator_runbook.md",
|
||||
"exists": true,
|
||||
"bytes": 25504,
|
||||
"sha256": "fe3a73bf2eb9a018ec03881c95d23d30abcbf8bc36cbb264f68daa08238d8e5f"
|
||||
"sha256": "e8d4dee7541323f0e6fa6be4903e7c482b1d00ef1db5594f0c44212088b53d85"
|
||||
},
|
||||
{
|
||||
"label": "world_class_operator_runbook_html",
|
||||
@@ -329,8 +352,8 @@
|
||||
"label": "world_class_claim_guard",
|
||||
"path": "reports/world_class_claim_guard.json",
|
||||
"exists": true,
|
||||
"bytes": 18759,
|
||||
"sha256": "556700f05a65bda9b55d829c109d1aec54ae5b4da80ffbefe1196319df86f117"
|
||||
"bytes": 20713,
|
||||
"sha256": "911ba833055ab857250f88d88ccdd0bb652076a81214f725c49d763352035572"
|
||||
}
|
||||
],
|
||||
"missing_artifacts": [],
|
||||
|
||||
@@ -1,20 +1,20 @@
|
||||
# Benchmark Reproducibility
|
||||
|
||||
Generated at: `2026-06-21`
|
||||
Commit: `139d0fd15ce995757d6d75fb45fb417d0b1b4e7d`
|
||||
Generated at: `2026-07-02`
|
||||
Commit: `24bea607a2b16e766bc8f2bc8483f22fae1edc61`
|
||||
Working tree dirty at generation: `true`
|
||||
Source tree dirty at generation: `false`
|
||||
Source tree dirty at generation: `true`
|
||||
Generated evidence dirty at generation: `true`
|
||||
Evidence bundle SHA256: `e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64cbe8db9ad`
|
||||
Evidence bundle SHA256: `6c95043c2d8513102b37bc70a01647246933c84e8a27c2748cc2cae20e040158`
|
||||
|
||||
## Summary
|
||||
|
||||
- reproducibility ready: `true`
|
||||
- release lock ready: `true`
|
||||
- release lock ready: `false`
|
||||
- methodology complete: `true`
|
||||
- required artifacts: `25`
|
||||
- missing artifacts: `0`
|
||||
- source contract sha256: `eddeea80a657`
|
||||
- source contract sha256: `db71157184dc`
|
||||
- archive sha256: `c56a8519244c`
|
||||
- output cases: `5`
|
||||
- disclosed failure cases: `3`
|
||||
@@ -23,27 +23,27 @@ Evidence bundle SHA256: `e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64
|
||||
- human review complete: `false`
|
||||
- world-class ready: `false`
|
||||
- world-class source checks: `12` pass / `19` total; `7` blocked
|
||||
- beta test ready: `true`
|
||||
- beta test blockers: `0`
|
||||
- beta test ready: `false`
|
||||
- beta test blockers: `1`
|
||||
- beta deferred evidence: `4`
|
||||
- public claim ready: `false`
|
||||
- public claim blockers: `3`
|
||||
- changed files at generation: `3`
|
||||
- source changed files at generation: `0`
|
||||
- generated changed files at generation: `3`
|
||||
- public claim blockers: `4`
|
||||
- changed files at generation: `37`
|
||||
- source changed files at generation: `1`
|
||||
- generated changed files at generation: `36`
|
||||
|
||||
This report proves local benchmark reproducibility only. It keeps external provider and human-review gaps visible instead of counting them as complete. The git commit and dirty samples are generation-time context; the evidence bundle SHA is the durable anchor for the artifacts listed below.
|
||||
|
||||
## Beta Test Boundary
|
||||
|
||||
- ready: `true`
|
||||
- ready: `false`
|
||||
- scope: beta/public test release without superiority, fully-reviewed, or world-class claims
|
||||
- policy: Human blind-review, native permission enforcement, real client telemetry, and ledger acceptance may be deferred for beta/public testing, but public claims must remain blocked until those evidence entries are accepted.
|
||||
- required wording: Use beta, public test, or technical preview wording; do not claim world-class readiness, fully reviewed quality, or proven superiority over baseline.
|
||||
|
||||
| Blocker |
|
||||
| --- |
|
||||
| none |
|
||||
| release lock is not clean or commit is unavailable |
|
||||
|
||||
| Deferred evidence | Reason |
|
||||
| --- | --- |
|
||||
@@ -60,21 +60,22 @@ This report proves local benchmark reproducibility only. It keeps external provi
|
||||
|
||||
| Blocker |
|
||||
| --- |
|
||||
| release lock is not clean or commit is unavailable |
|
||||
| human blind-review adjudication is incomplete |
|
||||
| world-class evidence is not accepted yet (3 open gaps, 4 ledger pending) |
|
||||
| world-class source checks are not all accepted (12/19 pass, 7 blocked) |
|
||||
|
||||
## Release Lock
|
||||
|
||||
- ready: `true`
|
||||
- reason: only generated evidence artifacts were dirty at generation time
|
||||
- ready: `false`
|
||||
- reason: source files were dirty at generation time
|
||||
- status scope: generation-time status before this report is written
|
||||
|
||||
## Evidence Bundle
|
||||
|
||||
- algorithm: `sha256(path,label,exists,artifact_sha256)`
|
||||
- artifacts: `25` / `25`
|
||||
- sha256: `e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64cbe8db9ad`
|
||||
- sha256: `6c95043c2d8513102b37bc70a01647246933c84e8a27c2748cc2cae20e040158`
|
||||
|
||||
## Methodology Sections
|
||||
|
||||
@@ -99,23 +100,23 @@ This report proves local benchmark reproducibility only. It keeps external provi
|
||||
| output_execution | `reports/output_execution_runs.json` | present | `4df66b63d2e7` |
|
||||
| blind_review | `reports/output_blind_review_pack.json` | present | `bbe2db8ec277` |
|
||||
| review_adjudication | `reports/output_review_adjudication.json` | present | `91fd88dd9b0f` |
|
||||
| trigger_scorecard | `reports/route_scorecard.json` | present | `a649547a7d3d` |
|
||||
| trigger_scorecard | `reports/route_scorecard.json` | present | `53fc22d220dc` |
|
||||
| runtime_conformance | `reports/conformance_matrix.json` | present | `97f9ba949c23` |
|
||||
| trust_report | `reports/security_trust_report.json` | present | `2ef43f009be6` |
|
||||
| python_compatibility | `reports/python_compatibility.json` | present | `7f3fc8e785bf` |
|
||||
| registry_audit | `reports/registry_audit.json` | present | `03cb951dc8ba` |
|
||||
| trust_report | `reports/security_trust_report.json` | present | `108aee597a1f` |
|
||||
| python_compatibility | `reports/python_compatibility.json` | present | `4d82942052a2` |
|
||||
| registry_audit | `reports/registry_audit.json` | present | `d307675d5c6c` |
|
||||
| package_verification | `reports/package_verification.json` | present | `e2ad726ce048` |
|
||||
| install_simulation | `reports/install_simulation.json` | present | `6cf792017273` |
|
||||
| skill_os2_audit | `reports/skill_os2_audit.json` | present | `1079221b5ac7` |
|
||||
| world_class_evidence_plan | `reports/world_class_evidence_plan.json` | present | `374ee899a0ba` |
|
||||
| world_class_evidence_ledger | `reports/world_class_evidence_ledger.json` | present | `565ae80a8228` |
|
||||
| world_class_evidence_intake | `reports/world_class_evidence_intake.json` | present | `e36a7e753f41` |
|
||||
| world_class_evidence_preflight | `reports/world_class_evidence_preflight.json` | present | `9e4f0bc489ca` |
|
||||
| world_class_submission_review | `reports/world_class_submission_review.json` | present | `3c944b4bd27f` |
|
||||
| world_class_operator_runbook | `reports/world_class_operator_runbook.json` | present | `d8678010fcfd` |
|
||||
| world_class_operator_runbook_markdown | `reports/world_class_operator_runbook.md` | present | `fe3a73bf2eb9` |
|
||||
| install_simulation | `reports/install_simulation.json` | present | `65adf51d8c4b` |
|
||||
| skill_os2_audit | `reports/skill_os2_audit.json` | present | `150c0027deaa` |
|
||||
| world_class_evidence_plan | `reports/world_class_evidence_plan.json` | present | `483ed2b3bd02` |
|
||||
| world_class_evidence_ledger | `reports/world_class_evidence_ledger.json` | present | `b19e7113ec46` |
|
||||
| world_class_evidence_intake | `reports/world_class_evidence_intake.json` | present | `885bff9c1c85` |
|
||||
| world_class_evidence_preflight | `reports/world_class_evidence_preflight.json` | present | `06e93b1c0c99` |
|
||||
| world_class_submission_review | `reports/world_class_submission_review.json` | present | `e8df5c72ade7` |
|
||||
| world_class_operator_runbook | `reports/world_class_operator_runbook.json` | present | `bb67813244d6` |
|
||||
| world_class_operator_runbook_markdown | `reports/world_class_operator_runbook.md` | present | `e8d4dee75413` |
|
||||
| world_class_operator_runbook_html | `reports/world_class_operator_runbook.html` | present | `022594013b24` |
|
||||
| world_class_claim_guard | `reports/world_class_claim_guard.json` | present | `556700f05a65` |
|
||||
| world_class_claim_guard | `reports/world_class_claim_guard.json` | present | `911ba833055a` |
|
||||
|
||||
## Reproduction Commands
|
||||
|
||||
|
||||
@@ -0,0 +1,149 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>答案钥匙 - Skill 盲测评审</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
table { width:100%; border-collapse: collapse; } td, th { border:1px solid var(--line); padding:8px; text-align:left; }</style>
|
||||
</head>
|
||||
<body>
|
||||
<header>
|
||||
<a class="button" href="index.html">返回入口</a>
|
||||
<h1>答案钥匙</h1>
|
||||
<p class="warn">请只在所有评审判断都记录完成后再打开。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<table>
|
||||
<thead><tr><th>案例</th><th>方案 A 来源</th><th>方案 B 来源</th></tr></thead>
|
||||
<tbody><tr><td>case-01-support-triage</td><td>官方 skill-creator</td><td>yao-meta-skill</td></tr><tr><td>case-02-monthly-revenue-reconciliation</td><td>yao-meta-skill</td><td>官方 skill-creator</td></tr><tr><td>case-03-webinar-repurposing</td><td>官方 skill-creator</td><td>yao-meta-skill</td></tr><tr><td>case-04-incident-postmortem</td><td>yao-meta-skill</td><td>官方 skill-creator</td></tr><tr><td>case-05-pr-review-followup</td><td>官方 skill-creator</td><td>yao-meta-skill</td></tr></tbody>
|
||||
</table>
|
||||
<p class="note" style="margin-top:12px">来源路径：yao-meta-skill = /Users/laoyao/AI Coding/03-Development/Skills/yao-meta-skill/SKILL.md；官方 skill-creator = /Users/laoyao/.codex/skills/.system/skill-creator/SKILL.md。</p>
|
||||
</section>
|
||||
</main>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,62 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"seed": "blind-human-review-2026-06-29-v1",
|
||||
"answer_key_warning": "请只在记录完所有判断后再打开。",
|
||||
"answers": [
|
||||
{
|
||||
"case_id": "case-01-support-triage",
|
||||
"variant_a_source": "official",
|
||||
"variant_b_source": "yao",
|
||||
"variant_a_source_label": "官方 skill-creator",
|
||||
"variant_b_source_label": "yao-meta-skill",
|
||||
"source_paths": {
|
||||
"yao": "/Users/laoyao/AI Coding/03-Development/Skills/yao-meta-skill/SKILL.md",
|
||||
"official": "/Users/laoyao/.codex/skills/.system/skill-creator/SKILL.md"
|
||||
}
|
||||
},
|
||||
{
|
||||
"case_id": "case-02-monthly-revenue-reconciliation",
|
||||
"variant_a_source": "yao",
|
||||
"variant_b_source": "official",
|
||||
"variant_a_source_label": "yao-meta-skill",
|
||||
"variant_b_source_label": "官方 skill-creator",
|
||||
"source_paths": {
|
||||
"yao": "/Users/laoyao/AI Coding/03-Development/Skills/yao-meta-skill/SKILL.md",
|
||||
"official": "/Users/laoyao/.codex/skills/.system/skill-creator/SKILL.md"
|
||||
}
|
||||
},
|
||||
{
|
||||
"case_id": "case-03-webinar-repurposing",
|
||||
"variant_a_source": "official",
|
||||
"variant_b_source": "yao",
|
||||
"variant_a_source_label": "官方 skill-creator",
|
||||
"variant_b_source_label": "yao-meta-skill",
|
||||
"source_paths": {
|
||||
"yao": "/Users/laoyao/AI Coding/03-Development/Skills/yao-meta-skill/SKILL.md",
|
||||
"official": "/Users/laoyao/.codex/skills/.system/skill-creator/SKILL.md"
|
||||
}
|
||||
},
|
||||
{
|
||||
"case_id": "case-04-incident-postmortem",
|
||||
"variant_a_source": "yao",
|
||||
"variant_b_source": "official",
|
||||
"variant_a_source_label": "yao-meta-skill",
|
||||
"variant_b_source_label": "官方 skill-creator",
|
||||
"source_paths": {
|
||||
"yao": "/Users/laoyao/AI Coding/03-Development/Skills/yao-meta-skill/SKILL.md",
|
||||
"official": "/Users/laoyao/.codex/skills/.system/skill-creator/SKILL.md"
|
||||
}
|
||||
},
|
||||
{
|
||||
"case_id": "case-05-pr-review-followup",
|
||||
"variant_a_source": "official",
|
||||
"variant_b_source": "yao",
|
||||
"variant_a_source_label": "官方 skill-creator",
|
||||
"variant_b_source_label": "yao-meta-skill",
|
||||
"source_paths": {
|
||||
"yao": "/Users/laoyao/AI Coding/03-Development/Skills/yao-meta-skill/SKILL.md",
|
||||
"official": "/Users/laoyao/.codex/skills/.system/skill-creator/SKILL.md"
|
||||
}
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -0,0 +1,15 @@
|
||||
# 人工盲测结果
|
||||
|
||||
这组材料记录了 2026-06-29 的单人 A/B 盲测。评审者在揭晓来源前完成了 5 个判断，结果为 `yao-meta-skill` 5 胜，官方 `skill-creator` 0 胜。
|
||||
|
||||
## 文件
|
||||
|
||||
- [index.html](index.html)：盲测入口。
|
||||
- [adjudication.md](adjudication.md)：揭晓后的统计摘要。
|
||||
- [review-decisions.recorded.json](review-decisions.recorded.json)：评审者选择、确认和证据边界。
|
||||
- [blind-pack.json](blind-pack.json)：不含答案钥匙的盲测包。
|
||||
- [DO_NOT_OPEN_answer_key.json](DO_NOT_OPEN_answer_key.json)：答案钥匙，只应在评审完成后打开。
|
||||
|
||||
## 证据边界
|
||||
|
||||
这可以作为单人盲测偏好证据。它不等同于 provider-backed 的独立模型执行证据，也不等同于 world-class readiness。当前缺口是逐案理由为空、评审人数为 1，尚未形成多评审者一致性证据。
|
||||
@@ -0,0 +1,39 @@
|
||||
# 人工盲测 Adjudication
|
||||
|
||||
生成时间：`2026-06-29T03:04:34Z`
|
||||
|
||||
## 结论
|
||||
|
||||
在 5 个真实常见 skill 创建场景的单人盲测中，评审者在揭晓来源前完成判断，5/5 选择了 `yao-meta-skill` 输出。
|
||||
|
||||
| 案例 | 评审选择 | 揭晓来源 |
|
||||
| --- | --- | --- |
|
||||
| `case-01-support-triage` | B | `yao-meta-skill` |
|
||||
| `case-02-monthly-revenue-reconciliation` | A | `yao-meta-skill` |
|
||||
| `case-03-webinar-repurposing` | B | `yao-meta-skill` |
|
||||
| `case-04-incident-postmortem` | A | `yao-meta-skill` |
|
||||
| `case-05-pr-review-followup` | B | `yao-meta-skill` |
|
||||
|
||||
## 统计
|
||||
|
||||
- `yao-meta-skill`：5
|
||||
- 官方 `skill-creator`：0
|
||||
- 平局：0
|
||||
- 评审人数：1
|
||||
- 信心程度：5 个判断均为 `1.0`
|
||||
|
||||
## 盲审确认
|
||||
|
||||
评审者确认：
|
||||
|
||||
> 确认：我是在完成五个判断之后才让你打开答案钥匙的，评审前没有看来源。以上 5 个判断都是揭晓来源前完成的。
|
||||
|
||||
## 证据边界
|
||||
|
||||
这可以作为单人独立盲测偏好证据。它不等同于 provider-backed 独立模型执行证据，因为两个输出是本地按两份 skill 说明生成的。
|
||||
|
||||
当前缺口：
|
||||
|
||||
- 每个案例的 `reason` 字段为空，缺少逐案 rationale。
|
||||
- 评审人数为 1，尚未形成多评审者一致性证据。
|
||||
- 尚未加入外部冻结 holdout 任务集。
|
||||
@@ -0,0 +1,98 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"seed": "blind-human-review-2026-06-29-v1",
|
||||
"generated_by": "Codex 在本地套用两份 skill 说明生成",
|
||||
"evidence_boundary": "人类盲测评审起始包；不是 provider-backed 的独立模型执行证据。",
|
||||
"cases": [
|
||||
{
|
||||
"id": "case-01-support-triage",
|
||||
"title": "客服工单分诊 Skill",
|
||||
"scenario": "一个 B2B SaaS 团队每天都要处理客户工单：判断分类、紧急程度、起草首轮回复，并把账务、安全、故障类问题升级给对应负责人。他们希望把这个重复流程做成一个给支持团队使用的 Codex skill。",
|
||||
"user_prompt": "请把我们反复使用的客服工单分诊流程做成一个团队可复用的 skill。输入包括原始工单文本、客户等级、产品模块和近期故障记录。输出需要包含问题分类、紧急程度、首轮回复草稿、升级负责人和判断依据。不要把 PII 泄露到报告里。",
|
||||
"rubric": [
|
||||
"是否有清楚的触发边界和近邻排除。",
|
||||
"是否是可复用的 skill 包结构，而不只是一个提示词。",
|
||||
"是否定义了分类、紧急程度、回复、升级和证据的输出契约。",
|
||||
"是否处理 PII 和客户内容的隐私风险。",
|
||||
"是否有能发现错误升级和泛泛回复的评测方案。"
|
||||
],
|
||||
"variants": {
|
||||
"A": "## 建议 Skill：support-triage\n\n### 目的\n创建一个简洁的 skill，帮助 Codex 对 B2B SaaS 客服工单进行分诊，并起草首轮回复。\n\n### 建议包结构\n```\nsupport-triage/\n SKILL.md\n agents/openai.yaml\n references/\n triage-taxonomy.md\n escalation-policy.md\n```\n\n### SKILL.md 草稿\n```markdown\n---\nname: support-triage\ndescription: 对 B2B SaaS 客服工单进行分诊并起草首轮回复。当用户提供原始工单文本、客户等级、产品模块、故障记录，或需要紧急程度、分类、升级建议时使用。\n---\n\n# 客服工单分诊\n\n使用这个 skill 对入站工单分类、起草合适的首轮回复，并识别是否需要升级。\n\n## 工作流\n1. 阅读工单文本、客户等级、产品模块和近期故障记录。\n2. 将工单归为一个主分类：账务、访问权限、缺陷、故障、功能请求、安全、数据/隐私、上手问题或其他。\n3. 标记紧急程度：低、普通、高、严重。\n4. 起草首轮回复：确认问题、只询问必要补充信息，并避免没有依据的承诺。\n5. 对安全、隐私、严重故障、数据丢失或企业客户影响问题进行升级。\n6. 汇报判断依据，但不要复制不必要的 PII。\n\n## 输出格式\n- 分类：\n- 紧急程度：\n- 首轮回复：\n- 升级负责人：\n- 判断依据：\n- 缺失信息：\n\n## 参考资料\n- 分类规则见 `references/triage-taxonomy.md`。\n- 升级标准见 `references/escalation-policy.md`。\n```\n\n### agents/openai.yaml\n```yaml\ndisplay_name: 客服工单分诊\nshort_description: 对客服工单分类，并起草首轮回复。\ndefault_prompt: 请分诊这个客服工单，并起草首轮回复。\n```\n\n### 资源\n- `references/triage-taxonomy.md`：分类定义、紧急程度提示和示例。\n- `references/escalation-policy.md`：升级负责人和升级标准。\n\n### 验证\n用账务、安全、故障和功能请求等代表性工单测试。确认输出会最小化 PII，并且严重问题会被升级。\n",
|
||||
"B": "## Skill 包建议：support-triage\n\n### 边界\n负责重复出现的客服工单分诊：用户提供工单文本以及客户/产品上下文，需要结构化路由决策。不要用于一次性文案润色、泛泛的客服同理心训练、CRM 配置，或超出升级范围的法律/安全事件处置。\n\n### 输出契约\n这个 skill 必须返回：\n- `category`\n- `urgency`\n- `first_response_draft`\n- `escalation_owner`\n- `evidence_used`\n- `missing_information`\n- `pii_handling_note`\n\n### 包结构\n```\nsupport-triage/\n SKILL.md\n agents/interface.yaml\n references/\n triage-taxonomy.md\n escalation-policy.md\n privacy-redaction.md\n evals/\n trigger_cases.json\n output/\n cases.jsonl\n fixtures/\n reports/\n output-risk-profile.md\n output_quality_scorecard.md\n```\n\n### SKILL.md\n```markdown\n---\nname: support-triage\ndescription: 将重复出现的 B2B SaaS 客服工单分诊为分类、紧急程度、首轮回复、升级负责人、判断依据和缺失信息。当输入包含原始工单、客户等级、产品模块、故障记录或支持队列上下文时使用。不要用于一次性文案润色、CRM 设置、法律建议或最终安全事件处置。\n---\n\n# 客服工单分诊\n\n## 工作流\n1. 确认这是重复的工单分诊任务，而不是一次性文案润色。\n2. 阅读工单文本、客户等级、产品模块和故障记录。\n3. 使用 `references/triage-taxonomy.md` 判断分类和紧急程度。\n4. 按 `references/escalation-policy.md` 检查升级标准。\n5. 起草首轮回复：确认问题、避免无依据承诺，只请求最少的缺失信息。\n6. 按 `references/privacy-redaction.md` 对 PII 做脱敏或摘要。\n7. 严格按输出契约返回。\n\n## 必填输出\n使用这些字段：\n- category\n- urgency\n- first_response_draft\n- escalation_owner\n- evidence_used\n- missing_information\n- pii_handling_note\n```\n\n### agents/interface.yaml\n```yaml\ndisplay_name: 客服工单分诊\nshort_description: 对工单分类、起草首轮回复，并给出升级依据。\ndefault_prompt: 请用分类、紧急程度、回复、升级负责人和依据来分诊这个客服工单。\n```\n\n### 评测用例\n1. 企业客户在已知故障期间提交工单：必须标为 `critical`，并升级给 incident commander。\n2. SMB 客户的账务困惑：不应过度升级。\n3. 带客户邮箱和 token 片段的安全披露：必须脱敏 token，并升级安全团队。\n4. 伪装成投诉的功能请求：应归类为功能请求，紧急程度为普通。\n5. 近邻请求：“把这段回复改得更温和”不应触发包级分诊。\n\n### 发布门禁\n- 触发评测：正例、反例、近邻文案润色。\n- 输出评测：首轮回复不能编造 SLA，升级必须匹配策略。\n- 隐私检查：报告不能保存原始工单 PII。\n- 审查备注：如果分类规则或升级负责人未提供，标记为 `missing evidence`，不要编造。\n\n### 下一步\n加入 3 个匿名工单 fixture，运行输出评测，并记录错误升级、泛泛回复和 PII 泄露的失败分类。\n"
|
||||
},
|
||||
"html_report": "case-01-support-triage.html"
|
||||
},
|
||||
{
|
||||
"id": "case-02-monthly-revenue-reconciliation",
|
||||
"title": "月度收入对账 Skill",
|
||||
"scenario": "一个财务运营团队每个月结账前都要比对 Stripe 导出、数据仓库发票 CSV 和人工调整表，找出金额、币种、发票和调整项的不一致。",
|
||||
"user_prompt": "请创建一个用于月度收入对账的可复用 skill。输入是 Stripe balance export CSV、warehouse invoice CSV 和 adjustments sheet。输出需要标出不一致项、解释可能原因，并生成可用于月结的摘要。准确性比速度更重要。",
|
||||
"rubric": [
|
||||
"是否识别出这是 file-backed 且准确性敏感的任务。",
|
||||
"是否定义了确定性脚本和资源边界。",
|
||||
"是否说明输入/输出 schema 与对账容差。",
|
||||
"是否包含 fixture 和失败用例验证。",
|
||||
"是否避免编造财务事实或隐藏未解决差异。"
|
||||
],
|
||||
"variants": {
|
||||
"A": "## Skill 包建议：revenue-reconciliation\n\n### 边界\n负责围绕 Stripe balance export、warehouse invoice CSV 和调整表的重复月结对账。排除税务建议、收入确认政策决策、支付渠道配置和一次性表格美化。\n\n### 风险等级\nGoverned，file-backed，准确性敏感。任何可用于月结的结论前，都必须有确定性解析和可见的未解决项目。\n\n### 包结构\n```\nrevenue-reconciliation/\n SKILL.md\n agents/interface.yaml\n scripts/\n reconcile_revenue.py\n validate_reconciliation_fixture.py\n references/\n input-schema.md\n tolerance-policy.md\n close-summary-contract.md\n evals/\n output/\n cases.jsonl\n fixtures/\n stripe_sample.csv\n warehouse_sample.csv\n adjustments_sample.csv\n reports/\n output-risk-profile.md\n output_quality_scorecard.md\n trust_report.md\n```\n\n### SKILL.md\n```markdown\n---\nname: revenue-reconciliation\ndescription: 对来自 Stripe 导出、warehouse invoice CSV 和调整表的重复月结收入文件进行对账。用于 file-backed 差异检测、可能原因分析、未解决项目报告和月结摘要。不要用于收入确认建议、税务指导、支付渠道配置或一次性表格格式整理。\n---\n\n# 收入对账\n\n## 工作流\n1. 要求提供所有输入文件；缺失文件必须标记为 `missing evidence`。\n2. 阅读 `references/input-schema.md`，先校验列再分析。\n3. 运行 `scripts/reconcile_revenue.py`，规范化 ID、币种、金额精度、日期和调整项关联。\n4. 审查 JSON 输出，并按缺失发票、金额差异、币种差异、重复项、时间差异或仅调整项分类。\n5. 只基于脚本证据生成月结摘要。\n6. 保持未解决差异可见。不要编造原因、审批或政策判断。\n\n## 输出契约\n- input_files\n- validation_status\n- totals_by_source\n- matched_count\n- mismatch_table\n- likely_causes\n- unresolved_items\n- close_ready_summary\n- missing_evidence\n```\n\n### 确定性脚本契约\n`scripts/reconcile_revenue.py` 应接受：\n```bash\npython3 scripts/reconcile_revenue.py --stripe stripe.csv --warehouse warehouse.csv --adjustments adjustments.csv --output reconciliation.json\n```\n\n它应返回包含源行 ID 的结构化 JSON，让摘要里的每个结论都能追溯到 file-backed fixture。\n\n### 评测\n- Fixture 1：所有记录匹配。\n- Fixture 2：Stripe 有付款，但 warehouse 缺发票。\n- Fixture 3：warehouse 金额超过容差。\n- Fixture 4：人工调整解释了差异。\n- 近邻请求：“把这个表格弄好看一点”不应路由到这里。\n\n### 门禁\n- 汇总前必须通过输入 schema 校验。\n- 如果遗漏未解决差异，输出评测必须失败。\n- Trust check 应标记网络访问为不必要。\n- Review Studio 应在晋级前显示 file-backed fixture 覆盖和未解决差异处理。\n",
|
||||
"B": "## 建议 Skill：revenue-reconciliation\n\n### 目的\n帮助 Codex 对 Stripe、数据仓库发票和人工调整表中的月度收入记录进行对账。\n\n### 建议包结构\n```\nrevenue-reconciliation/\n SKILL.md\n agents/openai.yaml\n scripts/\n reconcile_revenue.py\n references/\n csv-schema.md\n```\n\n### SKILL.md 草稿\n```markdown\n---\nname: revenue-reconciliation\ndescription: 对 Stripe balance export、warehouse invoice CSV 和调整表中的月度收入数据进行对账。当用户要求比较收入文件、找出不一致项或准备月结摘要时使用。\n---\n\n# 收入对账\n\n## 工作流\n1. 确认用户提供了 Stripe 导出、warehouse invoice CSV 和调整表。\n2. 阅读 `references/csv-schema.md`，了解预期列。\n3. 使用用户提供的文件运行 `scripts/reconcile_revenue.py`。\n4. 审查不一致项，并总结可能原因。\n5. 不要编造缺失值。清楚标记未解决记录。\n\n## 输出\n- 已检查文件\n- 匹配总额\n- 不一致项\n- 可能原因\n- 未解决项目\n- 月结摘要\n```\n\n### 脚本\n`scripts/reconcile_revenue.py` 应解析 CSV 输入，规范化 invoice ID 和币种，比较金额，并输出 JSON 供 Codex 总结。\n\n### agents/openai.yaml\n```yaml\ndisplay_name: 收入对账\nshort_description: 比对收入 CSV，并总结月结差异。\ndefault_prompt: 请对这些收入文件进行对账，并生成月结摘要。\n```\n\n### 验证\n使用包含匹配发票、缺失发票、重复发票和仅调整项记录的样例 CSV。确认未解决差异不会被隐藏。\n"
|
||||
},
|
||||
"html_report": "case-02-monthly-revenue-reconciliation.html"
|
||||
},
|
||||
{
|
||||
"id": "case-03-webinar-repurposing",
|
||||
"title": "Webinar 内容复用 Skill",
|
||||
"scenario": "一个市场团队经常把 webinar 逐字稿改写成 LinkedIn 帖子、邮件 teaser 和 newsletter 段落，同时必须保证所有说法都有来源，并避开禁止宣传的 claim。",
|
||||
"user_prompt": "请做一个可复用 skill，把 webinar 逐字稿复用成市场内容。输入包括逐字稿、讲者姓名、产品定位说明和禁止使用的 claim。输出包括 LinkedIn 帖子、邮件 teaser、newsletter 段落、可引用金句和来源依据说明。",
|
||||
"rubric": [
|
||||
"是否保留来源约束，并处理 banned claims。",
|
||||
"是否定义可重复的多渠道输出格式。",
|
||||
"是否把语气和定位资料放到 references，避免入口膨胀。",
|
||||
"是否有针对幻觉 claim 和泛泛市场文案的评测。",
|
||||
"是否在中等治理风险下保持 skill 足够轻量。"
|
||||
],
|
||||
"variants": {
|
||||
"A": "## 建议 Skill：webinar-repurposer\n\n### 目的\n创建一个 skill，把 webinar 逐字稿转成可复用的市场内容。\n\n### 包结构\n```\nwebinar-repurposer/\n SKILL.md\n agents/openai.yaml\n references/\n brand-voice.md\n banned-claims.md\n```\n\n### SKILL.md 草稿\n```markdown\n---\nname: webinar-repurposer\ndescription: 将 webinar 逐字稿复用成 LinkedIn 帖子、邮件 teaser、newsletter 段落、可引用金句和来源依据说明。当用户提供逐字稿、讲者、定位说明或禁止 claim 时使用。\n---\n\n# Webinar 内容复用\n\n## 工作流\n1. 阅读逐字稿、讲者姓名、产品定位说明和禁止 claim。\n2. 提取核心主题、最强的来源支持观点和可用引语。\n3. 起草一条 LinkedIn 帖子、一段邮件 teaser、一段 newsletter 和若干金句。\n4. 对照逐字稿和禁止 claim 检查每个说法。\n5. 为重要 claim 添加来源依据说明。\n\n## 输出\n- LinkedIn 帖子\n- 邮件 teaser\n- Newsletter 段落\n- 可引用金句\n- 来源依据说明\n- 已避免的 claim\n\n## 参考资料\n语气见 `references/brand-voice.md`，禁止 claim 见 `references/banned-claims.md`。\n```\n\n### agents/openai.yaml\n```yaml\ndisplay_name: Webinar 内容复用\nshort_description: 将 webinar 逐字稿转成有来源依据的市场内容。\ndefault_prompt: 请把这份 webinar 逐字稿复用成可发布的多渠道市场内容。\n```\n\n### 验证\n用包含强金句、证据较弱、以及容易误用禁止 claim 的逐字稿测试。确认输出会避免没有依据的 claim。\n",
|
||||
"B": "## Skill 包建议：webinar-repurposer\n\n### 边界\n负责在提供来源逐字稿和定位约束时，把逐字稿复用为市场内容。排除全新 campaign strategy、没有依据的产品 claim、法律审核和一次性文案润色。\n\n### 类型\nProduction-light。它需要输出质量检查和 banned-claim 防护，但除非涉及受监管 claim 或上市公司披露规则，否则不需要做成很重的 governed 包。\n\n### 包结构\n```\nwebinar-repurposer/\n SKILL.md\n agents/interface.yaml\n references/\n brand-voice.md\n positioning-notes.md\n banned-claims.md\n evals/\n output/\n cases.jsonl\n reports/\n output-risk-profile.md\n prompt-quality-profile.md\n```\n\n### SKILL.md\n```markdown\n---\nname: webinar-repurposer\ndescription: 将重复出现的 webinar 逐字稿复用为有来源依据的 LinkedIn 帖子、邮件 teaser、newsletter 段落、金句和 claim 依据说明。当提供逐字稿、讲者、定位说明或禁止 claim 时使用。不要用于无依据的发布 claim、法律审批、全新 campaign strategy 或一次性文案润色。\n---\n\n# Webinar 内容复用\n\n## 工作流\n1. 确认逐字稿是事实来源。\n2. 提取有来源支持的主题、讲者背书的引语和可安全复用的 claim。\n3. 起草前先检查 `references/banned-claims.md`。\n4. 生成各渠道输出，但不要添加逐字稿中没有的性能数字、客户结果或产品承诺。\n5. 添加来源依据说明，把每个主要 claim 绑定到逐字稿证据。\n\n## 必填输出\n- linkedin_post\n- email_teaser\n- newsletter_section\n- pull_quotes\n- source_grounding_notes\n- claims_avoided\n- missing_evidence\n```\n\n### 输出风险画像\n常见失败：\n- 生成任何产品都能用的泛泛市场话术。\n- 编造指标或客户结果。\n- 过度改写金句，导致意思偏离。\n- 因为某个 claim 很有吸引力而忽略 banned claims。\n\n### 输出评测用例\n1. 逐字稿包含诱人的“guaranteed ROI”禁止 claim：输出必须避开。\n2. 逐字稿没有量化证明：输出不能编造数字。\n3. 讲者原话不够顺：可以轻微修语法，但必须保留原意。\n4. 近邻请求：“从零写一个新 campaign idea”不应路由到这里。\n\n### 审查门禁\n- 必填 section 必须全部出现。\n- Banned claim 检查必须显式出现。\n- 来源依据说明必须引用逐字稿位置或原话片段。\n- 缺失证据必须被标出，而不是用通用卖点填补。\n"
|
||||
},
|
||||
"html_report": "case-03-webinar-repurposing.html"
|
||||
},
|
||||
{
|
||||
"id": "case-04-incident-postmortem",
|
||||
"title": "故障复盘 Skill",
|
||||
"scenario": "一个基础设施团队经常把 Slack 故障时间线、告警数据和部署记录整理成故障复盘和后续行动项。",
|
||||
"user_prompt": "请创建一个可复用的 governed skill，用于故障复盘。输入包括告警时间线、Slack 摘要、部署记录、客户影响说明和负责人列表。输出应包含时间线、影响、根因假设、行动项、未解决证据和后续负责人矩阵。",
|
||||
"rubric": [
|
||||
"是否处理 governed/运营风险和未解决证据。",
|
||||
"是否区分假设和已确认根因。",
|
||||
"是否定义行动项负责人矩阵和回滚/跟进边界。",
|
||||
"是否要求 file-backed 或 source-backed 证据。",
|
||||
"是否有针对 blame language 和编造因果的审查门禁。"
|
||||
],
|
||||
"variants": {
|
||||
"A": "## Skill 包建议：incident-postmortem\n\n### 边界\n负责根据 source-backed 时间线、Slack 摘要、部署记录、客户影响说明和负责人列表起草 governed 故障复盘。不要用于实时 incident command、最终 RCA 签核、HR/归责分析或面向客户的法律声明。\n\n### 类型\nGoverned。这个包会影响运营责任归属，如果证据不足，容易制造虚假因果。\n\n### 包结构\n```\nincident-postmortem/\n SKILL.md\n agents/interface.yaml\n references/\n postmortem-contract.md\n severity-policy.md\n blame-free-language.md\n action-owner-matrix.md\n evals/\n output/\n cases.jsonl\n fixtures/\n alert_timeline.json\n slack_summary.md\n deploy_notes.md\n reports/\n output-risk-profile.md\n output_quality_scorecard.md\n trust_report.md\n review-studio.html\n```\n\n### SKILL.md\n```markdown\n---\nname: incident-postmortem\ndescription: 根据告警时间线、Slack 摘要、部署记录、影响说明和负责人列表起草 governed 故障复盘。用于 source-backed 时间线重建、影响总结、根因假设、行动项、未解决证据和后续负责人矩阵。不要用于实时故障指挥、最终 RCA 审批、归责或法律/客户承诺。\n---\n\n# 故障复盘\n\n## 工作流\n1. 要求提供 source-backed 故障输入，并把缺失输入列为 `missing evidence`。\n2. 只根据已提供时间戳建立时间线；如需推断顺序，必须明确标注。\n3. 分开列出 `confirmed_facts`、`root_cause_hypotheses` 和 `unresolved_evidence`。\n4. 总结客户影响，但不要编造受影响账户、持续时间或 SLA 违约。\n5. 创建行动项：包含 owner、due date、验证信号和回滚/跟进边界。\n6. 使用 `references/blame-free-language.md` 的无责语言。\n7. 除非 reviewer 明确提供，否则最终 RCA 审批不属于本 skill。\n\n## 输出契约\n- incident_summary\n- source_inputs\n- timeline\n- customer_impact\n- confirmed_facts\n- root_cause_hypotheses\n- unresolved_evidence\n- action_items\n- owner_matrix\n- approval_status\n```\n\n### 输出评测用例\n1. Slack 和部署记录冲突：必须保留为未解决证据。\n2. 告警时间线缺恢复时间：不能编造持续时长。\n3. 用户要求实时故障决策：应路由出去，或说明本 skill 只做复盘。\n4. 来源材料带有归责语言：输出必须改写为系统/流程语言。\n5. 缺负责人列表：行动项 owner 字段应为 `missing evidence`。\n\n### 门禁\n- 时间线和部署记录需要 file-backed fixture 覆盖。\n- 输出评测禁止编造因果和隐藏未解决证据。\n- Review Studio 在人工 reviewer 审批行动负责人矩阵前保持 warning。\n- Trust report 应显示无网络和无破坏性操作。\n",
|
||||
"B": "## 建议 Skill：incident-postmortem\n\n### 目的\n帮助 Codex 根据时间线、Slack 摘要、部署记录、影响说明和负责人列表创建结构化故障复盘。\n\n### 包结构\n```\nincident-postmortem/\n SKILL.md\n agents/openai.yaml\n references/\n postmortem-template.md\n severity-policy.md\n```\n\n### SKILL.md 草稿\n```markdown\n---\nname: incident-postmortem\ndescription: 根据告警时间线、Slack 摘要、部署记录、客户影响说明和负责人列表创建故障复盘。当用户需要时间线、影响、根因假设、行动项、未解决证据或负责人矩阵时使用。\n---\n\n# 故障复盘\n\n## 工作流\n1. 收集告警时间线、Slack 摘要、部署记录、客户影响说明和负责人列表。\n2. 建立按时间排序的时间线。\n3. 总结客户和系统影响。\n4. 识别已确认事实和根因假设。\n5. 在提供负责人和截止时间时，起草行动项。\n6. 清楚标记未解决证据。\n7. 避免归责式语言。\n\n## 输出\n- 故障摘要\n- 时间线\n- 影响\n- 根因假设\n- 已确认事实\n- 未解决证据\n- 行动项\n- 负责人矩阵\n```\n\n### agents/openai.yaml\n```yaml\ndisplay_name: 故障复盘\nshort_description: 根据故障证据生成结构化复盘。\ndefault_prompt: 请把这些故障证据整理成复盘和负责人矩阵。\n```\n\n### 验证\n用证据完整、缺部署记录、Slack 说法冲突和暂时没有根因的 case 测试。确认 skill 会区分事实和假设。\n"
|
||||
},
|
||||
"html_report": "case-04-incident-postmortem.html"
|
||||
},
|
||||
{
|
||||
"id": "case-05-pr-review-followup",
|
||||
"title": "PR Review 跟进 Skill",
|
||||
"scenario": "一个小工程团队经常收到 GitHub PR review comments，希望 Codex 能把评论转成补丁、回复摘要和验证记录。",
|
||||
"user_prompt": "请设计一个用于处理 PR review comments 的可复用 skill。输入包括 review comments、变更文件、失败 CI 说明和 maintainer preferences。输出需要分组评论、只修改相关文件、写回复说明并运行验证。必须避免回滚无关的用户改动。",
|
||||
"rubric": [
|
||||
"是否理解 code-review 跟进和 dirty worktree 安全。",
|
||||
"是否定义评论分组、补丁、回复和验证工作流。",
|
||||
"是否避免过度重构和无关 revert。",
|
||||
"是否说明变更后需要的命令和证据。",
|
||||
"是否定义一般 code review 与评论跟进的触发排除。"
|
||||
],
|
||||
"variants": {
|
||||
"A": "## 建议 Skill：pr-review-followup\n\n### 目的\n创建一个 skill，帮助 Codex 安全处理 PR review comments，并总结回复。\n\n### 包结构\n```\npr-review-followup/\n SKILL.md\n agents/openai.yaml\n references/\n response-style.md\n```\n\n### SKILL.md 草稿\n```markdown\n---\nname: pr-review-followup\ndescription: 通过分组反馈、修改相关文件、编写回复说明和运行验证来处理 GitHub PR review comments。当用户提供 review comments、变更文件、CI 说明或 maintainer preferences 时使用。\n---\n\n# PR Review 跟进\n\n## 工作流\n1. 阅读所有 review comments，并按文件、主题和严重程度分组。\n2. 编辑前检查受影响文件。\n3. 只修改处理 comments 所需的文件。\n4. 不要回滚无关用户改动。\n5. 运行相关测试或 CI 复现命令。\n6. 总结变更，并为 reviewer 起草回复说明。\n\n## 输出\n- 评论分组\n- 修改文件\n- 验证命令\n- Reviewer 回复说明\n- 剩余问题\n```\n\n### agents/openai.yaml\n```yaml\ndisplay_name: PR Review 跟进\nshort_description: 处理 PR comments 并准备 reviewer 回复。\ndefault_prompt: 请处理这些 PR review comments，并总结验证结果。\n```\n\n### 验证\n用需要代码修改、文档修改、无需修改只需解释、以及 reviewer 要求冲突的 comments 测试。\n",
|
||||
"B": "## Skill 包建议：pr-review-followup\n\n### 边界\n负责 PR 已经有明确 reviewer comments、变更文件或 CI 说明之后的评论跟进。排除首次 code review、大范围重构、issue triage，以及没有绑定评论的推测性清理。\n\n### 包结构\n```\npr-review-followup/\n SKILL.md\n agents/interface.yaml\n references/\n response-style.md\n dirty-worktree-safety.md\n verification-policy.md\n evals/\n trigger_cases.json\n output/\n cases.jsonl\n reports/\n output-risk-profile.md\n output_quality_scorecard.md\n```\n\n### SKILL.md\n```markdown\n---\nname: pr-review-followup\ndescription: 处理具体 PR review comments：分组反馈、只修改相关文件、保留无关用户改动、起草 reviewer 回复并运行验证。当提供 review comments、变更文件、失败 CI 说明或 maintainer preferences 时使用。不要用于首次 code review、大范围重构、issue triage 或无关清理。\n---\n\n# PR Review 跟进\n\n## 工作流\n1. 编辑前记录 git status，并识别用户已经改动的文件。\n2. 按文件、行为、严重程度，以及是否需要代码、测试、文档或仅解释来分组 review comments。\n3. 修改前阅读受影响代码和附近测试。\n4. 只修改与评论绑定的文件。不要回滚无关改动，也不要格式化未触碰文件。\n5. 运行有针对性的验证，并记录命令和结果。\n6. 起草 reviewer 回复说明，把每组评论映射到变更、无需修改的理由或剩余问题。\n7. 如果评论冲突，停止并询问哪个 reviewer 指令优先。\n\n## 输出契约\n- comment_groups\n- patch_summary\n- files_changed\n- verification\n- reviewer_response_notes\n- unresolved_questions\n- unrelated_changes_preserved\n```\n\n### 输出评测用例\n1. 评论要求添加特定 null check：输出必须只修改受影响函数，并提到测试。\n2. Reviewer 要求与 PR 范围无关的大重构：输出应标出范围风险。\n3. Dirty worktree 中有无关用户文件：输出必须保留它。\n4. 两个 reviewer comments 冲突：输出必须询问优先级，而不是猜。\n5. 近邻请求：“从零 review 这个 PR”不应触发 follow-up mode。\n\n### 门禁\n- 触发评测必须区分首次 review 和评论跟进。\n- 如果回滚或隐藏无关改动，输出评测必须失败。\n- 验证策略必须记录跳过测试的原因。\n- 回复说明必须能追溯到评论分组。\n"
|
||||
},
|
||||
"html_report": "case-05-pr-review-followup.html"
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -0,0 +1,380 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>客服工单分诊 Skill - Skill 盲测评审</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
</style>
|
||||
</head>
|
||||
<body data-case-id="case-01-support-triage">
|
||||
<header>
|
||||
<div class="split"><a class="button" href="index.html">返回入口</a><a class="button" href="case-02-monthly-revenue-reconciliation.html">下一个</a></div>
|
||||
<h1>客服工单分诊 Skill</h1>
|
||||
<p class="meta">A/B 盲测评审。记录完判断前，不要打开答案钥匙。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<h2>场景</h2>
|
||||
<p>一个 B2B SaaS 团队每天都要处理客户工单：判断分类、紧急程度、起草首轮回复，并把账务、安全、故障类问题升级给对应负责人。他们希望把这个重复流程做成一个给支持团队使用的 Codex skill。</p>
|
||||
<h3>用户请求</h3>
|
||||
<p>请把我们反复使用的客服工单分诊流程做成一个团队可复用的 skill。输入包括原始工单文本、客户等级、产品模块和近期故障记录。输出需要包含问题分类、紧急程度、首轮回复草稿、升级负责人和判断依据。不要把 PII 泄露到报告里。</p>
|
||||
<h3>评审标准</h3>
|
||||
<ol class="rubric"><li>是否有清楚的触发边界和近邻排除。</li>
|
||||
<li>是否是可复用的 skill 包结构，而不只是一个提示词。</li>
|
||||
<li>是否定义了分类、紧急程度、回复、升级和证据的输出契约。</li>
|
||||
<li>是否处理 PII 和客户内容的隐私风险。</li>
|
||||
<li>是否有能发现错误升级和泛泛回复的评测方案。</li></ol>
|
||||
</section>
|
||||
|
||||
<div class="grid" style="margin-top:18px">
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 A</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>建议 Skill：support-triage</h2>
|
||||
|
||||
<h3>目的</h3>
|
||||
<p>创建一个简洁的 skill，帮助 Codex 对 B2B SaaS 客服工单进行分诊，并起草首轮回复。</p>
|
||||
|
||||
<h3>建议包结构</h3>
|
||||
<pre><code>support-triage/
|
||||
SKILL.md
|
||||
agents/openai.yaml
|
||||
references/
|
||||
triage-taxonomy.md
|
||||
escalation-policy.md</code></pre>
|
||||
|
||||
<h3>SKILL.md 草稿</h3>
|
||||
<pre><code>---
|
||||
name: support-triage
|
||||
description: 对 B2B SaaS 客服工单进行分诊并起草首轮回复。当用户提供原始工单文本、客户等级、产品模块、故障记录，或需要紧急程度、分类、升级建议时使用。
|
||||
---
|
||||
|
||||
# 客服工单分诊
|
||||
|
||||
使用这个 skill 对入站工单分类、起草合适的首轮回复，并识别是否需要升级。
|
||||
|
||||
## 工作流
|
||||
1. 阅读工单文本、客户等级、产品模块和近期故障记录。
|
||||
2. 将工单归为一个主分类：账务、访问权限、缺陷、故障、功能请求、安全、数据/隐私、上手问题或其他。
|
||||
3. 标记紧急程度：低、普通、高、严重。
|
||||
4. 起草首轮回复：确认问题、只询问必要补充信息，并避免没有依据的承诺。
|
||||
5. 对安全、隐私、严重故障、数据丢失或企业客户影响问题进行升级。
|
||||
6. 汇报判断依据，但不要复制不必要的 PII。
|
||||
|
||||
## 输出格式
|
||||
- 分类：
|
||||
- 紧急程度：
|
||||
- 首轮回复：
|
||||
- 升级负责人：
|
||||
- 判断依据：
|
||||
- 缺失信息：
|
||||
|
||||
## 参考资料
|
||||
- 分类规则见 `references/triage-taxonomy.md`。
|
||||
- 升级标准见 `references/escalation-policy.md`。</code></pre>
|
||||
|
||||
<h3>agents/openai.yaml</h3>
|
||||
<pre><code>display_name: 客服工单分诊
|
||||
short_description: 对客服工单分类，并起草首轮回复。
|
||||
default_prompt: 请分诊这个客服工单，并起草首轮回复。</code></pre>
|
||||
|
||||
<h3>资源</h3>
|
||||
<ul>
|
||||
<li>`references/triage-taxonomy.md`：分类定义、紧急程度提示和示例。</li>
|
||||
<li>`references/escalation-policy.md`：升级负责人和升级标准。</li>
|
||||
</ul>
|
||||
|
||||
<h3>验证</h3>
|
||||
<p>用账务、安全、故障和功能请求等代表性工单测试。确认输出会最小化 PII，并且严重问题会被升级。</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 B</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>Skill 包建议：support-triage</h2>
|
||||
|
||||
<h3>边界</h3>
|
||||
<p>负责重复出现的客服工单分诊：用户提供工单文本以及客户/产品上下文，需要结构化路由决策。不要用于一次性文案润色、泛泛的客服同理心训练、CRM 配置，或超出升级范围的法律/安全事件处置。</p>
|
||||
|
||||
<h3>输出契约</h3>
|
||||
<p>这个 skill 必须返回：</p>
|
||||
<ul>
|
||||
<li>`category`</li>
|
||||
<li>`urgency`</li>
|
||||
<li>`first_response_draft`</li>
|
||||
<li>`escalation_owner`</li>
|
||||
<li>`evidence_used`</li>
|
||||
<li>`missing_information`</li>
|
||||
<li>`pii_handling_note`</li>
|
||||
</ul>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>support-triage/
|
||||
SKILL.md
|
||||
agents/interface.yaml
|
||||
references/
|
||||
triage-taxonomy.md
|
||||
escalation-policy.md
|
||||
privacy-redaction.md
|
||||
evals/
|
||||
trigger_cases.json
|
||||
output/
|
||||
cases.jsonl
|
||||
fixtures/
|
||||
reports/
|
||||
output-risk-profile.md
|
||||
output_quality_scorecard.md</code></pre>
|
||||
|
||||
<h3>SKILL.md</h3>
|
||||
<pre><code>---
|
||||
name: support-triage
|
||||
description: 将重复出现的 B2B SaaS 客服工单分诊为分类、紧急程度、首轮回复、升级负责人、判断依据和缺失信息。当输入包含原始工单、客户等级、产品模块、故障记录或支持队列上下文时使用。不要用于一次性文案润色、CRM 设置、法律建议或最终安全事件处置。
|
||||
---
|
||||
|
||||
# 客服工单分诊
|
||||
|
||||
## 工作流
|
||||
1. 确认这是重复的工单分诊任务，而不是一次性文案润色。
|
||||
2. 阅读工单文本、客户等级、产品模块和故障记录。
|
||||
3. 使用 `references/triage-taxonomy.md` 判断分类和紧急程度。
|
||||
4. 按 `references/escalation-policy.md` 检查升级标准。
|
||||
5. 起草首轮回复：确认问题、避免无依据承诺，只请求最少的缺失信息。
|
||||
6. 按 `references/privacy-redaction.md` 对 PII 做脱敏或摘要。
|
||||
7. 严格按输出契约返回。
|
||||
|
||||
## 必填输出
|
||||
使用这些字段：
|
||||
- category
|
||||
- urgency
|
||||
- first_response_draft
|
||||
- escalation_owner
|
||||
- evidence_used
|
||||
- missing_information
|
||||
- pii_handling_note</code></pre>
|
||||
|
||||
<h3>agents/interface.yaml</h3>
|
||||
<pre><code>display_name: 客服工单分诊
|
||||
short_description: 对工单分类、起草首轮回复，并给出升级依据。
|
||||
default_prompt: 请用分类、紧急程度、回复、升级负责人和依据来分诊这个客服工单。</code></pre>
|
||||
|
||||
<h3>评测用例</h3>
|
||||
<p>1. 企业客户在已知故障期间提交工单：必须标为 `critical`，并升级给 incident commander。</p>
|
||||
<p>2. SMB 客户的账务困惑：不应过度升级。</p>
|
||||
<p>3. 带客户邮箱和 token 片段的安全披露：必须脱敏 token，并升级安全团队。</p>
|
||||
<p>4. 伪装成投诉的功能请求：应归类为功能请求，紧急程度为普通。</p>
|
||||
<p>5. 近邻请求：“把这段回复改得更温和”不应触发包级分诊。</p>
|
||||
|
||||
<h3>发布门禁</h3>
|
||||
<ul>
|
||||
<li>触发评测：正例、反例、近邻文案润色。</li>
|
||||
<li>输出评测：首轮回复不能编造 SLA，升级必须匹配策略。</li>
|
||||
<li>隐私检查：报告不能保存原始工单 PII。</li>
|
||||
<li>审查备注：如果分类规则或升级负责人未提供，标记为 `missing evidence`，不要编造。</li>
|
||||
</ul>
|
||||
|
||||
<h3>下一步</h3>
|
||||
<p>加入 3 个匿名工单 fixture，运行输出评测，并记录错误升级、泛泛回复和 PII 泄露的失败分类。</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
</div>
|
||||
|
||||
<section class="review-box">
|
||||
<h2>你的判断</h2>
|
||||
<p class="note">只根据评审标准和页面里可见的两个输出做判断。选择会保存到当前浏览器的本地存储里，也可以回到入口页导出。</p>
|
||||
<div class="controls" role="radiogroup" aria-label="胜出方案">
|
||||
<label><input type="radio" name="winner" value="A"> 方案 A 更好</label>
|
||||
<label><input type="radio" name="winner" value="B"> 方案 B 更好</label>
|
||||
<label><input type="radio" name="winner" value="tie"> 平局 / 没有明显胜出</label>
|
||||
</div>
|
||||
<label for="confidence">信心程度</label>
|
||||
<div class="controls">
|
||||
<select id="confidence">
|
||||
<option value="">请选择</option>
|
||||
<option value="0.4">0.4，较弱</option>
|
||||
<option value="0.6">0.6，中等</option>
|
||||
<option value="0.8">0.8，较强</option>
|
||||
<option value="1.0">1.0，非常确定</option>
|
||||
</select>
|
||||
</div>
|
||||
<label for="reason">理由</label>
|
||||
<textarea id="reason" placeholder="为什么这个方案更好？请写出具体的评审标准差异。"></textarea>
|
||||
<div class="controls">
|
||||
<button class="primary" type="button" onclick="saveDecision()">保存判断</button>
|
||||
<button type="button" onclick="clearDecision()">清空</button>
|
||||
</div>
|
||||
<p id="save-status" class="small note"></p>
|
||||
</section>
|
||||
</main>
|
||||
<script>
|
||||
const caseId = document.body.dataset.caseId;
|
||||
const key = "blindSkillReview:" + caseId;
|
||||
function currentDecision() {
|
||||
const selected = document.querySelector('input[name="winner"]:checked');
|
||||
return {
|
||||
case_id: caseId,
|
||||
winner_variant: selected ? selected.value : "",
|
||||
confidence: document.getElementById("confidence").value,
|
||||
reason: document.getElementById("reason").value.trim(),
|
||||
reviewed_at: new Date().toISOString()
|
||||
};
|
||||
}
|
||||
function saveDecision() {
|
||||
const decision = currentDecision();
|
||||
localStorage.setItem(key, JSON.stringify(decision));
|
||||
document.getElementById("save-status").textContent = "已保存：" + decision.reviewed_at;
|
||||
}
|
||||
function clearDecision() {
|
||||
localStorage.removeItem(key);
|
||||
document.querySelectorAll('input[name="winner"]').forEach(el => el.checked = false);
|
||||
document.getElementById("confidence").value = "";
|
||||
document.getElementById("reason").value = "";
|
||||
document.getElementById("save-status").textContent = "已清空。";
|
||||
}
|
||||
function loadDecision() {
|
||||
const raw = localStorage.getItem(key);
|
||||
if (!raw) return;
|
||||
const decision = JSON.parse(raw);
|
||||
const selected = document.querySelector('input[name="winner"][value="' + decision.winner_variant + '"]');
|
||||
if (selected) selected.checked = true;
|
||||
document.getElementById("confidence").value = decision.confidence || "";
|
||||
document.getElementById("reason").value = decision.reason || "";
|
||||
document.getElementById("save-status").textContent = "已加载保存过的判断。";
|
||||
}
|
||||
loadDecision();
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,368 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>月度收入对账 Skill - Skill 盲测评审</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
</style>
|
||||
</head>
|
||||
<body data-case-id="case-02-monthly-revenue-reconciliation">
|
||||
<header>
|
||||
<div class="split"><a class="button" href="index.html">返回入口</a><a class="button" href="case-01-support-triage.html">上一个</a><a class="button" href="case-03-webinar-repurposing.html">下一个</a></div>
|
||||
<h1>月度收入对账 Skill</h1>
|
||||
<p class="meta">A/B 盲测评审。记录完判断前，不要打开答案钥匙。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<h2>场景</h2>
|
||||
<p>一个财务运营团队每个月结账前都要比对 Stripe 导出、数据仓库发票 CSV 和人工调整表，找出金额、币种、发票和调整项的不一致。</p>
|
||||
<h3>用户请求</h3>
|
||||
<p>请创建一个用于月度收入对账的可复用 skill。输入是 Stripe balance export CSV、warehouse invoice CSV 和 adjustments sheet。输出需要标出不一致项、解释可能原因，并生成可用于月结的摘要。准确性比速度更重要。</p>
|
||||
<h3>评审标准</h3>
|
||||
<ol class="rubric"><li>是否识别出这是 file-backed 且准确性敏感的任务。</li>
|
||||
<li>是否定义了确定性脚本和资源边界。</li>
|
||||
<li>是否说明输入/输出 schema 与对账容差。</li>
|
||||
<li>是否包含 fixture 和失败用例验证。</li>
|
||||
<li>是否避免编造财务事实或隐藏未解决差异。</li></ol>
|
||||
</section>
|
||||
|
||||
<div class="grid" style="margin-top:18px">
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 A</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>Skill 包建议：revenue-reconciliation</h2>
|
||||
|
||||
<h3>边界</h3>
|
||||
<p>负责围绕 Stripe balance export、warehouse invoice CSV 和调整表的重复月结对账。排除税务建议、收入确认政策决策、支付渠道配置和一次性表格美化。</p>
|
||||
|
||||
<h3>风险等级</h3>
|
||||
<p>Governed，file-backed，准确性敏感。任何可用于月结的结论前，都必须有确定性解析和可见的未解决项目。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>revenue-reconciliation/
|
||||
SKILL.md
|
||||
agents/interface.yaml
|
||||
scripts/
|
||||
reconcile_revenue.py
|
||||
validate_reconciliation_fixture.py
|
||||
references/
|
||||
input-schema.md
|
||||
tolerance-policy.md
|
||||
close-summary-contract.md
|
||||
evals/
|
||||
output/
|
||||
cases.jsonl
|
||||
fixtures/
|
||||
stripe_sample.csv
|
||||
warehouse_sample.csv
|
||||
adjustments_sample.csv
|
||||
reports/
|
||||
output-risk-profile.md
|
||||
output_quality_scorecard.md
|
||||
trust_report.md</code></pre>
|
||||
|
||||
<h3>SKILL.md</h3>
|
||||
<pre><code>---
|
||||
name: revenue-reconciliation
|
||||
description: 对来自 Stripe 导出、warehouse invoice CSV 和调整表的重复月结收入文件进行对账。用于 file-backed 差异检测、可能原因分析、未解决项目报告和月结摘要。不要用于收入确认建议、税务指导、支付渠道配置或一次性表格格式整理。
|
||||
---
|
||||
|
||||
# 收入对账
|
||||
|
||||
## 工作流
|
||||
1. 要求提供所有输入文件；缺失文件必须标记为 `missing evidence`。
|
||||
2. 阅读 `references/input-schema.md`，先校验列再分析。
|
||||
3. 运行 `scripts/reconcile_revenue.py`，规范化 ID、币种、金额精度、日期和调整项关联。
|
||||
4. 审查 JSON 输出，并按缺失发票、金额差异、币种差异、重复项、时间差异或仅调整项分类。
|
||||
5. 只基于脚本证据生成月结摘要。
|
||||
6. 保持未解决差异可见。不要编造原因、审批或政策判断。
|
||||
|
||||
## 输出契约
|
||||
- input_files
|
||||
- validation_status
|
||||
- totals_by_source
|
||||
- matched_count
|
||||
- mismatch_table
|
||||
- likely_causes
|
||||
- unresolved_items
|
||||
- close_ready_summary
|
||||
- missing_evidence</code></pre>
|
||||
|
||||
<h3>确定性脚本契约</h3>
|
||||
<p>`scripts/reconcile_revenue.py` 应接受：</p>
|
||||
<pre><code>python3 scripts/reconcile_revenue.py --stripe stripe.csv --warehouse warehouse.csv --adjustments adjustments.csv --output reconciliation.json</code></pre>
|
||||
|
||||
<p>它应返回包含源行 ID 的结构化 JSON，让摘要里的每个结论都能追溯到 file-backed fixture。</p>
|
||||
|
||||
<h3>评测</h3>
|
||||
<ul>
|
||||
<li>Fixture 1：所有记录匹配。</li>
|
||||
<li>Fixture 2：Stripe 有付款，但 warehouse 缺发票。</li>
|
||||
<li>Fixture 3：warehouse 金额超过容差。</li>
|
||||
<li>Fixture 4：人工调整解释了差异。</li>
|
||||
<li>近邻请求：“把这个表格弄好看一点”不应路由到这里。</li>
|
||||
</ul>
|
||||
|
||||
<h3>门禁</h3>
|
||||
<ul>
|
||||
<li>汇总前必须通过输入 schema 校验。</li>
|
||||
<li>如果遗漏未解决差异，输出评测必须失败。</li>
|
||||
<li>Trust check 应标记网络访问为不必要。</li>
|
||||
<li>Review Studio 应在晋级前显示 file-backed fixture 覆盖和未解决差异处理。</li>
|
||||
</ul>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 B</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>建议 Skill：revenue-reconciliation</h2>
|
||||
|
||||
<h3>目的</h3>
|
||||
<p>帮助 Codex 对 Stripe、数据仓库发票和人工调整表中的月度收入记录进行对账。</p>
|
||||
|
||||
<h3>建议包结构</h3>
|
||||
<pre><code>revenue-reconciliation/
|
||||
SKILL.md
|
||||
agents/openai.yaml
|
||||
scripts/
|
||||
reconcile_revenue.py
|
||||
references/
|
||||
csv-schema.md</code></pre>
|
||||
|
||||
<h3>SKILL.md 草稿</h3>
|
||||
<pre><code>---
|
||||
name: revenue-reconciliation
|
||||
description: 对 Stripe balance export、warehouse invoice CSV 和调整表中的月度收入数据进行对账。当用户要求比较收入文件、找出不一致项或准备月结摘要时使用。
|
||||
---
|
||||
|
||||
# 收入对账
|
||||
|
||||
## 工作流
|
||||
1. 确认用户提供了 Stripe 导出、warehouse invoice CSV 和调整表。
|
||||
2. 阅读 `references/csv-schema.md`，了解预期列。
|
||||
3. 使用用户提供的文件运行 `scripts/reconcile_revenue.py`。
|
||||
4. 审查不一致项，并总结可能原因。
|
||||
5. 不要编造缺失值。清楚标记未解决记录。
|
||||
|
||||
## 输出
|
||||
- 已检查文件
|
||||
- 匹配总额
|
||||
- 不一致项
|
||||
- 可能原因
|
||||
- 未解决项目
|
||||
- 月结摘要</code></pre>
|
||||
|
||||
<h3>脚本</h3>
|
||||
<p>`scripts/reconcile_revenue.py` 应解析 CSV 输入，规范化 invoice ID 和币种，比较金额，并输出 JSON 供 Codex 总结。</p>
|
||||
|
||||
<h3>agents/openai.yaml</h3>
|
||||
<pre><code>display_name: 收入对账
|
||||
short_description: 比对收入 CSV，并总结月结差异。
|
||||
default_prompt: 请对这些收入文件进行对账，并生成月结摘要。</code></pre>
|
||||
|
||||
<h3>验证</h3>
|
||||
<p>使用包含匹配发票、缺失发票、重复发票和仅调整项记录的样例 CSV。确认未解决差异不会被隐藏。</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
</div>
|
||||
|
||||
<section class="review-box">
|
||||
<h2>你的判断</h2>
|
||||
<p class="note">只根据评审标准和页面里可见的两个输出做判断。选择会保存到当前浏览器的本地存储里，也可以回到入口页导出。</p>
|
||||
<div class="controls" role="radiogroup" aria-label="胜出方案">
|
||||
<label><input type="radio" name="winner" value="A"> 方案 A 更好</label>
|
||||
<label><input type="radio" name="winner" value="B"> 方案 B 更好</label>
|
||||
<label><input type="radio" name="winner" value="tie"> 平局 / 没有明显胜出</label>
|
||||
</div>
|
||||
<label for="confidence">信心程度</label>
|
||||
<div class="controls">
|
||||
<select id="confidence">
|
||||
<option value="">请选择</option>
|
||||
<option value="0.4">0.4，较弱</option>
|
||||
<option value="0.6">0.6，中等</option>
|
||||
<option value="0.8">0.8，较强</option>
|
||||
<option value="1.0">1.0，非常确定</option>
|
||||
</select>
|
||||
</div>
|
||||
<label for="reason">理由</label>
|
||||
<textarea id="reason" placeholder="为什么这个方案更好？请写出具体的评审标准差异。"></textarea>
|
||||
<div class="controls">
|
||||
<button class="primary" type="button" onclick="saveDecision()">保存判断</button>
|
||||
<button type="button" onclick="clearDecision()">清空</button>
|
||||
</div>
|
||||
<p id="save-status" class="small note"></p>
|
||||
</section>
|
||||
</main>
|
||||
<script>
|
||||
const caseId = document.body.dataset.caseId;
|
||||
const key = "blindSkillReview:" + caseId;
|
||||
function currentDecision() {
|
||||
const selected = document.querySelector('input[name="winner"]:checked');
|
||||
return {
|
||||
case_id: caseId,
|
||||
winner_variant: selected ? selected.value : "",
|
||||
confidence: document.getElementById("confidence").value,
|
||||
reason: document.getElementById("reason").value.trim(),
|
||||
reviewed_at: new Date().toISOString()
|
||||
};
|
||||
}
|
||||
function saveDecision() {
|
||||
const decision = currentDecision();
|
||||
localStorage.setItem(key, JSON.stringify(decision));
|
||||
document.getElementById("save-status").textContent = "已保存：" + decision.reviewed_at;
|
||||
}
|
||||
function clearDecision() {
|
||||
localStorage.removeItem(key);
|
||||
document.querySelectorAll('input[name="winner"]').forEach(el => el.checked = false);
|
||||
document.getElementById("confidence").value = "";
|
||||
document.getElementById("reason").value = "";
|
||||
document.getElementById("save-status").textContent = "已清空。";
|
||||
}
|
||||
function loadDecision() {
|
||||
const raw = localStorage.getItem(key);
|
||||
if (!raw) return;
|
||||
const decision = JSON.parse(raw);
|
||||
const selected = document.querySelector('input[name="winner"][value="' + decision.winner_variant + '"]');
|
||||
if (selected) selected.checked = true;
|
||||
document.getElementById("confidence").value = decision.confidence || "";
|
||||
document.getElementById("reason").value = decision.reason || "";
|
||||
document.getElementById("save-status").textContent = "已加载保存过的判断。";
|
||||
}
|
||||
loadDecision();
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,356 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>Webinar 内容复用 Skill - Skill 盲测评审</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
</style>
|
||||
</head>
|
||||
<body data-case-id="case-03-webinar-repurposing">
|
||||
<header>
|
||||
<div class="split"><a class="button" href="index.html">返回入口</a><a class="button" href="case-02-monthly-revenue-reconciliation.html">上一个</a><a class="button" href="case-04-incident-postmortem.html">下一个</a></div>
|
||||
<h1>Webinar 内容复用 Skill</h1>
|
||||
<p class="meta">A/B 盲测评审。记录完判断前，不要打开答案钥匙。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<h2>场景</h2>
|
||||
<p>一个市场团队经常把 webinar 逐字稿改写成 LinkedIn 帖子、邮件 teaser 和 newsletter 段落，同时必须保证所有说法都有来源，并避开禁止宣传的 claim。</p>
|
||||
<h3>用户请求</h3>
|
||||
<p>请做一个可复用 skill，把 webinar 逐字稿复用成市场内容。输入包括逐字稿、讲者姓名、产品定位说明和禁止使用的 claim。输出包括 LinkedIn 帖子、邮件 teaser、newsletter 段落、可引用金句和来源依据说明。</p>
|
||||
<h3>评审标准</h3>
|
||||
<ol class="rubric"><li>是否保留来源约束，并处理 banned claims。</li>
|
||||
<li>是否定义可重复的多渠道输出格式。</li>
|
||||
<li>是否把语气和定位资料放到 references，避免入口膨胀。</li>
|
||||
<li>是否有针对幻觉 claim 和泛泛市场文案的评测。</li>
|
||||
<li>是否在中等治理风险下保持 skill 足够轻量。</li></ol>
|
||||
</section>
|
||||
|
||||
<div class="grid" style="margin-top:18px">
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 A</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>建议 Skill：webinar-repurposer</h2>
|
||||
|
||||
<h3>目的</h3>
|
||||
<p>创建一个 skill，把 webinar 逐字稿转成可复用的市场内容。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>webinar-repurposer/
|
||||
SKILL.md
|
||||
agents/openai.yaml
|
||||
references/
|
||||
brand-voice.md
|
||||
banned-claims.md</code></pre>
|
||||
|
||||
<h3>SKILL.md 草稿</h3>
|
||||
<pre><code>---
|
||||
name: webinar-repurposer
|
||||
description: 将 webinar 逐字稿复用成 LinkedIn 帖子、邮件 teaser、newsletter 段落、可引用金句和来源依据说明。当用户提供逐字稿、讲者、定位说明或禁止 claim 时使用。
|
||||
---
|
||||
|
||||
# Webinar 内容复用
|
||||
|
||||
## 工作流
|
||||
1. 阅读逐字稿、讲者姓名、产品定位说明和禁止 claim。
|
||||
2. 提取核心主题、最强的来源支持观点和可用引语。
|
||||
3. 起草一条 LinkedIn 帖子、一段邮件 teaser、一段 newsletter 和若干金句。
|
||||
4. 对照逐字稿和禁止 claim 检查每个说法。
|
||||
5. 为重要 claim 添加来源依据说明。
|
||||
|
||||
## 输出
|
||||
- LinkedIn 帖子
|
||||
- 邮件 teaser
|
||||
- Newsletter 段落
|
||||
- 可引用金句
|
||||
- 来源依据说明
|
||||
- 已避免的 claim
|
||||
|
||||
## 参考资料
|
||||
语气见 `references/brand-voice.md`，禁止 claim 见 `references/banned-claims.md`。</code></pre>
|
||||
|
||||
<h3>agents/openai.yaml</h3>
|
||||
<pre><code>display_name: Webinar 内容复用
|
||||
short_description: 将 webinar 逐字稿转成有来源依据的市场内容。
|
||||
default_prompt: 请把这份 webinar 逐字稿复用成可发布的多渠道市场内容。</code></pre>
|
||||
|
||||
<h3>验证</h3>
|
||||
<p>用包含强金句、证据较弱、以及容易误用禁止 claim 的逐字稿测试。确认输出会避免没有依据的 claim。</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 B</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>Skill 包建议：webinar-repurposer</h2>
|
||||
|
||||
<h3>边界</h3>
|
||||
<p>负责在提供来源逐字稿和定位约束时，把逐字稿复用为市场内容。排除全新 campaign strategy、没有依据的产品 claim、法律审核和一次性文案润色。</p>
|
||||
|
||||
<h3>类型</h3>
|
||||
<p>Production-light。它需要输出质量检查和 banned-claim 防护，但除非涉及受监管 claim 或上市公司披露规则，否则不需要做成很重的 governed 包。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>webinar-repurposer/
|
||||
SKILL.md
|
||||
agents/interface.yaml
|
||||
references/
|
||||
brand-voice.md
|
||||
positioning-notes.md
|
||||
banned-claims.md
|
||||
evals/
|
||||
output/
|
||||
cases.jsonl
|
||||
reports/
|
||||
output-risk-profile.md
|
||||
prompt-quality-profile.md</code></pre>
|
||||
|
||||
<h3>SKILL.md</h3>
|
||||
<pre><code>---
|
||||
name: webinar-repurposer
|
||||
description: 将重复出现的 webinar 逐字稿复用为有来源依据的 LinkedIn 帖子、邮件 teaser、newsletter 段落、金句和 claim 依据说明。当提供逐字稿、讲者、定位说明或禁止 claim 时使用。不要用于无依据的发布 claim、法律审批、全新 campaign strategy 或一次性文案润色。
|
||||
---
|
||||
|
||||
# Webinar 内容复用
|
||||
|
||||
## 工作流
|
||||
1. 确认逐字稿是事实来源。
|
||||
2. 提取有来源支持的主题、讲者背书的引语和可安全复用的 claim。
|
||||
3. 起草前先检查 `references/banned-claims.md`。
|
||||
4. 生成各渠道输出，但不要添加逐字稿中没有的性能数字、客户结果或产品承诺。
|
||||
5. 添加来源依据说明，把每个主要 claim 绑定到逐字稿证据。
|
||||
|
||||
## 必填输出
|
||||
- linkedin_post
|
||||
- email_teaser
|
||||
- newsletter_section
|
||||
- pull_quotes
|
||||
- source_grounding_notes
|
||||
- claims_avoided
|
||||
- missing_evidence</code></pre>
|
||||
|
||||
<h3>输出风险画像</h3>
|
||||
<p>常见失败：</p>
|
||||
<ul>
|
||||
<li>生成任何产品都能用的泛泛市场话术。</li>
|
||||
<li>编造指标或客户结果。</li>
|
||||
<li>过度改写金句，导致意思偏离。</li>
|
||||
<li>因为某个 claim 很有吸引力而忽略 banned claims。</li>
|
||||
</ul>
|
||||
|
||||
<h3>输出评测用例</h3>
|
||||
<p>1. 逐字稿包含诱人的“guaranteed ROI”禁止 claim：输出必须避开。</p>
|
||||
<p>2. 逐字稿没有量化证明：输出不能编造数字。</p>
|
||||
<p>3. 讲者原话不够顺：可以轻微修语法，但必须保留原意。</p>
|
||||
<p>4. 近邻请求：“从零写一个新 campaign idea”不应路由到这里。</p>
|
||||
|
||||
<h3>审查门禁</h3>
|
||||
<ul>
|
||||
<li>必填 section 必须全部出现。</li>
|
||||
<li>Banned claim 检查必须显式出现。</li>
|
||||
<li>来源依据说明必须引用逐字稿位置或原话片段。</li>
|
||||
<li>缺失证据必须被标出，而不是用通用卖点填补。</li>
|
||||
</ul>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
</div>
|
||||
|
||||
<section class="review-box">
|
||||
<h2>你的判断</h2>
|
||||
<p class="note">只根据评审标准和页面里可见的两个输出做判断。选择会保存到当前浏览器的本地存储里，也可以回到入口页导出。</p>
|
||||
<div class="controls" role="radiogroup" aria-label="胜出方案">
|
||||
<label><input type="radio" name="winner" value="A"> 方案 A 更好</label>
|
||||
<label><input type="radio" name="winner" value="B"> 方案 B 更好</label>
|
||||
<label><input type="radio" name="winner" value="tie"> 平局 / 没有明显胜出</label>
|
||||
</div>
|
||||
<label for="confidence">信心程度</label>
|
||||
<div class="controls">
|
||||
<select id="confidence">
|
||||
<option value="">请选择</option>
|
||||
<option value="0.4">0.4，较弱</option>
|
||||
<option value="0.6">0.6，中等</option>
|
||||
<option value="0.8">0.8，较强</option>
|
||||
<option value="1.0">1.0，非常确定</option>
|
||||
</select>
|
||||
</div>
|
||||
<label for="reason">理由</label>
|
||||
<textarea id="reason" placeholder="为什么这个方案更好？请写出具体的评审标准差异。"></textarea>
|
||||
<div class="controls">
|
||||
<button class="primary" type="button" onclick="saveDecision()">保存判断</button>
|
||||
<button type="button" onclick="clearDecision()">清空</button>
|
||||
</div>
|
||||
<p id="save-status" class="small note"></p>
|
||||
</section>
|
||||
</main>
|
||||
<script>
|
||||
const caseId = document.body.dataset.caseId;
|
||||
const key = "blindSkillReview:" + caseId;
|
||||
function currentDecision() {
|
||||
const selected = document.querySelector('input[name="winner"]:checked');
|
||||
return {
|
||||
case_id: caseId,
|
||||
winner_variant: selected ? selected.value : "",
|
||||
confidence: document.getElementById("confidence").value,
|
||||
reason: document.getElementById("reason").value.trim(),
|
||||
reviewed_at: new Date().toISOString()
|
||||
};
|
||||
}
|
||||
function saveDecision() {
|
||||
const decision = currentDecision();
|
||||
localStorage.setItem(key, JSON.stringify(decision));
|
||||
document.getElementById("save-status").textContent = "已保存：" + decision.reviewed_at;
|
||||
}
|
||||
function clearDecision() {
|
||||
localStorage.removeItem(key);
|
||||
document.querySelectorAll('input[name="winner"]').forEach(el => el.checked = false);
|
||||
document.getElementById("confidence").value = "";
|
||||
document.getElementById("reason").value = "";
|
||||
document.getElementById("save-status").textContent = "已清空。";
|
||||
}
|
||||
function loadDecision() {
|
||||
const raw = localStorage.getItem(key);
|
||||
if (!raw) return;
|
||||
const decision = JSON.parse(raw);
|
||||
const selected = document.querySelector('input[name="winner"][value="' + decision.winner_variant + '"]');
|
||||
if (selected) selected.checked = true;
|
||||
document.getElementById("confidence").value = decision.confidence || "";
|
||||
document.getElementById("reason").value = decision.reason || "";
|
||||
document.getElementById("save-status").textContent = "已加载保存过的判断。";
|
||||
}
|
||||
loadDecision();
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,361 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>故障复盘 Skill - Skill 盲测评审</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
</style>
|
||||
</head>
|
||||
<body data-case-id="case-04-incident-postmortem">
|
||||
<header>
|
||||
<div class="split"><a class="button" href="index.html">返回入口</a><a class="button" href="case-03-webinar-repurposing.html">上一个</a><a class="button" href="case-05-pr-review-followup.html">下一个</a></div>
|
||||
<h1>故障复盘 Skill</h1>
|
||||
<p class="meta">A/B 盲测评审。记录完判断前，不要打开答案钥匙。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<h2>场景</h2>
|
||||
<p>一个基础设施团队经常把 Slack 故障时间线、告警数据和部署记录整理成故障复盘和后续行动项。</p>
|
||||
<h3>用户请求</h3>
|
||||
<p>请创建一个可复用的 governed skill，用于故障复盘。输入包括告警时间线、Slack 摘要、部署记录、客户影响说明和负责人列表。输出应包含时间线、影响、根因假设、行动项、未解决证据和后续负责人矩阵。</p>
|
||||
<h3>评审标准</h3>
|
||||
<ol class="rubric"><li>是否处理 governed/运营风险和未解决证据。</li>
|
||||
<li>是否区分假设和已确认根因。</li>
|
||||
<li>是否定义行动项负责人矩阵和回滚/跟进边界。</li>
|
||||
<li>是否要求 file-backed 或 source-backed 证据。</li>
|
||||
<li>是否有针对 blame language 和编造因果的审查门禁。</li></ol>
|
||||
</section>
|
||||
|
||||
<div class="grid" style="margin-top:18px">
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 A</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>Skill 包建议：incident-postmortem</h2>
|
||||
|
||||
<h3>边界</h3>
|
||||
<p>负责根据 source-backed 时间线、Slack 摘要、部署记录、客户影响说明和负责人列表起草 governed 故障复盘。不要用于实时 incident command、最终 RCA 签核、HR/归责分析或面向客户的法律声明。</p>
|
||||
|
||||
<h3>类型</h3>
|
||||
<p>Governed。这个包会影响运营责任归属，如果证据不足，容易制造虚假因果。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>incident-postmortem/
|
||||
SKILL.md
|
||||
agents/interface.yaml
|
||||
references/
|
||||
postmortem-contract.md
|
||||
severity-policy.md
|
||||
blame-free-language.md
|
||||
action-owner-matrix.md
|
||||
evals/
|
||||
output/
|
||||
cases.jsonl
|
||||
fixtures/
|
||||
alert_timeline.json
|
||||
slack_summary.md
|
||||
deploy_notes.md
|
||||
reports/
|
||||
output-risk-profile.md
|
||||
output_quality_scorecard.md
|
||||
trust_report.md
|
||||
review-studio.html</code></pre>
|
||||
|
||||
<h3>SKILL.md</h3>
|
||||
<pre><code>---
|
||||
name: incident-postmortem
|
||||
description: 根据告警时间线、Slack 摘要、部署记录、影响说明和负责人列表起草 governed 故障复盘。用于 source-backed 时间线重建、影响总结、根因假设、行动项、未解决证据和后续负责人矩阵。不要用于实时故障指挥、最终 RCA 审批、归责或法律/客户承诺。
|
||||
---
|
||||
|
||||
# 故障复盘
|
||||
|
||||
## 工作流
|
||||
1. 要求提供 source-backed 故障输入，并把缺失输入列为 `missing evidence`。
|
||||
2. 只根据已提供时间戳建立时间线；如需推断顺序，必须明确标注。
|
||||
3. 分开列出 `confirmed_facts`、`root_cause_hypotheses` 和 `unresolved_evidence`。
|
||||
4. 总结客户影响，但不要编造受影响账户、持续时间或 SLA 违约。
|
||||
5. 创建行动项：包含 owner、due date、验证信号和回滚/跟进边界。
|
||||
6. 使用 `references/blame-free-language.md` 的无责语言。
|
||||
7. 除非 reviewer 明确提供，否则最终 RCA 审批不属于本 skill。
|
||||
|
||||
## 输出契约
|
||||
- incident_summary
|
||||
- source_inputs
|
||||
- timeline
|
||||
- customer_impact
|
||||
- confirmed_facts
|
||||
- root_cause_hypotheses
|
||||
- unresolved_evidence
|
||||
- action_items
|
||||
- owner_matrix
|
||||
- approval_status</code></pre>
|
||||
|
||||
<h3>输出评测用例</h3>
|
||||
<p>1. Slack 和部署记录冲突：必须保留为未解决证据。</p>
|
||||
<p>2. 告警时间线缺恢复时间：不能编造持续时长。</p>
|
||||
<p>3. 用户要求实时故障决策：应路由出去，或说明本 skill 只做复盘。</p>
|
||||
<p>4. 来源材料带有归责语言：输出必须改写为系统/流程语言。</p>
|
||||
<p>5. 缺负责人列表：行动项 owner 字段应为 `missing evidence`。</p>
|
||||
|
||||
<h3>门禁</h3>
|
||||
<ul>
|
||||
<li>时间线和部署记录需要 file-backed fixture 覆盖。</li>
|
||||
<li>输出评测禁止编造因果和隐藏未解决证据。</li>
|
||||
<li>Review Studio 在人工 reviewer 审批行动负责人矩阵前保持 warning。</li>
|
||||
<li>Trust report 应显示无网络和无破坏性操作。</li>
|
||||
</ul>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 B</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>建议 Skill：incident-postmortem</h2>
|
||||
|
||||
<h3>目的</h3>
|
||||
<p>帮助 Codex 根据时间线、Slack 摘要、部署记录、影响说明和负责人列表创建结构化故障复盘。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>incident-postmortem/
|
||||
SKILL.md
|
||||
agents/openai.yaml
|
||||
references/
|
||||
postmortem-template.md
|
||||
severity-policy.md</code></pre>
|
||||
|
||||
<h3>SKILL.md 草稿</h3>
|
||||
<pre><code>---
|
||||
name: incident-postmortem
|
||||
description: 根据告警时间线、Slack 摘要、部署记录、客户影响说明和负责人列表创建故障复盘。当用户需要时间线、影响、根因假设、行动项、未解决证据或负责人矩阵时使用。
|
||||
---
|
||||
|
||||
# 故障复盘
|
||||
|
||||
## 工作流
|
||||
1. 收集告警时间线、Slack 摘要、部署记录、客户影响说明和负责人列表。
|
||||
2. 建立按时间排序的时间线。
|
||||
3. 总结客户和系统影响。
|
||||
4. 识别已确认事实和根因假设。
|
||||
5. 在提供负责人和截止时间时，起草行动项。
|
||||
6. 清楚标记未解决证据。
|
||||
7. 避免归责式语言。
|
||||
|
||||
## 输出
|
||||
- 故障摘要
|
||||
- 时间线
|
||||
- 影响
|
||||
- 根因假设
|
||||
- 已确认事实
|
||||
- 未解决证据
|
||||
- 行动项
|
||||
- 负责人矩阵</code></pre>
|
||||
|
||||
<h3>agents/openai.yaml</h3>
|
||||
<pre><code>display_name: 故障复盘
|
||||
short_description: 根据故障证据生成结构化复盘。
|
||||
default_prompt: 请把这些故障证据整理成复盘和负责人矩阵。</code></pre>
|
||||
|
||||
<h3>验证</h3>
|
||||
<p>用证据完整、缺部署记录、Slack 说法冲突和暂时没有根因的 case 测试。确认 skill 会区分事实和假设。</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
</div>
|
||||
|
||||
<section class="review-box">
|
||||
<h2>你的判断</h2>
|
||||
<p class="note">只根据评审标准和页面里可见的两个输出做判断。选择会保存到当前浏览器的本地存储里，也可以回到入口页导出。</p>
|
||||
<div class="controls" role="radiogroup" aria-label="胜出方案">
|
||||
<label><input type="radio" name="winner" value="A"> 方案 A 更好</label>
|
||||
<label><input type="radio" name="winner" value="B"> 方案 B 更好</label>
|
||||
<label><input type="radio" name="winner" value="tie"> 平局 / 没有明显胜出</label>
|
||||
</div>
|
||||
<label for="confidence">信心程度</label>
|
||||
<div class="controls">
|
||||
<select id="confidence">
|
||||
<option value="">请选择</option>
|
||||
<option value="0.4">0.4，较弱</option>
|
||||
<option value="0.6">0.6，中等</option>
|
||||
<option value="0.8">0.8，较强</option>
|
||||
<option value="1.0">1.0，非常确定</option>
|
||||
</select>
|
||||
</div>
|
||||
<label for="reason">理由</label>
|
||||
<textarea id="reason" placeholder="为什么这个方案更好？请写出具体的评审标准差异。"></textarea>
|
||||
<div class="controls">
|
||||
<button class="primary" type="button" onclick="saveDecision()">保存判断</button>
|
||||
<button type="button" onclick="clearDecision()">清空</button>
|
||||
</div>
|
||||
<p id="save-status" class="small note"></p>
|
||||
</section>
|
||||
</main>
|
||||
<script>
|
||||
const caseId = document.body.dataset.caseId;
|
||||
const key = "blindSkillReview:" + caseId;
|
||||
function currentDecision() {
|
||||
const selected = document.querySelector('input[name="winner"]:checked');
|
||||
return {
|
||||
case_id: caseId,
|
||||
winner_variant: selected ? selected.value : "",
|
||||
confidence: document.getElementById("confidence").value,
|
||||
reason: document.getElementById("reason").value.trim(),
|
||||
reviewed_at: new Date().toISOString()
|
||||
};
|
||||
}
|
||||
function saveDecision() {
|
||||
const decision = currentDecision();
|
||||
localStorage.setItem(key, JSON.stringify(decision));
|
||||
document.getElementById("save-status").textContent = "已保存：" + decision.reviewed_at;
|
||||
}
|
||||
function clearDecision() {
|
||||
localStorage.removeItem(key);
|
||||
document.querySelectorAll('input[name="winner"]').forEach(el => el.checked = false);
|
||||
document.getElementById("confidence").value = "";
|
||||
document.getElementById("reason").value = "";
|
||||
document.getElementById("save-status").textContent = "已清空。";
|
||||
}
|
||||
function loadDecision() {
|
||||
const raw = localStorage.getItem(key);
|
||||
if (!raw) return;
|
||||
const decision = JSON.parse(raw);
|
||||
const selected = document.querySelector('input[name="winner"][value="' + decision.winner_variant + '"]');
|
||||
if (selected) selected.checked = true;
|
||||
document.getElementById("confidence").value = decision.confidence || "";
|
||||
document.getElementById("reason").value = decision.reason || "";
|
||||
document.getElementById("save-status").textContent = "已加载保存过的判断。";
|
||||
}
|
||||
loadDecision();
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,344 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>PR Review 跟进 Skill - Skill 盲测评审</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
</style>
|
||||
</head>
|
||||
<body data-case-id="case-05-pr-review-followup">
|
||||
<header>
|
||||
<div class="split"><a class="button" href="index.html">返回入口</a><a class="button" href="case-04-incident-postmortem.html">上一个</a></div>
|
||||
<h1>PR Review 跟进 Skill</h1>
|
||||
<p class="meta">A/B 盲测评审。记录完判断前，不要打开答案钥匙。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<h2>场景</h2>
|
||||
<p>一个小工程团队经常收到 GitHub PR review comments，希望 Codex 能把评论转成补丁、回复摘要和验证记录。</p>
|
||||
<h3>用户请求</h3>
|
||||
<p>请设计一个用于处理 PR review comments 的可复用 skill。输入包括 review comments、变更文件、失败 CI 说明和 maintainer preferences。输出需要分组评论、只修改相关文件、写回复说明并运行验证。必须避免回滚无关的用户改动。</p>
|
||||
<h3>评审标准</h3>
|
||||
<ol class="rubric"><li>是否理解 code-review 跟进和 dirty worktree 安全。</li>
|
||||
<li>是否定义评论分组、补丁、回复和验证工作流。</li>
|
||||
<li>是否避免过度重构和无关 revert。</li>
|
||||
<li>是否说明变更后需要的命令和证据。</li>
|
||||
<li>是否定义一般 code review 与评论跟进的触发排除。</li></ol>
|
||||
</section>
|
||||
|
||||
<div class="grid" style="margin-top:18px">
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 A</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>建议 Skill：pr-review-followup</h2>
|
||||
|
||||
<h3>目的</h3>
|
||||
<p>创建一个 skill，帮助 Codex 安全处理 PR review comments，并总结回复。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>pr-review-followup/
|
||||
SKILL.md
|
||||
agents/openai.yaml
|
||||
references/
|
||||
response-style.md</code></pre>
|
||||
|
||||
<h3>SKILL.md 草稿</h3>
|
||||
<pre><code>---
|
||||
name: pr-review-followup
|
||||
description: 通过分组反馈、修改相关文件、编写回复说明和运行验证来处理 GitHub PR review comments。当用户提供 review comments、变更文件、CI 说明或 maintainer preferences 时使用。
|
||||
---
|
||||
|
||||
# PR Review 跟进
|
||||
|
||||
## 工作流
|
||||
1. 阅读所有 review comments，并按文件、主题和严重程度分组。
|
||||
2. 编辑前检查受影响文件。
|
||||
3. 只修改处理 comments 所需的文件。
|
||||
4. 不要回滚无关用户改动。
|
||||
5. 运行相关测试或 CI 复现命令。
|
||||
6. 总结变更，并为 reviewer 起草回复说明。
|
||||
|
||||
## 输出
|
||||
- 评论分组
|
||||
- 修改文件
|
||||
- 验证命令
|
||||
- Reviewer 回复说明
|
||||
- 剩余问题</code></pre>
|
||||
|
||||
<h3>agents/openai.yaml</h3>
|
||||
<pre><code>display_name: PR Review 跟进
|
||||
short_description: 处理 PR comments 并准备 reviewer 回复。
|
||||
default_prompt: 请处理这些 PR review comments，并总结验证结果。</code></pre>
|
||||
|
||||
<h3>验证</h3>
|
||||
<p>用需要代码修改、文档修改、无需修改只需解释、以及 reviewer 要求冲突的 comments 测试。</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
|
||||
<section class="variant">
|
||||
<div class="variant-head">
|
||||
<h2>方案 B</h2>
|
||||
<span class="badge">来源已隐藏</span>
|
||||
</div>
|
||||
<div class="variant-body">
|
||||
<h2>Skill 包建议：pr-review-followup</h2>
|
||||
|
||||
<h3>边界</h3>
|
||||
<p>负责 PR 已经有明确 reviewer comments、变更文件或 CI 说明之后的评论跟进。排除首次 code review、大范围重构、issue triage，以及没有绑定评论的推测性清理。</p>
|
||||
|
||||
<h3>包结构</h3>
|
||||
<pre><code>pr-review-followup/
|
||||
SKILL.md
|
||||
agents/interface.yaml
|
||||
references/
|
||||
response-style.md
|
||||
dirty-worktree-safety.md
|
||||
verification-policy.md
|
||||
evals/
|
||||
trigger_cases.json
|
||||
output/
|
||||
cases.jsonl
|
||||
reports/
|
||||
output-risk-profile.md
|
||||
output_quality_scorecard.md</code></pre>
|
||||
|
||||
<h3>SKILL.md</h3>
|
||||
<pre><code>---
|
||||
name: pr-review-followup
|
||||
description: 处理具体 PR review comments：分组反馈、只修改相关文件、保留无关用户改动、起草 reviewer 回复并运行验证。当提供 review comments、变更文件、失败 CI 说明或 maintainer preferences 时使用。不要用于首次 code review、大范围重构、issue triage 或无关清理。
|
||||
---
|
||||
|
||||
# PR Review 跟进
|
||||
|
||||
## 工作流
|
||||
1. 编辑前记录 git status，并识别用户已经改动的文件。
|
||||
2. 按文件、行为、严重程度，以及是否需要代码、测试、文档或仅解释来分组 review comments。
|
||||
3. 修改前阅读受影响代码和附近测试。
|
||||
4. 只修改与评论绑定的文件。不要回滚无关改动，也不要格式化未触碰文件。
|
||||
5. 运行有针对性的验证，并记录命令和结果。
|
||||
6. 起草 reviewer 回复说明，把每组评论映射到变更、无需修改的理由或剩余问题。
|
||||
7. 如果评论冲突，停止并询问哪个 reviewer 指令优先。
|
||||
|
||||
## 输出契约
|
||||
- comment_groups
|
||||
- patch_summary
|
||||
- files_changed
|
||||
- verification
|
||||
- reviewer_response_notes
|
||||
- unresolved_questions
|
||||
- unrelated_changes_preserved</code></pre>
|
||||
|
||||
<h3>输出评测用例</h3>
|
||||
<p>1. 评论要求添加特定 null check：输出必须只修改受影响函数，并提到测试。</p>
|
||||
<p>2. Reviewer 要求与 PR 范围无关的大重构：输出应标出范围风险。</p>
|
||||
<p>3. Dirty worktree 中有无关用户文件：输出必须保留它。</p>
|
||||
<p>4. 两个 reviewer comments 冲突：输出必须询问优先级，而不是猜。</p>
|
||||
<p>5. 近邻请求：“从零 review 这个 PR”不应触发 follow-up mode。</p>
|
||||
|
||||
<h3>门禁</h3>
|
||||
<ul>
|
||||
<li>触发评测必须区分首次 review 和评论跟进。</li>
|
||||
<li>如果回滚或隐藏无关改动，输出评测必须失败。</li>
|
||||
<li>验证策略必须记录跳过测试的原因。</li>
|
||||
<li>回复说明必须能追溯到评论分组。</li>
|
||||
</ul>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
</div>
|
||||
|
||||
<section class="review-box">
|
||||
<h2>你的判断</h2>
|
||||
<p class="note">只根据评审标准和页面里可见的两个输出做判断。选择会保存到当前浏览器的本地存储里，也可以回到入口页导出。</p>
|
||||
<div class="controls" role="radiogroup" aria-label="胜出方案">
|
||||
<label><input type="radio" name="winner" value="A"> 方案 A 更好</label>
|
||||
<label><input type="radio" name="winner" value="B"> 方案 B 更好</label>
|
||||
<label><input type="radio" name="winner" value="tie"> 平局 / 没有明显胜出</label>
|
||||
</div>
|
||||
<label for="confidence">信心程度</label>
|
||||
<div class="controls">
|
||||
<select id="confidence">
|
||||
<option value="">请选择</option>
|
||||
<option value="0.4">0.4，较弱</option>
|
||||
<option value="0.6">0.6，中等</option>
|
||||
<option value="0.8">0.8，较强</option>
|
||||
<option value="1.0">1.0，非常确定</option>
|
||||
</select>
|
||||
</div>
|
||||
<label for="reason">理由</label>
|
||||
<textarea id="reason" placeholder="为什么这个方案更好？请写出具体的评审标准差异。"></textarea>
|
||||
<div class="controls">
|
||||
<button class="primary" type="button" onclick="saveDecision()">保存判断</button>
|
||||
<button type="button" onclick="clearDecision()">清空</button>
|
||||
</div>
|
||||
<p id="save-status" class="small note"></p>
|
||||
</section>
|
||||
</main>
|
||||
<script>
|
||||
const caseId = document.body.dataset.caseId;
|
||||
const key = "blindSkillReview:" + caseId;
|
||||
function currentDecision() {
|
||||
const selected = document.querySelector('input[name="winner"]:checked');
|
||||
return {
|
||||
case_id: caseId,
|
||||
winner_variant: selected ? selected.value : "",
|
||||
confidence: document.getElementById("confidence").value,
|
||||
reason: document.getElementById("reason").value.trim(),
|
||||
reviewed_at: new Date().toISOString()
|
||||
};
|
||||
}
|
||||
function saveDecision() {
|
||||
const decision = currentDecision();
|
||||
localStorage.setItem(key, JSON.stringify(decision));
|
||||
document.getElementById("save-status").textContent = "已保存：" + decision.reviewed_at;
|
||||
}
|
||||
function clearDecision() {
|
||||
localStorage.removeItem(key);
|
||||
document.querySelectorAll('input[name="winner"]').forEach(el => el.checked = false);
|
||||
document.getElementById("confidence").value = "";
|
||||
document.getElementById("reason").value = "";
|
||||
document.getElementById("save-status").textContent = "已清空。";
|
||||
}
|
||||
function loadDecision() {
|
||||
const raw = localStorage.getItem(key);
|
||||
if (!raw) return;
|
||||
const decision = JSON.parse(raw);
|
||||
const selected = document.querySelector('input[name="winner"][value="' + decision.winner_variant + '"]');
|
||||
if (selected) selected.checked = true;
|
||||
document.getElementById("confidence").value = decision.confidence || "";
|
||||
document.getElementById("reason").value = decision.reason || "";
|
||||
document.getElementById("save-status").textContent = "已加载保存过的判断。";
|
||||
}
|
||||
loadDecision();
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
File diff suppressed because it is too large
Load Diff
@@ -0,0 +1,220 @@
|
||||
<!doctype html>
|
||||
<html lang="zh-CN">
|
||||
<head>
|
||||
<meta charset="utf-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1">
|
||||
<title>人工盲测评审包 - Meta Skill 对比</title>
|
||||
<style>
|
||||
:root {
|
||||
color-scheme: light;
|
||||
--bg: #f7f8fb;
|
||||
--panel: #ffffff;
|
||||
--ink: #20242c;
|
||||
--muted: #687082;
|
||||
--line: #d9deea;
|
||||
--accent: #2563eb;
|
||||
--accent-2: #0f766e;
|
||||
--warn: #b45309;
|
||||
}
|
||||
* { box-sizing: border-box; }
|
||||
body {
|
||||
margin: 0;
|
||||
font-family: Inter, ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif;
|
||||
background: var(--bg);
|
||||
color: var(--ink);
|
||||
line-height: 1.55;
|
||||
}
|
||||
header {
|
||||
padding: 28px clamp(18px, 4vw, 52px) 18px;
|
||||
background: #ffffff;
|
||||
border-bottom: 1px solid var(--line);
|
||||
}
|
||||
main { padding: 24px clamp(18px, 4vw, 52px) 52px; }
|
||||
h1 { margin: 0 0 8px; font-size: clamp(26px, 3vw, 38px); letter-spacing: 0; }
|
||||
h2 { margin: 0 0 12px; font-size: 20px; }
|
||||
h3 { margin: 18px 0 8px; font-size: 16px; }
|
||||
p { margin: 0 0 10px; }
|
||||
a { color: var(--accent); text-decoration: none; }
|
||||
a:hover { text-decoration: underline; }
|
||||
.meta, .note { color: var(--muted); }
|
||||
.grid { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 18px; align-items: start; }
|
||||
.card, .panel {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 18px;
|
||||
}
|
||||
.case-list { display: grid; gap: 12px; margin-top: 18px; }
|
||||
.case-row {
|
||||
display: grid;
|
||||
grid-template-columns: 1fr auto;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 14px 16px;
|
||||
}
|
||||
.badge {
|
||||
display: inline-flex;
|
||||
align-items: center;
|
||||
min-height: 28px;
|
||||
padding: 4px 10px;
|
||||
border-radius: 999px;
|
||||
background: #e8f0ff;
|
||||
color: #1d4ed8;
|
||||
font-size: 13px;
|
||||
font-weight: 650;
|
||||
}
|
||||
.rubric { margin: 0; padding-left: 20px; }
|
||||
.rubric li { margin-bottom: 6px; }
|
||||
.variant {
|
||||
background: var(--panel);
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
overflow: hidden;
|
||||
}
|
||||
.variant-head {
|
||||
display: flex;
|
||||
justify-content: space-between;
|
||||
gap: 12px;
|
||||
align-items: center;
|
||||
padding: 12px 16px;
|
||||
border-bottom: 1px solid var(--line);
|
||||
background: #f2f5fa;
|
||||
}
|
||||
.variant-body { padding: 16px; }
|
||||
pre {
|
||||
overflow: auto;
|
||||
padding: 12px;
|
||||
border-radius: 6px;
|
||||
background: #111827;
|
||||
color: #f9fafb;
|
||||
font-size: 13px;
|
||||
}
|
||||
code { font-family: "SFMono-Regular", Consolas, monospace; }
|
||||
.review-box {
|
||||
margin-top: 18px;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 8px;
|
||||
padding: 16px;
|
||||
background: #fff;
|
||||
}
|
||||
.controls { display: flex; flex-wrap: wrap; gap: 10px; margin: 12px 0; }
|
||||
button, .button {
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
background: #fff;
|
||||
color: var(--ink);
|
||||
min-height: 36px;
|
||||
padding: 7px 12px;
|
||||
cursor: pointer;
|
||||
font-weight: 650;
|
||||
}
|
||||
button.primary, .button.primary { background: var(--accent); border-color: var(--accent); color: #fff; }
|
||||
textarea {
|
||||
width: 100%;
|
||||
min-height: 96px;
|
||||
resize: vertical;
|
||||
border: 1px solid var(--line);
|
||||
border-radius: 6px;
|
||||
padding: 10px;
|
||||
font: inherit;
|
||||
}
|
||||
.warn { color: var(--warn); font-weight: 650; }
|
||||
.split { display: flex; flex-wrap: wrap; gap: 10px; }
|
||||
.small { font-size: 13px; }
|
||||
@media (max-width: 900px) {
|
||||
.grid { grid-template-columns: 1fr; }
|
||||
.case-row { grid-template-columns: 1fr; }
|
||||
}
|
||||
</style>
|
||||
</head>
|
||||
<body>
|
||||
<header>
|
||||
<h1>人工盲测评审包</h1>
|
||||
<p class="meta">5 个真实常见的 skill 创建场景。打开答案钥匙前，方案来源都会保持隐藏。</p>
|
||||
</header>
|
||||
<main>
|
||||
<section class="panel">
|
||||
<h2>评审说明</h2>
|
||||
<p>依次打开每个案例，按评审标准比较方案 A 和方案 B，保存胜出方案和理由，然后回到这里导出判断结果。5 个判断全部保存前，不要打开 <code>DO_NOT_OPEN_answer_key.html</code> 或 <code>DO_NOT_OPEN_answer_key.json</code>。</p>
|
||||
<p class="warn">证据边界：这些输出是 Codex 在本地套用两份 skill 说明生成的，适合做人类盲测评审，但不能冒充 provider-backed 的独立模型执行证据。</p>
|
||||
<div class="controls">
|
||||
<button class="primary" type="button" onclick="exportDecisions()">导出已保存判断</button>
|
||||
<a class="button" href="review-decisions-template.json">判断模板</a>
|
||||
<a class="button" href="blind-pack.json">盲测包 JSON</a>
|
||||
</div>
|
||||
<textarea id="export" placeholder="导出的判断结果会显示在这里。"></textarea>
|
||||
</section>
|
||||
<section class="case-list">
|
||||
|
||||
<div class="case-row">
|
||||
<div>
|
||||
<div class="badge">案例 1</div>
|
||||
<h2 style="margin-top:10px">客服工单分诊 Skill</h2>
|
||||
<p class="meta">一个 B2B SaaS 团队每天都要处理客户工单：判断分类、紧急程度、起草首轮回复，并把账务、安全、故障类问题升级给对应负责人。他们希望把这个重复流程做成一个给支持团队使用的 Codex skill。</p>
|
||||
</div>
|
||||
<a class="button primary" href="case-01-support-triage.html">打开报告</a>
|
||||
</div>
|
||||
|
||||
<div class="case-row">
|
||||
<div>
|
||||
<div class="badge">案例 2</div>
|
||||
<h2 style="margin-top:10px">月度收入对账 Skill</h2>
|
||||
<p class="meta">一个财务运营团队每个月结账前都要比对 Stripe 导出、数据仓库发票 CSV 和人工调整表，找出金额、币种、发票和调整项的不一致。</p>
|
||||
</div>
|
||||
<a class="button primary" href="case-02-monthly-revenue-reconciliation.html">打开报告</a>
|
||||
</div>
|
||||
|
||||
<div class="case-row">
|
||||
<div>
|
||||
<div class="badge">案例 3</div>
|
||||
<h2 style="margin-top:10px">Webinar 内容复用 Skill</h2>
|
||||
<p class="meta">一个市场团队经常把 webinar 逐字稿改写成 LinkedIn 帖子、邮件 teaser 和 newsletter 段落，同时必须保证所有说法都有来源，并避开禁止宣传的 claim。</p>
|
||||
</div>
|
||||
<a class="button primary" href="case-03-webinar-repurposing.html">打开报告</a>
|
||||
</div>
|
||||
|
||||
<div class="case-row">
|
||||
<div>
|
||||
<div class="badge">案例 4</div>
|
||||
<h2 style="margin-top:10px">故障复盘 Skill</h2>
|
||||
<p class="meta">一个基础设施团队经常把 Slack 故障时间线、告警数据和部署记录整理成故障复盘和后续行动项。</p>
|
||||
</div>
|
||||
<a class="button primary" href="case-04-incident-postmortem.html">打开报告</a>
|
||||
</div>
|
||||
|
||||
<div class="case-row">
|
||||
<div>
|
||||
<div class="badge">案例 5</div>
|
||||
<h2 style="margin-top:10px">PR Review 跟进 Skill</h2>
|
||||
<p class="meta">一个小工程团队经常收到 GitHub PR review comments，希望 Codex 能把评论转成补丁、回复摘要和验证记录。</p>
|
||||
</div>
|
||||
<a class="button primary" href="case-05-pr-review-followup.html">打开报告</a>
|
||||
</div>
|
||||
|
||||
</section>
|
||||
</main>
|
||||
<script>
|
||||
const caseIds = ["case-01-support-triage", "case-02-monthly-revenue-reconciliation", "case-03-webinar-repurposing", "case-04-incident-postmortem", "case-05-pr-review-followup"];
|
||||
function exportDecisions() {
|
||||
const decisions = caseIds.map(id => {
|
||||
const raw = localStorage.getItem("blindSkillReview:" + id);
|
||||
return raw ? JSON.parse(raw) : { case_id: id, winner_variant: "", confidence: "", reason: "", reviewed_at: "" };
|
||||
});
|
||||
const payload = {
|
||||
schema_version: "1.0",
|
||||
review_pack: "blind-human-review-2026-06-29",
|
||||
reviewer: "",
|
||||
blind_review_attestation: {
|
||||
answer_key_not_opened_before_decisions: false,
|
||||
completed_before_answer_key: false
|
||||
},
|
||||
decisions
|
||||
};
|
||||
document.getElementById("export").value = JSON.stringify(payload, null, 2);
|
||||
}
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
@@ -0,0 +1,42 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"review_pack": "blind-human-review-2026-06-29",
|
||||
"reviewer": "",
|
||||
"reviewed_at": "",
|
||||
"blind_review_attestation": {
|
||||
"answer_key_not_opened_before_decisions": false,
|
||||
"completed_before_answer_key": false
|
||||
},
|
||||
"decisions": [
|
||||
{
|
||||
"case_id": "case-01-support-triage",
|
||||
"winner_variant": "",
|
||||
"confidence": "",
|
||||
"reason": ""
|
||||
},
|
||||
{
|
||||
"case_id": "case-02-monthly-revenue-reconciliation",
|
||||
"winner_variant": "",
|
||||
"confidence": "",
|
||||
"reason": ""
|
||||
},
|
||||
{
|
||||
"case_id": "case-03-webinar-repurposing",
|
||||
"winner_variant": "",
|
||||
"confidence": "",
|
||||
"reason": ""
|
||||
},
|
||||
{
|
||||
"case_id": "case-04-incident-postmortem",
|
||||
"winner_variant": "",
|
||||
"confidence": "",
|
||||
"reason": ""
|
||||
},
|
||||
{
|
||||
"case_id": "case-05-pr-review-followup",
|
||||
"winner_variant": "",
|
||||
"confidence": "",
|
||||
"reason": ""
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -0,0 +1,55 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"review_pack": "blind-human-review-2026-06-29",
|
||||
"reviewer": "single human reviewer",
|
||||
"reviewed_at": "2026-06-29T03:01:03.037Z",
|
||||
"recorded_at": "2026-06-29T03:04:34Z",
|
||||
"blind_review_attestation": {
|
||||
"answer_key_not_opened_before_decisions": true,
|
||||
"completed_before_answer_key": true,
|
||||
"attestation_source": "User confirmed in chat after decisions were submitted: 确认：我是在完成五个判断之后才让你打开答案钥匙的，评审前没有看来源。以上 5 个判断都是揭晓来源前完成的。"
|
||||
},
|
||||
"limitations": {
|
||||
"reviewer_count": 1,
|
||||
"reasons_present": false,
|
||||
"reason_gap": "The reviewer selected winners with confidence 1.0, but per-case rationale fields were left empty.",
|
||||
"execution_boundary": "Outputs were generated locally from two skill instruction files. This is human blind A/B review evidence, not provider-backed independent model execution evidence."
|
||||
},
|
||||
"decisions": [
|
||||
{
|
||||
"case_id": "case-01-support-triage",
|
||||
"winner_variant": "B",
|
||||
"confidence": "1.0",
|
||||
"reason": "",
|
||||
"reviewed_at": "2026-06-29T03:00:00.994Z"
|
||||
},
|
||||
{
|
||||
"case_id": "case-02-monthly-revenue-reconciliation",
|
||||
"winner_variant": "A",
|
||||
"confidence": "1.0",
|
||||
"reason": "",
|
||||
"reviewed_at": "2026-06-29T03:00:18.277Z"
|
||||
},
|
||||
{
|
||||
"case_id": "case-03-webinar-repurposing",
|
||||
"winner_variant": "B",
|
||||
"confidence": "1.0",
|
||||
"reason": "",
|
||||
"reviewed_at": "2026-06-29T03:00:34.343Z"
|
||||
},
|
||||
{
|
||||
"case_id": "case-04-incident-postmortem",
|
||||
"winner_variant": "A",
|
||||
"confidence": "1.0",
|
||||
"reason": "",
|
||||
"reviewed_at": "2026-06-29T03:00:49.160Z"
|
||||
},
|
||||
{
|
||||
"case_id": "case-05-pr-review-followup",
|
||||
"winner_variant": "B",
|
||||
"confidence": "1.0",
|
||||
"reason": "",
|
||||
"reviewed_at": "2026-06-29T03:01:03.037Z"
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -3,9 +3,9 @@
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"winner_label": "Current",
|
||||
"winner_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"winner_tokens": 53,
|
||||
"current_tokens": 53,
|
||||
"winner_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"winner_tokens": 54,
|
||||
"current_tokens": 54,
|
||||
"winner_holdout_fp": 0,
|
||||
"winner_holdout_fn": 0,
|
||||
"current_holdout_fp": 0,
|
||||
@@ -36,44 +36,44 @@
|
||||
"calibration": {
|
||||
"holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 0.908,
|
||||
"mean_non_trigger_score": 0.003,
|
||||
"mean_near_neighbor_score": 0.006,
|
||||
"min_positive_score": 0.767,
|
||||
"max_non_trigger_score": 0.023,
|
||||
"score_gap": 0.744,
|
||||
"threshold_margin": 0.307,
|
||||
"positive_threshold_buffer": 0.437,
|
||||
"negative_threshold_buffer": 0.307,
|
||||
"mean_positive_score": 0.704,
|
||||
"mean_non_trigger_score": 0.0,
|
||||
"mean_near_neighbor_score": 0.0,
|
||||
"min_positive_score": 0.465,
|
||||
"max_non_trigger_score": 0.0,
|
||||
"score_gap": 0.465,
|
||||
"threshold_margin": 0.135,
|
||||
"positive_threshold_buffer": 0.135,
|
||||
"negative_threshold_buffer": 0.33,
|
||||
"boundary_case_count": 0,
|
||||
"boundary_case_rate": 0.0,
|
||||
"risk_band": "healthy"
|
||||
},
|
||||
"blind_holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 0.669,
|
||||
"mean_non_trigger_score": 0.116,
|
||||
"mean_near_neighbor_score": 0.152,
|
||||
"min_positive_score": 0.665,
|
||||
"max_non_trigger_score": 0.305,
|
||||
"score_gap": 0.36,
|
||||
"threshold_margin": 0.025,
|
||||
"positive_threshold_buffer": 0.335,
|
||||
"negative_threshold_buffer": 0.025,
|
||||
"boundary_case_count": 1,
|
||||
"boundary_case_rate": 0.167,
|
||||
"risk_band": "tight"
|
||||
"mean_positive_score": 0.377,
|
||||
"mean_non_trigger_score": 0.024,
|
||||
"mean_near_neighbor_score": 0.006,
|
||||
"min_positive_score": 0.374,
|
||||
"max_non_trigger_score": 0.084,
|
||||
"score_gap": 0.29,
|
||||
"threshold_margin": 0.044,
|
||||
"positive_threshold_buffer": 0.044,
|
||||
"negative_threshold_buffer": 0.246,
|
||||
"boundary_case_count": 2,
|
||||
"boundary_case_rate": 0.333,
|
||||
"risk_band": "watch"
|
||||
},
|
||||
"adversarial_holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 1.0,
|
||||
"mean_positive_score": 0.81,
|
||||
"mean_non_trigger_score": 0.0,
|
||||
"mean_near_neighbor_score": 0.0,
|
||||
"min_positive_score": 1.0,
|
||||
"min_positive_score": 0.808,
|
||||
"max_non_trigger_score": 0.0,
|
||||
"score_gap": 1.0,
|
||||
"score_gap": 0.808,
|
||||
"threshold_margin": 0.33,
|
||||
"positive_threshold_buffer": 0.67,
|
||||
"positive_threshold_buffer": 0.478,
|
||||
"negative_threshold_buffer": 0.33,
|
||||
"boundary_case_count": 0,
|
||||
"boundary_case_rate": 0.0,
|
||||
@@ -164,7 +164,7 @@
|
||||
"route_metrics": {
|
||||
"precision": 1.0,
|
||||
"recall": 1.0,
|
||||
"average_margin": 0.701,
|
||||
"average_margin": 0.644,
|
||||
"misroute_count": 0,
|
||||
"ambiguous_case_count": 0
|
||||
}
|
||||
@@ -187,8 +187,8 @@
|
||||
"label": "Current",
|
||||
"ranking_state": "selected_by_dev",
|
||||
"promotion_state": "kept_current",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"tokens": 53,
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"tokens": 54,
|
||||
"dev_errors": 0,
|
||||
"holdout_errors": 0,
|
||||
"reason_tags": []
|
||||
@@ -696,7 +696,7 @@
|
||||
"route_metrics": {
|
||||
"precision": 1.0,
|
||||
"recall": 1.0,
|
||||
"average_margin": 0.586,
|
||||
"average_margin": 0.709,
|
||||
"misroute_count": 0,
|
||||
"ambiguous_case_count": 0
|
||||
}
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
| Target | Role | Label | Ranking State | Promotion State | Tokens | Dev Errors | Holdout Errors | Reason Tags |
|
||||
| --- | --- | --- | --- | --- | ---: | ---: | ---: | --- |
|
||||
| `yao-meta-skill` | baseline | `Baseline` | reference | reference | 8 | 1 | 0 | - |
|
||||
| `yao-meta-skill` | current | `Current` | selected_by_dev | kept_current | 53 | 0 | 0 | - |
|
||||
| `yao-meta-skill` | current | `Current` | selected_by_dev | kept_current | 54 | 0 | 0 | - |
|
||||
| `yao-meta-skill` | candidate | `Minimal` | not_selected | blocked | 41 | 2 | 0 | weaker_dev_fit |
|
||||
| `yao-meta-skill` | candidate | `Guardrail` | not_selected | blocked | 56 | 2 | 0 | weaker_dev_fit, longer_without_gain |
|
||||
| `yao-meta-skill` | candidate | `Balanced` | not_selected | blocked | 60 | 2 | 0 | weaker_dev_fit, longer_without_gain |
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-06-13",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"target_count": 5,
|
||||
@@ -38,10 +38,10 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"job_to_be_done": "Turn repeated workflows, prompts, transcripts, runbooks, documents, or existing skill packages into routeable, evaluable, packageable, and governable agent skills for personal, team, library, or governed reuse.",
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"should_trigger": [
|
||||
"Create a skill from this repeated workflow.",
|
||||
"Turn this runbook into a reusable agent skill.",
|
||||
@@ -77,17 +77,17 @@
|
||||
},
|
||||
"workflow": {
|
||||
"steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"decision_points": [
|
||||
"Route by frontmatter `description`.",
|
||||
"Keep `SKILL.md` lean; put guidance in `references/`, logic in `scripts/`, and evidence in `reports/`.",
|
||||
"Use the lightest reliable process.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infrastructure. `Governed`: high-trust, policy-sensitive, or release-critical.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infra. `Governed`: high-trust/release-critical.",
|
||||
"Rules: [Method](references/skill-engineering-method.md), [Operating Modes](references/operating-modes.md), [Resource Boundaries](references/resource-boundaries.md).",
|
||||
"Ask one focused clarification when the real job, output, or exclusion boundary is unclear.",
|
||||
"Escalate visible tradeoffs when benchmark patterns conflict with local privacy, naming, or governance constraints.",
|
||||
@@ -623,7 +623,7 @@
|
||||
"native_surface": "OpenAI-style interface metadata plus neutral Agent Skills source",
|
||||
"activation": {
|
||||
"policy": "Use frontmatter description for catalog routing and targets/openai/agents/openai.yaml for display name, default prompt, and compatibility metadata.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -881,7 +881,7 @@
|
||||
"native_surface": "OpenAI-style interface metadata plus neutral Agent Skills source",
|
||||
"activation": {
|
||||
"policy": "Use frontmatter description for catalog routing and targets/openai/agents/openai.yaml for display name, default prompt, and compatibility metadata.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -995,10 +995,10 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"job_to_be_done": "Turn repeated workflows, prompts, transcripts, runbooks, documents, or existing skill packages into routeable, evaluable, packageable, and governable agent skills for personal, team, library, or governed reuse.",
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"should_trigger": [
|
||||
"Create a skill from this repeated workflow.",
|
||||
"Turn this runbook into a reusable agent skill.",
|
||||
@@ -1034,17 +1034,17 @@
|
||||
},
|
||||
"workflow": {
|
||||
"steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"decision_points": [
|
||||
"Route by frontmatter `description`.",
|
||||
"Keep `SKILL.md` lean; put guidance in `references/`, logic in `scripts/`, and evidence in `reports/`.",
|
||||
"Use the lightest reliable process.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infrastructure. `Governed`: high-trust, policy-sensitive, or release-critical.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infra. `Governed`: high-trust/release-critical.",
|
||||
"Rules: [Method](references/skill-engineering-method.md), [Operating Modes](references/operating-modes.md), [Resource Boundaries](references/resource-boundaries.md).",
|
||||
"Ask one focused clarification when the real job, output, or exclusion boundary is unclear.",
|
||||
"Escalate visible tradeoffs when benchmark patterns conflict with local privacy, naming, or governance constraints.",
|
||||
@@ -1580,7 +1580,7 @@
|
||||
"native_surface": "Claude-compatible neutral source folder with adapter notes",
|
||||
"activation": {
|
||||
"policy": "Use SKILL.md frontmatter description as the primary activation contract and adapter.json for review metadata.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -1838,7 +1838,7 @@
|
||||
"native_surface": "Claude-compatible neutral source folder with adapter notes",
|
||||
"activation": {
|
||||
"policy": "Use SKILL.md frontmatter description as the primary activation contract and adapter.json for review metadata.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -1952,10 +1952,10 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"job_to_be_done": "Turn repeated workflows, prompts, transcripts, runbooks, documents, or existing skill packages into routeable, evaluable, packageable, and governable agent skills for personal, team, library, or governed reuse.",
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"should_trigger": [
|
||||
"Create a skill from this repeated workflow.",
|
||||
"Turn this runbook into a reusable agent skill.",
|
||||
@@ -1991,17 +1991,17 @@
|
||||
},
|
||||
"workflow": {
|
||||
"steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"decision_points": [
|
||||
"Route by frontmatter `description`.",
|
||||
"Keep `SKILL.md` lean; put guidance in `references/`, logic in `scripts/`, and evidence in `reports/`.",
|
||||
"Use the lightest reliable process.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infrastructure. `Governed`: high-trust, policy-sensitive, or release-critical.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infra. `Governed`: high-trust/release-critical.",
|
||||
"Rules: [Method](references/skill-engineering-method.md), [Operating Modes](references/operating-modes.md), [Resource Boundaries](references/resource-boundaries.md).",
|
||||
"Ask one focused clarification when the real job, output, or exclusion boundary is unclear.",
|
||||
"Escalate visible tradeoffs when benchmark patterns conflict with local privacy, naming, or governance constraints.",
|
||||
@@ -2537,7 +2537,7 @@
|
||||
"native_surface": "Agent Skills compatible neutral package",
|
||||
"activation": {
|
||||
"policy": "Use SKILL.md name and description; consumers decide automatic or manual activation.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -2788,7 +2788,7 @@
|
||||
"native_surface": "Agent Skills compatible neutral package",
|
||||
"activation": {
|
||||
"policy": "Use SKILL.md name and description; consumers decide automatic or manual activation.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -2893,10 +2893,10 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"job_to_be_done": "Turn repeated workflows, prompts, transcripts, runbooks, documents, or existing skill packages into routeable, evaluable, packageable, and governable agent skills for personal, team, library, or governed reuse.",
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"should_trigger": [
|
||||
"Create a skill from this repeated workflow.",
|
||||
"Turn this runbook into a reusable agent skill.",
|
||||
@@ -2932,17 +2932,17 @@
|
||||
},
|
||||
"workflow": {
|
||||
"steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"decision_points": [
|
||||
"Route by frontmatter `description`.",
|
||||
"Keep `SKILL.md` lean; put guidance in `references/`, logic in `scripts/`, and evidence in `reports/`.",
|
||||
"Use the lightest reliable process.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infrastructure. `Governed`: high-trust, policy-sensitive, or release-critical.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infra. `Governed`: high-trust/release-critical.",
|
||||
"Rules: [Method](references/skill-engineering-method.md), [Operating Modes](references/operating-modes.md), [Resource Boundaries](references/resource-boundaries.md).",
|
||||
"Ask one focused clarification when the real job, output, or exclusion boundary is unclear.",
|
||||
"Escalate visible tradeoffs when benchmark patterns conflict with local privacy, naming, or governance constraints.",
|
||||
@@ -3478,7 +3478,7 @@
|
||||
"native_surface": "Agent Skills standard source tree",
|
||||
"activation": {
|
||||
"policy": "Use SKILL.md frontmatter name and description for progressive disclosure.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -3729,7 +3729,7 @@
|
||||
"native_surface": "Agent Skills standard source tree",
|
||||
"activation": {
|
||||
"policy": "Use SKILL.md frontmatter name and description for progressive disclosure.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -3834,10 +3834,10 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"job_to_be_done": "Turn repeated workflows, prompts, transcripts, runbooks, documents, or existing skill packages into routeable, evaluable, packageable, and governable agent skills for personal, team, library, or governed reuse.",
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"should_trigger": [
|
||||
"Create a skill from this repeated workflow.",
|
||||
"Turn this runbook into a reusable agent skill.",
|
||||
@@ -3873,17 +3873,17 @@
|
||||
},
|
||||
"workflow": {
|
||||
"steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"decision_points": [
|
||||
"Route by frontmatter `description`.",
|
||||
"Keep `SKILL.md` lean; put guidance in `references/`, logic in `scripts/`, and evidence in `reports/`.",
|
||||
"Use the lightest reliable process.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infrastructure. `Governed`: high-trust, policy-sensitive, or release-critical.",
|
||||
"`Scaffold`: exploratory/personal. `Production`: team reuse. `Library`: shared infra. `Governed`: high-trust/release-critical.",
|
||||
"Rules: [Method](references/skill-engineering-method.md), [Operating Modes](references/operating-modes.md), [Resource Boundaries](references/resource-boundaries.md).",
|
||||
"Ask one focused clarification when the real job, output, or exclusion boundary is unclear.",
|
||||
"Escalate visible tradeoffs when benchmark patterns conflict with local privacy, naming, or governance constraints.",
|
||||
@@ -4419,7 +4419,7 @@
|
||||
"native_surface": "VS Code/Copilot Agent Skills project or user scope",
|
||||
"activation": {
|
||||
"policy": "Use folder name plus SKILL.md name/description; keep description under platform limits.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
@@ -4674,7 +4674,7 @@
|
||||
"native_surface": "VS Code/Copilot Agent Skills project or user scope",
|
||||
"activation": {
|
||||
"policy": "Use folder name plus SKILL.md name/description; keep description under platform limits.",
|
||||
"trigger_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"trigger_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"manual_activation_supported": true,
|
||||
"automatic_activation_note": "Depends on the target client route/catalog implementation."
|
||||
},
|
||||
|
||||
@@ -5,11 +5,11 @@
|
||||
"stats": {
|
||||
"context_budget_tier": "production",
|
||||
"context_budget_limit": 1000,
|
||||
"skill_body_tokens": 805,
|
||||
"other_text_tokens": 1169049,
|
||||
"estimated_initial_load_tokens": 998,
|
||||
"estimated_total_text_tokens": 1169854,
|
||||
"deferred_resource_tokens": 530871,
|
||||
"skill_body_tokens": 794,
|
||||
"other_text_tokens": 1200569,
|
||||
"estimated_initial_load_tokens": 987,
|
||||
"estimated_total_text_tokens": 1201363,
|
||||
"deferred_resource_tokens": 531767,
|
||||
"deferred_resource_warn_threshold": 120000,
|
||||
"deferred_resource_dirs": [
|
||||
{
|
||||
@@ -24,7 +24,7 @@
|
||||
},
|
||||
{
|
||||
"path": "evals",
|
||||
"estimated_tokens": 21835,
|
||||
"estimated_tokens": 22731,
|
||||
"file_count": 27
|
||||
},
|
||||
{
|
||||
@@ -66,9 +66,9 @@
|
||||
],
|
||||
"summary": "Large deferred resources are indexed and backed by evidence."
|
||||
},
|
||||
"relevant_file_count": 571,
|
||||
"relevant_file_count": 591,
|
||||
"unused_resource_dirs": [],
|
||||
"quality_signal_points": 140,
|
||||
"quality_density": 140.3
|
||||
"quality_density": 141.8
|
||||
}
|
||||
}
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
|
||||
| Target | Path | Tier | Limit | Initial | SKILL | Deferred | Resource Governance | Large Deferred Dirs | Quality Density | Unused Dirs | Status |
|
||||
| --- | --- | --- | ---: | ---: | ---: | ---: | --- | --- | ---: | --- | --- |
|
||||
| root | `.` | `production` | 1000 | 998 | 805 | 530871 | `governed` | scripts:469568 | 140.3 | - | ok |
|
||||
| root | `.` | `production` | 1000 | 987 | 794 | 531767 | `governed` | scripts:469568 | 141.8 | - | ok |
|
||||
| complex-release-orchestrator | `examples/complex-release-orchestrator/generated-skill` | `production` | 1000 | 790 | 718 | 1657 | `not-required` | - | 164.6 | - | ok |
|
||||
| governed-incident-command | `examples/governed-incident-command/generated-skill` | `production` | 1000 | 760 | 658 | 1030 | `not-required` | - | 171.1 | - | ok |
|
||||
|
||||
|
||||
@@ -1,14 +1,14 @@
|
||||
{
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-03-31",
|
||||
"targets": [
|
||||
{
|
||||
"label": "root",
|
||||
"path": ".",
|
||||
"budget_tier": "production",
|
||||
"budget_limit": 1000,
|
||||
"initial_tokens": 998,
|
||||
"skill_body_tokens": 805,
|
||||
"deferred_resource_tokens": 530871,
|
||||
"initial_tokens": 987,
|
||||
"skill_body_tokens": 794,
|
||||
"deferred_resource_tokens": 531767,
|
||||
"large_deferred_resource_dirs": [
|
||||
{
|
||||
"path": "scripts",
|
||||
@@ -42,7 +42,7 @@
|
||||
],
|
||||
"summary": "Large deferred resources are indexed and backed by evidence."
|
||||
},
|
||||
"quality_density": 140.3,
|
||||
"quality_density": 141.8,
|
||||
"unused_resource_dirs": [],
|
||||
"ok": true,
|
||||
"warnings": []
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@@ -2,19 +2,19 @@
|
||||
|
||||
Winner: `Current`
|
||||
|
||||
- current tokens: `53`
|
||||
- winner tokens: `53`
|
||||
- current tokens: `54`
|
||||
- winner tokens: `54`
|
||||
- baseline tokens: `8`
|
||||
|
||||
## Winner
|
||||
|
||||
Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
|
||||
## Candidate Ranking
|
||||
|
||||
| Candidate | Tokens | Dev FP | Dev FN | Dev Near | Holdout FP | Holdout FN |
|
||||
| --- | ---: | ---: | ---: | ---: | ---: | ---: |
|
||||
| `Current` | 53 | 0 | 0 | 1.0 | 0 | 0 |
|
||||
| `Current` | 54 | 0 | 0 | 1.0 | 0 | 0 |
|
||||
| `Minimal` | 41 | 1 | 1 | 1.0 | 0 | 0 |
|
||||
| `Guardrail` | 56 | 1 | 1 | 1.0 | 0 | 0 |
|
||||
| `Balanced` | 60 | 1 | 1 | 1.0 | 0 | 0 |
|
||||
@@ -34,9 +34,9 @@ Create, refactor, evaluate, and package agent skills from workflows, prompts, tr
|
||||
|
||||
| Gate | Winner Gap | Winner Risk | Winner Boundary Rate | Current Gap | Baseline Gap |
|
||||
| --- | ---: | --- | ---: | ---: | ---: |
|
||||
| Holdout | 0.744 | healthy | 0.0 | 0.744 | 0.416 |
|
||||
| Blind Holdout | 0.36 | tight | 0.167 | 0.36 | 0.368 |
|
||||
| Adversarial Holdout | 1.0 | healthy | 0.0 | 1.0 | 0.845 |
|
||||
| Holdout | 0.465 | healthy | 0.0 | 0.465 | 0.416 |
|
||||
| Blind Holdout | 0.29 | watch | 0.333 | 0.29 | 0.368 |
|
||||
| Adversarial Holdout | 0.808 | healthy | 0.0 | 0.808 | 0.845 |
|
||||
|
||||
## Judge Blind Summary
|
||||
|
||||
|
||||
@@ -3,9 +3,9 @@
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"winner_label": "Current",
|
||||
"winner_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"winner_tokens": 53,
|
||||
"current_tokens": 53,
|
||||
"winner_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"winner_tokens": 54,
|
||||
"current_tokens": 54,
|
||||
"winner_holdout_fp": 0,
|
||||
"winner_holdout_fn": 0,
|
||||
"current_holdout_fp": 0,
|
||||
@@ -36,44 +36,44 @@
|
||||
"calibration": {
|
||||
"holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 0.908,
|
||||
"mean_non_trigger_score": 0.003,
|
||||
"mean_near_neighbor_score": 0.006,
|
||||
"min_positive_score": 0.767,
|
||||
"max_non_trigger_score": 0.023,
|
||||
"score_gap": 0.744,
|
||||
"threshold_margin": 0.307,
|
||||
"positive_threshold_buffer": 0.437,
|
||||
"negative_threshold_buffer": 0.307,
|
||||
"mean_positive_score": 0.704,
|
||||
"mean_non_trigger_score": 0.0,
|
||||
"mean_near_neighbor_score": 0.0,
|
||||
"min_positive_score": 0.465,
|
||||
"max_non_trigger_score": 0.0,
|
||||
"score_gap": 0.465,
|
||||
"threshold_margin": 0.135,
|
||||
"positive_threshold_buffer": 0.135,
|
||||
"negative_threshold_buffer": 0.33,
|
||||
"boundary_case_count": 0,
|
||||
"boundary_case_rate": 0.0,
|
||||
"risk_band": "healthy"
|
||||
},
|
||||
"blind_holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 0.669,
|
||||
"mean_non_trigger_score": 0.116,
|
||||
"mean_near_neighbor_score": 0.152,
|
||||
"min_positive_score": 0.665,
|
||||
"max_non_trigger_score": 0.305,
|
||||
"score_gap": 0.36,
|
||||
"threshold_margin": 0.025,
|
||||
"positive_threshold_buffer": 0.335,
|
||||
"negative_threshold_buffer": 0.025,
|
||||
"boundary_case_count": 1,
|
||||
"boundary_case_rate": 0.167,
|
||||
"risk_band": "tight"
|
||||
"mean_positive_score": 0.377,
|
||||
"mean_non_trigger_score": 0.024,
|
||||
"mean_near_neighbor_score": 0.006,
|
||||
"min_positive_score": 0.374,
|
||||
"max_non_trigger_score": 0.084,
|
||||
"score_gap": 0.29,
|
||||
"threshold_margin": 0.044,
|
||||
"positive_threshold_buffer": 0.044,
|
||||
"negative_threshold_buffer": 0.246,
|
||||
"boundary_case_count": 2,
|
||||
"boundary_case_rate": 0.333,
|
||||
"risk_band": "watch"
|
||||
},
|
||||
"adversarial_holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 1.0,
|
||||
"mean_positive_score": 0.81,
|
||||
"mean_non_trigger_score": 0.0,
|
||||
"mean_near_neighbor_score": 0.0,
|
||||
"min_positive_score": 1.0,
|
||||
"min_positive_score": 0.808,
|
||||
"max_non_trigger_score": 0.0,
|
||||
"score_gap": 1.0,
|
||||
"score_gap": 0.808,
|
||||
"threshold_margin": 0.33,
|
||||
"positive_threshold_buffer": 0.67,
|
||||
"positive_threshold_buffer": 0.478,
|
||||
"negative_threshold_buffer": 0.33,
|
||||
"boundary_case_count": 0,
|
||||
"boundary_case_rate": 0.0,
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
|
||||
| Target | Winner | Winner Tokens | Holdout FP | Holdout FN | Blind FP | Blind FN | Judge Blind Errors | Adv FP | Adv FN | Adv Gap | Adv Risk | Status |
|
||||
| --- | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | --- | --- |
|
||||
| `yao-meta-skill` | `Current` | 53 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1.0 | healthy | ok |
|
||||
| `yao-meta-skill` | `Current` | 54 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.808 | healthy | ok |
|
||||
| `team-frontend-review` | `Current` | 50 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.509 | healthy | ok |
|
||||
| `governed-incident-command` | `Current` | 37 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0.538 | watch | ok |
|
||||
|
||||
|
||||
+328
-297
File diff suppressed because it is too large
Load Diff
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"check_count": 39,
|
||||
@@ -324,12 +324,12 @@
|
||||
"status": "pass",
|
||||
"expected": {
|
||||
"status": "pass",
|
||||
"detail": "initial load 998/1000; deferred 530871/120000; top deferred scripts 469568; resource governance governed; quality density 140.3",
|
||||
"detail": "initial load 987/1000; deferred 531767/120000; top deferred scripts 469568; resource governance governed; quality density 141.8",
|
||||
"evidence": "reports/context_budget.json"
|
||||
},
|
||||
"actual": {
|
||||
"status": "pass",
|
||||
"detail": "initial load 998/1000; deferred 530871/120000; top deferred scripts 469568; resource governance governed; quality density 140.3",
|
||||
"detail": "initial load 987/1000; deferred 531767/120000; top deferred scripts 469568; resource governance governed; quality density 141.8",
|
||||
"evidence": "reports/context_budget.json"
|
||||
},
|
||||
"paths": [
|
||||
@@ -342,8 +342,8 @@
|
||||
"key": "benchmark-release-lock-self-consistency",
|
||||
"label": "Benchmark release lock matches source dirty state",
|
||||
"status": "pass",
|
||||
"expected": true,
|
||||
"actual": true,
|
||||
"expected": false,
|
||||
"actual": false,
|
||||
"paths": [
|
||||
"reports/benchmark_reproducibility.json"
|
||||
],
|
||||
@@ -357,7 +357,7 @@
|
||||
"actual": {
|
||||
"available": true,
|
||||
"clean": false,
|
||||
"changed_file_count": 21
|
||||
"changed_file_count": 39
|
||||
},
|
||||
"paths": [
|
||||
"reports/benchmark_reproducibility.json"
|
||||
@@ -398,8 +398,8 @@
|
||||
"key": "overview-benchmark-commit",
|
||||
"label": "overview embeds the benchmark commit",
|
||||
"status": "pass",
|
||||
"expected": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"actual": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"expected": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"actual": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"paths": [
|
||||
"reports/benchmark_reproducibility.json",
|
||||
"reports/skill-overview.json"
|
||||
@@ -411,36 +411,36 @@
|
||||
"label": "overview embeds benchmark summary fields",
|
||||
"status": "pass",
|
||||
"expected": {
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"source_contract_sha256": "b5cfa61c532d9ecd55d4d3a91aaf249bab0393251319a0f391422edb07a9e658",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"world_class_ledger_pending_count": 4,
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3
|
||||
"public_claim_blocker_count": 4
|
||||
},
|
||||
"actual": {
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"source_contract_sha256": "b5cfa61c532d9ecd55d4d3a91aaf249bab0393251319a0f391422edb07a9e658",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"world_class_ledger_pending_count": 4,
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3
|
||||
"public_claim_blocker_count": 4
|
||||
},
|
||||
"paths": [
|
||||
"reports/benchmark_reproducibility.json",
|
||||
@@ -550,8 +550,8 @@
|
||||
"key": "interpretation-benchmark-commit",
|
||||
"label": "interpretation embeds the benchmark commit",
|
||||
"status": "pass",
|
||||
"expected": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"actual": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"expected": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"actual": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"paths": [
|
||||
"reports/benchmark_reproducibility.json",
|
||||
"reports/skill-interpretation.json"
|
||||
@@ -563,36 +563,36 @@
|
||||
"label": "interpretation embeds benchmark summary fields",
|
||||
"status": "pass",
|
||||
"expected": {
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"source_contract_sha256": "b5cfa61c532d9ecd55d4d3a91aaf249bab0393251319a0f391422edb07a9e658",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"world_class_ledger_pending_count": 4,
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3
|
||||
"public_claim_blocker_count": 4
|
||||
},
|
||||
"actual": {
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"source_contract_sha256": "b5cfa61c532d9ecd55d4d3a91aaf249bab0393251319a0f391422edb07a9e658",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"world_class_ledger_pending_count": 4,
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3
|
||||
"public_claim_blocker_count": 4
|
||||
},
|
||||
"paths": [
|
||||
"reports/benchmark_reproducibility.json",
|
||||
@@ -739,7 +739,7 @@
|
||||
"label": "可维护性",
|
||||
"score": 100,
|
||||
"reasons": [
|
||||
"SKILL.md 约 339 个词/字。",
|
||||
"SKILL.md 约 314 个词/字。",
|
||||
"入口文件保持克制，可维护性较好。",
|
||||
"references/ 已承载扩展指导。",
|
||||
"scripts/ 已承载确定性逻辑。",
|
||||
@@ -760,7 +760,7 @@
|
||||
"label": "上下文成本",
|
||||
"score": 42,
|
||||
"reasons": [
|
||||
"入口约 339 个词/字，references 约 16934 个词/字。",
|
||||
"入口约 314 个词/字，references 约 16934 个词/字。",
|
||||
"分数越高代表上下文成本越低。",
|
||||
"上下文成本偏高，建议压缩入口或拆分 references。"
|
||||
]
|
||||
@@ -803,7 +803,7 @@
|
||||
"label": "可维护性",
|
||||
"score": 100,
|
||||
"reasons": [
|
||||
"SKILL.md 约 339 个词/字。",
|
||||
"SKILL.md 约 314 个词/字。",
|
||||
"入口文件保持克制，可维护性较好。",
|
||||
"references/ 已承载扩展指导。",
|
||||
"scripts/ 已承载确定性逻辑。",
|
||||
@@ -824,7 +824,7 @@
|
||||
"label": "上下文成本",
|
||||
"score": 42,
|
||||
"reasons": [
|
||||
"入口约 339 个词/字，references 约 16934 个词/字。",
|
||||
"入口约 314 个词/字，references 约 16934 个词/字。",
|
||||
"分数越高代表上下文成本越低。",
|
||||
"上下文成本偏高，建议压缩入口或拆分 references。"
|
||||
]
|
||||
@@ -954,7 +954,7 @@
|
||||
"status": "pass",
|
||||
"expected": {
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"activation": "manual",
|
||||
"execution": "inline",
|
||||
"shell": "bash"
|
||||
@@ -982,7 +982,7 @@
|
||||
"boundary_cards": [
|
||||
{
|
||||
"label": "Owned",
|
||||
"body": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"body": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
},
|
||||
{
|
||||
"label": "Adjacent",
|
||||
@@ -996,7 +996,7 @@
|
||||
},
|
||||
"actual": {
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"activation": "manual",
|
||||
"execution": "inline",
|
||||
"shell": "bash"
|
||||
@@ -1024,7 +1024,7 @@
|
||||
"boundary_cards": [
|
||||
{
|
||||
"label": "Owned",
|
||||
"body": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"body": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
},
|
||||
{
|
||||
"label": "Adjacent",
|
||||
@@ -1056,7 +1056,7 @@
|
||||
"已生成 Output Review Adjudication，可记录盲评决策、一致率和待评审项。"
|
||||
],
|
||||
"gaps": [
|
||||
"上下文成本需要补强：入口约 339 个词/字，references 约 16934 个词/字。"
|
||||
"上下文成本需要补强：入口约 314 个词/字，references 约 16934 个词/字。"
|
||||
],
|
||||
"recommendations": [
|
||||
"先改触发边界，再扩展工作流。",
|
||||
@@ -1104,7 +1104,7 @@
|
||||
"已生成 Output Review Adjudication，可记录盲评决策、一致率和待评审项。"
|
||||
],
|
||||
"gaps": [
|
||||
"上下文成本需要补强：入口约 339 个词/字，references 约 16934 个词/字。"
|
||||
"上下文成本需要补强：入口约 314 个词/字，references 约 16934 个词/字。"
|
||||
],
|
||||
"recommendations": [
|
||||
"先改触发边界，再扩展工作流。",
|
||||
@@ -1179,7 +1179,7 @@
|
||||
"name": "包体膨胀风险",
|
||||
"impact": 2,
|
||||
"probability": 1,
|
||||
"signal": "SKILL.md 约 339 个词/字。",
|
||||
"signal": "SKILL.md 约 314 个词/字。",
|
||||
"response": "先补证据和边界，再增加包体复杂度。"
|
||||
},
|
||||
{
|
||||
@@ -1338,7 +1338,7 @@
|
||||
"name": "包体膨胀风险",
|
||||
"impact": 2,
|
||||
"probability": 1,
|
||||
"signal": "SKILL.md 约 339 个词/字。",
|
||||
"signal": "SKILL.md 约 314 个词/字。",
|
||||
"response": "先补证据和边界，再增加包体复杂度。"
|
||||
},
|
||||
{
|
||||
@@ -1680,10 +1680,10 @@
|
||||
"path": "reports",
|
||||
"label": "Generated evidence and overview artifacts",
|
||||
"kind": "folder",
|
||||
"file_count": 152
|
||||
"file_count": 170
|
||||
}
|
||||
],
|
||||
"file_count": 375,
|
||||
"file_count": 393,
|
||||
"folder_count": 4,
|
||||
"distribution": [
|
||||
{
|
||||
@@ -1716,7 +1716,7 @@
|
||||
},
|
||||
{
|
||||
"label": "reports",
|
||||
"value": 152
|
||||
"value": 170
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -1768,10 +1768,10 @@
|
||||
"path": "reports",
|
||||
"label": "Generated evidence and overview artifacts",
|
||||
"kind": "folder",
|
||||
"file_count": 152
|
||||
"file_count": 170
|
||||
}
|
||||
],
|
||||
"file_count": 375,
|
||||
"file_count": 393,
|
||||
"folder_count": 4,
|
||||
"distribution": [
|
||||
{
|
||||
@@ -1804,7 +1804,7 @@
|
||||
},
|
||||
{
|
||||
"label": "reports",
|
||||
"value": 152
|
||||
"value": 170
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -1989,10 +1989,10 @@
|
||||
"label": "Benchmark separates beta testing from public claims",
|
||||
"status": "pass",
|
||||
"expected": {
|
||||
"beta_test_ready": true,
|
||||
"beta_test_ready": false,
|
||||
"public_claim_ready": false,
|
||||
"human_review_complete": false,
|
||||
"beta_release_ready": true,
|
||||
"beta_release_ready": false,
|
||||
"beta_release_scope": "beta/public test release without superiority, fully-reviewed, or world-class claims",
|
||||
"deferred_evidence_keys": [
|
||||
"human-adjudication",
|
||||
@@ -2003,10 +2003,10 @@
|
||||
"deferred_human_review": true
|
||||
},
|
||||
"actual": {
|
||||
"beta_test_ready": true,
|
||||
"beta_test_ready": false,
|
||||
"public_claim_ready": false,
|
||||
"human_review_complete": false,
|
||||
"beta_release_ready": true,
|
||||
"beta_release_ready": false,
|
||||
"beta_release_scope": "beta/public test release without superiority, fully-reviewed, or world-class claims",
|
||||
"deferred_evidence_keys": [
|
||||
"human-adjudication",
|
||||
@@ -3585,7 +3585,7 @@
|
||||
"`0` permission failures",
|
||||
"`25` required artifacts",
|
||||
"`23` reproduction commands",
|
||||
"initial load `998/1000`",
|
||||
"initial load `987/1000`",
|
||||
"target count is `83`"
|
||||
],
|
||||
"actual": "all present",
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Evidence Consistency
|
||||
|
||||
Generated at: `2026-06-21`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,14 +1,14 @@
|
||||
{
|
||||
"ok": true,
|
||||
"schema_version": "2.0",
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-06-13",
|
||||
"skill_dir": ".",
|
||||
"package_dir": "dist",
|
||||
"install_root": "dist/install-simulation/simulate-yao-meta-skill",
|
||||
"installed_skill_dir": "dist/install-simulation/simulate-yao-meta-skill/yao-meta-skill",
|
||||
"package_dir": "tests/tmp_review_studio/dist",
|
||||
"install_root": "tests/tmp_review_studio/install-root/simulate-yao-meta-skill",
|
||||
"installed_skill_dir": "tests/tmp_review_studio/install-root/simulate-yao-meta-skill/yao-meta-skill",
|
||||
"summary": {
|
||||
"archive_present": true,
|
||||
"archive_entry_count": 580,
|
||||
"archive_entry_count": 598,
|
||||
"nested_skill_entry_count": 0,
|
||||
"archive_extracted": true,
|
||||
"entrypoint_loaded": true,
|
||||
@@ -27,7 +27,7 @@
|
||||
{
|
||||
"id": "archive-present",
|
||||
"status": "pass",
|
||||
"detail": "Package archive exists: dist/yao-meta-skill.zip"
|
||||
"detail": "Package archive exists: tests/tmp_review_studio/dist/yao-meta-skill.zip"
|
||||
},
|
||||
{
|
||||
"id": "archive-safe-paths",
|
||||
@@ -278,9 +278,9 @@
|
||||
"failures": [],
|
||||
"warnings": [],
|
||||
"artifacts": {
|
||||
"archive": "dist/yao-meta-skill.zip",
|
||||
"package_manifest": "dist/manifest.json",
|
||||
"json": "reports/install_simulation.json",
|
||||
"markdown": "reports/install_simulation.md"
|
||||
"archive": "tests/tmp_review_studio/dist/yao-meta-skill.zip",
|
||||
"package_manifest": "tests/tmp_review_studio/dist/manifest.json",
|
||||
"json": "tests/tmp_review_studio/install_simulation.json",
|
||||
"markdown": "tests/tmp_review_studio/install_simulation.md"
|
||||
}
|
||||
}
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
# Install Simulation
|
||||
|
||||
- OK: `True`
|
||||
- Package directory: `dist`
|
||||
- Package directory: `tests/tmp_review_studio/dist`
|
||||
- Archive extracted: `True`
|
||||
- Nested SKILL.md entries: `0`
|
||||
- Entrypoint loaded: `True`
|
||||
@@ -17,7 +17,7 @@
|
||||
|
||||
| Check | Status | Detail |
|
||||
| --- | --- | --- |
|
||||
| `archive-present` | `pass` | Package archive exists: dist/yao-meta-skill.zip |
|
||||
| `archive-present` | `pass` | Package archive exists: tests/tmp_review_studio/dist/yao-meta-skill.zip |
|
||||
| `archive-safe-paths` | `pass` | Archive has no absolute or parent-traversal entries |
|
||||
| `single-skill-entrypoint` | `pass` | Installed package exposes only the root SKILL.md entrypoint |
|
||||
| `single-top-level` | `pass` | Archive top-level directory is yao-meta-skill |
|
||||
|
||||
@@ -35,8 +35,8 @@
|
||||
"label": "Current",
|
||||
"ranking_state": "selected_by_dev",
|
||||
"promotion_state": "kept_current",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"tokens": 53,
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"tokens": 54,
|
||||
"dev_errors": 0,
|
||||
"holdout_errors": 0,
|
||||
"reason_tags": []
|
||||
@@ -118,8 +118,8 @@
|
||||
],
|
||||
"review_template": {
|
||||
"target": "yao-meta-skill",
|
||||
"current_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"candidate_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"current_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"candidate_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"focus": [
|
||||
"no_candidate_outperformed_current"
|
||||
]
|
||||
|
||||
@@ -27,7 +27,7 @@
|
||||
| Role | Label | Ranking State | Promotion State | Tokens | Dev Errors | Holdout Errors |
|
||||
| --- | --- | --- | --- | ---: | ---: | ---: |
|
||||
| baseline | `Baseline` | reference | reference | 8 | 1 | 0 |
|
||||
| current | `Current` | selected_by_dev | kept_current | 53 | 0 | 0 |
|
||||
| current | `Current` | selected_by_dev | kept_current | 54 | 0 | 0 |
|
||||
| candidate | `Minimal` | not_selected | blocked | 41 | 2 | 0 |
|
||||
| candidate | `Guardrail` | not_selected | blocked | 56 | 2 | 0 |
|
||||
| candidate | `Balanced` | not_selected | blocked | 60 | 2 | 0 |
|
||||
@@ -37,8 +37,8 @@
|
||||
## Human Review Stub
|
||||
|
||||
- target: yao-meta-skill
|
||||
- current description: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
- candidate description: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
- current description: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
- candidate description: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
- review focus: no_candidate_outperformed_current
|
||||
|
||||
## Artifact Paths
|
||||
|
||||
@@ -1,8 +1,8 @@
|
||||
# Human Review
|
||||
|
||||
- target: yao-meta-skill
|
||||
- current description: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
- candidate description: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
- current description: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
- candidate description: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
- suggested focus: no_candidate_outperformed_current
|
||||
|
||||
Use the shared template in `references/human-review-template.md` to complete the final decision.
|
||||
|
||||
@@ -43,7 +43,7 @@
|
||||
|
||||
| Route | Precision | Recall | Avg Margin |
|
||||
| --- | ---: | ---: | ---: |
|
||||
| `yao-meta-skill` | 1.0 | 1.0 | 0.701 |
|
||||
| `yao-meta-skill` | 1.0 | 1.0 | 0.644 |
|
||||
| `team-frontend-review` | 1.0 | 1.0 | 0.805 |
|
||||
| `governed-incident-command` | 1.0 | 1.0 | 0.586 |
|
||||
| `governed-incident-command` | 1.0 | 1.0 | 0.709 |
|
||||
| `no_route` | 1.0 | 1.0 | - |
|
||||
|
||||
@@ -9,9 +9,9 @@
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"winner_label": "Current",
|
||||
"winner_description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"winner_tokens": 53,
|
||||
"current_tokens": 53,
|
||||
"winner_description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"winner_tokens": 54,
|
||||
"current_tokens": 54,
|
||||
"winner_holdout_fp": 0,
|
||||
"winner_holdout_fn": 0,
|
||||
"current_holdout_fp": 0,
|
||||
@@ -42,44 +42,44 @@
|
||||
"calibration": {
|
||||
"holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 0.908,
|
||||
"mean_non_trigger_score": 0.003,
|
||||
"mean_near_neighbor_score": 0.006,
|
||||
"min_positive_score": 0.767,
|
||||
"max_non_trigger_score": 0.023,
|
||||
"score_gap": 0.744,
|
||||
"threshold_margin": 0.307,
|
||||
"positive_threshold_buffer": 0.437,
|
||||
"negative_threshold_buffer": 0.307,
|
||||
"mean_positive_score": 0.704,
|
||||
"mean_non_trigger_score": 0.0,
|
||||
"mean_near_neighbor_score": 0.0,
|
||||
"min_positive_score": 0.465,
|
||||
"max_non_trigger_score": 0.0,
|
||||
"score_gap": 0.465,
|
||||
"threshold_margin": 0.135,
|
||||
"positive_threshold_buffer": 0.135,
|
||||
"negative_threshold_buffer": 0.33,
|
||||
"boundary_case_count": 0,
|
||||
"boundary_case_rate": 0.0,
|
||||
"risk_band": "healthy"
|
||||
},
|
||||
"blind_holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 0.669,
|
||||
"mean_non_trigger_score": 0.116,
|
||||
"mean_near_neighbor_score": 0.152,
|
||||
"min_positive_score": 0.665,
|
||||
"max_non_trigger_score": 0.305,
|
||||
"score_gap": 0.36,
|
||||
"threshold_margin": 0.025,
|
||||
"positive_threshold_buffer": 0.335,
|
||||
"negative_threshold_buffer": 0.025,
|
||||
"boundary_case_count": 1,
|
||||
"boundary_case_rate": 0.167,
|
||||
"risk_band": "tight"
|
||||
"mean_positive_score": 0.377,
|
||||
"mean_non_trigger_score": 0.024,
|
||||
"mean_near_neighbor_score": 0.006,
|
||||
"min_positive_score": 0.374,
|
||||
"max_non_trigger_score": 0.084,
|
||||
"score_gap": 0.29,
|
||||
"threshold_margin": 0.044,
|
||||
"positive_threshold_buffer": 0.044,
|
||||
"negative_threshold_buffer": 0.246,
|
||||
"boundary_case_count": 2,
|
||||
"boundary_case_rate": 0.333,
|
||||
"risk_band": "watch"
|
||||
},
|
||||
"adversarial_holdout": {
|
||||
"threshold": 0.33,
|
||||
"mean_positive_score": 1.0,
|
||||
"mean_positive_score": 0.81,
|
||||
"mean_non_trigger_score": 0.0,
|
||||
"mean_near_neighbor_score": 0.0,
|
||||
"min_positive_score": 1.0,
|
||||
"min_positive_score": 0.808,
|
||||
"max_non_trigger_score": 0.0,
|
||||
"score_gap": 1.0,
|
||||
"score_gap": 0.808,
|
||||
"threshold_margin": 0.33,
|
||||
"positive_threshold_buffer": 0.67,
|
||||
"positive_threshold_buffer": 0.478,
|
||||
"negative_threshold_buffer": 0.33,
|
||||
"boundary_case_count": 0,
|
||||
"boundary_case_rate": 0.0,
|
||||
@@ -170,7 +170,7 @@
|
||||
"route_metrics": {
|
||||
"precision": 1.0,
|
||||
"recall": 1.0,
|
||||
"average_margin": 0.701,
|
||||
"average_margin": 0.644,
|
||||
"misroute_count": 0,
|
||||
"ambiguous_case_count": 0
|
||||
}
|
||||
@@ -193,8 +193,8 @@
|
||||
"label": "Current",
|
||||
"ranking_state": "selected_by_dev",
|
||||
"promotion_state": "kept_current",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"tokens": 53,
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"tokens": 54,
|
||||
"dev_errors": 0,
|
||||
"holdout_errors": 0,
|
||||
"reason_tags": []
|
||||
@@ -702,7 +702,7 @@
|
||||
"route_metrics": {
|
||||
"precision": 1.0,
|
||||
"recall": 1.0,
|
||||
"average_margin": 0.586,
|
||||
"average_margin": 0.709,
|
||||
"misroute_count": 0,
|
||||
"ambiguous_case_count": 0
|
||||
}
|
||||
|
||||
@@ -1,5 +1,5 @@
|
||||
{
|
||||
"skill_name": "yao-meta-skill-operator-ux-worktree",
|
||||
"skill_name": "yao-meta-skill-trigger-coverage-merge",
|
||||
"relevance": "prompt-aware",
|
||||
"primary_task_family": {
|
||||
"key": "execution_operation",
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Prompt Quality Profile
|
||||
|
||||
Skill: `yao-meta-skill-operator-ux-worktree`
|
||||
Skill: `yao-meta-skill-trigger-coverage-merge`
|
||||
Relevance: `prompt-aware`
|
||||
Overall quality score: `89.0/100`
|
||||
|
||||
|
||||
@@ -5,7 +5,7 @@
|
||||
"root": ".",
|
||||
"summary": {
|
||||
"target_python": "3.11",
|
||||
"file_count": 234,
|
||||
"file_count": 235,
|
||||
"issue_count": 0,
|
||||
"syntax_error_count": 0,
|
||||
"fstring_311_violation_count": 0,
|
||||
@@ -34,6 +34,12 @@
|
||||
"issue_count": 0,
|
||||
"issues": []
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/generate_pack.py",
|
||||
"ok": true,
|
||||
"issue_count": 0,
|
||||
"issues": []
|
||||
},
|
||||
{
|
||||
"path": "scripts/adaptation_patch_safety.py",
|
||||
"ok": true,
|
||||
|
||||
@@ -6,7 +6,7 @@ Generated at: `2026-06-13`
|
||||
|
||||
- decision: `pass`
|
||||
- target python: `3.11`
|
||||
- files scanned: `234`
|
||||
- files scanned: `235`
|
||||
- issues: `0`
|
||||
- syntax errors: `0`
|
||||
- f-string 3.11 violations: `0`
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
{
|
||||
"skill_name": "yao-meta-skill",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"intent_confidence": {
|
||||
"score": 100,
|
||||
"band": "high",
|
||||
@@ -50,39 +50,41 @@
|
||||
},
|
||||
{
|
||||
"source_type": "research",
|
||||
"name": "Human-in-the-loop verification",
|
||||
"name": "Hypothesis-test-learn loop",
|
||||
"evidence_mode": "curated-pattern-track",
|
||||
"matched_keywords": [
|
||||
"review",
|
||||
"govern"
|
||||
"test",
|
||||
"iteration"
|
||||
],
|
||||
"borrow": "Borrow a review checkpoint wherever trust matters more than raw speed.",
|
||||
"avoid": "Do not force every skill through heavyweight review when the risk is low.",
|
||||
"why_relevant": "This track matches: review, govern."
|
||||
"borrow": "Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.",
|
||||
"avoid": "Do not create experimental overhead that exceeds the skill's real risk tier.",
|
||||
"why_relevant": "This track matches: test, iteration."
|
||||
},
|
||||
{
|
||||
"source_type": "principles",
|
||||
"name": "Boundary-first design",
|
||||
"evidence_mode": "curated-pattern-track",
|
||||
"matched_keywords": [
|
||||
"route"
|
||||
"route",
|
||||
"trigger",
|
||||
"exclude"
|
||||
],
|
||||
"borrow": "Borrow the discipline of defining what the skill should not own before growing the package.",
|
||||
"avoid": "Do not expand execution assets until route boundaries stay clean.",
|
||||
"why_relevant": "This track matches: route."
|
||||
"why_relevant": "This track matches: route, trigger, exclude."
|
||||
}
|
||||
],
|
||||
"synthesis": {
|
||||
"borrow_now": [
|
||||
"Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.",
|
||||
"Borrow a review checkpoint wherever trust matters more than raw speed.",
|
||||
"Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.",
|
||||
"Borrow the discipline of defining what the skill should not own before growing the package.",
|
||||
"Borrow the way it turns a messy workflow into a repeatable operating path.",
|
||||
"Borrow the clear execution entrypoints and command structure."
|
||||
],
|
||||
"avoid_now": [
|
||||
"Do not let packaging or platform concerns swallow the core job boundary.",
|
||||
"Do not force every skill through heavyweight review when the risk is low.",
|
||||
"Do not create experimental overhead that exceeds the skill's real risk tier.",
|
||||
"Do not expand execution assets until route boundaries stay clean.",
|
||||
"Do not import process overhead that only exists for that project's scale.",
|
||||
"Do not copy repo-specific commands or environment assumptions verbatim."
|
||||
@@ -118,10 +120,10 @@
|
||||
"score": 4
|
||||
},
|
||||
{
|
||||
"name": "Human-in-the-loop verification",
|
||||
"name": "Hypothesis-test-learn loop",
|
||||
"source_type": "research",
|
||||
"borrow": "Borrow a review checkpoint wherever trust matters more than raw speed.",
|
||||
"avoid": "Do not force every skill through heavyweight review when the risk is low.",
|
||||
"borrow": "Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.",
|
||||
"avoid": "Do not create experimental overhead that exceeds the skill's real risk tier.",
|
||||
"gates": {
|
||||
"recurrence": true,
|
||||
"generativity": true,
|
||||
@@ -235,11 +237,11 @@
|
||||
"summary": "Start by borrowing this pattern: Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts. Avoid this for the first pass: Do not let packaging or platform concerns swallow the core job boundary.",
|
||||
"borrow_now": [
|
||||
"Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.",
|
||||
"Borrow a review checkpoint wherever trust matters more than raw speed."
|
||||
"Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed."
|
||||
],
|
||||
"avoid_for_now": [
|
||||
"Do not let packaging or platform concerns swallow the core job boundary.",
|
||||
"Do not force every skill through heavyweight review when the risk is low."
|
||||
"Do not create experimental overhead that exceeds the skill's real risk tier."
|
||||
],
|
||||
"why": "There is a real design conflict to resolve: The stated preference leans lightweight or speed-first, while the benchmark mix leans toward governance, review, or heavier evaluation structure.",
|
||||
"user_decision_required": true
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
# Reference Synthesis
|
||||
|
||||
Skill: `yao-meta-skill`
|
||||
- Description: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.
|
||||
- Description: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.
|
||||
- Intent confidence: `100/100` (`high`)
|
||||
|
||||
## Live GitHub Benchmarks
|
||||
@@ -33,24 +33,24 @@ Skill: `yao-meta-skill`
|
||||
- Borrow: Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.
|
||||
- Avoid: Do not let packaging or platform concerns swallow the core job boundary.
|
||||
|
||||
### Human-in-the-loop verification
|
||||
### Hypothesis-test-learn loop
|
||||
- Type: `research`
|
||||
- Evidence mode: `curated-pattern-track`
|
||||
- Why relevant: This track matches: review, govern.
|
||||
- Borrow: Borrow a review checkpoint wherever trust matters more than raw speed.
|
||||
- Avoid: Do not force every skill through heavyweight review when the risk is low.
|
||||
- Why relevant: This track matches: test, iteration.
|
||||
- Borrow: Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.
|
||||
- Avoid: Do not create experimental overhead that exceeds the skill's real risk tier.
|
||||
|
||||
### Boundary-first design
|
||||
- Type: `principles`
|
||||
- Evidence mode: `curated-pattern-track`
|
||||
- Why relevant: This track matches: route.
|
||||
- Why relevant: This track matches: route, trigger, exclude.
|
||||
- Borrow: Borrow the discipline of defining what the skill should not own before growing the package.
|
||||
- Avoid: Do not expand execution assets until route boundaries stay clean.
|
||||
|
||||
## Borrow Now
|
||||
|
||||
- Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.
|
||||
- Borrow a review checkpoint wherever trust matters more than raw speed.
|
||||
- Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.
|
||||
- Borrow the discipline of defining what the skill should not own before growing the package.
|
||||
- Borrow the way it turns a messy workflow into a repeatable operating path.
|
||||
- Borrow the clear execution entrypoints and command structure.
|
||||
@@ -58,7 +58,7 @@ Skill: `yao-meta-skill`
|
||||
## Avoid Now
|
||||
|
||||
- Do not let packaging or platform concerns swallow the core job boundary.
|
||||
- Do not force every skill through heavyweight review when the risk is low.
|
||||
- Do not create experimental overhead that exceeds the skill's real risk tier.
|
||||
- Do not expand execution assets until route boundaries stay clean.
|
||||
- Do not import process overhead that only exists for that project's scale.
|
||||
- Do not copy repo-specific commands or environment assumptions verbatim.
|
||||
@@ -69,7 +69,7 @@ Skill: `yao-meta-skill`
|
||||
- Acceptance threshold: `4/4`
|
||||
- Accepted patterns:
|
||||
- **Official skill anatomy and context discipline**: 4/4 (recurrence, generativity, distinctiveness, boundary)
|
||||
- **Human-in-the-loop verification**: 4/4 (recurrence, generativity, distinctiveness, boundary)
|
||||
- **Hypothesis-test-learn loop**: 4/4 (recurrence, generativity, distinctiveness, boundary)
|
||||
- **Boundary-first design**: 4/4 (recurrence, generativity, distinctiveness, boundary)
|
||||
- **obra/superpowers**: 4/4 (recurrence, generativity, distinctiveness, boundary)
|
||||
- **affaan-m/ECC**: 4/4 (recurrence, generativity, distinctiveness, boundary)
|
||||
|
||||
@@ -7,7 +7,7 @@
|
||||
"schema_version": "2.0",
|
||||
"name": "yao-meta-skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"targets": [
|
||||
"openai",
|
||||
"claude",
|
||||
@@ -21,7 +21,7 @@
|
||||
"trust_level": "local",
|
||||
"license": "MIT",
|
||||
"checksums": {
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7"
|
||||
},
|
||||
"compatibility": {
|
||||
@@ -58,11 +58,11 @@
|
||||
"install_simulated": true,
|
||||
"install_simulation": "reports/install_simulation.json"
|
||||
},
|
||||
"generated_at": "2026-06-21"
|
||||
"generated_at": "2026-06-13"
|
||||
},
|
||||
"index": {
|
||||
"schema_version": "2.0",
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-06-13",
|
||||
"package_count": 1,
|
||||
"packages": [
|
||||
{
|
||||
@@ -78,7 +78,7 @@
|
||||
"vscode"
|
||||
],
|
||||
"package_metadata": "registry/packages/yao-meta-skill.json",
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
}
|
||||
]
|
||||
},
|
||||
|
||||
@@ -6,7 +6,7 @@
|
||||
- Maturity: `governed`
|
||||
- Owner: `Yao Team`
|
||||
- License: `MIT`
|
||||
- Package SHA256: `eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383`
|
||||
- Package SHA256: `db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c`
|
||||
- Archive SHA256: `c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7`
|
||||
- Install simulated: `True`
|
||||
|
||||
|
||||
+13
-13
@@ -762,7 +762,7 @@
|
||||
<header id="overview">
|
||||
<div class="eyebrow">Review Studio 2.0</div>
|
||||
<h1>Yao Meta Skill</h1>
|
||||
<p class="lede">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</p>
|
||||
<p class="lede">Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</p>
|
||||
<div class="decision">
|
||||
<span>审查结论</span>
|
||||
<strong>review</strong>
|
||||
@@ -772,12 +772,12 @@
|
||||
|
||||
<section>
|
||||
<h2>核心指标</h2>
|
||||
<div class="metrics"><article class='metric'><span>Skill IR</span><strong>2.0.0</strong><p>5 targets in platform-neutral contract</p></article><article class='metric'><span>Compiler</span><strong>5/5</strong><p>target contracts compiled from Skill IR</p></article><article class='metric'><span>Output Delta</span><strong>100.0</strong><p>5 cases; 1 file-backed</p></article><article class='metric'><span>Exec Runs</span><strong>10</strong><p>command 10; model 10; recorded 0</p></article><article class='metric'><span>Blind A/B</span><strong>5</strong><p>review pairs hide baseline vs with-skill labels</p></article><article class='metric'><span>Review Kit</span><strong>0/5</strong><p>pending 5; answer key hidden</p></article><article class='metric'><span>Review A/B</span><strong>0/5</strong><p>adjudication decisions; pending 5</p></article><article class='metric'><span>Public Claim</span><strong>blocked</strong><p>3 blockers; local reproducible true</p></article><article class='metric'><span>Blueprint</span><strong>21/21</strong><p>2.0 coverage; extensions partial 0, planned 0; evidence pending 4</p></article><article class='metric'><span>Runtime</span><strong>5/5</strong><p>target conformance pass rate</p></article><article class='metric'><span>Perm Probe</span><strong>4/4</strong><p>0 native; 4 installer-enforced</p></article><article class='metric'><span>Trust</span><strong>0</strong><p>155 scripts scanned; secrets found</p></article><article class='metric'><span>Py Compat</span><strong>0</strong><p>234 files scanned for Python 3.11</p></article><article class='metric'><span>Arch Debt</span><strong>0</strong><p>719 largest lines; 0 watchlist; 6 early; 71 CLI handlers; 18 in entrypoint</p></article><article class='metric'><span>Atlas</span><strong>5</strong><p>11 scanned skills; route collisions</p></article><article class='metric'><span>Drift</span><strong>low</strong><p>1 metadata events; 0 missed triggers</p></article><article class='metric'><span>Daily Ops</span><strong>5</strong><p>proposal-review; approval 0; release lock true</p></article><article class='metric'><span>Weekly Queue</span><strong>5</strong><p>curator-review; ready 1; top score 88</p></article><article class='metric'><span>Waivers</span><strong>0</strong><p>0 gates covered; human risk decisions</p></article><article class='metric'><span>Intake</span><strong>4/4</strong><p>0 valid submissions; 0 invalid</p></article><article class='metric'><span>Claim Guard</span><strong>0</strong><p>184 public surfaces scanned</p></article><article class='metric'><span>Notes</span><strong>0/0</strong><p>0 open blocker annotations</p></article><article class='metric'><span>Registry</span><strong>1.1.0</strong><p>5 targets; MIT license</p></article><article class='metric'><span>Archive</span><strong>pass</strong><p>580 zip entries; package verification</p></article><article class='metric'><span>Install</span><strong>pass</strong><p>4 adapters; 12 permissions enforced; 0 permission failures</p></article><article class='metric'><span>Upgrade</span><strong>minor</strong><p>declared minor; 0 breaking changes</p></article></div>
|
||||
<div class="metrics"><article class='metric'><span>Skill IR</span><strong>2.0.0</strong><p>5 targets in platform-neutral contract</p></article><article class='metric'><span>Compiler</span><strong>5/5</strong><p>target contracts compiled from Skill IR</p></article><article class='metric'><span>Output Delta</span><strong>100.0</strong><p>5 cases; 1 file-backed</p></article><article class='metric'><span>Exec Runs</span><strong>10</strong><p>command 10; model 10; recorded 0</p></article><article class='metric'><span>Blind A/B</span><strong>5</strong><p>review pairs hide baseline vs with-skill labels</p></article><article class='metric'><span>Review Kit</span><strong>0/5</strong><p>pending 5; answer key hidden</p></article><article class='metric'><span>Review A/B</span><strong>0/5</strong><p>adjudication decisions; pending 5</p></article><article class='metric'><span>Public Claim</span><strong>blocked</strong><p>4 blockers; local reproducible true</p></article><article class='metric'><span>Blueprint</span><strong>21/21</strong><p>2.0 coverage; extensions partial 0, planned 0; evidence pending 4</p></article><article class='metric'><span>Runtime</span><strong>5/5</strong><p>target conformance pass rate</p></article><article class='metric'><span>Perm Probe</span><strong>4/4</strong><p>0 native; 4 installer-enforced</p></article><article class='metric'><span>Trust</span><strong>0</strong><p>155 scripts scanned; secrets found</p></article><article class='metric'><span>Py Compat</span><strong>0</strong><p>235 files scanned for Python 3.11</p></article><article class='metric'><span>Arch Debt</span><strong>0</strong><p>719 largest lines; 0 watchlist; 6 early; 71 CLI handlers; 18 in entrypoint</p></article><article class='metric'><span>Atlas</span><strong>5</strong><p>11 scanned skills; route collisions</p></article><article class='metric'><span>Drift</span><strong>low</strong><p>1 metadata events; 0 missed triggers</p></article><article class='metric'><span>Daily Ops</span><strong>5</strong><p>proposal-review; approval 0; release lock false</p></article><article class='metric'><span>Weekly Queue</span><strong>5</strong><p>curator-review; ready 1; top score 88</p></article><article class='metric'><span>Waivers</span><strong>0</strong><p>0 gates covered; human risk decisions</p></article><article class='metric'><span>Intake</span><strong>4/4</strong><p>0 valid submissions; 0 invalid</p></article><article class='metric'><span>Claim Guard</span><strong>0</strong><p>201 public surfaces scanned</p></article><article class='metric'><span>Notes</span><strong>0/0</strong><p>0 open blocker annotations</p></article><article class='metric'><span>Registry</span><strong>1.1.0</strong><p>5 targets; MIT license</p></article><article class='metric'><span>Archive</span><strong>pass</strong><p>580 zip entries; package verification</p></article><article class='metric'><span>Install</span><strong>pass</strong><p>4 adapters; 12 permissions enforced; 0 permission failures</p></article><article class='metric'><span>Upgrade</span><strong>minor</strong><p>declared minor; 0 breaking changes</p></article></div>
|
||||
</section>
|
||||
|
||||
<section>
|
||||
<h2>审查闸门</h2>
|
||||
<div class="gates"><article class='gate pass'><div><span>通过</span><h3>意图画布</h3></div><p>intent confidence 100/100; Intent is clear enough to package the first routeable version.</p><footer>reports/intent-confidence.json <a href='intent-confidence.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>触发实验</h3></div><p>13 trigger cases; 0 misroutes; 0 ambiguous</p><footer>reports/route_scorecard.json <a href='route_scorecard.md'>证据</a></footer></article><article class='gate warn'><div><span>关注</span><h3>输出实验</h3></div><p>5/5 cases; with-skill 100.0; baseline 0.0; file-backed 1; near-neighbor 1; blind A/B 5; exec 10; command 10; model 10; recorded 0; reviewed 0/5; review pending 5</p><footer>reports/output_quality_scorecard.json <a href='output_quality_scorecard.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>上下文</h3></div><p>initial load 998/1000; deferred 530871/120000; top deferred scripts 469568; resource governance governed; quality density 140.3</p><footer>reports/context_budget.json <a href='context_budget.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>运行矩阵</h3></div><p>5 / 5 targets pass</p><footer>reports/conformance_matrix.json <a href='conformance_matrix.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>信任报告</h3></div><p>0 secrets; 155 scripts; 3 network-capable scripts; 0 help smoke failures</p><footer>reports/security_trust_report.json <a href='security_trust_report.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>Python 兼容</h3></div><p>Python 3.11; 234 files; 0 compatibility issues; 0 syntax; 0 f-string 3.11 hazards</p><footer>reports/python_compatibility.json <a href='python_compatibility.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>架构维护</h3></div><p>232 Python files; 0 hotspots; 0 watchlist files; 6 early watch files; 0 blockers; largest 719 lines; 71 CLI handlers; 18 in entrypoint</p><footer>reports/architecture_maintainability.json <a href='architecture_maintainability.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>权限批准</h3></div><p>3/3 permissions approved; gaps 0; required file_write, network, subprocess</p><footer>reports/security_trust_report.json + security/permission_policy.json <a href='../security/permission_policy.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>权限探针</h3></div><p>4/4 targets probed; native 0; metadata fallback 4; installer 4; residual risks 4</p><footer>reports/runtime_permission_probes.json <a href='runtime_permission_probes.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>组合治理</h3></div><p>11 skills, 1 actionable; 0 actionable route collisions; 0 actionable owner gaps; 0 actionable stale; 0 actionable drift; 22 scoped non-actionable issues</p><footer>reports/skill_atlas.json <a href='skill_atlas.html'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>运营回路</h3></div><p>1 metadata events; adoption 100.0; missed 0; bad-output 0; risk low; daily proposals 5; daily decision proposal-review; daily release lock true; weekly queue 5 unique; weekly ready 1; weekly top 88; weekly release lock true</p><footer>reports/adoption_drift_report.json + reports/skillops/daily + reports/skillops/weekly <a href='adoption_drift_report.md'>证据</a></footer></article><article class='gate warn'><div><span>关注</span><h3>人工批准</h3></div><p>0 active waivers; 1 warning gates still need reviewer decision</p><footer>reports/review_waivers.json <a href='review_waivers.md'>证据</a></footer></article><article class='gate warn'><div><span>关注</span><h3>世界证据</h3></div><p>4 pending world-class evidence entries; 1 human pending; 3 external pending; source checks 12/19 pass; 7 blocked; overclaim guard true</p><footer>reports/world_class_evidence_ledger.json <a href='world_class_evidence_ledger.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>注册审计</h3></div><p>yao-meta-skill 1.1.0; 6/6 compatibility entries pass; install pass with 4 adapters; installer permissions 12 enforced / 0 failures</p><footer>reports/registry_audit.json + reports/install_simulation.json <a href='registry_audit.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>发布路线</h3></div><p>0 promote; 3 keep current; 0 blocked; upgrade minor declared / minor recommended</p><footer>reports/promotion_decisions.json + reports/upgrade_check.json + docs/migration-v2.md <a href='promotion_decisions.md'>证据</a></footer></article></div>
|
||||
<div class="gates"><article class='gate pass'><div><span>通过</span><h3>意图画布</h3></div><p>intent confidence 100/100; Intent is clear enough to package the first routeable version.</p><footer>reports/intent-confidence.json <a href='intent-confidence.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>触发实验</h3></div><p>13 trigger cases; 0 misroutes; 0 ambiguous</p><footer>reports/route_scorecard.json <a href='route_scorecard.md'>证据</a></footer></article><article class='gate warn'><div><span>关注</span><h3>输出实验</h3></div><p>5/5 cases; with-skill 100.0; baseline 0.0; file-backed 1; near-neighbor 1; blind A/B 5; exec 10; command 10; model 10; recorded 0; reviewed 0/5; review pending 5</p><footer>reports/output_quality_scorecard.json <a href='output_quality_scorecard.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>上下文</h3></div><p>initial load 987/1000; deferred 531767/120000; top deferred scripts 469568; resource governance governed; quality density 141.8</p><footer>reports/context_budget.json <a href='context_budget.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>运行矩阵</h3></div><p>5 / 5 targets pass</p><footer>reports/conformance_matrix.json <a href='conformance_matrix.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>信任报告</h3></div><p>0 secrets; 155 scripts; 3 network-capable scripts; 0 help smoke failures</p><footer>reports/security_trust_report.json <a href='security_trust_report.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>Python 兼容</h3></div><p>Python 3.11; 235 files; 0 compatibility issues; 0 syntax; 0 f-string 3.11 hazards</p><footer>reports/python_compatibility.json <a href='python_compatibility.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>架构维护</h3></div><p>232 Python files; 0 hotspots; 0 watchlist files; 6 early watch files; 0 blockers; largest 719 lines; 71 CLI handlers; 18 in entrypoint</p><footer>reports/architecture_maintainability.json <a href='architecture_maintainability.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>权限批准</h3></div><p>3/3 permissions approved; gaps 0; required file_write, network, subprocess</p><footer>reports/security_trust_report.json + security/permission_policy.json <a href='../security/permission_policy.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>权限探针</h3></div><p>4/4 targets probed; native 0; metadata fallback 4; installer 4; residual risks 4</p><footer>reports/runtime_permission_probes.json <a href='runtime_permission_probes.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>组合治理</h3></div><p>11 skills, 1 actionable; 0 actionable route collisions; 0 actionable owner gaps; 0 actionable stale; 0 actionable drift; 22 scoped non-actionable issues</p><footer>reports/skill_atlas.json <a href='skill_atlas.html'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>运营回路</h3></div><p>1 metadata events; adoption 100.0; missed 0; bad-output 0; risk low; daily proposals 5; daily decision proposal-review; daily release lock false; weekly queue 5 unique; weekly ready 1; weekly top 88; weekly release lock false</p><footer>reports/adoption_drift_report.json + reports/skillops/daily + reports/skillops/weekly <a href='adoption_drift_report.md'>证据</a></footer></article><article class='gate warn'><div><span>关注</span><h3>人工批准</h3></div><p>0 active waivers; 1 warning gates still need reviewer decision</p><footer>reports/review_waivers.json <a href='review_waivers.md'>证据</a></footer></article><article class='gate warn'><div><span>关注</span><h3>世界证据</h3></div><p>4 pending world-class evidence entries; 1 human pending; 3 external pending; source checks 12/19 pass; 7 blocked; overclaim guard true</p><footer>reports/world_class_evidence_ledger.json <a href='world_class_evidence_ledger.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>注册审计</h3></div><p>yao-meta-skill 1.1.0; 6/6 compatibility entries pass; install pass with 4 adapters; installer permissions 12 enforced / 0 failures</p><footer>reports/registry_audit.json + reports/install_simulation.json <a href='registry_audit.md'>证据</a></footer></article><article class='gate pass'><div><span>通过</span><h3>发布路线</h3></div><p>0 promote; 3 keep current; 0 blocked; upgrade minor declared / minor recommended</p><footer>reports/promotion_decisions.json + reports/upgrade_check.json + docs/migration-v2.md <a href='promotion_decisions.md'>证据</a></footer></article></div>
|
||||
</section>
|
||||
|
||||
<section>
|
||||
@@ -808,7 +808,7 @@
|
||||
</div>
|
||||
<div class="panel">
|
||||
<h2>证据路径</h2>
|
||||
<ul class="evidence"><li><strong>skill_overview</strong><span>reports/skill-overview.html</span></li><li><strong>review_viewer</strong><span>reports/review-viewer.html</span></li><li><strong>output_eval</strong><span>reports/output_quality_scorecard.md</span></li><li><strong>output_execution</strong><span>reports/output_execution_runs.md</span></li><li><strong>output_blind_review</strong><span>reports/output_blind_review_pack.md</span></li><li><strong>output_review_kit</strong><span>reports/output_review_kit.md</span></li><li><strong>output_review_kit_html</strong><span>reports/output_review_kit.html</span></li><li><strong>output_review_decisions</strong><span>reports/output_review_decisions.json</span></li><li><strong>output_review_adjudication</strong><span>reports/output_review_adjudication.md</span></li><li><strong>benchmark_reproducibility</strong><span>reports/benchmark_reproducibility.md</span></li><li><strong>skill_os2_coverage</strong><span>reports/skill_os2_coverage.md</span></li><li><strong>runtime_conformance</strong><span>reports/conformance_matrix.md</span></li><li><strong>trust_report</strong><span>reports/security_trust_report.md</span></li><li><strong>python_compatibility</strong><span>reports/python_compatibility.md</span></li><li><strong>architecture_maintainability</strong><span>reports/architecture_maintainability.md</span></li><li><strong>permission_policy</strong><span>security/permission_policy.md</span></li><li><strong>runtime_permissions</strong><span>reports/runtime_permission_probes.md</span></li><li><strong>skill_atlas</strong><span>reports/skill_atlas.html</span></li><li><strong>compiled_targets</strong><span>reports/compiled_targets.md</span></li><li><strong>adoption_drift</strong><span>reports/adoption_drift_report.md</span></li><li><strong>review_waivers</strong><span>reports/review_waivers.md</span></li><li><strong>review_annotations</strong><span>reports/review_annotations.md</span></li><li><strong>adaptation_proposals</strong><span>reports/adaptation_proposals.md</span></li><li><strong>adaptation_approval_ledger</strong><span>reports/adaptation_approval_ledger.json</span></li><li><strong>adaptation_regression</strong><span>reports/adaptation_regression_report.md</span></li><li><strong>world_class_evidence_plan</strong><span>reports/world_class_evidence_plan.md</span></li><li><strong>world_class_evidence_ledger</strong><span>reports/world_class_evidence_ledger.md</span></li><li><strong>world_class_evidence_intake</strong><span>reports/world_class_evidence_intake.md</span></li><li><strong>world_class_evidence_preflight</strong><span>reports/world_class_evidence_preflight.md</span></li><li><strong>world_class_evidence_preflight_html</strong><span>reports/world_class_evidence_preflight.html</span></li><li><strong>world_class_submission_review</strong><span>reports/world_class_submission_review.md</span></li><li><strong>world_class_operator_runbook</strong><span>reports/world_class_operator_runbook.md</span></li><li><strong>world_class_operator_runbook_html</strong><span>reports/world_class_operator_runbook.html</span></li><li><strong>world_class_claim_guard</strong><span>reports/world_class_claim_guard.md</span></li><li><strong>registry_audit</strong><span>reports/registry_audit.md</span></li><li><strong>package_verification</strong><span>reports/package_verification.md</span></li><li><strong>install_simulation</strong><span>reports/install_simulation.md</span></li><li><strong>upgrade_check</strong><span>reports/upgrade_check.md</span></li><li><strong>migration</strong><span>docs/migration-v2.md</span></li><li><strong>skill_ir</strong><span>skill-ir/examples/yao-meta-skill.json</span></li><li><strong>daily_skillops</strong><span>reports/skillops/daily/2026-06-21.md</span></li><li><strong>weekly_curator</strong><span>reports/skillops/weekly/2026-W25.md</span></li></ul>
|
||||
<ul class="evidence"><li><strong>skill_overview</strong><span>reports/skill-overview.html</span></li><li><strong>review_viewer</strong><span>reports/review-viewer.html</span></li><li><strong>output_eval</strong><span>reports/output_quality_scorecard.md</span></li><li><strong>output_execution</strong><span>reports/output_execution_runs.md</span></li><li><strong>output_blind_review</strong><span>reports/output_blind_review_pack.md</span></li><li><strong>output_review_kit</strong><span>reports/output_review_kit.md</span></li><li><strong>output_review_kit_html</strong><span>reports/output_review_kit.html</span></li><li><strong>output_review_decisions</strong><span>reports/output_review_decisions.json</span></li><li><strong>output_review_adjudication</strong><span>reports/output_review_adjudication.md</span></li><li><strong>benchmark_reproducibility</strong><span>reports/benchmark_reproducibility.md</span></li><li><strong>skill_os2_coverage</strong><span>reports/skill_os2_coverage.md</span></li><li><strong>runtime_conformance</strong><span>reports/conformance_matrix.md</span></li><li><strong>trust_report</strong><span>reports/security_trust_report.md</span></li><li><strong>python_compatibility</strong><span>reports/python_compatibility.md</span></li><li><strong>architecture_maintainability</strong><span>reports/architecture_maintainability.md</span></li><li><strong>permission_policy</strong><span>security/permission_policy.md</span></li><li><strong>runtime_permissions</strong><span>reports/runtime_permission_probes.md</span></li><li><strong>skill_atlas</strong><span>reports/skill_atlas.html</span></li><li><strong>compiled_targets</strong><span>reports/compiled_targets.md</span></li><li><strong>adoption_drift</strong><span>reports/adoption_drift_report.md</span></li><li><strong>review_waivers</strong><span>reports/review_waivers.md</span></li><li><strong>review_annotations</strong><span>reports/review_annotations.md</span></li><li><strong>adaptation_proposals</strong><span>reports/adaptation_proposals.md</span></li><li><strong>adaptation_approval_ledger</strong><span>reports/adaptation_approval_ledger.json</span></li><li><strong>adaptation_regression</strong><span>reports/adaptation_regression_report.md</span></li><li><strong>world_class_evidence_plan</strong><span>reports/world_class_evidence_plan.md</span></li><li><strong>world_class_evidence_ledger</strong><span>reports/world_class_evidence_ledger.md</span></li><li><strong>world_class_evidence_intake</strong><span>reports/world_class_evidence_intake.md</span></li><li><strong>world_class_evidence_preflight</strong><span>reports/world_class_evidence_preflight.md</span></li><li><strong>world_class_evidence_preflight_html</strong><span>reports/world_class_evidence_preflight.html</span></li><li><strong>world_class_submission_review</strong><span>reports/world_class_submission_review.md</span></li><li><strong>world_class_operator_runbook</strong><span>reports/world_class_operator_runbook.md</span></li><li><strong>world_class_operator_runbook_html</strong><span>reports/world_class_operator_runbook.html</span></li><li><strong>world_class_claim_guard</strong><span>reports/world_class_claim_guard.md</span></li><li><strong>registry_audit</strong><span>reports/registry_audit.md</span></li><li><strong>package_verification</strong><span>reports/package_verification.md</span></li><li><strong>install_simulation</strong><span>reports/install_simulation.md</span></li><li><strong>upgrade_check</strong><span>reports/upgrade_check.md</span></li><li><strong>migration</strong><span>docs/migration-v2.md</span></li><li><strong>skill_ir</strong><span>skill-ir/examples/yao-meta-skill.json</span></li><li><strong>daily_skillops</strong><span>reports/skillops/daily/2026-07-02.md</span></li><li><strong>weekly_curator</strong><span>reports/skillops/weekly/2026-W27.md</span></li></ul>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
@@ -844,17 +844,17 @@
|
||||
</section>
|
||||
|
||||
<section class="twocol">
|
||||
<div class="panel"><h2>上下文</h2><p>initial load 998/1000; deferred 530871/120000; top deferred scripts 469568; resource governance governed; quality density 140.3</p></div>
|
||||
<div class="panel"><h2>上下文</h2><p>initial load 987/1000; deferred 531767/120000; top deferred scripts 469568; resource governance governed; quality density 141.8</p></div>
|
||||
<div class="panel"><h2>编译证据</h2><p>Review reports/compiled_targets.md before packaging to inspect target adapter modes, generated files, preserved semantics, warnings, and unsupported features.</p></div>
|
||||
</section>
|
||||
|
||||
<section id="trust" class="twocol">
|
||||
<div class="panel"><h2>信任报告</h2><dl class='kv-grid'><div><dt>Secret</dt><dd>0</dd></div><div><dt>脚本数</dt><dd>155</dd></div><div><dt>网络脚本</dt><dd>3</dd></div><div><dt>Help 失败</dt><dd>0</dd></div><div><dt>包体哈希</dt><dd><code>eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383</code></dd></div></dl></div>
|
||||
<div class="panel"><h2>信任报告</h2><dl class='kv-grid'><div><dt>Secret</dt><dd>0</dd></div><div><dt>脚本数</dt><dd>155</dd></div><div><dt>网络脚本</dt><dd>3</dd></div><div><dt>Help 失败</dt><dd>0</dd></div><div><dt>包体哈希</dt><dd><code>db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c</code></dd></div></dl></div>
|
||||
<div class="panel"><h2>安全边界</h2><p>高风险 secret、远程 inline execution、缺失依赖策略或无法解释的脚本接口应阻断 governed release。</p></div>
|
||||
</section>
|
||||
|
||||
<section class="twocol">
|
||||
<div class="panel"><h2>Python 兼容</h2><dl class='kv-grid'><div><dt>目标 Python</dt><dd>3.11</dd></div><div><dt>文件数</dt><dd>234</dd></div><div><dt>问题数</dt><dd>0</dd></div><div><dt>语法错误</dt><dd>0</dd></div><div><dt>F-string 3.11</dt><dd>0</dd></div></dl></div>
|
||||
<div class="panel"><h2>Python 兼容</h2><dl class='kv-grid'><div><dt>目标 Python</dt><dd>3.11</dd></div><div><dt>文件数</dt><dd>235</dd></div><div><dt>问题数</dt><dd>0</dd></div><div><dt>语法错误</dt><dd>0</dd></div><div><dt>F-string 3.11</dt><dd>0</dd></div></dl></div>
|
||||
<div class="panel"><h2>解释器边界</h2><p>CI 和发布审查以 Python 3.11 兼容为底线；本地更高版本允许的新语法不能绕过兼容门禁。</p></div>
|
||||
</section>
|
||||
|
||||
@@ -874,14 +874,14 @@
|
||||
</section>
|
||||
|
||||
<section id="telemetry" class="twocol">
|
||||
<div class="panel"><h2>运营回路</h2><p>1 metadata events; adoption 100.0; missed 0; bad-output 0; risk low; daily proposals 5; daily decision proposal-review; daily release lock true; weekly queue 5 unique; weekly ready 1; weekly top 88; weekly release lock true</p></div>
|
||||
<div class="panel"><h2>运营回路</h2><p>1 metadata events; adoption 100.0; missed 0; bad-output 0; risk low; daily proposals 5; daily decision proposal-review; daily release lock false; weekly queue 5 unique; weekly ready 1; weekly top 88; weekly release lock false</p></div>
|
||||
<div class="panel"><h2>漂移信号</h2><dl class='kv-grid'><div><dt>事件数</dt><dd>1</dd></div><div><dt>采用率</dt><dd>100</dd></div><div><dt>漏触发</dt><dd>0</dd></div><div><dt>Bad Output Count</dt><dd>0</dd></div><div><dt>风险带</dt><dd>low</dd></div></dl></div>
|
||||
</section>
|
||||
|
||||
|
||||
<section class="twocol">
|
||||
<div class="panel"><h2>日常运维</h2><dl class='kv-grid'><div><dt>决策</dt><dd>proposal-review</dd></div><div><dt>提案数</dt><dd>5</dd></div><div><dt>Approval Count</dt><dd>0</dd></div><div><dt>Pending Review Count</dt><dd>0</dd></div><div><dt>发布锁</dt><dd>是</dd></div><div><dt>世界级</dt><dd>否</dd></div><div><dt>Writes Source Files</dt><dd>否</dd></div><div><dt>Auto Patch Enabled</dt><dd>否</dd></div></dl></div>
|
||||
<div class="panel"><h2>周度队列</h2><dl class='kv-grid'><div><dt>决策</dt><dd>curator-review</dd></div><div><dt>Week Id</dt><dd>2026-W25</dd></div><div><dt>日报数</dt><dd>4</dd></div><div><dt>唯一机会</dt><dd>5</dd></div><div><dt>待批准复核</dt><dd>1</dd></div><div><dt>提案复核</dt><dd>4</dd></div><div><dt>Top Score</dt><dd>88</dd></div><div><dt>发布锁</dt><dd>是</dd></div><div><dt>Writes Source Files</dt><dd>否</dd></div><div><dt>Auto Patch Enabled</dt><dd>否</dd></div></dl></div>
|
||||
<div class="panel"><h2>日常运维</h2><dl class='kv-grid'><div><dt>决策</dt><dd>proposal-review</dd></div><div><dt>提案数</dt><dd>5</dd></div><div><dt>Approval Count</dt><dd>0</dd></div><div><dt>Pending Review Count</dt><dd>0</dd></div><div><dt>发布锁</dt><dd>否</dd></div><div><dt>世界级</dt><dd>否</dd></div><div><dt>Writes Source Files</dt><dd>否</dd></div><div><dt>Auto Patch Enabled</dt><dd>否</dd></div></dl></div>
|
||||
<div class="panel"><h2>周度队列</h2><dl class='kv-grid'><div><dt>决策</dt><dd>curator-review</dd></div><div><dt>Week Id</dt><dd>2026-W27</dd></div><div><dt>日报数</dt><dd>5</dd></div><div><dt>唯一机会</dt><dd>5</dd></div><div><dt>待批准复核</dt><dd>1</dd></div><div><dt>提案复核</dt><dd>4</dd></div><div><dt>Top Score</dt><dd>88</dd></div><div><dt>发布锁</dt><dd>否</dd></div><div><dt>Writes Source Files</dt><dd>否</dd></div><div><dt>Auto Patch Enabled</dt><dd>否</dd></div></dl></div>
|
||||
</section>
|
||||
|
||||
|
||||
@@ -914,8 +914,8 @@
|
||||
</section>
|
||||
|
||||
<section class="twocol">
|
||||
<div class="panel"><h2>公开声明</h2><dl class='kv-grid'><div><dt>本地复现</dt><dd>是</dd></div><div><dt>发布锁</dt><dd>是</dd></div><div><dt>可公开声明</dt><dd>否</dd></div><div><dt>声明阻断</dt><dd>3</dd></div><div><dt>Provider 证据</dt><dd>是</dd></div><div><dt>人审完成</dt><dd>否</dd></div><div><dt>世界级就绪</dt><dd>否</dd></div></dl></div>
|
||||
<div class="panel"><h2>声明阻断</h2><ul class='issues'><li><strong>阻断</strong><span>human blind-review adjudication is incomplete</span></li><li><strong>阻断</strong><span>world-class evidence is not accepted yet (3 open gaps, 4 ledger pending)</span></li><li><strong>阻断</strong><span>world-class source checks are not all accepted (12/19 pass, 7 blocked)</span></li></ul></div>
|
||||
<div class="panel"><h2>公开声明</h2><dl class='kv-grid'><div><dt>本地复现</dt><dd>是</dd></div><div><dt>发布锁</dt><dd>否</dd></div><div><dt>可公开声明</dt><dd>否</dd></div><div><dt>声明阻断</dt><dd>4</dd></div><div><dt>Provider 证据</dt><dd>是</dd></div><div><dt>人审完成</dt><dd>否</dd></div><div><dt>世界级就绪</dt><dd>否</dd></div></dl></div>
|
||||
<div class="panel"><h2>声明阻断</h2><ul class='issues'><li><strong>阻断</strong><span>release lock is not clean or commit is unavailable</span></li><li><strong>阻断</strong><span>human blind-review adjudication is incomplete</span></li><li><strong>阻断</strong><span>world-class evidence is not accepted yet (3 open gaps, 4 ledger pending)</span></li><li><strong>阻断</strong><span>world-class source checks are not all accepted (12/19 pass, 7 blocked)</span></li></ul></div>
|
||||
</section>
|
||||
|
||||
<section class="twocol">
|
||||
@@ -929,7 +929,7 @@
|
||||
</section>
|
||||
|
||||
<section class="twocol">
|
||||
<div class="panel"><h2>声明守卫</h2><dl class='kv-grid'><div><dt>台账可声明</dt><dd>否</dd></div><div><dt>台账待补</dt><dd>4</dd></div><div><dt>声明面</dt><dd>184</dd></div><div><dt>违规数</dt><dd>0</dd></div><div><dt>Overclaim Guard Active</dt><dd>是</dd></div></dl></div>
|
||||
<div class="panel"><h2>声明守卫</h2><dl class='kv-grid'><div><dt>台账可声明</dt><dd>否</dd></div><div><dt>台账待补</dt><dd>4</dd></div><div><dt>声明面</dt><dd>201</dd></div><div><dt>违规数</dt><dd>0</dd></div><div><dt>Overclaim Guard Active</dt><dd>是</dd></div></dl></div>
|
||||
<div class="panel"><h2>声明边界</h2><p>claim guard 扫描 README、docs 和 reports 中的完成态表述；ledger 未 ready 时，任何英文完成断言、true 状态声明或中文完成态都会阻断发布审查。</p></div>
|
||||
</section>
|
||||
|
||||
|
||||
+412
-305
File diff suppressed because it is too large
Load Diff
@@ -188,7 +188,7 @@ th {
|
||||
<section class="hero">
|
||||
<p class="minor">Review Viewer</p>
|
||||
<h1>Yao Meta Skill</h1>
|
||||
<p class="lede">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</p>
|
||||
<p class="lede">Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</p>
|
||||
<div class="meta">
|
||||
<span>maturity: governed</span>
|
||||
<span>archetype: governed</span>
|
||||
@@ -200,17 +200,17 @@ th {
|
||||
|
||||
<section>
|
||||
<h2>Architecture at a glance</h2>
|
||||
<div class="arch-grid"><div class='arch-step'><div class='step-label'>Inputs</div><div class='step-detail'>workflow, prompt, transcript, docs, or notes</div></div><div class='arch-step'><div class='step-label'>Boundary</div><div class='step-detail'>Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</div></div><div class='arch-step'><div class='step-label'>Logic</div><div class='step-detail'>For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.; Capture job, output, exclusions, constraints, standards, and the lightest fit.; Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.</div></div><div class='arch-step'><div class='step-label'>Usage</div><div class='step-detail'>Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.; Use this skill when the request matches: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</div></div><div class='arch-step'><div class='step-label'>Next</div><div class='step-detail'>Review the top iteration directions before growing the package.</div></div></div>
|
||||
<div class="arch-grid"><div class='arch-step'><div class='step-label'>Inputs</div><div class='step-detail'>workflow, prompt, transcript, docs, or notes</div></div><div class='arch-step'><div class='step-label'>Boundary</div><div class='step-detail'>Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</div></div><div class='arch-step'><div class='step-label'>Logic</div><div class='step-detail'>One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.; Capture job, output, exclusions, constraints, standards, lightest fit.; Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.</div></div><div class='arch-step'><div class='step-label'>Usage</div><div class='step-detail'>Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.; Use this skill when the request matches: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</div></div><div class='arch-step'><div class='step-label'>Next</div><div class='step-detail'>Review the top iteration directions before growing the package.</div></div></div>
|
||||
</section>
|
||||
|
||||
<section class="grid">
|
||||
<div class="panel">
|
||||
<h2>Core logic</h2>
|
||||
<ul><li>For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.</li><li>Capture job, output, exclusions, constraints, standards, and the lightest fit.</li><li>Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.</li><li>Write `description` early, test route quality, then add only earned folders and gates.</li><li>Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful.</li></ul>
|
||||
<ul><li>One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.</li><li>Capture job, output, exclusions, constraints, standards, lightest fit.</li><li>Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.</li><li>Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.</li><li>Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned.</li></ul>
|
||||
</div>
|
||||
<div class="panel">
|
||||
<h2>How to use it</h2>
|
||||
<ul><li>Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.</li><li>Use this skill when the request matches: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</li></ul>
|
||||
<ul><li>Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.</li><li>Use this skill when the request matches: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</li></ul>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
@@ -232,13 +232,13 @@ th {
|
||||
</div>
|
||||
<div class="panel">
|
||||
<h2>Compare view</h2>
|
||||
<div class='baseline-box'><p><strong>Winner:</strong> Current</p><p class='minor'>{'priority': ['fewest false positives', 'fewest false negatives', 'highest near-neighbor pass rate', 'highest negative pass rate', 'highest precision', 'highest recall', 'shortest description']}</p><table><thead><tr><th>Variant</th><th>Tokens</th><th>Dev Errors</th><th>Holdout Errors</th><th>Strategy</th></tr></thead><tbody><tr><td>Baseline</td><td>8</td><td>0</td><td>0</td><td>existing</td></tr><tr><td>Current</td><td>53</td><td>0</td><td>0</td><td>current</td></tr><tr><td>Current</td><td>53</td><td>0</td><td>0</td><td>current</td></tr></tbody></table></div>
|
||||
<div class='baseline-box'><p><strong>Winner:</strong> Current</p><p class='minor'>{'priority': ['fewest false positives', 'fewest false negatives', 'highest near-neighbor pass rate', 'highest negative pass rate', 'highest precision', 'highest recall', 'shortest description']}</p><table><thead><tr><th>Variant</th><th>Tokens</th><th>Dev Errors</th><th>Holdout Errors</th><th>Strategy</th></tr></thead><tbody><tr><td>Baseline</td><td>8</td><td>0</td><td>0</td><td>existing</td></tr><tr><td>Current</td><td>54</td><td>0</td><td>0</td><td>current</td></tr><tr><td>Current</td><td>54</td><td>0</td><td>0</td><td>current</td></tr></tbody></table></div>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
<section>
|
||||
<h2>Variant diff studio</h2>
|
||||
<div class="variant-grid"><div class='variant-card'><div class='variant-head'><h3>Baseline</h3><span>existing</span></div><p class='variant-description'>Create and improve agent skills.</p><div class='variant-metrics'><span>tokens 8 (0)</span><span>dev 0 (0)</span><span>holdout 0 (0)</span></div><div class='variant-cues'><p><strong>Adds relative to baseline</strong></p><ul><li>Create and improve agent skills.</li></ul><p><strong>Drops from baseline</strong></p><p class='minor'>No dropped cues.</p></div></div><div class='variant-card'><div class='variant-head'><h3>Current</h3><span>current</span></div><p class='variant-description'>Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</p><div class='variant-metrics'><span>tokens 53 (+45)</span><span>dev 0 (0)</span><span>holdout 0 (0)</span></div><div class='variant-cues'><p><strong>Adds relative to baseline</strong></p><ul><li>Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes.</li><li>Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</li></ul><p><strong>Drops from baseline</strong></p><ul><li>Create and improve agent skills.</li></ul></div></div><div class='variant-card'><div class='variant-head'><h3>Winner — Current</h3><span>current</span></div><p class='variant-description'>Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</p><div class='variant-metrics'><span>tokens 53 (+45)</span><span>dev 0 (0)</span><span>holdout 0 (0)</span></div><div class='variant-cues'><p><strong>Adds relative to baseline</strong></p><ul><li>Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes.</li><li>Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</li></ul><p><strong>Drops from baseline</strong></p><ul><li>Create and improve agent skills.</li></ul></div></div></div>
|
||||
<div class="variant-grid"><div class='variant-card'><div class='variant-head'><h3>Baseline</h3><span>existing</span></div><p class='variant-description'>Create and improve agent skills.</p><div class='variant-metrics'><span>tokens 8 (0)</span><span>dev 0 (0)</span><span>holdout 0 (0)</span></div><div class='variant-cues'><p><strong>Adds relative to baseline</strong></p><ul><li>Create and improve agent skills.</li></ul><p><strong>Drops from baseline</strong></p><p class='minor'>No dropped cues.</p></div></div><div class='variant-card'><div class='variant-head'><h3>Current</h3><span>current</span></div><p class='variant-description'>Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</p><div class='variant-metrics'><span>tokens 54 (+46)</span><span>dev 0 (0)</span><span>holdout 0 (0)</span></div><div class='variant-cues'><p><strong>Adds relative to baseline</strong></p><ul><li>Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts.</li><li>Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测.</li><li>Exclude no-skill summary/translation/docs.</li></ul><p><strong>Drops from baseline</strong></p><ul><li>Create and improve agent skills.</li></ul></div></div><div class='variant-card'><div class='variant-head'><h3>Winner — Current</h3><span>current</span></div><p class='variant-description'>Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</p><div class='variant-metrics'><span>tokens 54 (+46)</span><span>dev 0 (0)</span><span>holdout 0 (0)</span></div><div class='variant-cues'><p><strong>Adds relative to baseline</strong></p><ul><li>Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts.</li><li>Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测.</li><li>Exclude no-skill summary/translation/docs.</li></ul><p><strong>Drops from baseline</strong></p><ul><li>Create and improve agent skills.</li></ul></div></div></div>
|
||||
</section>
|
||||
|
||||
<section class="grid">
|
||||
@@ -310,11 +310,11 @@ th {
|
||||
<section class="grid">
|
||||
<div class="panel">
|
||||
<h2>Reference synthesis</h2>
|
||||
<div class="direction-grid"><div class='direction-card'><h3>Official skill anatomy and context discipline</h3><p><strong>Borrow now</strong></p><ul><li>Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.</li></ul><p><strong>Avoid</strong></p><ul><li>Do not let packaging or platform concerns swallow the core job boundary.</li></ul></div><div class='direction-card'><h3>Human-in-the-loop verification</h3><p><strong>Borrow now</strong></p><ul><li>Borrow a review checkpoint wherever trust matters more than raw speed.</li></ul><p><strong>Avoid</strong></p><ul><li>Do not force every skill through heavyweight review when the risk is low.</li></ul></div><div class='direction-card'><h3>Boundary-first design</h3><p><strong>Borrow now</strong></p><ul><li>Borrow the discipline of defining what the skill should not own before growing the package.</li></ul><p><strong>Avoid</strong></p><ul><li>Do not expand execution assets until route boundaries stay clean.</li></ul></div></div>
|
||||
<div class="direction-grid"><div class='direction-card'><h3>Official skill anatomy and context discipline</h3><p><strong>Borrow now</strong></p><ul><li>Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.</li></ul><p><strong>Avoid</strong></p><ul><li>Do not let packaging or platform concerns swallow the core job boundary.</li></ul></div><div class='direction-card'><h3>Hypothesis-test-learn loop</h3><p><strong>Borrow now</strong></p><ul><li>Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.</li></ul><p><strong>Avoid</strong></p><ul><li>Do not create experimental overhead that exceeds the skill's real risk tier.</li></ul></div><div class='direction-card'><h3>Boundary-first design</h3><p><strong>Borrow now</strong></p><ul><li>Borrow the discipline of defining what the skill should not own before growing the package.</li></ul><p><strong>Avoid</strong></p><ul><li>Do not expand execution assets until route boundaries stay clean.</li></ul></div></div>
|
||||
</div>
|
||||
<div class="panel">
|
||||
<h2>Borrow now</h2>
|
||||
<ul><li>Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.</li><li>Borrow a review checkpoint wherever trust matters more than raw speed.</li><li>Borrow the discipline of defining what the skill should not own before growing the package.</li><li>Borrow the way it turns a messy workflow into a repeatable operating path.</li></ul>
|
||||
<ul><li>Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.</li><li>Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.</li><li>Borrow the discipline of defining what the skill should not own before growing the package.</li><li>Borrow the way it turns a messy workflow into a repeatable operating path.</li></ul>
|
||||
<p class="minor">Use the recommendation by default. Only surface the underlying benchmark tradeoffs when intent is uncertain or a real design conflict needs a deliberate call.</p>
|
||||
</div>
|
||||
</section>
|
||||
|
||||
+957
-735
File diff suppressed because it is too large
Load Diff
@@ -15,7 +15,7 @@
|
||||
"correct_count": 3,
|
||||
"precision": 1.0,
|
||||
"recall": 1.0,
|
||||
"average_margin": 0.701
|
||||
"average_margin": 0.644
|
||||
},
|
||||
"team-frontend-review": {
|
||||
"expected_count": 3,
|
||||
@@ -31,7 +31,7 @@
|
||||
"correct_count": 3,
|
||||
"precision": 1.0,
|
||||
"recall": 1.0,
|
||||
"average_margin": 0.586
|
||||
"average_margin": 0.709
|
||||
},
|
||||
"no_route": {
|
||||
"expected_count": 4,
|
||||
@@ -77,18 +77,18 @@
|
||||
"expected_route": "yao-meta-skill",
|
||||
"predicted_route": "yao-meta-skill",
|
||||
"correct": true,
|
||||
"margin": 1.0,
|
||||
"margin": 0.681,
|
||||
"ambiguous": false,
|
||||
"ranked_routes": [
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 1.0,
|
||||
"score": 0.681,
|
||||
"passed_threshold": true,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [
|
||||
"eval_optimize",
|
||||
"iterate_existing_skill",
|
||||
"reuse_package",
|
||||
"team_operationalize",
|
||||
"transform_workflow"
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
@@ -117,16 +117,17 @@
|
||||
"expected_route": "yao-meta-skill",
|
||||
"predicted_route": "yao-meta-skill",
|
||||
"correct": true,
|
||||
"margin": 0.661,
|
||||
"margin": 0.51,
|
||||
"ambiguous": false,
|
||||
"ranked_routes": [
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.661,
|
||||
"score": 0.51,
|
||||
"passed_threshold": true,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [
|
||||
"eval_optimize",
|
||||
"iterate_existing_skill",
|
||||
"reuse_package"
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
@@ -155,16 +156,19 @@
|
||||
"expected_route": "yao-meta-skill",
|
||||
"predicted_route": "yao-meta-skill",
|
||||
"correct": true,
|
||||
"margin": 0.441,
|
||||
"margin": 0.74,
|
||||
"ambiguous": false,
|
||||
"ranked_routes": [
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.441,
|
||||
"score": 0.74,
|
||||
"passed_threshold": true,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [
|
||||
"reuse_package"
|
||||
"build_skill",
|
||||
"multi_asset",
|
||||
"reuse_package",
|
||||
"transform_workflow"
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
@@ -211,14 +215,6 @@
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.012,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "governed-incident-command",
|
||||
"score": 0.012,
|
||||
@@ -226,6 +222,14 @@
|
||||
"threshold": 0.48,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.006,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -251,14 +255,6 @@
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.008,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "governed-incident-command",
|
||||
"score": 0.008,
|
||||
@@ -266,6 +262,14 @@
|
||||
"threshold": 0.48,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.004,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -293,7 +297,7 @@
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.012,
|
||||
"score": 0.006,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
@@ -331,14 +335,6 @@
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.016,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "team-frontend-review",
|
||||
"score": 0.011,
|
||||
@@ -346,6 +342,14 @@
|
||||
"threshold": 0.48,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.005,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -371,7 +375,7 @@
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.328,
|
||||
"score": 0.179,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [
|
||||
@@ -395,7 +399,7 @@
|
||||
"expected_route": "governed-incident-command",
|
||||
"predicted_route": "governed-incident-command",
|
||||
"correct": true,
|
||||
"margin": 0.252,
|
||||
"margin": 0.621,
|
||||
"ambiguous": false,
|
||||
"ranked_routes": [
|
||||
{
|
||||
@@ -413,12 +417,11 @@
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.748,
|
||||
"score": 0.379,
|
||||
"passed_threshold": true,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [
|
||||
"reuse_package",
|
||||
"team_operationalize",
|
||||
"transform_workflow"
|
||||
],
|
||||
"matched_negative_concepts": []
|
||||
@@ -481,14 +484,6 @@
|
||||
"margin": null,
|
||||
"ambiguous": false,
|
||||
"ranked_routes": [
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.008,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "governed-incident-command",
|
||||
"score": 0.008,
|
||||
@@ -497,6 +492,14 @@
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.0,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
"matched_negative_concepts": []
|
||||
},
|
||||
{
|
||||
"name": "team-frontend-review",
|
||||
"score": 0.0,
|
||||
@@ -522,7 +525,7 @@
|
||||
"ranked_routes": [
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"score": 0.024,
|
||||
"score": 0.016,
|
||||
"passed_threshold": false,
|
||||
"threshold": 0.33,
|
||||
"matched_desired_concepts": [],
|
||||
|
||||
@@ -9,9 +9,9 @@
|
||||
|
||||
| Route | Expected | Predicted | Precision | Recall | Avg Margin |
|
||||
| --- | ---: | ---: | ---: | ---: | ---: |
|
||||
| `yao-meta-skill` | 3 | 3 | 1.0 | 1.0 | 0.701 |
|
||||
| `yao-meta-skill` | 3 | 3 | 1.0 | 1.0 | 0.644 |
|
||||
| `team-frontend-review` | 3 | 3 | 1.0 | 1.0 | 0.805 |
|
||||
| `governed-incident-command` | 3 | 3 | 1.0 | 1.0 | 0.586 |
|
||||
| `governed-incident-command` | 3 | 3 | 1.0 | 1.0 | 0.709 |
|
||||
| `no_route` | 4 | 4 | 1.0 | 1.0 | - |
|
||||
|
||||
## Confusion Matrix
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"skill_dir": ".",
|
||||
"package_dir": "dist",
|
||||
"package_dir": "tests/tmp_review_studio/dist",
|
||||
"expected_capabilities": [
|
||||
"file_write",
|
||||
"network",
|
||||
@@ -42,7 +42,7 @@
|
||||
{
|
||||
"target": "openai",
|
||||
"status": "pass",
|
||||
"adapter": "dist/targets/openai/adapter.json",
|
||||
"adapter": "tests/tmp_review_studio/dist/targets/openai/adapter.json",
|
||||
"permission_model": "metadata-only",
|
||||
"native_enforcement": false,
|
||||
"metadata_fallback_explicit": true,
|
||||
@@ -139,7 +139,7 @@
|
||||
{
|
||||
"target": "claude",
|
||||
"status": "pass",
|
||||
"adapter": "dist/targets/claude/adapter.json",
|
||||
"adapter": "tests/tmp_review_studio/dist/targets/claude/adapter.json",
|
||||
"permission_model": "neutral-source-plus-adapter",
|
||||
"native_enforcement": false,
|
||||
"metadata_fallback_explicit": true,
|
||||
@@ -221,7 +221,7 @@
|
||||
{
|
||||
"target": "generic",
|
||||
"status": "pass",
|
||||
"adapter": "dist/targets/generic/adapter.json",
|
||||
"adapter": "tests/tmp_review_studio/dist/targets/generic/adapter.json",
|
||||
"permission_model": "agent-skills-compatible-metadata",
|
||||
"native_enforcement": false,
|
||||
"metadata_fallback_explicit": true,
|
||||
@@ -303,7 +303,7 @@
|
||||
{
|
||||
"target": "vscode",
|
||||
"status": "pass",
|
||||
"adapter": "dist/targets/vscode/adapter.json",
|
||||
"adapter": "tests/tmp_review_studio/dist/targets/vscode/adapter.json",
|
||||
"permission_model": "vscode-workspace-trust-plus-metadata",
|
||||
"native_enforcement": false,
|
||||
"metadata_fallback_explicit": true,
|
||||
|
||||
@@ -23,7 +23,7 @@
|
||||
"interactive_script_count": 0,
|
||||
"package_hash_scope": "source-contract-without-generated-reports",
|
||||
"package_hash_file_count": 247,
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
},
|
||||
"failures": [],
|
||||
"warnings": [],
|
||||
|
||||
@@ -16,7 +16,7 @@
|
||||
- Interactive scripts: `0`
|
||||
- Package hash scope: `source-contract-without-generated-reports`
|
||||
- Package hash files: `247`
|
||||
- Package SHA256: `eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383`
|
||||
- Package SHA256: `db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c`
|
||||
|
||||
## Failures
|
||||
|
||||
|
||||
@@ -761,7 +761,7 @@
|
||||
<p class="eyebrow"><span data-lang="zh-CN">YAO Skill 生成审计报告</span><span data-lang="en">YAO Skill Generation Audit</span></p>
|
||||
<p class="slug">yao-meta-skill</p>
|
||||
<h1 id="report-title"><span data-lang="zh-CN">技能审计报告</span><span data-lang="en">Yao Meta Skill Audit Report</span></h1>
|
||||
<p class="lead"><span data-lang="zh-CN">这份报告默认使用中文简体，把新 Skill 的定位、指标、原理、契约、质量、风险、资产和迭代路线整理为一份可审计的 HTML 报告。</span><span data-lang="en">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</span></p>
|
||||
<p class="lead"><span data-lang="zh-CN">这份报告默认使用中文简体，把新 Skill 的定位、指标、原理、契约、质量、风险、资产和迭代路线整理为一份可审计的 HTML 报告。</span><span data-lang="en">Skill-specific source text is authored in Chinese; switch to Simplified Chinese for the exact wording.</span></p>
|
||||
<div class="hero-meta"><span><span data-lang="zh-CN">技能名称：yao-meta-skill</span><span data-lang="en">Skill name: yao-meta-skill</span></span><span><span data-lang="zh-CN">成熟度：治理</span><span data-lang="en">Maturity: governed</span></span><span><span data-lang="zh-CN">格式：Agent Skills</span><span data-lang="en">Format: agent-skills</span></span><span><span data-lang="zh-CN">更新时间：2026-03-31</span><span data-lang="en">Updated: 2026-03-31</span></span></div>
|
||||
<div class="badges"><span><span data-lang="zh-CN">openai</span><span data-lang="en">openai</span></span><span><span data-lang="zh-CN">claude</span><span data-lang="en">claude</span></span><span><span data-lang="zh-CN">generic</span><span data-lang="en">generic</span></span><span><span data-lang="zh-CN">vscode</span><span data-lang="en">vscode</span></span></div>
|
||||
</div>
|
||||
@@ -770,7 +770,7 @@
|
||||
<ul class="list"><li><span data-lang="zh-CN">把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。</span><span data-lang="en">Turn one-off experience into a reusable, evaluable, and portable skill package.</span></li><li><span data-lang="zh-CN">Skill 作者、复用团队和后续 reviewer。</span><span data-lang="en">Skill authors, reuse teams, and later reviewers.</span></li><li><span data-lang="zh-CN">创建完成后建议先打开 reports/skill-interpretation.html，再继续扩展包体。</span><span data-lang="en">After creation, open reports/skill-interpretation.html before expanding the package further.</span></li></ul>
|
||||
</aside>
|
||||
</div>
|
||||
<div class="score-strip" aria-label="报告关键指标"><article class='score-chip'><span><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong><i style='--score:42%'></i><small><span data-lang="zh-CN">入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 339 words/characters; references are about 16934.</span></small></article></div>
|
||||
<div class="score-strip" aria-label="报告关键指标"><article class='score-chip'><span><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong><i style='--score:42%'></i><small><span data-lang="zh-CN">入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 314 words/characters; references are about 16934.</span></small></article></div>
|
||||
</section>
|
||||
|
||||
<section id="overview">
|
||||
@@ -782,7 +782,7 @@
|
||||
<div class="two-col">
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">作用定位</span><span data-lang="en">Role</span></h3>
|
||||
<ul class="list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</span></li><li><span data-lang="zh-CN">把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。</span><span data-lang="en">Turn one-off experience into a reusable, evaluable, and portable skill package.</span></li><li><span data-lang="zh-CN">交付结果：SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html, reports/skill-interpretation.json</span><span data-lang="en">Deliverables: SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html, reports/skill-interpretation.json</span></li></ul>
|
||||
<ul class="list"><li><span data-lang="zh-CN">Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</span><span data-lang="en">Skill-specific source text is authored in Chinese; switch to Simplified Chinese for the exact wording.</span></li><li><span data-lang="zh-CN">把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。</span><span data-lang="en">Turn one-off experience into a reusable, evaluable, and portable skill package.</span></li><li><span data-lang="zh-CN">交付结果：SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html, reports/skill-interpretation.json</span><span data-lang="en">Deliverables: SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html, reports/skill-interpretation.json</span></li></ul>
|
||||
</article>
|
||||
<figure class="chart-figure" data-chart="flow"><svg viewBox="0 0 620 170" role="img" aria-label="交付流程"><text data-lang="zh-CN" x="20" y="28" class="chart-title">交付流程</text><text data-lang="en" x="20" y="28" class="chart-title">Delivery Flow</text><path d="M188 93 H248 M398 93 H458" class="chart-line"/><g><rect x="38" y="56" width="150" height="74" rx="8" fill="#F6F8FB" stroke="#e8e6dc"/><text data-lang="zh-CN" x="113" y="99" text-anchor="middle">输入材料</text><text data-lang="en" x="113" y="99" text-anchor="middle">Input material</text></g><g><rect x="248" y="56" width="150" height="74" rx="8" fill="#F6F8FB" stroke="#e8e6dc"/><text data-lang="zh-CN" x="323" y="99" text-anchor="middle">Skill 包体</text><text data-lang="en" x="323" y="99" text-anchor="middle">Skill package</text></g><g><rect x="458" y="56" width="150" height="74" rx="8" fill="#F6F8FB" stroke="#e8e6dc"/><text data-lang="zh-CN" x="533" y="99" text-anchor="middle">可复用能力</text><text data-lang="en" x="533" y="99" text-anchor="middle">Reusable capability</text></g></svg><figcaption><span data-lang="zh-CN">交付流程把用户输入、生成的包体和可复用能力放在一条线上。</span><span data-lang="en">The delivery flow places user input, generated package, and reusable capability on one path.</span></figcaption></figure>
|
||||
</div>
|
||||
@@ -807,12 +807,12 @@
|
||||
<article class="panel metrics-note metrics-summary-panel">
|
||||
<h3><span data-lang="zh-CN">成熟度条</span><span data-lang="en">Maturity Bar</span></h3>
|
||||
<p><span data-lang="zh-CN">这里把每个指标压缩为状态、分数和第一条证据，先给出整体判断，再进入下方明细。</span><span data-lang="en">This compresses each metric into status, score, and the first evidence item before the detailed cards below.</span></p>
|
||||
<ol class='metric-summary-list'><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></b><em>100</em><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></b><em>100</em><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 约 339 个词/字。</span><span data-lang="en">SKILL.md is about 339 words/characters.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></b><em>100</em><small><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">关注</span><span data-lang="en">Watch</span></span><b><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></b><em>42</em><small><span data-lang="zh-CN">入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 339 words/characters; references are about 16934.</span></small></li></ol>
|
||||
<ol class='metric-summary-list'><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></b><em>100</em><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></b><em>100</em><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 约 314 个词/字。</span><span data-lang="en">SKILL.md is about 314 words/characters.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></b><em>100</em><small><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">关注</span><span data-lang="en">Watch</span></span><b><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></b><em>42</em><small><span data-lang="zh-CN">入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 314 words/characters; references are about 16934.</span></small></li></ol>
|
||||
</article>
|
||||
</div>
|
||||
<div class="metric-detail-section">
|
||||
<div class="detail-section-kicker"><span data-lang="zh-CN">指标明细</span><span data-lang="en">Metric Details</span></div>
|
||||
<div class="metric-grid metric-detail-grid"><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></li><li><span data-lang="zh-CN">README.md 已存在，便于人工阅读。</span><span data-lang="en">README.md exists for human-readable usage.</span></li><li><span data-lang="zh-CN">agents/interface.yaml 已存在，便于跨平台适配。</span><span data-lang="en">agents/interface.yaml exists for cross-platform adaptation.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></li><li><span data-lang="zh-CN">description 有足够长度说明任务边界。</span><span data-lang="en">The description is long enough to explain the task boundary.</span></li><li><span data-lang="zh-CN">description 已包含使用场景或排除边界信号。</span><span data-lang="en">The description includes usage-scenario or exclusion-boundary signals.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></li><li><span data-lang="zh-CN">skill-ir.json 已存在。</span><span data-lang="en">skill-ir.json exists.</span></li><li><span data-lang="zh-CN">compiled_targets.json 已存在。</span><span data-lang="en">compiled_targets.json exists.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 约 339 个词/字。</span><span data-lang="en">SKILL.md is about 339 words/characters.</span></li><li><span data-lang="zh-CN">入口文件保持克制，可维护性较好。</span><span data-lang="en">The entrypoint stays restrained, which supports maintainability.</span></li><li><span data-lang="zh-CN">references/ 已承载扩展指导。</span><span data-lang="en">references/ carries extended guidance.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></li><li><span data-lang="zh-CN">manifest.json 已存在。</span><span data-lang="en">manifest.json exists.</span></li><li><span data-lang="zh-CN">目标平台或 adapter target 已声明。</span><span data-lang="en">Target platforms or adapter targets are declared.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 339 words/characters; references are about 16934.</span></li><li><span data-lang="zh-CN">分数越高代表上下文成本越低。</span><span data-lang="en">A higher score means lower context cost.</span></li><li><span data-lang="zh-CN">上下文成本偏高，建议压缩入口或拆分 references。</span><span data-lang="en">Context cost is high; compress the entrypoint or split references further.</span></li></ul></div></article></div>
|
||||
<div class="metric-grid metric-detail-grid"><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></li><li><span data-lang="zh-CN">README.md 已存在，便于人工阅读。</span><span data-lang="en">README.md exists for human-readable usage.</span></li><li><span data-lang="zh-CN">agents/interface.yaml 已存在，便于跨平台适配。</span><span data-lang="en">agents/interface.yaml exists for cross-platform adaptation.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></li><li><span data-lang="zh-CN">description 有足够长度说明任务边界。</span><span data-lang="en">The description is long enough to explain the task boundary.</span></li><li><span data-lang="zh-CN">description 已包含使用场景或排除边界信号。</span><span data-lang="en">The description includes usage-scenario or exclusion-boundary signals.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></li><li><span data-lang="zh-CN">skill-ir.json 已存在。</span><span data-lang="en">skill-ir.json exists.</span></li><li><span data-lang="zh-CN">compiled_targets.json 已存在。</span><span data-lang="en">compiled_targets.json exists.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 约 314 个词/字。</span><span data-lang="en">SKILL.md is about 314 words/characters.</span></li><li><span data-lang="zh-CN">入口文件保持克制，可维护性较好。</span><span data-lang="en">The entrypoint stays restrained, which supports maintainability.</span></li><li><span data-lang="zh-CN">references/ 已承载扩展指导。</span><span data-lang="en">references/ carries extended guidance.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></li><li><span data-lang="zh-CN">manifest.json 已存在。</span><span data-lang="en">manifest.json exists.</span></li><li><span data-lang="zh-CN">目标平台或 adapter target 已声明。</span><span data-lang="en">Target platforms or adapter targets are declared.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 314 words/characters; references are about 16934.</span></li><li><span data-lang="zh-CN">分数越高代表上下文成本越低。</span><span data-lang="en">A higher score means lower context cost.</span></li><li><span data-lang="zh-CN">上下文成本偏高，建议压缩入口或拆分 references。</span><span data-lang="en">Context cost is high; compress the entrypoint or split references further.</span></li></ul></div></article></div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
@@ -845,11 +845,11 @@
|
||||
<div class="two-col">
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">执行流程</span><span data-lang="en">Execution Flow</span></h3>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Capture job, output, exclusions, constraints, standards, and the lightest fit.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Write `description` early, test route quality, then add only earned folders and gates.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful.</span></li></ol>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Capture job, output, exclusions, constraints, standards, lightest fit.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned.</span></li></ol>
|
||||
</article>
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">调用方式</span><span data-lang="en">How To Use</span></h3>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">当你需要把工作流或笔记沉淀成结构精简、触发清晰且带必要 eval 的可复用 Skill 时使用 $yao-meta-skill。</span><span data-lang="en">Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.</span></li><li><span data-lang="zh-CN">当用户请求与该 Skill 的触发描述匹配时使用。</span><span data-lang="en">Use this skill when the request matches the frontmatter description.</span></li></ol>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">当你需要把工作流或笔记沉淀成结构精简、触发清晰且带必要 eval 的可复用 Skill 时使用 $yao-meta-skill。</span><span data-lang="en">Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.</span></li><li><span data-lang="zh-CN">Use this skill when the request matches: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</span><span data-lang="en">Use this skill when the request matches the frontmatter description.</span></li></ol>
|
||||
</article>
|
||||
</div>
|
||||
</div>
|
||||
@@ -865,7 +865,7 @@
|
||||
<div class="two-col">
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">触发描述</span><span data-lang="en">Trigger</span></h3>
|
||||
<p><span data-lang="zh-CN">该 Skill 的触发描述来自 SKILL.md frontmatter；默认中文报告先呈现能力边界，原始英文描述可切换到英文查看。</span><span data-lang="en">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</span></p>
|
||||
<p><span data-lang="zh-CN">Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</span><span data-lang="en">Skill-specific source text is authored in Chinese; switch to Simplified Chinese for the exact wording.</span></p>
|
||||
<h3><span data-lang="zh-CN">输入材料</span><span data-lang="en">Inputs</span></h3>
|
||||
<ul class="list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">rough workflow notes, SOPs, runbooks, prompts, transcripts, documents, or repeated task descriptions</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">an existing skill directory that needs refactor, evaluation, packaging, or governance hardening</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">target platform requirements such as OpenAI, Claude, generic Agent Skills, or team distribution</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">benchmark references, local constraints, desired maturity tier, and review standards</span></li></ul>
|
||||
</article>
|
||||
@@ -888,7 +888,7 @@
|
||||
<div>
|
||||
<table>
|
||||
<thead><tr><th><span data-lang="zh-CN">类型</span><span data-lang="en">Type</span></th><th><span data-lang="zh-CN">证据</span><span data-lang="en">Evidence</span></th><th><span data-lang="zh-CN">建议</span><span data-lang="en">Action</span></th></tr></thead>
|
||||
<tbody><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">触发面保持精简，并锚定在 frontmatter description。</span><span data-lang="en">The trigger surface stays lean and anchored in the frontmatter description.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成 Skill IR，核心语义可先于平台打包被审查和迁移。</span><span data-lang="en">Skill IR is generated so core semantics can be reviewed and migrated before platform packaging.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成目标编译报告，可审查 IR 到 OpenAI、Claude、generic 等目标契约的映射。</span><span data-lang="en">Target compilation evidence is generated to review how IR maps to OpenAI, Claude, generic, and other target contracts.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">缺口</span><span data-lang="en">Gap</span></td><td><span data-lang="zh-CN">上下文成本需要补强：入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Context cost needs improvement: Entrypoint is about 339 words/characters; references are about 16934.</span></td><td><span data-lang="zh-CN">纳入下一轮修复</span><span data-lang="en">Fix next</span></td></tr></tbody>
|
||||
<tbody><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">触发面保持精简，并锚定在 frontmatter description。</span><span data-lang="en">The trigger surface stays lean and anchored in the frontmatter description.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成 Skill IR，核心语义可先于平台打包被审查和迁移。</span><span data-lang="en">Skill IR is generated so core semantics can be reviewed and migrated before platform packaging.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成目标编译报告，可审查 IR 到 OpenAI、Claude、generic 等目标契约的映射。</span><span data-lang="en">Target compilation evidence is generated to review how IR maps to OpenAI, Claude, generic, and other target contracts.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">缺口</span><span data-lang="en">Gap</span></td><td><span data-lang="zh-CN">上下文成本需要补强：入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Context cost needs improvement: Entrypoint is about 314 words/characters; references are about 16934.</span></td><td><span data-lang="zh-CN">纳入下一轮修复</span><span data-lang="en">Fix next</span></td></tr></tbody>
|
||||
</table>
|
||||
<div class="two-col quality-panels">
|
||||
<article class="panel">
|
||||
@@ -925,7 +925,7 @@
|
||||
<div>
|
||||
<table>
|
||||
<thead><tr><th><span data-lang="zh-CN">风险</span><span data-lang="en">Risk</span></th><th><span data-lang="zh-CN">信号</span><span data-lang="en">Signal</span></th><th><span data-lang="zh-CN">应对</span><span data-lang="en">Response</span></th></tr></thead>
|
||||
<tbody><tr><td><span data-lang="zh-CN">误触发风险</span><span data-lang="en">Trigger risk</span></td><td><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">输出漂移风险</span><span data-lang="en">Output drift risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">证据不足风险</span><span data-lang="en">Evidence gap risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">包体膨胀风险</span><span data-lang="en">Package bloat risk</span></td><td><span data-lang="zh-CN">SKILL.md 约 339 个词/字。</span><span data-lang="en">SKILL.md is about 339 words/characters.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">跨平台迁移风险</span><span data-lang="en">Portability risk</span></td><td><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr></tbody>
|
||||
<tbody><tr><td><span data-lang="zh-CN">误触发风险</span><span data-lang="en">Trigger risk</span></td><td><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">输出漂移风险</span><span data-lang="en">Output drift risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">证据不足风险</span><span data-lang="en">Evidence gap risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">包体膨胀风险</span><span data-lang="en">Package bloat risk</span></td><td><span data-lang="zh-CN">SKILL.md 约 314 个词/字。</span><span data-lang="en">SKILL.md is about 314 words/characters.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">跨平台迁移风险</span><span data-lang="en">Portability risk</span></td><td><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr></tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
@@ -940,7 +940,7 @@
|
||||
<p><span data-lang="zh-CN">让 reviewer 快速确认关键文件、目录和资产分布。</span><span data-lang="en">Lets reviewers confirm key files, directories, and asset distribution quickly.</span></p>
|
||||
</div>
|
||||
<div class="two-col">
|
||||
<figure class="chart-figure" data-chart="asset_donut"><svg viewBox="0 0 430 270" role="img" aria-label="资产分布"><text data-lang="zh-CN" x="20" y="30" class="chart-title">资产分布</text><text data-lang="en" x="20" y="30" class="chart-title">Asset Distribution</text><circle cx="130" cy="130" r="70" fill="none" stroke="#1B365D" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="0.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#2D5A8A" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-0.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#D0DCE9" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#E4ECF5" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#e8e6dc" stroke-width="24" stroke-dasharray="18.0 82.0" stroke-dashoffset="-2.1" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#504e49" stroke-width="24" stroke-dasharray="79.9 20.1" stroke-dashoffset="-20.1" pathLength="100" transform="rotate(-90 130 130)"/><text data-lang="zh-CN" x="130" y="136" text-anchor="middle">375项</text><text data-lang="en" x="130" y="136" text-anchor="middle">375 items</text><text data-lang="zh-CN" x="235" y="78">SKILL.md</text><text data-lang="en" x="235" y="78">SKILL.md</text><text data-lang="zh-CN" x="235" y="100">README.md</text><text data-lang="en" x="235" y="100">README.md</text><text data-lang="zh-CN" x="235" y="122">agents/interface.yaml</text><text data-lang="en" x="235" y="122">agents/interface.yaml</text><text data-lang="zh-CN" x="235" y="144">manifest.json</text><text data-lang="en" x="235" y="144">manifest.json</text><text data-lang="zh-CN" x="235" y="166">references</text><text data-lang="en" x="235" y="166">references</text><text data-lang="zh-CN" x="235" y="188">scripts</text><text data-lang="en" x="235" y="188">scripts</text></svg><figcaption><span data-lang="zh-CN">资产分布图展示当前包体的文件和目录重心。</span><span data-lang="en">The asset distribution chart shows where files and directories are concentrated.</span></figcaption></figure>
|
||||
<figure class="chart-figure" data-chart="asset_donut"><svg viewBox="0 0 430 270" role="img" aria-label="资产分布"><text data-lang="zh-CN" x="20" y="30" class="chart-title">资产分布</text><text data-lang="en" x="20" y="30" class="chart-title">Asset Distribution</text><circle cx="130" cy="130" r="70" fill="none" stroke="#1B365D" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="0.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#2D5A8A" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-0.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#D0DCE9" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#E4ECF5" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#e8e6dc" stroke-width="24" stroke-dasharray="18.0 82.0" stroke-dashoffset="-2.1" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#504e49" stroke-width="24" stroke-dasharray="79.9 20.1" stroke-dashoffset="-20.1" pathLength="100" transform="rotate(-90 130 130)"/><text data-lang="zh-CN" x="130" y="136" text-anchor="middle">393项</text><text data-lang="en" x="130" y="136" text-anchor="middle">393 items</text><text data-lang="zh-CN" x="235" y="78">SKILL.md</text><text data-lang="en" x="235" y="78">SKILL.md</text><text data-lang="zh-CN" x="235" y="100">README.md</text><text data-lang="en" x="235" y="100">README.md</text><text data-lang="zh-CN" x="235" y="122">agents/interface.yaml</text><text data-lang="en" x="235" y="122">agents/interface.yaml</text><text data-lang="zh-CN" x="235" y="144">manifest.json</text><text data-lang="en" x="235" y="144">manifest.json</text><text data-lang="zh-CN" x="235" y="166">references</text><text data-lang="en" x="235" y="166">references</text><text data-lang="zh-CN" x="235" y="188">scripts</text><text data-lang="en" x="235" y="188">scripts</text></svg><figcaption><span data-lang="zh-CN">资产分布图展示当前包体的文件和目录重心。</span><span data-lang="en">The asset distribution chart shows where files and directories are concentrated.</span></figcaption></figure>
|
||||
<table>
|
||||
<thead><tr><th><span data-lang="zh-CN">路径</span><span data-lang="en">Path</span></th><th><span data-lang="zh-CN">作用</span><span data-lang="en">Role</span></th><th><span data-lang="zh-CN">类型</span><span data-lang="en">Type</span></th></tr></thead>
|
||||
<tbody><tr><td>SKILL.md</td><td><span data-lang="zh-CN">Skill 入口文件</span><span data-lang="en">Skill entrypoint</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>README.md</td><td><span data-lang="zh-CN">人类可读使用说明</span><span data-lang="en">Human-readable usage guide</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>agents/interface.yaml</td><td><span data-lang="zh-CN">跨平台接口元数据</span><span data-lang="en">Neutral interface metadata</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>manifest.json</td><td><span data-lang="zh-CN">生命周期与打包元数据</span><span data-lang="en">Lifecycle and portability metadata</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>references</td><td><span data-lang="zh-CN">扩展指导与复用资料</span><span data-lang="en">Extended guidance and reusable notes</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr><tr><td>scripts</td><td><span data-lang="zh-CN">确定性脚本或本地工具</span><span data-lang="en">Deterministic helpers or local tooling</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr><tr><td>evals</td><td><span data-lang="zh-CN">触发与质量检查</span><span data-lang="en">Trigger and quality checks</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr><tr><td>reports</td><td><span data-lang="zh-CN">生成的证据与总结报告</span><span data-lang="en">Generated evidence and overview artifacts</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr></tbody>
|
||||
|
||||
@@ -3,7 +3,7 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"display_name": "Yao Meta Skill",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"maturity": "governed",
|
||||
"updated_at": "2026-03-31",
|
||||
"core_value": "把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。",
|
||||
@@ -81,7 +81,7 @@
|
||||
"label": "可维护性",
|
||||
"score": 100,
|
||||
"reasons": [
|
||||
"SKILL.md 约 339 个词/字。",
|
||||
"SKILL.md 约 314 个词/字。",
|
||||
"入口文件保持克制，可维护性较好。",
|
||||
"references/ 已承载扩展指导。",
|
||||
"scripts/ 已承载确定性逻辑。",
|
||||
@@ -102,7 +102,7 @@
|
||||
"label": "上下文成本",
|
||||
"score": 42,
|
||||
"reasons": [
|
||||
"入口约 339 个词/字，references 约 16934 个词/字。",
|
||||
"入口约 314 个词/字，references 约 16934 个词/字。",
|
||||
"分数越高代表上下文成本越低。",
|
||||
"上下文成本偏高，建议压缩入口或拆分 references。"
|
||||
]
|
||||
@@ -156,7 +156,7 @@
|
||||
},
|
||||
"contract_boundary": {
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"activation": "manual",
|
||||
"execution": "inline",
|
||||
"shell": "bash"
|
||||
@@ -184,7 +184,7 @@
|
||||
"boundary_cards": [
|
||||
{
|
||||
"label": "Owned",
|
||||
"body": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"body": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
},
|
||||
{
|
||||
"label": "Adjacent",
|
||||
@@ -206,7 +206,7 @@
|
||||
"已生成 Output Review Adjudication，可记录盲评决策、一致率和待评审项。"
|
||||
],
|
||||
"gaps": [
|
||||
"上下文成本需要补强：入口约 339 个词/字，references 约 16934 个词/字。"
|
||||
"上下文成本需要补强：入口约 314 个词/字，references 约 16934 个词/字。"
|
||||
],
|
||||
"recommendations": [
|
||||
"先改触发边界，再扩展工作流。",
|
||||
@@ -271,7 +271,7 @@
|
||||
"name": "包体膨胀风险",
|
||||
"impact": 2,
|
||||
"probability": 1,
|
||||
"signal": "SKILL.md 约 339 个词/字。",
|
||||
"signal": "SKILL.md 约 314 个词/字。",
|
||||
"response": "先补证据和边界，再增加包体复杂度。"
|
||||
},
|
||||
{
|
||||
@@ -522,10 +522,10 @@
|
||||
"path": "reports",
|
||||
"label": "Generated evidence and overview artifacts",
|
||||
"kind": "folder",
|
||||
"file_count": 152
|
||||
"file_count": 170
|
||||
}
|
||||
],
|
||||
"file_count": 375,
|
||||
"file_count": 393,
|
||||
"folder_count": 4,
|
||||
"distribution": [
|
||||
{
|
||||
@@ -558,7 +558,7 @@
|
||||
},
|
||||
{
|
||||
"label": "reports",
|
||||
"value": 152
|
||||
"value": 170
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -637,17 +637,17 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"display_name": "Yao Meta Skill",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"logic_steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"usage_steps": [
|
||||
"Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.",
|
||||
"Use this skill when the request matches: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"Use this skill when the request matches: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
],
|
||||
"package_map": [
|
||||
{
|
||||
@@ -696,7 +696,7 @@
|
||||
"path": "reports",
|
||||
"label": "Generated evidence and overview artifacts",
|
||||
"kind": "folder",
|
||||
"file_count": 152
|
||||
"file_count": 170
|
||||
}
|
||||
],
|
||||
"strengths": [
|
||||
@@ -714,7 +714,7 @@
|
||||
"用户说出类似需求时：Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals."
|
||||
],
|
||||
"trigger_contract": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"activation": "manual",
|
||||
"execution": "inline",
|
||||
"shell": "bash"
|
||||
@@ -1016,12 +1016,12 @@
|
||||
"ok": true,
|
||||
"summary": {
|
||||
"reproducibility_ready": true,
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"methodology_complete": true,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"evidence_bundle_sha256": "e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64cbe8db9ad",
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"evidence_bundle_sha256": "6c95043c2d8513102b37bc70a01647246933c84e8a27c2748cc2cae20e040158",
|
||||
"source_contract_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"output_case_count": 5,
|
||||
"failure_disclosure_count": 3,
|
||||
@@ -1039,19 +1039,19 @@
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3,
|
||||
"public_claim_blocker_count": 4,
|
||||
"working_tree_dirty": true,
|
||||
"changed_file_count": 3,
|
||||
"source_tree_dirty": false,
|
||||
"source_changed_file_count": 0,
|
||||
"changed_file_count": 37,
|
||||
"source_tree_dirty": true,
|
||||
"source_changed_file_count": 1,
|
||||
"generated_tree_dirty": true,
|
||||
"generated_changed_file_count": 3
|
||||
"generated_changed_file_count": 36
|
||||
},
|
||||
"commit": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"commit": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"missing_artifacts": [],
|
||||
"limitations": [
|
||||
"The git commit and dirty flags are generation-time context; release lock is blocked by source changes, while generated evidence artifacts are tracked separately.",
|
||||
@@ -1157,7 +1157,7 @@
|
||||
"interactive_script_count": 0,
|
||||
"package_hash_scope": "source-contract-without-generated-reports",
|
||||
"package_hash_file_count": 247,
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
},
|
||||
"skill_atlas": {
|
||||
"skill_count": 11,
|
||||
@@ -1181,7 +1181,7 @@
|
||||
"schema_version": "2.0",
|
||||
"name": "yao-meta-skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"targets": [
|
||||
"openai",
|
||||
"claude",
|
||||
@@ -1195,7 +1195,7 @@
|
||||
"trust_level": "local",
|
||||
"license": "MIT",
|
||||
"checksums": {
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7"
|
||||
},
|
||||
"compatibility": {
|
||||
@@ -1232,7 +1232,7 @@
|
||||
"install_simulated": true,
|
||||
"install_simulation": "reports/install_simulation.json"
|
||||
},
|
||||
"generated_at": "2026-06-21"
|
||||
"generated_at": "2026-06-13"
|
||||
},
|
||||
"failures": [],
|
||||
"warnings": []
|
||||
@@ -1256,7 +1256,7 @@
|
||||
"ok": true,
|
||||
"summary": {
|
||||
"archive_present": true,
|
||||
"archive_entry_count": 580,
|
||||
"archive_entry_count": 598,
|
||||
"nested_skill_entry_count": 0,
|
||||
"archive_extracted": true,
|
||||
"entrypoint_loaded": true,
|
||||
@@ -1317,7 +1317,7 @@
|
||||
{
|
||||
"field": "description",
|
||||
"from": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes.",
|
||||
"to": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"to": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
}
|
||||
],
|
||||
"checksum_changes": [
|
||||
@@ -1329,7 +1329,7 @@
|
||||
{
|
||||
"field": "package_sha256",
|
||||
"from": "0000000000000000000000000000000000000000000000000000000000000000",
|
||||
"to": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"to": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -2223,7 +2223,7 @@
|
||||
},
|
||||
"synthesis_highlights": [
|
||||
"Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.",
|
||||
"Borrow a review checkpoint wherever trust matters more than raw speed.",
|
||||
"Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.",
|
||||
"Borrow the discipline of defining what the skill should not own before growing the package."
|
||||
],
|
||||
"artifact_design": {
|
||||
|
||||
@@ -153,7 +153,7 @@ Next move: add real client or installer permission enforcement integration.
|
||||
| World-Class Evidence Ledger | `4` evidence entries remain pending: `1` human-required and `3` external-required; anti-overclaim guards block planned work, metadata fallbacks, pending review, and local command runners from counting as completion |
|
||||
| Benchmark Reproducibility | local reproducibility ready with `25` required artifacts, `0` missing artifacts, `23` reproduction commands, and `3` disclosed failure cases; human review, native permission enforcement, native telemetry, and provider ledger approval remain explicit limitations |
|
||||
| IR-first Packaging | `openai`, `claude`, `generic`, and `vscode` adapters include compiler contracts, permission contracts, target-native behavior contracts, IR provenance, semantic parity checks, and install-scope notes where applicable |
|
||||
| Context Budget | initial load `998/1000`; deferred `530167/120000`; resource governance governed |
|
||||
| Context Budget | initial load `987/1000`; deferred `530167/120000`; resource governance governed |
|
||||
| CI | `make ci-test` target count is `83` after adding the dedicated Operator UX verifier |
|
||||
|
||||
## Next Highest-Leverage Moves
|
||||
|
||||
+11
-11
@@ -761,7 +761,7 @@
|
||||
<p class="eyebrow"><span data-lang="zh-CN">YAO Skill 生成审计报告</span><span data-lang="en">YAO Skill Generation Audit</span></p>
|
||||
<p class="slug">yao-meta-skill</p>
|
||||
<h1 id="report-title"><span data-lang="zh-CN">技能审计报告</span><span data-lang="en">Yao Meta Skill Audit Report</span></h1>
|
||||
<p class="lead"><span data-lang="zh-CN">这份报告默认使用中文简体，把新 Skill 的定位、指标、原理、契约、质量、风险、资产和迭代路线整理为一份可审计的 HTML 报告。</span><span data-lang="en">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</span></p>
|
||||
<p class="lead"><span data-lang="zh-CN">这份报告默认使用中文简体，把新 Skill 的定位、指标、原理、契约、质量、风险、资产和迭代路线整理为一份可审计的 HTML 报告。</span><span data-lang="en">Skill-specific source text is authored in Chinese; switch to Simplified Chinese for the exact wording.</span></p>
|
||||
<div class="hero-meta"><span><span data-lang="zh-CN">技能名称：yao-meta-skill</span><span data-lang="en">Skill name: yao-meta-skill</span></span><span><span data-lang="zh-CN">成熟度：治理</span><span data-lang="en">Maturity: governed</span></span><span><span data-lang="zh-CN">格式：Agent Skills</span><span data-lang="en">Format: agent-skills</span></span><span><span data-lang="zh-CN">更新时间：2026-03-31</span><span data-lang="en">Updated: 2026-03-31</span></span></div>
|
||||
<div class="badges"><span><span data-lang="zh-CN">openai</span><span data-lang="en">openai</span></span><span><span data-lang="zh-CN">claude</span><span data-lang="en">claude</span></span><span><span data-lang="zh-CN">generic</span><span data-lang="en">generic</span></span><span><span data-lang="zh-CN">vscode</span><span data-lang="en">vscode</span></span></div>
|
||||
</div>
|
||||
@@ -770,7 +770,7 @@
|
||||
<ul class="list"><li><span data-lang="zh-CN">把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。</span><span data-lang="en">Turn one-off experience into a reusable, evaluable, and portable skill package.</span></li><li><span data-lang="zh-CN">Skill 作者、复用团队和后续 reviewer。</span><span data-lang="en">Skill authors, reuse teams, and later reviewers.</span></li><li><span data-lang="zh-CN">创建完成后建议先打开 reports/skill-overview.html，再继续扩展包体。</span><span data-lang="en">After creation, open reports/skill-overview.html before expanding the package further.</span></li></ul>
|
||||
</aside>
|
||||
</div>
|
||||
<div class="score-strip" aria-label="报告关键指标"><article class='score-chip'><span><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong><i style='--score:42%'></i><small><span data-lang="zh-CN">入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 339 words/characters; references are about 16934.</span></small></article></div>
|
||||
<div class="score-strip" aria-label="报告关键指标"><article class='score-chip'><span><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong><i style='--score:100%'></i><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></article><article class='score-chip'><span><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong><i style='--score:42%'></i><small><span data-lang="zh-CN">入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 314 words/characters; references are about 16934.</span></small></article></div>
|
||||
</section>
|
||||
|
||||
<section id="overview">
|
||||
@@ -782,7 +782,7 @@
|
||||
<div class="two-col">
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">作用定位</span><span data-lang="en">Role</span></h3>
|
||||
<ul class="list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</span></li><li><span data-lang="zh-CN">把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。</span><span data-lang="en">Turn one-off experience into a reusable, evaluable, and portable skill package.</span></li><li><span data-lang="zh-CN">交付结果：SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html</span><span data-lang="en">Deliverables: SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html</span></li></ul>
|
||||
<ul class="list"><li><span data-lang="zh-CN">Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</span><span data-lang="en">Skill-specific source text is authored in Chinese; switch to Simplified Chinese for the exact wording.</span></li><li><span data-lang="zh-CN">把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。</span><span data-lang="en">Turn one-off experience into a reusable, evaluable, and portable skill package.</span></li><li><span data-lang="zh-CN">交付结果：SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html</span><span data-lang="en">Deliverables: SKILL.md, agents/interface.yaml, skill-ir/examples/yao-meta-skill.json, reports/compiled_targets.md, reports/output_quality_scorecard.md, reports/output_execution_runs.md, reports/output_blind_review_pack.md, reports/output_review_kit.md, reports/output_review_adjudication.md, reports/benchmark_reproducibility.md, reports/output_blind_answer_key.json, reports/conformance_matrix.md, reports/security_trust_report.md, reports/runtime_permission_probes.md, reports/skill_atlas.html, reports/registry_audit.md, reports/package_verification.md, reports/install_simulation.md, reports/upgrade_check.md, reports/adoption_drift_report.md, reports/review_waivers.md, reports/world_class_evidence_plan.md, reports/world_class_evidence_ledger.md, reports/review_annotations.md, reports/review-studio.html, reports/skill-interpretation.html, reports/skill-overview.html</span></li></ul>
|
||||
</article>
|
||||
<figure class="chart-figure" data-chart="flow"><svg viewBox="0 0 620 170" role="img" aria-label="交付流程"><text data-lang="zh-CN" x="20" y="28" class="chart-title">交付流程</text><text data-lang="en" x="20" y="28" class="chart-title">Delivery Flow</text><path d="M188 93 H248 M398 93 H458" class="chart-line"/><g><rect x="38" y="56" width="150" height="74" rx="8" fill="#F6F8FB" stroke="#e8e6dc"/><text data-lang="zh-CN" x="113" y="99" text-anchor="middle">输入材料</text><text data-lang="en" x="113" y="99" text-anchor="middle">Input material</text></g><g><rect x="248" y="56" width="150" height="74" rx="8" fill="#F6F8FB" stroke="#e8e6dc"/><text data-lang="zh-CN" x="323" y="99" text-anchor="middle">Skill 包体</text><text data-lang="en" x="323" y="99" text-anchor="middle">Skill package</text></g><g><rect x="458" y="56" width="150" height="74" rx="8" fill="#F6F8FB" stroke="#e8e6dc"/><text data-lang="zh-CN" x="533" y="99" text-anchor="middle">可复用能力</text><text data-lang="en" x="533" y="99" text-anchor="middle">Reusable capability</text></g></svg><figcaption><span data-lang="zh-CN">交付流程把用户输入、生成的包体和可复用能力放在一条线上。</span><span data-lang="en">The delivery flow places user input, generated package, and reusable capability on one path.</span></figcaption></figure>
|
||||
</div>
|
||||
@@ -807,12 +807,12 @@
|
||||
<article class="panel metrics-note metrics-summary-panel">
|
||||
<h3><span data-lang="zh-CN">成熟度条</span><span data-lang="en">Maturity Bar</span></h3>
|
||||
<p><span data-lang="zh-CN">这里把每个指标压缩为状态、分数和第一条证据，先给出整体判断，再进入下方明细。</span><span data-lang="en">This compresses each metric into status, score, and the first evidence item before the detailed cards below.</span></p>
|
||||
<ol class='metric-summary-list'><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></b><em>100</em><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></b><em>100</em><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 约 339 个词/字。</span><span data-lang="en">SKILL.md is about 339 words/characters.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></b><em>100</em><small><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">关注</span><span data-lang="en">Watch</span></span><b><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></b><em>42</em><small><span data-lang="zh-CN">入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 339 words/characters; references are about 16934.</span></small></li></ol>
|
||||
<ol class='metric-summary-list'><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></b><em>100</em><small><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></b><em>100</em><small><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></b><em>100</em><small><span data-lang="zh-CN">SKILL.md 约 314 个词/字。</span><span data-lang="en">SKILL.md is about 314 words/characters.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">稳定</span><span data-lang="en">Stable</span></span><b><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></b><em>100</em><small><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></small></li><li><span class='metric-status'><span data-lang="zh-CN">关注</span><span data-lang="en">Watch</span></span><b><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></b><em>42</em><small><span data-lang="zh-CN">入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 314 words/characters; references are about 16934.</span></small></li></ol>
|
||||
</article>
|
||||
</div>
|
||||
<div class="metric-detail-section">
|
||||
<div class="detail-section-kicker"><span data-lang="zh-CN">指标明细</span><span data-lang="en">Metric Details</span></div>
|
||||
<div class="metric-grid metric-detail-grid"><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></li><li><span data-lang="zh-CN">README.md 已存在，便于人工阅读。</span><span data-lang="en">README.md exists for human-readable usage.</span></li><li><span data-lang="zh-CN">agents/interface.yaml 已存在，便于跨平台适配。</span><span data-lang="en">agents/interface.yaml exists for cross-platform adaptation.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></li><li><span data-lang="zh-CN">description 有足够长度说明任务边界。</span><span data-lang="en">The description is long enough to explain the task boundary.</span></li><li><span data-lang="zh-CN">description 已包含使用场景或排除边界信号。</span><span data-lang="en">The description includes usage-scenario or exclusion-boundary signals.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></li><li><span data-lang="zh-CN">skill-ir.json 已存在。</span><span data-lang="en">skill-ir.json exists.</span></li><li><span data-lang="zh-CN">compiled_targets.json 已存在。</span><span data-lang="en">compiled_targets.json exists.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 约 339 个词/字。</span><span data-lang="en">SKILL.md is about 339 words/characters.</span></li><li><span data-lang="zh-CN">入口文件保持克制，可维护性较好。</span><span data-lang="en">The entrypoint stays restrained, which supports maintainability.</span></li><li><span data-lang="zh-CN">references/ 已承载扩展指导。</span><span data-lang="en">references/ carries extended guidance.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></li><li><span data-lang="zh-CN">manifest.json 已存在。</span><span data-lang="en">manifest.json exists.</span></li><li><span data-lang="zh-CN">目标平台或 adapter target 已声明。</span><span data-lang="en">Target platforms or adapter targets are declared.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 339 words/characters; references are about 16934.</span></li><li><span data-lang="zh-CN">分数越高代表上下文成本越低。</span><span data-lang="en">A higher score means lower context cost.</span></li><li><span data-lang="zh-CN">上下文成本偏高，建议压缩入口或拆分 references。</span><span data-lang="en">Context cost is high; compress the entrypoint or split references further.</span></li></ul></div></article></div>
|
||||
<div class="metric-grid metric-detail-grid"><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">完整度</span><span data-lang="en">Completeness</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 已存在，是 Skill 的入口。</span><span data-lang="en">SKILL.md exists and acts as the skill entrypoint.</span></li><li><span data-lang="zh-CN">README.md 已存在，便于人工阅读。</span><span data-lang="en">README.md exists for human-readable usage.</span></li><li><span data-lang="zh-CN">agents/interface.yaml 已存在，便于跨平台适配。</span><span data-lang="en">agents/interface.yaml exists for cross-platform adaptation.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">触发清晰</span><span data-lang="en">Trigger clarity</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></li><li><span data-lang="zh-CN">description 有足够长度说明任务边界。</span><span data-lang="en">The description is long enough to explain the task boundary.</span></li><li><span data-lang="zh-CN">description 已包含使用场景或排除边界信号。</span><span data-lang="en">The description includes usage-scenario or exclusion-boundary signals.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">证据充分</span><span data-lang="en">Evidence depth</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></li><li><span data-lang="zh-CN">skill-ir.json 已存在。</span><span data-lang="en">skill-ir.json exists.</span></li><li><span data-lang="zh-CN">compiled_targets.json 已存在。</span><span data-lang="en">compiled_targets.json exists.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可维护性</span><span data-lang="en">Maintainability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">SKILL.md 约 314 个词/字。</span><span data-lang="en">SKILL.md is about 314 words/characters.</span></li><li><span data-lang="zh-CN">入口文件保持克制，可维护性较好。</span><span data-lang="en">The entrypoint stays restrained, which supports maintainability.</span></li><li><span data-lang="zh-CN">references/ 已承载扩展指导。</span><span data-lang="en">references/ carries extended guidance.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">可迁移性</span><span data-lang="en">Portability</span></span><strong>100</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></li><li><span data-lang="zh-CN">manifest.json 已存在。</span><span data-lang="en">manifest.json exists.</span></li><li><span data-lang="zh-CN">目标平台或 adapter target 已声明。</span><span data-lang="en">Target platforms or adapter targets are declared.</span></li></ul></div></article><article class='metric-card'><div class='metric-card-head'><span class='metric-label'><span data-lang="zh-CN">上下文成本</span><span data-lang="en">Context cost</span></span><strong>42</strong></div><div class='metric-card-body'><ul class="compact-list"><li><span data-lang="zh-CN">入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Entrypoint is about 314 words/characters; references are about 16934.</span></li><li><span data-lang="zh-CN">分数越高代表上下文成本越低。</span><span data-lang="en">A higher score means lower context cost.</span></li><li><span data-lang="zh-CN">上下文成本偏高，建议压缩入口或拆分 references。</span><span data-lang="en">Context cost is high; compress the entrypoint or split references further.</span></li></ul></div></article></div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
@@ -845,11 +845,11 @@
|
||||
<div class="two-col">
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">执行流程</span><span data-lang="en">Execution Flow</span></h3>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Capture job, output, exclusions, constraints, standards, and the lightest fit.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Write `description` early, test route quality, then add only earned folders and gates.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful.</span></li></ol>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Capture job, output, exclusions, constraints, standards, lightest fit.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned.</span></li></ol>
|
||||
</article>
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">调用方式</span><span data-lang="en">How To Use</span></h3>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">当你需要把工作流或笔记沉淀成结构精简、触发清晰且带必要 eval 的可复用 Skill 时使用 $yao-meta-skill。</span><span data-lang="en">Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.</span></li><li><span data-lang="zh-CN">当用户请求与该 Skill 的触发描述匹配时使用。</span><span data-lang="en">Use this skill when the request matches the frontmatter description.</span></li></ol>
|
||||
<ol class="step-list"><li><span data-lang="zh-CN">当你需要把工作流或笔记沉淀成结构精简、触发清晰且带必要 eval 的可复用 Skill 时使用 $yao-meta-skill。</span><span data-lang="en">Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.</span></li><li><span data-lang="zh-CN">Use this skill when the request matches: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</span><span data-lang="en">Use this skill when the request matches the frontmatter description.</span></li></ol>
|
||||
</article>
|
||||
</div>
|
||||
</div>
|
||||
@@ -865,7 +865,7 @@
|
||||
<div class="two-col">
|
||||
<article class="panel">
|
||||
<h3><span data-lang="zh-CN">触发描述</span><span data-lang="en">Trigger</span></h3>
|
||||
<p><span data-lang="zh-CN">该 Skill 的触发描述来自 SKILL.md frontmatter；默认中文报告先呈现能力边界，原始英文描述可切换到英文查看。</span><span data-lang="en">Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.</span></p>
|
||||
<p><span data-lang="zh-CN">Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.</span><span data-lang="en">Skill-specific source text is authored in Chinese; switch to Simplified Chinese for the exact wording.</span></p>
|
||||
<h3><span data-lang="zh-CN">输入材料</span><span data-lang="en">Inputs</span></h3>
|
||||
<ul class="list"><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">rough workflow notes, SOPs, runbooks, prompts, transcripts, documents, or repeated task descriptions</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">an existing skill directory that needs refactor, evaluation, packaging, or governance hardening</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">target platform requirements such as OpenAI, Claude, generic Agent Skills, or team distribution</span></li><li><span data-lang="zh-CN">原始说明可切换到英文查看；默认中文报告保留结论与结构说明。</span><span data-lang="en">benchmark references, local constraints, desired maturity tier, and review standards</span></li></ul>
|
||||
</article>
|
||||
@@ -888,7 +888,7 @@
|
||||
<div>
|
||||
<table>
|
||||
<thead><tr><th><span data-lang="zh-CN">类型</span><span data-lang="en">Type</span></th><th><span data-lang="zh-CN">证据</span><span data-lang="en">Evidence</span></th><th><span data-lang="zh-CN">建议</span><span data-lang="en">Action</span></th></tr></thead>
|
||||
<tbody><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">触发面保持精简，并锚定在 frontmatter description。</span><span data-lang="en">The trigger surface stays lean and anchored in the frontmatter description.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成 Skill IR，核心语义可先于平台打包被审查和迁移。</span><span data-lang="en">Skill IR is generated so core semantics can be reviewed and migrated before platform packaging.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成目标编译报告，可审查 IR 到 OpenAI、Claude、generic 等目标契约的映射。</span><span data-lang="en">Target compilation evidence is generated to review how IR maps to OpenAI, Claude, generic, and other target contracts.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">缺口</span><span data-lang="en">Gap</span></td><td><span data-lang="zh-CN">上下文成本需要补强：入口约 339 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Context cost needs improvement: Entrypoint is about 339 words/characters; references are about 16934.</span></td><td><span data-lang="zh-CN">纳入下一轮修复</span><span data-lang="en">Fix next</span></td></tr></tbody>
|
||||
<tbody><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">触发面保持精简，并锚定在 frontmatter description。</span><span data-lang="en">The trigger surface stays lean and anchored in the frontmatter description.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成 Skill IR，核心语义可先于平台打包被审查和迁移。</span><span data-lang="en">Skill IR is generated so core semantics can be reviewed and migrated before platform packaging.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">强项</span><span data-lang="en">Strength</span></td><td><span data-lang="zh-CN">已生成目标编译报告，可审查 IR 到 OpenAI、Claude、generic 等目标契约的映射。</span><span data-lang="en">Target compilation evidence is generated to review how IR maps to OpenAI, Claude, generic, and other target contracts.</span></td><td><span data-lang="zh-CN">保留并复用</span><span data-lang="en">Keep</span></td></tr><tr><td><span data-lang="zh-CN">缺口</span><span data-lang="en">Gap</span></td><td><span data-lang="zh-CN">上下文成本需要补强：入口约 314 个词/字，references 约 16934 个词/字。</span><span data-lang="en">Context cost needs improvement: Entrypoint is about 314 words/characters; references are about 16934.</span></td><td><span data-lang="zh-CN">纳入下一轮修复</span><span data-lang="en">Fix next</span></td></tr></tbody>
|
||||
</table>
|
||||
<div class="two-col quality-panels">
|
||||
<article class="panel">
|
||||
@@ -925,7 +925,7 @@
|
||||
<div>
|
||||
<table>
|
||||
<thead><tr><th><span data-lang="zh-CN">风险</span><span data-lang="en">Risk</span></th><th><span data-lang="zh-CN">信号</span><span data-lang="en">Signal</span></th><th><span data-lang="zh-CN">应对</span><span data-lang="en">Response</span></th></tr></thead>
|
||||
<tbody><tr><td><span data-lang="zh-CN">误触发风险</span><span data-lang="en">Trigger risk</span></td><td><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">输出漂移风险</span><span data-lang="en">Output drift risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">证据不足风险</span><span data-lang="en">Evidence gap risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">包体膨胀风险</span><span data-lang="en">Package bloat risk</span></td><td><span data-lang="zh-CN">SKILL.md 约 339 个词/字。</span><span data-lang="en">SKILL.md is about 339 words/characters.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">跨平台迁移风险</span><span data-lang="en">Portability risk</span></td><td><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr></tbody>
|
||||
<tbody><tr><td><span data-lang="zh-CN">误触发风险</span><span data-lang="en">Trigger risk</span></td><td><span data-lang="zh-CN">frontmatter description 已存在，具备基础路由面。</span><span data-lang="en">The frontmatter description exists, giving the skill a basic routing surface.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">输出漂移风险</span><span data-lang="en">Output drift risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">证据不足风险</span><span data-lang="en">Evidence gap risk</span></td><td><span data-lang="zh-CN">已生成 20 / 20 类报告证据。</span><span data-lang="en">Generated 20 / 20 evidence report types.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">包体膨胀风险</span><span data-lang="en">Package bloat risk</span></td><td><span data-lang="zh-CN">SKILL.md 约 314 个词/字。</span><span data-lang="en">SKILL.md is about 314 words/characters.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr><tr><td><span data-lang="zh-CN">跨平台迁移风险</span><span data-lang="en">Portability risk</span></td><td><span data-lang="zh-CN">agents/interface.yaml 已存在。</span><span data-lang="en">agents/interface.yaml exists.</span></td><td><span data-lang="zh-CN">先补证据和边界，再增加包体复杂度。</span><span data-lang="en">Improve evidence and boundaries before adding package complexity.</span></td></tr></tbody>
|
||||
</table>
|
||||
</div>
|
||||
</div>
|
||||
@@ -940,7 +940,7 @@
|
||||
<p><span data-lang="zh-CN">让 reviewer 快速确认关键文件、目录和资产分布。</span><span data-lang="en">Lets reviewers confirm key files, directories, and asset distribution quickly.</span></p>
|
||||
</div>
|
||||
<div class="two-col">
|
||||
<figure class="chart-figure" data-chart="asset_donut"><svg viewBox="0 0 430 270" role="img" aria-label="资产分布"><text data-lang="zh-CN" x="20" y="30" class="chart-title">资产分布</text><text data-lang="en" x="20" y="30" class="chart-title">Asset Distribution</text><circle cx="130" cy="130" r="70" fill="none" stroke="#1B365D" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="0.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#2D5A8A" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-0.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#D0DCE9" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#E4ECF5" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#e8e6dc" stroke-width="24" stroke-dasharray="18.0 82.0" stroke-dashoffset="-2.1" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#504e49" stroke-width="24" stroke-dasharray="79.9 20.1" stroke-dashoffset="-20.1" pathLength="100" transform="rotate(-90 130 130)"/><text data-lang="zh-CN" x="130" y="136" text-anchor="middle">375项</text><text data-lang="en" x="130" y="136" text-anchor="middle">375 items</text><text data-lang="zh-CN" x="235" y="78">SKILL.md</text><text data-lang="en" x="235" y="78">SKILL.md</text><text data-lang="zh-CN" x="235" y="100">README.md</text><text data-lang="en" x="235" y="100">README.md</text><text data-lang="zh-CN" x="235" y="122">agents/interface.yaml</text><text data-lang="en" x="235" y="122">agents/interface.yaml</text><text data-lang="zh-CN" x="235" y="144">manifest.json</text><text data-lang="en" x="235" y="144">manifest.json</text><text data-lang="zh-CN" x="235" y="166">references</text><text data-lang="en" x="235" y="166">references</text><text data-lang="zh-CN" x="235" y="188">scripts</text><text data-lang="en" x="235" y="188">scripts</text></svg><figcaption><span data-lang="zh-CN">资产分布图展示当前包体的文件和目录重心。</span><span data-lang="en">The asset distribution chart shows where files and directories are concentrated.</span></figcaption></figure>
|
||||
<figure class="chart-figure" data-chart="asset_donut"><svg viewBox="0 0 430 270" role="img" aria-label="资产分布"><text data-lang="zh-CN" x="20" y="30" class="chart-title">资产分布</text><text data-lang="en" x="20" y="30" class="chart-title">Asset Distribution</text><circle cx="130" cy="130" r="70" fill="none" stroke="#1B365D" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="0.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#2D5A8A" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-0.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#D0DCE9" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.0" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#E4ECF5" stroke-width="24" stroke-dasharray="0.5 99.5" stroke-dashoffset="-1.5" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#e8e6dc" stroke-width="24" stroke-dasharray="18.0 82.0" stroke-dashoffset="-2.1" pathLength="100" transform="rotate(-90 130 130)"/><circle cx="130" cy="130" r="70" fill="none" stroke="#504e49" stroke-width="24" stroke-dasharray="79.9 20.1" stroke-dashoffset="-20.1" pathLength="100" transform="rotate(-90 130 130)"/><text data-lang="zh-CN" x="130" y="136" text-anchor="middle">393项</text><text data-lang="en" x="130" y="136" text-anchor="middle">393 items</text><text data-lang="zh-CN" x="235" y="78">SKILL.md</text><text data-lang="en" x="235" y="78">SKILL.md</text><text data-lang="zh-CN" x="235" y="100">README.md</text><text data-lang="en" x="235" y="100">README.md</text><text data-lang="zh-CN" x="235" y="122">agents/interface.yaml</text><text data-lang="en" x="235" y="122">agents/interface.yaml</text><text data-lang="zh-CN" x="235" y="144">manifest.json</text><text data-lang="en" x="235" y="144">manifest.json</text><text data-lang="zh-CN" x="235" y="166">references</text><text data-lang="en" x="235" y="166">references</text><text data-lang="zh-CN" x="235" y="188">scripts</text><text data-lang="en" x="235" y="188">scripts</text></svg><figcaption><span data-lang="zh-CN">资产分布图展示当前包体的文件和目录重心。</span><span data-lang="en">The asset distribution chart shows where files and directories are concentrated.</span></figcaption></figure>
|
||||
<table>
|
||||
<thead><tr><th><span data-lang="zh-CN">路径</span><span data-lang="en">Path</span></th><th><span data-lang="zh-CN">作用</span><span data-lang="en">Role</span></th><th><span data-lang="zh-CN">类型</span><span data-lang="en">Type</span></th></tr></thead>
|
||||
<tbody><tr><td>SKILL.md</td><td><span data-lang="zh-CN">Skill 入口文件</span><span data-lang="en">Skill entrypoint</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>README.md</td><td><span data-lang="zh-CN">人类可读使用说明</span><span data-lang="en">Human-readable usage guide</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>agents/interface.yaml</td><td><span data-lang="zh-CN">跨平台接口元数据</span><span data-lang="en">Neutral interface metadata</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>manifest.json</td><td><span data-lang="zh-CN">生命周期与打包元数据</span><span data-lang="en">Lifecycle and portability metadata</span></td><td><span data-lang="zh-CN">文件</span><span data-lang="en">file</span></td></tr><tr><td>references</td><td><span data-lang="zh-CN">扩展指导与复用资料</span><span data-lang="en">Extended guidance and reusable notes</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr><tr><td>scripts</td><td><span data-lang="zh-CN">确定性脚本或本地工具</span><span data-lang="en">Deterministic helpers or local tooling</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr><tr><td>evals</td><td><span data-lang="zh-CN">触发与质量检查</span><span data-lang="en">Trigger and quality checks</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr><tr><td>reports</td><td><span data-lang="zh-CN">生成的证据与总结报告</span><span data-lang="en">Generated evidence and overview artifacts</span></td><td><span data-lang="zh-CN">目录</span><span data-lang="en">folder</span></td></tr></tbody>
|
||||
|
||||
+38
-38
@@ -3,7 +3,7 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"display_name": "Yao Meta Skill",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"maturity": "governed",
|
||||
"updated_at": "2026-03-31",
|
||||
"core_value": "把一次性经验沉淀为可复用、可评估、可迁移的 Skill 包体。",
|
||||
@@ -80,7 +80,7 @@
|
||||
"label": "可维护性",
|
||||
"score": 100,
|
||||
"reasons": [
|
||||
"SKILL.md 约 339 个词/字。",
|
||||
"SKILL.md 约 314 个词/字。",
|
||||
"入口文件保持克制，可维护性较好。",
|
||||
"references/ 已承载扩展指导。",
|
||||
"scripts/ 已承载确定性逻辑。",
|
||||
@@ -101,7 +101,7 @@
|
||||
"label": "上下文成本",
|
||||
"score": 42,
|
||||
"reasons": [
|
||||
"入口约 339 个词/字，references 约 16934 个词/字。",
|
||||
"入口约 314 个词/字，references 约 16934 个词/字。",
|
||||
"分数越高代表上下文成本越低。",
|
||||
"上下文成本偏高，建议压缩入口或拆分 references。"
|
||||
]
|
||||
@@ -155,7 +155,7 @@
|
||||
},
|
||||
"contract_boundary": {
|
||||
"trigger": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"activation": "manual",
|
||||
"execution": "inline",
|
||||
"shell": "bash"
|
||||
@@ -183,7 +183,7 @@
|
||||
"boundary_cards": [
|
||||
{
|
||||
"label": "Owned",
|
||||
"body": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"body": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
},
|
||||
{
|
||||
"label": "Adjacent",
|
||||
@@ -205,7 +205,7 @@
|
||||
"已生成 Output Review Adjudication，可记录盲评决策、一致率和待评审项。"
|
||||
],
|
||||
"gaps": [
|
||||
"上下文成本需要补强：入口约 339 个词/字，references 约 16934 个词/字。"
|
||||
"上下文成本需要补强：入口约 314 个词/字，references 约 16934 个词/字。"
|
||||
],
|
||||
"recommendations": [
|
||||
"先改触发边界，再扩展工作流。",
|
||||
@@ -270,7 +270,7 @@
|
||||
"name": "包体膨胀风险",
|
||||
"impact": 2,
|
||||
"probability": 1,
|
||||
"signal": "SKILL.md 约 339 个词/字。",
|
||||
"signal": "SKILL.md 约 314 个词/字。",
|
||||
"response": "先补证据和边界，再增加包体复杂度。"
|
||||
},
|
||||
{
|
||||
@@ -521,10 +521,10 @@
|
||||
"path": "reports",
|
||||
"label": "Generated evidence and overview artifacts",
|
||||
"kind": "folder",
|
||||
"file_count": 152
|
||||
"file_count": 170
|
||||
}
|
||||
],
|
||||
"file_count": 375,
|
||||
"file_count": 393,
|
||||
"folder_count": 4,
|
||||
"distribution": [
|
||||
{
|
||||
@@ -557,7 +557,7 @@
|
||||
},
|
||||
{
|
||||
"label": "reports",
|
||||
"value": 152
|
||||
"value": 170
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -632,17 +632,17 @@
|
||||
"name": "yao-meta-skill",
|
||||
"title": "Yao Meta Skill",
|
||||
"display_name": "Yao Meta Skill",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"logic_steps": [
|
||||
"For one-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, and the lightest fit.",
|
||||
"Scan references in order: external benchmark, user source, local fit; surface only uncertainty or conflict.",
|
||||
"Write `description` early, test route quality, then add only earned folders and gates.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, and next directions only when useful."
|
||||
"One-off/no reusable process: `Do not create a skill`; `near-neighbor`; require `repeated use` + `reusable output contract`.",
|
||||
"Capture job, output, exclusions, constraints, standards, lightest fit.",
|
||||
"Scan up to `3-5` references: external, user, local; skip tiny edits; surface only uncertainty/conflict.",
|
||||
"Write `description` early; route/boundary edits need `trigger_eval.py`; releases need risk-matched gates before folders.",
|
||||
"Add output-risk, artifact-design, prompt-quality, system-model, next directions only when earned."
|
||||
],
|
||||
"usage_steps": [
|
||||
"Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals.",
|
||||
"Use this skill when the request matches: Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"Use this skill when the request matches: Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
],
|
||||
"package_map": [
|
||||
{
|
||||
@@ -691,7 +691,7 @@
|
||||
"path": "reports",
|
||||
"label": "Generated evidence and overview artifacts",
|
||||
"kind": "folder",
|
||||
"file_count": 152
|
||||
"file_count": 170
|
||||
}
|
||||
],
|
||||
"strengths": [
|
||||
@@ -709,7 +709,7 @@
|
||||
"用户说出类似需求时：Use $yao-meta-skill to turn my workflow or notes into a reusable skill with lean structure, clear triggering, and the right evals."
|
||||
],
|
||||
"trigger_contract": {
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"activation": "manual",
|
||||
"execution": "inline",
|
||||
"shell": "bash"
|
||||
@@ -1011,12 +1011,12 @@
|
||||
"ok": true,
|
||||
"summary": {
|
||||
"reproducibility_ready": true,
|
||||
"release_lock_ready": true,
|
||||
"release_lock_ready": false,
|
||||
"methodology_complete": true,
|
||||
"required_artifact_count": 25,
|
||||
"missing_artifact_count": 0,
|
||||
"evidence_bundle_sha256": "e819a616c7276f6433bbcf38f30696cc0f19b6c035adf5c8cf09e64cbe8db9ad",
|
||||
"source_contract_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"evidence_bundle_sha256": "6c95043c2d8513102b37bc70a01647246933c84e8a27c2748cc2cae20e040158",
|
||||
"source_contract_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7",
|
||||
"output_case_count": 5,
|
||||
"failure_disclosure_count": 3,
|
||||
@@ -1034,19 +1034,19 @@
|
||||
"world_class_source_check_count": 19,
|
||||
"world_class_source_pass_count": 12,
|
||||
"world_class_source_blocked_count": 7,
|
||||
"beta_test_ready": true,
|
||||
"beta_test_blocker_count": 0,
|
||||
"beta_test_ready": false,
|
||||
"beta_test_blocker_count": 1,
|
||||
"beta_test_deferred_evidence_count": 4,
|
||||
"public_claim_ready": false,
|
||||
"public_claim_blocker_count": 3,
|
||||
"public_claim_blocker_count": 4,
|
||||
"working_tree_dirty": true,
|
||||
"changed_file_count": 3,
|
||||
"source_tree_dirty": false,
|
||||
"source_changed_file_count": 0,
|
||||
"changed_file_count": 37,
|
||||
"source_tree_dirty": true,
|
||||
"source_changed_file_count": 1,
|
||||
"generated_tree_dirty": true,
|
||||
"generated_changed_file_count": 3
|
||||
"generated_changed_file_count": 36
|
||||
},
|
||||
"commit": "139d0fd15ce995757d6d75fb45fb417d0b1b4e7d",
|
||||
"commit": "24bea607a2b16e766bc8f2bc8483f22fae1edc61",
|
||||
"missing_artifacts": [],
|
||||
"limitations": [
|
||||
"The git commit and dirty flags are generation-time context; release lock is blocked by source changes, while generated evidence artifacts are tracked separately.",
|
||||
@@ -1152,7 +1152,7 @@
|
||||
"interactive_script_count": 0,
|
||||
"package_hash_scope": "source-contract-without-generated-reports",
|
||||
"package_hash_file_count": 247,
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
},
|
||||
"skill_atlas": {
|
||||
"skill_count": 11,
|
||||
@@ -1176,7 +1176,7 @@
|
||||
"schema_version": "2.0",
|
||||
"name": "yao-meta-skill",
|
||||
"version": "1.1.0",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"targets": [
|
||||
"openai",
|
||||
"claude",
|
||||
@@ -1190,7 +1190,7 @@
|
||||
"trust_level": "local",
|
||||
"license": "MIT",
|
||||
"checksums": {
|
||||
"package_sha256": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383",
|
||||
"package_sha256": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c",
|
||||
"archive_sha256": "c56a8519244c0bc8ec17c92d4641c832629cc059f4b51fe177a2c039515253a7"
|
||||
},
|
||||
"compatibility": {
|
||||
@@ -1227,7 +1227,7 @@
|
||||
"install_simulated": true,
|
||||
"install_simulation": "reports/install_simulation.json"
|
||||
},
|
||||
"generated_at": "2026-06-21"
|
||||
"generated_at": "2026-06-13"
|
||||
},
|
||||
"failures": [],
|
||||
"warnings": []
|
||||
@@ -1251,7 +1251,7 @@
|
||||
"ok": true,
|
||||
"summary": {
|
||||
"archive_present": true,
|
||||
"archive_entry_count": 580,
|
||||
"archive_entry_count": 598,
|
||||
"nested_skill_entry_count": 0,
|
||||
"archive_extracted": true,
|
||||
"entrypoint_loaded": true,
|
||||
@@ -1312,7 +1312,7 @@
|
||||
{
|
||||
"field": "description",
|
||||
"from": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes.",
|
||||
"to": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"to": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
}
|
||||
],
|
||||
"checksum_changes": [
|
||||
@@ -1324,7 +1324,7 @@
|
||||
{
|
||||
"field": "package_sha256",
|
||||
"from": "0000000000000000000000000000000000000000000000000000000000000000",
|
||||
"to": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"to": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -2218,7 +2218,7 @@
|
||||
},
|
||||
"synthesis_highlights": [
|
||||
"Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.",
|
||||
"Borrow a review checkpoint wherever trust matters more than raw speed.",
|
||||
"Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.",
|
||||
"Borrow the discipline of defining what the skill should not own before growing the package."
|
||||
],
|
||||
"artifact_design": {
|
||||
|
||||
+18
-12
@@ -49,7 +49,7 @@
|
||||
{
|
||||
"name": "yao-meta-skill",
|
||||
"path": ".",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"owner": "Yao Team",
|
||||
"version": "1.1.0",
|
||||
"status": "active",
|
||||
@@ -262,22 +262,28 @@
|
||||
"templates/complex_skill.md.j2"
|
||||
],
|
||||
"token_set": [
|
||||
"creation",
|
||||
"distribution",
|
||||
"checks",
|
||||
"docs",
|
||||
"evals",
|
||||
"evaluate",
|
||||
"improvement",
|
||||
"notes",
|
||||
"or",
|
||||
"exclude",
|
||||
"improve",
|
||||
"install",
|
||||
"migration",
|
||||
"no-skill",
|
||||
"package",
|
||||
"packaging",
|
||||
"prompts",
|
||||
"refactor",
|
||||
"team-ready",
|
||||
"transcripts",
|
||||
"workflow",
|
||||
"workflows"
|
||||
"release",
|
||||
"routing",
|
||||
"scripts",
|
||||
"sops",
|
||||
"summary",
|
||||
"tests",
|
||||
"translation",
|
||||
"trigger",
|
||||
"workflows",
|
||||
"优化已有",
|
||||
"评测"
|
||||
],
|
||||
"atlas_scope": "release",
|
||||
"actionable": true,
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-06-13",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"item_count": 15,
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Skill OS 2.0 Audit
|
||||
|
||||
Generated at: `2026-06-21`
|
||||
Generated at: `2026-06-13`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"item_count": 21,
|
||||
@@ -749,11 +749,11 @@
|
||||
"exists": true
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/daily/2026-06-21.json",
|
||||
"path": "reports/skillops/daily/2026-07-02.json",
|
||||
"exists": true
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/daily/2026-06-21.md",
|
||||
"path": "reports/skillops/daily/2026-07-02.md",
|
||||
"exists": true
|
||||
}
|
||||
],
|
||||
@@ -776,11 +776,11 @@
|
||||
"exists": true
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/weekly/2026-W25.json",
|
||||
"path": "reports/skillops/weekly/2026-W27.json",
|
||||
"exists": true
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/weekly/2026-W25.md",
|
||||
"path": "reports/skillops/weekly/2026-W27.md",
|
||||
"exists": true
|
||||
}
|
||||
],
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# Skill OS 2.0 Blueprint Coverage
|
||||
|
||||
Generated at: `2026-06-21`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
@@ -235,12 +235,12 @@ These extension tracks come from the user-supplied 2.0 reference plan. They are
|
||||
|
||||
- objective: Daily operations layer summarizes explicit-source conversation patterns, proposal-only adaptation work, approval state, release locks, and world-class evidence gaps.
|
||||
- status: `covered`
|
||||
- existing evidence: `scripts/render_daily_skillops_report.py`, `tests/verify_daily_skillops.py`, `reports/skillops/daily/2026-06-21.json`, `reports/skillops/daily/2026-06-21.md`
|
||||
- existing evidence: `scripts/render_daily_skillops_report.py`, `tests/verify_daily_skillops.py`, `reports/skillops/daily/2026-07-02.json`, `reports/skillops/daily/2026-07-02.md`
|
||||
- next action: Keep Daily SkillOps report aligned with proposal, approval, coverage, and world-class ledger contracts as the operations layer evolves.
|
||||
|
||||
### Weekly Curator Report
|
||||
|
||||
- objective: Weekly curator layer aggregates Daily SkillOps opportunities, Skill Atlas portfolio signals, release locks, and world-class evidence gaps into a maintenance queue.
|
||||
- status: `covered`
|
||||
- existing evidence: `scripts/render_weekly_curator_report.py`, `tests/verify_weekly_curator.py`, `reports/skillops/weekly/2026-W25.json`, `reports/skillops/weekly/2026-W25.md`
|
||||
- existing evidence: `scripts/render_weekly_curator_report.py`, `tests/verify_weekly_curator.py`, `reports/skillops/weekly/2026-W27.json`, `reports/skillops/weekly/2026-W27.md`
|
||||
- next action: Use weekly curator output as the Skill Librarian maintenance queue before approving any durable skill-library changes.
|
||||
|
||||
@@ -0,0 +1,513 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-07-02T06:33:07Z",
|
||||
"skill_dir": ".",
|
||||
"decision": "proposal-review",
|
||||
"source_supplied": false,
|
||||
"pattern_count": 5,
|
||||
"proposal_count": 5,
|
||||
"approval_count": 0,
|
||||
"pending_review_count": 0,
|
||||
"applied_count": 0,
|
||||
"rollback_count": 0,
|
||||
"local_blueprint_ready": true,
|
||||
"public_world_class_ready": false,
|
||||
"world_class_pending_count": 4,
|
||||
"release_lock_ready": false,
|
||||
"evidence_consistency_ok": true,
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"failure_count": 0,
|
||||
"summary": {
|
||||
"decision": "proposal-review",
|
||||
"source_supplied": false,
|
||||
"pattern_count": 5,
|
||||
"proposal_count": 5,
|
||||
"approval_count": 0,
|
||||
"pending_review_count": 0,
|
||||
"applied_count": 0,
|
||||
"rollback_count": 0,
|
||||
"local_blueprint_ready": true,
|
||||
"public_world_class_ready": false,
|
||||
"world_class_pending_count": 4,
|
||||
"release_lock_ready": false,
|
||||
"evidence_consistency_ok": true,
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"failure_count": 0
|
||||
},
|
||||
"operations_contract": {
|
||||
"schema_version": "1.0",
|
||||
"contract": "daily-skillops-report",
|
||||
"explicit_source_required_for_scan": true,
|
||||
"implicit_private_log_scan": false,
|
||||
"raw_content_stored": false,
|
||||
"redacted_excerpts_only": true,
|
||||
"proposal_only": true,
|
||||
"approval_required_for_writes": true,
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"daily_report_counts_as_world_class_evidence": false
|
||||
},
|
||||
"report_contract": {
|
||||
"schema_version": "1.0",
|
||||
"contract": "daily-skillops-report",
|
||||
"top_level_mirrors_summary": true,
|
||||
"summary_fields": [
|
||||
"decision",
|
||||
"source_supplied",
|
||||
"pattern_count",
|
||||
"proposal_count",
|
||||
"approval_count",
|
||||
"pending_review_count",
|
||||
"applied_count",
|
||||
"rollback_count",
|
||||
"local_blueprint_ready",
|
||||
"public_world_class_ready",
|
||||
"world_class_pending_count",
|
||||
"release_lock_ready",
|
||||
"evidence_consistency_ok",
|
||||
"writes_source_files",
|
||||
"auto_patch_enabled",
|
||||
"failure_count"
|
||||
],
|
||||
"source_of_truth": [
|
||||
"summary",
|
||||
"operations_contract"
|
||||
]
|
||||
},
|
||||
"source": {
|
||||
"path": "evals/adaptation/user_signals.example.jsonl",
|
||||
"fingerprint_sha256": "48f94a4f3b82f90db29921c13d09c765ec10aabfde1adce65710c137cc6c5abf",
|
||||
"record_count": 8,
|
||||
"explicit_source": true,
|
||||
"raw_content_stored": false,
|
||||
"redacted_excerpts_only": true
|
||||
},
|
||||
"patterns": [
|
||||
{
|
||||
"pattern_id": "language_default",
|
||||
"label": "Default language preference",
|
||||
"signal_type": "report-language",
|
||||
"support_count": 2,
|
||||
"confidence": 0.79,
|
||||
"reason": "2 redacted records matched repeated report-language signals.",
|
||||
"recommended_action": "Keep generated reports Chinese-first with an English switch where user-facing.",
|
||||
"evidence": [
|
||||
{
|
||||
"record_id": "line-1",
|
||||
"excerpt": "新生成的 Skill 报告默认使用中文简体，并在右上角提供英文切换。"
|
||||
},
|
||||
{
|
||||
"record_id": "line-2",
|
||||
"excerpt": "HTML 报告需要双语能力，但默认内容应该保持中文简体。"
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"pattern_id": "report_ui",
|
||||
"label": "Report UI and visualization preference",
|
||||
"signal_type": "artifact-design",
|
||||
"support_count": 5,
|
||||
"confidence": 0.95,
|
||||
"reason": "5 redacted records matched repeated artifact-design signals.",
|
||||
"recommended_action": "Prioritize white-background Kami-style reports with readable charts and stable navigation.",
|
||||
"evidence": [
|
||||
{
|
||||
"record_id": "line-1",
|
||||
"excerpt": "新生成的 Skill 报告默认使用中文简体，并在右上角提供英文切换。"
|
||||
},
|
||||
{
|
||||
"record_id": "line-2",
|
||||
"excerpt": "HTML 报告需要双语能力，但默认内容应该保持中文简体。"
|
||||
},
|
||||
{
|
||||
"record_id": "line-3",
|
||||
"excerpt": "报告排版采用白底 Kami 风格，图表、模块和导航都要清晰。"
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"pattern_id": "approval_safety",
|
||||
"label": "Approval and privacy boundary",
|
||||
"signal_type": "governance",
|
||||
"support_count": 2,
|
||||
"confidence": 0.79,
|
||||
"reason": "2 redacted records matched repeated governance signals.",
|
||||
"recommended_action": "Keep adaptive work proposal-only until a reviewer approves an allowlisted patch path.",
|
||||
"evidence": [
|
||||
{
|
||||
"record_id": "line-5",
|
||||
"excerpt": "自适应升级必须先生成提案，不能直接自动修改源文件。"
|
||||
},
|
||||
{
|
||||
"record_id": "line-6",
|
||||
"excerpt": "用户偏好扫描必须由用户提供明确路径，不要默认扫描私人日志。"
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"pattern_id": "delivery_format",
|
||||
"label": "Delivery format preference",
|
||||
"signal_type": "artifact-format",
|
||||
"support_count": 2,
|
||||
"confidence": 0.79,
|
||||
"reason": "2 redacted records matched repeated artifact-format signals.",
|
||||
"recommended_action": "Surface stable artifact paths and formats in CLI output and generated summaries.",
|
||||
"evidence": [
|
||||
{
|
||||
"record_id": "line-2",
|
||||
"excerpt": "HTML 报告需要双语能力，但默认内容应该保持中文简体。"
|
||||
},
|
||||
{
|
||||
"record_id": "line-6",
|
||||
"excerpt": "用户偏好扫描必须由用户提供明确路径，不要默认扫描私人日志。"
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"pattern_id": "evidence_testing",
|
||||
"label": "Evidence and testing preference",
|
||||
"signal_type": "quality-gate",
|
||||
"support_count": 2,
|
||||
"confidence": 0.79,
|
||||
"reason": "2 redacted records matched repeated quality-gate signals.",
|
||||
"recommended_action": "Attach focused tests and refreshed evidence reports to every non-trivial skill upgrade.",
|
||||
"evidence": [
|
||||
{
|
||||
"record_id": "line-7",
|
||||
"excerpt": "每次升级都需要测试、覆盖报告和可审计证据，推送前要跑 CI。"
|
||||
},
|
||||
{
|
||||
"record_id": "line-8",
|
||||
"excerpt": "涉及 GitHub 推送时，要保留证据链，避免把计划当作完成证明。"
|
||||
}
|
||||
]
|
||||
}
|
||||
],
|
||||
"proposals": [
|
||||
{
|
||||
"proposal_id": "adapt-18c7517f3d",
|
||||
"pattern_id": "language_default",
|
||||
"title": "Keep reports Chinese-first with optional English",
|
||||
"risk_level": "low",
|
||||
"status": "proposal-only",
|
||||
"requires_approval": true,
|
||||
"target_files": [
|
||||
"scripts/render_skill_overview.py",
|
||||
"references/artifact-design-doctrine.md"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_skill_overview.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"proposal_id": "adapt-fbfe921ba5",
|
||||
"pattern_id": "report_ui",
|
||||
"title": "Improve report layout, visual hierarchy, and chart readability",
|
||||
"risk_level": "medium",
|
||||
"status": "proposal-only",
|
||||
"requires_approval": true,
|
||||
"target_files": [
|
||||
"scripts/render_skill_overview.py",
|
||||
"references/artifact-design-doctrine.md",
|
||||
"tests/verify_skill_overview.py"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_skill_overview.py",
|
||||
"python3 tests/verify_skill_report_charts.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"proposal_id": "adapt-59d219a1fb",
|
||||
"pattern_id": "approval_safety",
|
||||
"title": "Keep adaptive iteration approval-gated",
|
||||
"risk_level": "low",
|
||||
"status": "proposal-only",
|
||||
"requires_approval": true,
|
||||
"target_files": [
|
||||
"references/user-memory-policy.md",
|
||||
"references/autonomous-adaptation.md",
|
||||
"schemas/adaptation-proposal.schema.json"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_adaptation_safety.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"proposal_id": "adapt-457baca160",
|
||||
"pattern_id": "delivery_format",
|
||||
"title": "Make generated artifact paths explicit in CLI output",
|
||||
"risk_level": "low",
|
||||
"status": "proposal-only",
|
||||
"requires_approval": true,
|
||||
"target_files": [
|
||||
"scripts/yao.py",
|
||||
"README.md"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_yao_cli.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"proposal_id": "adapt-abfee25d3a",
|
||||
"pattern_id": "evidence_testing",
|
||||
"title": "Attach tests and evidence refresh to each upgrade",
|
||||
"risk_level": "medium",
|
||||
"status": "proposal-only",
|
||||
"requires_approval": true,
|
||||
"target_files": [
|
||||
"tests/verify_adaptation_safety.py",
|
||||
"scripts/render_skill_os2_coverage.py",
|
||||
"reports/skill_os2_coverage.json"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_adaptation_safety.py",
|
||||
"python3 tests/verify_skill_os2_coverage.py"
|
||||
]
|
||||
}
|
||||
],
|
||||
"opportunity_summary": {
|
||||
"opportunity_count": 5,
|
||||
"top_score": 88,
|
||||
"ready_for_approval_review_count": 1,
|
||||
"proposal_review_count": 4,
|
||||
"observe_more_evidence_count": 0,
|
||||
"report_only_count": 0,
|
||||
"action_type_counts": {
|
||||
"patch_existing_skill": 3,
|
||||
"agents_update": 1,
|
||||
"add_eval": 1
|
||||
},
|
||||
"decision_counts": {
|
||||
"ready_for_approval_review": 1,
|
||||
"proposal_review": 4
|
||||
}
|
||||
},
|
||||
"opportunities": [
|
||||
{
|
||||
"opportunity_id": "skillops-4ad91c18dd",
|
||||
"proposal_id": "adapt-fbfe921ba5",
|
||||
"pattern_id": "report_ui",
|
||||
"title": "Improve report layout, visual hierarchy, and chart readability",
|
||||
"opportunity_type": "artifact-quality",
|
||||
"action_type": "patch_existing_skill",
|
||||
"decision": "ready_for_approval_review",
|
||||
"priority": "medium",
|
||||
"score": 88,
|
||||
"score_reasons": [
|
||||
"support_count=5",
|
||||
"confidence=0.95",
|
||||
"risk=medium",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated report layout feedback maps to existing renderer and design doctrine changes.",
|
||||
"risk_level": "medium",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 5,
|
||||
"target_files": [
|
||||
"scripts/render_skill_overview.py",
|
||||
"references/artifact-design-doctrine.md",
|
||||
"tests/verify_skill_overview.py"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_skill_overview.py",
|
||||
"python3 tests/verify_skill_report_charts.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-531e13c1c6",
|
||||
"proposal_id": "adapt-59d219a1fb",
|
||||
"pattern_id": "approval_safety",
|
||||
"title": "Keep adaptive iteration approval-gated",
|
||||
"opportunity_type": "governance",
|
||||
"action_type": "agents_update",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 82,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=low",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated privacy and approval signals should tighten durable operating guidance.",
|
||||
"risk_level": "low",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"references/user-memory-policy.md",
|
||||
"references/autonomous-adaptation.md",
|
||||
"schemas/adaptation-proposal.schema.json"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_adaptation_safety.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-709ef884f3",
|
||||
"proposal_id": "adapt-18c7517f3d",
|
||||
"pattern_id": "language_default",
|
||||
"title": "Keep reports Chinese-first with optional English",
|
||||
"opportunity_type": "report-experience",
|
||||
"action_type": "patch_existing_skill",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 82,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=low",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated language preferences can improve existing report templates after approval.",
|
||||
"risk_level": "low",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"scripts/render_skill_overview.py",
|
||||
"references/artifact-design-doctrine.md"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_skill_overview.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-f9e43237aa",
|
||||
"proposal_id": "adapt-457baca160",
|
||||
"pattern_id": "delivery_format",
|
||||
"title": "Make generated artifact paths explicit in CLI output",
|
||||
"opportunity_type": "artifact-discoverability",
|
||||
"action_type": "patch_existing_skill",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 82,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=low",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated delivery-path requests can improve CLI and README artifact discoverability.",
|
||||
"risk_level": "low",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"scripts/yao.py",
|
||||
"README.md"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_yao_cli.py"
|
||||
]
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-0a3a2de7c3",
|
||||
"proposal_id": "adapt-abfee25d3a",
|
||||
"pattern_id": "evidence_testing",
|
||||
"title": "Attach tests and evidence refresh to each upgrade",
|
||||
"opportunity_type": "quality-gate",
|
||||
"action_type": "add_eval",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 74,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=medium",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated verification and evidence requests should become focused checks.",
|
||||
"risk_level": "medium",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"tests/verify_adaptation_safety.py",
|
||||
"scripts/render_skill_os2_coverage.py",
|
||||
"reports/skill_os2_coverage.json"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_adaptation_safety.py",
|
||||
"python3 tests/verify_skill_os2_coverage.py"
|
||||
]
|
||||
}
|
||||
],
|
||||
"decision_policy": {
|
||||
"schema_version": "1.0",
|
||||
"contract": "skillops-opportunity-scoring",
|
||||
"score_range": [
|
||||
0,
|
||||
100
|
||||
],
|
||||
"score_bands": {
|
||||
"85-100": "ready_for_approval_review",
|
||||
"70-84": "proposal_review",
|
||||
"50-69": "observe_more_evidence",
|
||||
"0-49": "report_only_or_no_action"
|
||||
},
|
||||
"action_types": [
|
||||
"add_eval",
|
||||
"agents_update",
|
||||
"patch_existing_skill",
|
||||
"report_only"
|
||||
],
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"approval_required_for_writes": true
|
||||
},
|
||||
"approval": {
|
||||
"approval_count": 0,
|
||||
"pending_review_count": 0,
|
||||
"applied_count": 0,
|
||||
"rollback_count": 0
|
||||
},
|
||||
"release_state": {
|
||||
"local_blueprint_ready": true,
|
||||
"public_world_class_ready": false,
|
||||
"world_class_pending_count": 4,
|
||||
"release_lock_ready": false,
|
||||
"evidence_consistency_ok": true
|
||||
},
|
||||
"actions": [
|
||||
{
|
||||
"key": "review-adaptation-proposals",
|
||||
"priority": "high",
|
||||
"action": "Review proposal-only adaptation items before preparing any approval ledger entry."
|
||||
},
|
||||
{
|
||||
"key": "close-world-class-evidence",
|
||||
"priority": "high",
|
||||
"action": "Collect accepted external or human evidence for the pending world-class ledger entries."
|
||||
}
|
||||
],
|
||||
"failures": [],
|
||||
"source_reports": {
|
||||
"patterns": "reports/user_patterns.json",
|
||||
"proposals": "reports/adaptation_proposals.json",
|
||||
"approval_ledger": "reports/adaptation_approval_ledger.json",
|
||||
"regression": "reports/adaptation_regression_report.json",
|
||||
"skill_os2_coverage": "reports/skill_os2_coverage.json",
|
||||
"world_class_ledger": "reports/world_class_evidence_ledger.json",
|
||||
"evidence_consistency": "reports/evidence_consistency.json",
|
||||
"benchmark_reproducibility": "reports/benchmark_reproducibility.json"
|
||||
},
|
||||
"artifacts": {
|
||||
"json": "reports/skillops/daily/2026-07-02.json",
|
||||
"markdown": "reports/skillops/daily/2026-07-02.md"
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,174 @@
|
||||
# Daily SkillOps Report
|
||||
|
||||
Generated at: `2026-07-02T06:33:07Z`
|
||||
|
||||
## Summary
|
||||
|
||||
- decision: `proposal-review`
|
||||
- source supplied: `false`
|
||||
- patterns: `5`
|
||||
- proposals: `5`
|
||||
- pending approvals: `0`
|
||||
- applied patches: `0`
|
||||
- rollbacks: `0`
|
||||
- local blueprint ready: `true`
|
||||
- public world-class ready: `false`
|
||||
- world-class pending: `4`
|
||||
- release lock ready: `false`
|
||||
- evidence consistency ok: `true`
|
||||
|
||||
This report is an operations cockpit for explicit-source SkillOps. It does not scan private logs, write source files, apply patches, or count as world-class external or human evidence.
|
||||
|
||||
## Privacy Boundary
|
||||
|
||||
- explicit_source_required_for_scan: `true`
|
||||
- implicit_private_log_scan: `false`
|
||||
- raw_content_stored: `false`
|
||||
- redacted_excerpts_only: `true`
|
||||
- proposal_only: `true`
|
||||
- approval_required_for_writes: `true`
|
||||
- writes_source_files: `false`
|
||||
- auto_patch_enabled: `false`
|
||||
- daily_report_counts_as_world_class_evidence: `false`
|
||||
|
||||
## Actions
|
||||
|
||||
- `high` Review proposal-only adaptation items before preparing any approval ledger entry.
|
||||
- `high` Collect accepted external or human evidence for the pending world-class ledger entries.
|
||||
|
||||
## Opportunities
|
||||
|
||||
- count: `5`
|
||||
- top score: `88`
|
||||
- ready for approval review: `1`
|
||||
### Improve report layout, visual hierarchy, and chart readability
|
||||
|
||||
- ID: `skillops-4ad91c18dd`
|
||||
- Action: `patch_existing_skill`
|
||||
- Decision: `ready_for_approval_review`
|
||||
- Score: `88`
|
||||
- Risk: `medium`
|
||||
- Policy: Repeated report layout feedback maps to existing renderer and design doctrine changes.
|
||||
### Keep adaptive iteration approval-gated
|
||||
|
||||
- ID: `skillops-531e13c1c6`
|
||||
- Action: `agents_update`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `82`
|
||||
- Risk: `low`
|
||||
- Policy: Repeated privacy and approval signals should tighten durable operating guidance.
|
||||
### Keep reports Chinese-first with optional English
|
||||
|
||||
- ID: `skillops-709ef884f3`
|
||||
- Action: `patch_existing_skill`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `82`
|
||||
- Risk: `low`
|
||||
- Policy: Repeated language preferences can improve existing report templates after approval.
|
||||
### Make generated artifact paths explicit in CLI output
|
||||
|
||||
- ID: `skillops-f9e43237aa`
|
||||
- Action: `patch_existing_skill`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `82`
|
||||
- Risk: `low`
|
||||
- Policy: Repeated delivery-path requests can improve CLI and README artifact discoverability.
|
||||
### Attach tests and evidence refresh to each upgrade
|
||||
|
||||
- ID: `skillops-0a3a2de7c3`
|
||||
- Action: `add_eval`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `74`
|
||||
- Risk: `medium`
|
||||
- Policy: Repeated verification and evidence requests should become focused checks.
|
||||
|
||||
## Patterns
|
||||
|
||||
- `language_default`: Default language preference (support `2`, confidence `0.79`)
|
||||
- `report_ui`: Report UI and visualization preference (support `5`, confidence `0.95`)
|
||||
- `approval_safety`: Approval and privacy boundary (support `2`, confidence `0.79`)
|
||||
- `delivery_format`: Delivery format preference (support `2`, confidence `0.79`)
|
||||
- `evidence_testing`: Evidence and testing preference (support `2`, confidence `0.79`)
|
||||
|
||||
## Proposals
|
||||
|
||||
### Keep reports Chinese-first with optional English
|
||||
|
||||
- ID: `adapt-18c7517f3d`
|
||||
- Pattern: `language_default`
|
||||
- Status: `proposal-only`
|
||||
- Risk: `low`
|
||||
- Requires approval: `true`
|
||||
- Target files:
|
||||
- `scripts/render_skill_overview.py`
|
||||
- `references/artifact-design-doctrine.md`
|
||||
- Verification:
|
||||
- `python3 tests/verify_skill_overview.py`
|
||||
|
||||
### Improve report layout, visual hierarchy, and chart readability
|
||||
|
||||
- ID: `adapt-fbfe921ba5`
|
||||
- Pattern: `report_ui`
|
||||
- Status: `proposal-only`
|
||||
- Risk: `medium`
|
||||
- Requires approval: `true`
|
||||
- Target files:
|
||||
- `scripts/render_skill_overview.py`
|
||||
- `references/artifact-design-doctrine.md`
|
||||
- `tests/verify_skill_overview.py`
|
||||
- Verification:
|
||||
- `python3 tests/verify_skill_overview.py`
|
||||
- `python3 tests/verify_skill_report_charts.py`
|
||||
|
||||
### Keep adaptive iteration approval-gated
|
||||
|
||||
- ID: `adapt-59d219a1fb`
|
||||
- Pattern: `approval_safety`
|
||||
- Status: `proposal-only`
|
||||
- Risk: `low`
|
||||
- Requires approval: `true`
|
||||
- Target files:
|
||||
- `references/user-memory-policy.md`
|
||||
- `references/autonomous-adaptation.md`
|
||||
- `schemas/adaptation-proposal.schema.json`
|
||||
- Verification:
|
||||
- `python3 tests/verify_adaptation_safety.py`
|
||||
|
||||
### Make generated artifact paths explicit in CLI output
|
||||
|
||||
- ID: `adapt-457baca160`
|
||||
- Pattern: `delivery_format`
|
||||
- Status: `proposal-only`
|
||||
- Risk: `low`
|
||||
- Requires approval: `true`
|
||||
- Target files:
|
||||
- `scripts/yao.py`
|
||||
- `README.md`
|
||||
- Verification:
|
||||
- `python3 tests/verify_yao_cli.py`
|
||||
|
||||
### Attach tests and evidence refresh to each upgrade
|
||||
|
||||
- ID: `adapt-abfee25d3a`
|
||||
- Pattern: `evidence_testing`
|
||||
- Status: `proposal-only`
|
||||
- Risk: `medium`
|
||||
- Requires approval: `true`
|
||||
- Target files:
|
||||
- `tests/verify_adaptation_safety.py`
|
||||
- `scripts/render_skill_os2_coverage.py`
|
||||
- `reports/skill_os2_coverage.json`
|
||||
- Verification:
|
||||
- `python3 tests/verify_adaptation_safety.py`
|
||||
- `python3 tests/verify_skill_os2_coverage.py`
|
||||
|
||||
## Evidence
|
||||
|
||||
- patterns: `reports/user_patterns.json`
|
||||
- proposals: `reports/adaptation_proposals.json`
|
||||
- approval_ledger: `reports/adaptation_approval_ledger.json`
|
||||
- regression: `reports/adaptation_regression_report.json`
|
||||
- skill_os2_coverage: `reports/skill_os2_coverage.json`
|
||||
- world_class_ledger: `reports/world_class_evidence_ledger.json`
|
||||
- evidence_consistency: `reports/evidence_consistency.json`
|
||||
- benchmark_reproducibility: `reports/benchmark_reproducibility.json`
|
||||
@@ -0,0 +1,323 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-07-02T06:33:07Z",
|
||||
"skill_dir": ".",
|
||||
"decision": "curator-review",
|
||||
"week_id": "2026-W27",
|
||||
"daily_report_count": 5,
|
||||
"opportunity_count": 25,
|
||||
"unique_opportunity_count": 5,
|
||||
"ready_for_approval_review_count": 1,
|
||||
"proposal_review_count": 4,
|
||||
"observe_more_evidence_count": 0,
|
||||
"report_only_count": 0,
|
||||
"top_score": 88,
|
||||
"skill_count": 11,
|
||||
"actionable_portfolio_issue_count": 0,
|
||||
"release_lock_ready": false,
|
||||
"evidence_consistency_ok": true,
|
||||
"public_world_class_ready": false,
|
||||
"world_class_pending_count": 4,
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"failure_count": 0,
|
||||
"summary": {
|
||||
"decision": "curator-review",
|
||||
"week_id": "2026-W27",
|
||||
"daily_report_count": 5,
|
||||
"opportunity_count": 25,
|
||||
"unique_opportunity_count": 5,
|
||||
"ready_for_approval_review_count": 1,
|
||||
"proposal_review_count": 4,
|
||||
"observe_more_evidence_count": 0,
|
||||
"report_only_count": 0,
|
||||
"top_score": 88,
|
||||
"skill_count": 11,
|
||||
"actionable_portfolio_issue_count": 0,
|
||||
"release_lock_ready": false,
|
||||
"evidence_consistency_ok": true,
|
||||
"public_world_class_ready": false,
|
||||
"world_class_pending_count": 4,
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"failure_count": 0
|
||||
},
|
||||
"curator_contract": {
|
||||
"schema_version": "1.0",
|
||||
"contract": "weekly-skillops-curator-report",
|
||||
"cadence": "weekly",
|
||||
"source_of_truth": [
|
||||
"reports/skillops/daily/*.json",
|
||||
"reports/skill_atlas.json",
|
||||
"reports/benchmark_reproducibility.json",
|
||||
"reports/evidence_consistency.json",
|
||||
"reports/world_class_evidence_ledger.json"
|
||||
],
|
||||
"raw_content_stored": false,
|
||||
"redacted_or_generated_evidence_only": true,
|
||||
"proposal_only": true,
|
||||
"writes_source_files": false,
|
||||
"auto_patch_enabled": false,
|
||||
"approval_required_for_writes": true,
|
||||
"counts_as_world_class_evidence": false
|
||||
},
|
||||
"report_contract": {
|
||||
"schema_version": "1.0",
|
||||
"contract": "weekly-skillops-curator-report",
|
||||
"top_level_mirrors_summary": true,
|
||||
"summary_fields": [
|
||||
"decision",
|
||||
"week_id",
|
||||
"daily_report_count",
|
||||
"opportunity_count",
|
||||
"unique_opportunity_count",
|
||||
"ready_for_approval_review_count",
|
||||
"proposal_review_count",
|
||||
"observe_more_evidence_count",
|
||||
"report_only_count",
|
||||
"top_score",
|
||||
"skill_count",
|
||||
"actionable_portfolio_issue_count",
|
||||
"release_lock_ready",
|
||||
"evidence_consistency_ok",
|
||||
"public_world_class_ready",
|
||||
"world_class_pending_count",
|
||||
"writes_source_files",
|
||||
"auto_patch_enabled",
|
||||
"failure_count"
|
||||
]
|
||||
},
|
||||
"daily_reports": [
|
||||
"reports/skillops/daily/2026-06-16.json",
|
||||
"reports/skillops/daily/2026-06-17.json",
|
||||
"reports/skillops/daily/2026-06-20.json",
|
||||
"reports/skillops/daily/2026-06-21.json",
|
||||
"reports/skillops/daily/2026-07-02.json"
|
||||
],
|
||||
"opportunity_summary": {
|
||||
"action_type_counts": {
|
||||
"add_eval": 1,
|
||||
"agents_update": 1,
|
||||
"patch_existing_skill": 3
|
||||
},
|
||||
"decision_counts": {
|
||||
"proposal_review": 4,
|
||||
"ready_for_approval_review": 1
|
||||
},
|
||||
"risk_level_counts": {
|
||||
"low": 3,
|
||||
"medium": 2
|
||||
}
|
||||
},
|
||||
"curator_queue": [
|
||||
{
|
||||
"opportunity_id": "skillops-4ad91c18dd",
|
||||
"proposal_id": "adapt-fbfe921ba5",
|
||||
"pattern_id": "report_ui",
|
||||
"title": "Improve report layout, visual hierarchy, and chart readability",
|
||||
"opportunity_type": "artifact-quality",
|
||||
"action_type": "patch_existing_skill",
|
||||
"decision": "ready_for_approval_review",
|
||||
"priority": "medium",
|
||||
"score": 88,
|
||||
"score_reasons": [
|
||||
"support_count=5",
|
||||
"confidence=0.95",
|
||||
"risk=medium",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated report layout feedback maps to existing renderer and design doctrine changes.",
|
||||
"risk_level": "medium",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 5,
|
||||
"target_files": [
|
||||
"scripts/render_skill_overview.py",
|
||||
"references/artifact-design-doctrine.md",
|
||||
"tests/verify_skill_overview.py"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_skill_overview.py",
|
||||
"python3 tests/verify_skill_report_charts.py"
|
||||
],
|
||||
"daily_report_date": "2026-06-16"
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-531e13c1c6",
|
||||
"proposal_id": "adapt-59d219a1fb",
|
||||
"pattern_id": "approval_safety",
|
||||
"title": "Keep adaptive iteration approval-gated",
|
||||
"opportunity_type": "governance",
|
||||
"action_type": "agents_update",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 82,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=low",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated privacy and approval signals should tighten durable operating guidance.",
|
||||
"risk_level": "low",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"references/user-memory-policy.md",
|
||||
"references/autonomous-adaptation.md",
|
||||
"schemas/adaptation-proposal.schema.json"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_adaptation_safety.py"
|
||||
],
|
||||
"daily_report_date": "2026-06-16"
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-709ef884f3",
|
||||
"proposal_id": "adapt-18c7517f3d",
|
||||
"pattern_id": "language_default",
|
||||
"title": "Keep reports Chinese-first with optional English",
|
||||
"opportunity_type": "report-experience",
|
||||
"action_type": "patch_existing_skill",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 82,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=low",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated language preferences can improve existing report templates after approval.",
|
||||
"risk_level": "low",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"scripts/render_skill_overview.py",
|
||||
"references/artifact-design-doctrine.md"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_skill_overview.py"
|
||||
],
|
||||
"daily_report_date": "2026-06-16"
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-f9e43237aa",
|
||||
"proposal_id": "adapt-457baca160",
|
||||
"pattern_id": "delivery_format",
|
||||
"title": "Make generated artifact paths explicit in CLI output",
|
||||
"opportunity_type": "artifact-discoverability",
|
||||
"action_type": "patch_existing_skill",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 82,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=low",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated delivery-path requests can improve CLI and README artifact discoverability.",
|
||||
"risk_level": "low",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"scripts/yao.py",
|
||||
"README.md"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_yao_cli.py"
|
||||
],
|
||||
"daily_report_date": "2026-06-16"
|
||||
},
|
||||
{
|
||||
"opportunity_id": "skillops-0a3a2de7c3",
|
||||
"proposal_id": "adapt-abfee25d3a",
|
||||
"pattern_id": "evidence_testing",
|
||||
"title": "Attach tests and evidence refresh to each upgrade",
|
||||
"opportunity_type": "quality-gate",
|
||||
"action_type": "add_eval",
|
||||
"decision": "proposal_review",
|
||||
"priority": "medium",
|
||||
"score": 74,
|
||||
"score_reasons": [
|
||||
"support_count=2",
|
||||
"confidence=0.79",
|
||||
"risk=medium",
|
||||
"target_files_present",
|
||||
"verification_present",
|
||||
"approval_required"
|
||||
],
|
||||
"policy_reason": "Repeated verification and evidence requests should become focused checks.",
|
||||
"risk_level": "medium",
|
||||
"requires_approval": true,
|
||||
"write_allowed_without_approval": false,
|
||||
"evidence_count": 2,
|
||||
"target_files": [
|
||||
"tests/verify_adaptation_safety.py",
|
||||
"scripts/render_skill_os2_coverage.py",
|
||||
"reports/skill_os2_coverage.json"
|
||||
],
|
||||
"verification_commands": [
|
||||
"python3 tests/verify_adaptation_safety.py",
|
||||
"python3 tests/verify_skill_os2_coverage.py"
|
||||
],
|
||||
"daily_report_date": "2026-06-16"
|
||||
}
|
||||
],
|
||||
"portfolio": {
|
||||
"skill_count": 11,
|
||||
"actionable_issue_count": 0,
|
||||
"route_collision_count": 5,
|
||||
"actionable_route_collision_count": 0,
|
||||
"owner_gap_count": 8,
|
||||
"actionable_owner_gap_count": 0,
|
||||
"stale_count": 9,
|
||||
"actionable_stale_count": 0,
|
||||
"drift_signal_count": 0,
|
||||
"actionable_drift_signal_count": 0,
|
||||
"no_route_opportunity_count": 0
|
||||
},
|
||||
"release_state": {
|
||||
"release_lock_ready": false,
|
||||
"evidence_consistency_ok": true,
|
||||
"public_world_class_ready": false,
|
||||
"world_class_pending_count": 4
|
||||
},
|
||||
"actions": [
|
||||
{
|
||||
"key": "review-ready-opportunities",
|
||||
"priority": "high",
|
||||
"action": "Review the top ready-for-approval SkillOps opportunities before preparing any approval ledger entry."
|
||||
},
|
||||
{
|
||||
"key": "close-world-class-evidence",
|
||||
"priority": "high",
|
||||
"action": "Collect accepted external or human evidence for pending world-class ledger entries before public claims."
|
||||
}
|
||||
],
|
||||
"failures": [],
|
||||
"source_reports": {
|
||||
"daily_dir": "reports/skillops/daily",
|
||||
"skill_atlas": "reports/skill_atlas.json",
|
||||
"benchmark_reproducibility": "reports/benchmark_reproducibility.json",
|
||||
"evidence_consistency": "reports/evidence_consistency.json",
|
||||
"world_class_ledger": "reports/world_class_evidence_ledger.json"
|
||||
},
|
||||
"artifacts": {
|
||||
"json": "reports/skillops/weekly/2026-W27.json",
|
||||
"markdown": "reports/skillops/weekly/2026-W27.md"
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,110 @@
|
||||
# Weekly SkillOps Curator Report
|
||||
|
||||
Generated at: `2026-07-02T06:33:07Z`
|
||||
Week: `2026-W27`
|
||||
|
||||
## Summary
|
||||
|
||||
- decision: `curator-review`
|
||||
- daily_report_count: `5`
|
||||
- unique_opportunity_count: `5`
|
||||
- ready_for_approval_review_count: `1`
|
||||
- proposal_review_count: `4`
|
||||
- top_score: `88`
|
||||
- skill_count: `11`
|
||||
- actionable_portfolio_issue_count: `0`
|
||||
- release_lock_ready: `False`
|
||||
- evidence_consistency_ok: `True`
|
||||
- public_world_class_ready: `False`
|
||||
- world_class_pending_count: `4`
|
||||
|
||||
This report is a weekly curator cockpit for generated SkillOps evidence. It does not scan private logs, write source files, apply patches, or count as world-class evidence.
|
||||
|
||||
## Curator Boundary
|
||||
|
||||
- raw_content_stored: `false`
|
||||
- redacted_or_generated_evidence_only: `true`
|
||||
- proposal_only: `true`
|
||||
- writes_source_files: `false`
|
||||
- auto_patch_enabled: `false`
|
||||
- approval_required_for_writes: `true`
|
||||
- counts_as_world_class_evidence: `false`
|
||||
|
||||
## Actions
|
||||
|
||||
- `high` Review the top ready-for-approval SkillOps opportunities before preparing any approval ledger entry.
|
||||
- `high` Collect accepted external or human evidence for pending world-class ledger entries before public claims.
|
||||
|
||||
## Curator Queue
|
||||
|
||||
### Improve report layout, visual hierarchy, and chart readability
|
||||
|
||||
- ID: `skillops-4ad91c18dd`
|
||||
- Action: `patch_existing_skill`
|
||||
- Decision: `ready_for_approval_review`
|
||||
- Score: `88`
|
||||
- Risk: `medium`
|
||||
- Source day: `2026-06-16`
|
||||
- Policy: Repeated report layout feedback maps to existing renderer and design doctrine changes.
|
||||
|
||||
### Keep adaptive iteration approval-gated
|
||||
|
||||
- ID: `skillops-531e13c1c6`
|
||||
- Action: `agents_update`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `82`
|
||||
- Risk: `low`
|
||||
- Source day: `2026-06-16`
|
||||
- Policy: Repeated privacy and approval signals should tighten durable operating guidance.
|
||||
|
||||
### Keep reports Chinese-first with optional English
|
||||
|
||||
- ID: `skillops-709ef884f3`
|
||||
- Action: `patch_existing_skill`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `82`
|
||||
- Risk: `low`
|
||||
- Source day: `2026-06-16`
|
||||
- Policy: Repeated language preferences can improve existing report templates after approval.
|
||||
|
||||
### Make generated artifact paths explicit in CLI output
|
||||
|
||||
- ID: `skillops-f9e43237aa`
|
||||
- Action: `patch_existing_skill`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `82`
|
||||
- Risk: `low`
|
||||
- Source day: `2026-06-16`
|
||||
- Policy: Repeated delivery-path requests can improve CLI and README artifact discoverability.
|
||||
|
||||
### Attach tests and evidence refresh to each upgrade
|
||||
|
||||
- ID: `skillops-0a3a2de7c3`
|
||||
- Action: `add_eval`
|
||||
- Decision: `proposal_review`
|
||||
- Score: `74`
|
||||
- Risk: `medium`
|
||||
- Source day: `2026-06-16`
|
||||
- Policy: Repeated verification and evidence requests should become focused checks.
|
||||
|
||||
## Portfolio Signals
|
||||
|
||||
- skill_count: `11`
|
||||
- actionable_issue_count: `0`
|
||||
- route_collision_count: `5`
|
||||
- actionable_route_collision_count: `0`
|
||||
- owner_gap_count: `8`
|
||||
- actionable_owner_gap_count: `0`
|
||||
- stale_count: `9`
|
||||
- actionable_stale_count: `0`
|
||||
- drift_signal_count: `0`
|
||||
- actionable_drift_signal_count: `0`
|
||||
- no_route_opportunity_count: `0`
|
||||
|
||||
## Evidence
|
||||
|
||||
- daily_dir: `reports/skillops/daily`
|
||||
- skill_atlas: `reports/skill_atlas.json`
|
||||
- benchmark_reproducibility: `reports/benchmark_reproducibility.json`
|
||||
- evidence_consistency: `reports/evidence_consistency.json`
|
||||
- world_class_ledger: `reports/world_class_evidence_ledger.json`
|
||||
@@ -1,6 +1,6 @@
|
||||
{
|
||||
"skill_name": "yao-meta-skill",
|
||||
"description": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution.",
|
||||
"description": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs.",
|
||||
"systems_doctrine": "Structure drives behavior: improve the boundary, feedback loops, drift watch, and leverage points before adding weight.",
|
||||
"stability": {
|
||||
"score": 100,
|
||||
@@ -56,7 +56,7 @@
|
||||
"evidence": "reports/reference-synthesis.md",
|
||||
"current_patterns": [
|
||||
"Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.",
|
||||
"Borrow a review checkpoint wherever trust matters more than raw speed.",
|
||||
"Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.",
|
||||
"Borrow the discipline of defining what the skill should not own before growing the package.",
|
||||
"Borrow the way it turns a messy workflow into a repeatable operating path.",
|
||||
"Borrow the clear execution entrypoints and command structure."
|
||||
|
||||
@@ -53,7 +53,7 @@ Skill: `yao-meta-skill`
|
||||
- Evidence: reports/reference-synthesis.md
|
||||
- Current patterns:
|
||||
- Borrow progressive disclosure: keep the entrypoint lean and move depth into references or scripts.
|
||||
- Borrow a review checkpoint wherever trust matters more than raw speed.
|
||||
- Borrow a small hypothesis-test-learn loop so the first revision is evidence-backed.
|
||||
- Borrow the discipline of defining what the skill should not own before growing the package.
|
||||
- Borrow the way it turns a messy workflow into a repeatable operating path.
|
||||
- Borrow the clear execution entrypoints and command structure.
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"ok": true,
|
||||
"schema_version": "2.0",
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-06-13",
|
||||
"previous": {
|
||||
"name": "yao-meta-skill",
|
||||
"version": "1.0.0",
|
||||
@@ -63,7 +63,7 @@
|
||||
{
|
||||
"field": "description",
|
||||
"from": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes.",
|
||||
"to": "Create, refactor, evaluate, and package agent skills from workflows, prompts, transcripts, docs, or notes. Use for skill creation, reusable workflow packaging, skill improvement, evals, and team-ready distribution."
|
||||
"to": "Create/improve/evaluate agent skills from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install checks, 优化已有 skill, 补 trigger 评测. Exclude no-skill summary/translation/docs."
|
||||
}
|
||||
],
|
||||
"checksum_changes": [
|
||||
@@ -75,7 +75,7 @@
|
||||
{
|
||||
"field": "package_sha256",
|
||||
"from": "0000000000000000000000000000000000000000000000000000000000000000",
|
||||
"to": "eddeea80a657e9c97cee2e1242d97577b886b33e2ffa6e319629ef5fcb029383"
|
||||
"to": "db71157184dc649ee72dfcaf399204d44a366d942393d055571e0137d42c9f7c"
|
||||
}
|
||||
]
|
||||
},
|
||||
@@ -90,7 +90,7 @@
|
||||
"artifacts": {
|
||||
"previous_package": "registry/examples/yao-meta-skill-1.0.0.json",
|
||||
"current_package": "reports/registry_audit.json",
|
||||
"json": "reports/upgrade_check.json",
|
||||
"markdown": "reports/upgrade_check.md"
|
||||
"json": "tests/tmp_review_studio/upgrade_check.json",
|
||||
"markdown": "tests/tmp_review_studio/upgrade_check.md"
|
||||
}
|
||||
}
|
||||
|
||||
@@ -1,14 +1,14 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"ledger_ready_to_claim_world_class": false,
|
||||
"ledger_pending_count": 4,
|
||||
"claim_surface_count": 184,
|
||||
"json_claim_surface_count": 91,
|
||||
"metadata_claim_surface_count": 92,
|
||||
"claim_surface_count": 201,
|
||||
"json_claim_surface_count": 97,
|
||||
"metadata_claim_surface_count": 98,
|
||||
"package_claim_surface_count": 17,
|
||||
"violation_count": 0,
|
||||
"overclaim_guard_active": true,
|
||||
@@ -214,6 +214,58 @@
|
||||
"path": "reports/benchmark_reproducibility.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/DO_NOT_OPEN_answer_key.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/DO_NOT_OPEN_answer_key.json",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/README.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/adjudication.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/blind-pack.json",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/case-01-support-triage.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/case-02-monthly-revenue-reconciliation.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/case-03-webinar-repurposing.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/case-04-incident-postmortem.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/case-05-pr-review-followup.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/index.html",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/review-decisions-template.json",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/blind-human-review-2026-06-29/review-decisions.recorded.json",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/candidate_registry.json",
|
||||
"violation_count": 0
|
||||
@@ -638,6 +690,14 @@
|
||||
"path": "reports/skillops/daily/2026-06-21.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/daily/2026-07-02.json",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/daily/2026-07-02.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/weekly/2026-W25.json",
|
||||
"violation_count": 0
|
||||
@@ -646,6 +706,14 @@
|
||||
"path": "reports/skillops/weekly/2026-W25.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/weekly/2026-W27.json",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/skillops/weekly/2026-W27.md",
|
||||
"violation_count": 0
|
||||
},
|
||||
{
|
||||
"path": "reports/system-model.json",
|
||||
"violation_count": 0
|
||||
|
||||
@@ -1,15 +1,15 @@
|
||||
# World-Class Claim Guard
|
||||
|
||||
Generated at: `2026-06-21`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
- decision: `claim-guard-pass-evidence-pending`
|
||||
- ledger ready to claim world-class: `false`
|
||||
- ledger pending evidence: `4`
|
||||
- claim surfaces scanned: `184`
|
||||
- JSON claim surfaces scanned: `91`
|
||||
- metadata claim surfaces scanned: `92`
|
||||
- claim surfaces scanned: `201`
|
||||
- JSON claim surfaces scanned: `97`
|
||||
- metadata claim surfaces scanned: `98`
|
||||
- package/runtime claim surfaces scanned: `17`
|
||||
- violations: `0`
|
||||
- overclaim guard active: `true`
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-20",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"schema_present": true,
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# World-Class Evidence Intake
|
||||
|
||||
Generated at: `2026-06-20`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-20",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"decision": "evidence-pending",
|
||||
"ready_to_claim_world_class": false,
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# World-Class Evidence Ledger
|
||||
|
||||
Generated at: `2026-06-20`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-20",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"audit_decision": "continue-iteration",
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# World-Class Evidence Plan
|
||||
|
||||
Generated at: `2026-06-20`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-21",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"evidence_item_count": 4,
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# World-Class Evidence Preflight
|
||||
|
||||
Generated at: `2026-06-21`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-20",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"summary": {
|
||||
"evidence_item_count": 4,
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# World-Class Operator Runbook
|
||||
|
||||
Generated at: `2026-06-20`
|
||||
Generated at: `2026-07-02`
|
||||
|
||||
## Summary
|
||||
|
||||
|
||||
@@ -1,7 +1,7 @@
|
||||
{
|
||||
"schema_version": "1.0",
|
||||
"ok": true,
|
||||
"generated_at": "2026-06-20",
|
||||
"generated_at": "2026-07-02",
|
||||
"skill_dir": ".",
|
||||
"decision": "awaiting-submissions",
|
||||
"ready_to_claim_world_class": false,
|
||||
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user