d48cda4081
CI / Test (ubuntu-latest, Node 18.x, bun) (push) Failing after 15m1s
CI / Test (ubuntu-latest, Node 18.x, npm) (push) Failing after 15m1s
CI / Test (ubuntu-latest, Node 18.x, pnpm) (push) Failing after 15m1s
CI / Test (ubuntu-latest, Node 18.x, yarn) (push) Failing after 15m1s
CI / Test (ubuntu-latest, Node 20.x, bun) (push) Failing after 17m13s
CI / Test (ubuntu-latest, Node 20.x, npm) (push) Failing after 18m42s
CI / Test (ubuntu-latest, Node 20.x, pnpm) (push) Failing after 15m0s
CI / Test (ubuntu-latest, Node 20.x, yarn) (push) Failing after 49m44s
CI / Test (ubuntu-latest, Node 22.x, bun) (push) Failing after 51m55s
CI / Test (ubuntu-latest, Node 22.x, pnpm) (push) Failing after 21m57s
CI / Test (ubuntu-latest, Node 22.x, npm) (push) Failing after 37m39s
CI / Test (ubuntu-latest, Node 22.x, yarn) (push) Failing after 34m7s
CI / Validate Components (push) Failing after 37m15s
CI / Python Tests (push) Failing after 10m1s
CI / Security Scan (push) Failing after 10m1s
CI / Lint (push) Failing after 17m12s
CI / Coverage (push) Failing after 20m19s
CI / Test (macos-latest, Node 18.x, bun) (push) Has been cancelled
CI / Test (macos-latest, Node 18.x, npm) (push) Has been cancelled
CI / Test (macos-latest, Node 18.x, pnpm) (push) Has been cancelled
CI / Test (macos-latest, Node 18.x, yarn) (push) Has been cancelled
CI / Test (windows-latest, Node 18.x, npm) (push) Has been cancelled
CI / Test (windows-latest, Node 18.x, pnpm) (push) Has been cancelled
CI / Test (windows-latest, Node 18.x, yarn) (push) Has been cancelled
CI / Test (macos-latest, Node 20.x, bun) (push) Has been cancelled
CI / Test (macos-latest, Node 20.x, npm) (push) Has been cancelled
CI / Test (macos-latest, Node 20.x, pnpm) (push) Has been cancelled
CI / Test (macos-latest, Node 20.x, yarn) (push) Has been cancelled
CI / Test (windows-latest, Node 20.x, npm) (push) Has been cancelled
CI / Test (windows-latest, Node 20.x, pnpm) (push) Has been cancelled
CI / Test (windows-latest, Node 20.x, yarn) (push) Has been cancelled
CI / Test (macos-latest, Node 22.x, bun) (push) Has been cancelled
CI / Test (macos-latest, Node 22.x, npm) (push) Has been cancelled
CI / Test (macos-latest, Node 22.x, pnpm) (push) Has been cancelled
CI / Test (macos-latest, Node 22.x, yarn) (push) Has been cancelled
CI / Test (windows-latest, Node 22.x, npm) (push) Has been cancelled
CI / Test (windows-latest, Node 22.x, pnpm) (push) Has been cancelled
CI / Test (windows-latest, Node 22.x, yarn) (push) Has been cancelled
2.3 KiB
2.3 KiB
Eval Komutu
Eval-odaklı geliştirme iş akışını yönet.
Kullanım
/eval [define|check|report|list] [feature-name]
Eval Tanımla
/eval define feature-name
Yeni bir eval tanımı oluştur:
- Şablonla
.claude/evals/feature-name.mdoluştur:
## EVAL: feature-name
Created: $(date)
### Capability Evals
- [ ] [Capability 1 açıklaması]
- [ ] [Capability 2 açıklaması]
### Regression Evals
- [ ] [Mevcut davranış 1 hala çalışıyor]
- [ ] [Mevcut davranış 2 hala çalışıyor]
### Success Criteria
- pass@3 > 90% for capability evals
- pass^3 = 100% for regression evals
- Kullanıcıdan belirli kriterleri doldurmasını iste
Eval Kontrol Et
/eval check feature-name
Bir özellik için eval'ları çalıştır:
.claude/evals/feature-name.mddosyasından eval tanımını oku- Her capability eval için:
- Kriteri doğrulamayı dene
- PASS/FAIL kaydet
- Denemeyi
.claude/evals/feature-name.logdosyasına kaydet
- Her regression eval için:
- İlgili test'leri çalıştır
- Baseline ile karşılaştır
- PASS/FAIL kaydet
- Mevcut durumu raporla:
EVAL CHECK: feature-name
========================
Capability: X/Y passing
Regression: X/Y passing
Status: IN PROGRESS / READY
Eval Raporu
/eval report feature-name
Kapsamlı eval raporu oluştur:
EVAL REPORT: feature-name
=========================
Generated: $(date)
CAPABILITY EVALS
----------------
[eval-1]: PASS (pass@1)
[eval-2]: PASS (pass@2) - required retry
[eval-3]: FAIL - see notes
REGRESSION EVALS
----------------
[test-1]: PASS
[test-2]: PASS
[test-3]: PASS
METRICS
-------
Capability pass@1: 67%
Capability pass@3: 100%
Regression pass^3: 100%
NOTES
-----
[Herhangi bir sorun, edge case veya gözlem]
RECOMMENDATION
--------------
[SHIP / NEEDS WORK / BLOCKED]
Eval'ları Listele
/eval list
Tüm eval tanımlarını göster:
EVAL DEFINITIONS
================
feature-auth [3/5 passing] IN PROGRESS
feature-search [5/5 passing] READY
feature-export [0/4 passing] NOT STARTED
Argümanlar
$ARGUMENTS:
define <name>- Yeni eval tanımı oluşturcheck <name>- Eval'ları çalıştır ve kontrol etreport <name>- Tam rapor oluşturlist- Tüm eval'ları gösterclean- Eski eval loglarını kaldır (son 10 çalıştırmayı tutar)