26382a7ac6
CI / Clippy (push) Failing after 15m13s
CI / Test (ubuntu-latest) (push) Failing after 16m1s
CI / Test (macos-latest) (push) Has been cancelled
CI / Test (windows-latest) (push) Has been cancelled
CI / Build (no embeddings / no ORT) (push) Has been cancelled
CI / Format (push) Has been cancelled
CI / Cookbook (Node) (push) Has been cancelled
CI / Pi Extension (Node) (push) Has been cancelled
CI / Rust SDK (lean-ctx-client) (push) Has been cancelled
CI / Embed SDK (lean-ctx-sdk) (push) Has been cancelled
CI / Python SDK (leanctx) (push) Has been cancelled
CI / Hermes Plugin (Python) (push) Has been cancelled
CI / SDK Conformance Matrix (push) Has been cancelled
CI / Coverage (push) Has been cancelled
CI / cargo-deny (push) Has been cancelled
CI / Adversarial Safety (push) Has been cancelled
CI / Benchmarks (push) Has been cancelled
CI / Output-Quality Gate (eval A/B) (push) Has been cancelled
CI / Documentation (push) Has been cancelled
CI / CI Green (push) Has been cancelled
JetBrains Plugin / Actionlint (push) Has been cancelled
CodeQL / Analyze (actions) (push) Has been cancelled
CodeQL / Analyze (javascript-typescript) (push) Has been cancelled
CodeQL / Analyze (rust) (push) Has been cancelled
JetBrains Plugin / Validation (push) Has been cancelled
JetBrains Plugin / Build (push) Has been cancelled
JetBrains Plugin / Test (push) Has been cancelled
Security Check / Security Scan (push) Has been cancelled
32 lines
962 B
Rust
32 lines
962 B
Rust
//! CI gate for the conformance & reproducibility scorecard (EPIC 12.17).
|
|
//!
|
|
//! Fails the build if this instance violates any of its own contracts, the
|
|
//! discovery documents are non-deterministic, or a registered extension breaks
|
|
//! an invariant. See `core::conformance`.
|
|
|
|
use lean_ctx::core::conformance;
|
|
|
|
#[test]
|
|
fn conformance_scorecard_all_pass() {
|
|
let card = conformance::run();
|
|
assert!(
|
|
card.all_passed(),
|
|
"conformance scorecard has {} failure(s): {:#?}",
|
|
card.failures().len(),
|
|
card.failures()
|
|
);
|
|
}
|
|
|
|
#[test]
|
|
fn scorecard_covers_all_categories() {
|
|
let card = conformance::run();
|
|
let categories: std::collections::BTreeSet<&str> =
|
|
card.checks.iter().map(|c| c.category.as_str()).collect();
|
|
for expected in ["contracts", "reproducibility", "extensions"] {
|
|
assert!(
|
|
categories.contains(expected),
|
|
"scorecard missing category '{expected}'"
|
|
);
|
|
}
|
|
}
|