0ef5fcb1c5
Security / Dependency audit (pip-audit) (push) Has been cancelled
Security / CodeQL (javascript-typescript) (push) Has been cancelled
Security / CodeQL (python) (push) Has been cancelled
Security / Secret scan (gitleaks) (push) Has been cancelled
rust / test (ubuntu) (push) Has been cancelled
rust / simulator e2e (macos-latest) (push) Has been cancelled
rust / simulator e2e (ubuntu-latest) (push) Has been cancelled
rust / simulator e2e (windows-latest) (push) Has been cancelled
rust / wheels (aarch64-apple-darwin) (push) Has been cancelled
rust / wheels (x86_64-unknown-linux-gnu) (push) Has been cancelled
rust / wheels (x86_64-apple-darwin) (push) Has been cancelled
rust / audit (push) Has been cancelled
rust / parity (nightly, allowed to fail during Phase 0) (push) Has been cancelled
CI / commitlint (push) Has been skipped
Dev Containers / validate (.devcontainer/devcontainer.json, default) (push) Failing after 0s
Dev Containers / validate (.devcontainer/memory-stack/devcontainer.json, memory-stack) (push) Failing after 0s
Dev Containers / validate-worktree (push) Failing after 0s
CI / changes (push) Failing after 4s
Deploy Documentation / validate (push) Has been skipped
Deploy Documentation / deploy (push) Failing after 1s
Init Native E2E / init-native (ubuntu-latest, claude) (push) Failing after 1s
Init Native E2E / init-native (ubuntu-latest, codex) (push) Failing after 1s
Install Native E2E / install-native (ubuntu-latest) (push) Failing after 1s
OpenCode Plugin / typecheck + build + test (push) Failing after 1s
Init Native E2E / init-native (ubuntu-latest, copilot) (push) Failing after 1s
Release Please / release-please (push) Failing after 1s
Wrap E2E / docker-wrap-e2e (push) Failing after 1s
Wrap Native E2E / wrap-native (ubuntu-latest) (push) Failing after 1s
Init E2E / docker-init-e2e (push) Failing after 4s
Merge Conflicts / merge-conflicts (push) Failing after 4s
CI / lint (push) Has been cancelled
CI / build-wheel (push) Has been cancelled
CI / build-wheel-windows (push) Has been cancelled
CI / prefetch-model (push) Has been cancelled
CI / test-dashboard-ui (push) Has been cancelled
CI / test (1) (push) Has been cancelled
CI / test (2) (push) Has been cancelled
CI / test (3) (push) Has been cancelled
CI / test (4) (push) Has been cancelled
CI / test-extras (push) Has been cancelled
CI / test-agno (push) Has been cancelled
CI / build (push) Has been cancelled
CI / workflow-validation (push) Has been cancelled
CI / docker-native-e2e (push) Has been cancelled
CI / windows-native-wrapper (push) Has been cancelled
CI / macos-native-wrapper (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-code-nonroot name:code-nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-code-slim name:code-slim]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-code-slim-nonroot name:code-slim-nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-nonroot name:nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-slim name:slim]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-slim-nonroot name:slim-nonroot]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime name:]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-code name:code]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-code-nonroot name:code-nonroot]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-code-slim name:code-slim]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-code-slim-nonroot name:code-slim-nonroot]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-nonroot name:nonroot]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-slim name:slim]) (push) Has been cancelled
Docker / docker-manifest (map[bake_target:runtime-slim-nonroot name:slim-nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime name:]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-code name:code]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-code-nonroot name:code-nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-code-slim name:code-slim]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-code-slim-nonroot name:code-slim-nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-nonroot name:nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-slim name:slim]) (push) Has been cancelled
Docker / docker-build (map[name:amd64 platform:linux/amd64 runs_on:ubuntu-24.04], map[bake_target:runtime-slim-nonroot name:slim-nonroot]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime name:]) (push) Has been cancelled
Docker / docker-build (map[name:arm64 platform:linux/arm64 runs_on:ubuntu-24.04-arm], map[bake_target:runtime-code name:code]) (push) Has been cancelled
Docker / promote-latest (push) Has been cancelled
Init Native E2E / init-native (macos-latest, claude) (push) Has been cancelled
Init Native E2E / init-native (macos-latest, codex) (push) Has been cancelled
Init Native E2E / init-native (macos-latest, copilot) (push) Has been cancelled
Install Native E2E / install-native (macos-latest) (push) Has been cancelled
Wrap Native E2E / wrap-native (macos-latest) (push) Has been cancelled
215 lines
5.6 KiB
Python
215 lines
5.6 KiB
Python
"""Tests for pr-governance.py."""
|
|
|
|
from __future__ import annotations
|
|
|
|
import importlib.util
|
|
import json
|
|
import sys
|
|
from pathlib import Path
|
|
|
|
|
|
def _load_module():
|
|
script = Path(__file__).parent.parent / "pr-governance.py"
|
|
spec = importlib.util.spec_from_file_location("pr_governance", script)
|
|
assert spec is not None
|
|
assert spec.loader is not None
|
|
module = importlib.util.module_from_spec(spec)
|
|
sys.modules[spec.name] = module
|
|
spec.loader.exec_module(module)
|
|
return module
|
|
|
|
|
|
def _event(body: str, *, draft: bool = False, login: str = "octocat") -> dict[str, object]:
|
|
return {
|
|
"pull_request": {
|
|
"number": 42,
|
|
"draft": draft,
|
|
"body": body,
|
|
"user": {"login": login},
|
|
}
|
|
}
|
|
|
|
|
|
VALID_BODY = """## Description
|
|
|
|
Add a required PR-governance gate for template validation and review readiness.
|
|
|
|
Closes #123
|
|
|
|
## Type of Change
|
|
|
|
- [x] New feature (non-breaking change that adds functionality)
|
|
- [ ] Documentation update
|
|
|
|
## Changes Made
|
|
|
|
- Added a workflow-backed PR template validator.
|
|
- Added local commit message linting in the commit-msg hook.
|
|
|
|
## Testing
|
|
|
|
- [x] Unit tests pass (`pytest`)
|
|
- [x] Manual testing performed
|
|
|
|
### Test Output
|
|
|
|
```text
|
|
pytest scripts/tests/test_pr_governance.py -q
|
|
```
|
|
|
|
## Real Behavior Proof
|
|
|
|
- Environment: Ubuntu runner, Python 3.12
|
|
- Exact command / steps: Open a PR, remove the ready checkbox, re-run the workflow.
|
|
- Observed result: The governance check fails and the PR gets a needs-author-action label.
|
|
- Not tested: Automatic Copilot review rulesets in repository settings.
|
|
|
|
## Review Readiness
|
|
|
|
- [x] I have performed a self-review
|
|
- [x] This PR is ready for human review
|
|
|
|
## Additional Notes
|
|
|
|
- Maintainers can optionally enable Copilot code review from repository rulesets.
|
|
"""
|
|
|
|
|
|
def test_validate_pull_request_marks_ready_pr_valid() -> None:
|
|
module = _load_module()
|
|
|
|
report = module.validate_pull_request(_event(VALID_BODY))
|
|
|
|
assert report.valid is True
|
|
assert report.ready_for_review is True
|
|
assert report.needs_author_action is False
|
|
assert report.problems == []
|
|
assert report.labels_to_add == [module.READY_LABEL]
|
|
assert module.AUTHOR_ACTION_LABEL in report.labels_to_remove
|
|
|
|
|
|
def test_validate_pull_request_accepts_crlf_test_output_code_block() -> None:
|
|
module = _load_module()
|
|
body = VALID_BODY.replace("\n", "\r\n")
|
|
|
|
report = module.validate_pull_request(_event(body))
|
|
|
|
assert report.valid is True
|
|
assert report.problems == []
|
|
|
|
|
|
def test_validate_pull_request_body_override_uses_live_body() -> None:
|
|
module = _load_module()
|
|
stale_event_body = ""
|
|
|
|
report = module.validate_pull_request_body(_event(stale_event_body), VALID_BODY)
|
|
|
|
assert report.valid is True
|
|
assert report.ready_for_review is True
|
|
assert report.problems == []
|
|
|
|
|
|
def test_cli_body_file_override_uses_live_body(tmp_path: Path, monkeypatch) -> None:
|
|
module = _load_module()
|
|
event_path = tmp_path / "event.json"
|
|
body_path = tmp_path / "body.md"
|
|
report_path = tmp_path / "report.json"
|
|
event_path.write_text(
|
|
json.dumps(_event("")),
|
|
encoding="utf-8",
|
|
)
|
|
body_path.write_text(VALID_BODY, encoding="utf-8")
|
|
monkeypatch.delenv("GITHUB_OUTPUT", raising=False)
|
|
|
|
exit_code = module.main(
|
|
[
|
|
"--event",
|
|
str(event_path),
|
|
"--body-file",
|
|
str(body_path),
|
|
"--report",
|
|
str(report_path),
|
|
]
|
|
)
|
|
|
|
assert exit_code == 0
|
|
report = json.loads(report_path.read_text(encoding="utf-8"))
|
|
assert report["valid"] is True
|
|
assert report["ready_for_review"] is True
|
|
|
|
|
|
def test_validate_pull_request_allows_draft_without_ready_checkboxes() -> None:
|
|
module = _load_module()
|
|
body = VALID_BODY.replace(
|
|
"- [x] I have performed a self-review", "- [ ] I have performed a self-review"
|
|
)
|
|
body = body.replace(
|
|
"- [x] This PR is ready for human review",
|
|
"- [ ] This PR is ready for human review",
|
|
)
|
|
|
|
report = module.validate_pull_request(_event(body, draft=True))
|
|
|
|
assert report.valid is True
|
|
assert report.ready_for_review is False
|
|
assert report.needs_author_action is False
|
|
assert report.labels_to_add == []
|
|
assert module.READY_LABEL in report.labels_to_remove
|
|
|
|
|
|
def test_validate_pull_request_fails_on_missing_required_content() -> None:
|
|
module = _load_module()
|
|
body = """## Description
|
|
|
|
Fixes #123
|
|
|
|
## Type of Change
|
|
|
|
- [ ] New feature (non-breaking change that adds functionality)
|
|
|
|
## Changes Made
|
|
|
|
- Change 1
|
|
|
|
## Testing
|
|
|
|
### Test Output
|
|
|
|
```text
|
|
# Paste relevant command output or artifact links here
|
|
```
|
|
|
|
## Real Behavior Proof
|
|
|
|
- Environment:
|
|
- Exact command / steps:
|
|
- Observed result:
|
|
- Not tested:
|
|
|
|
## Review Readiness
|
|
|
|
- [ ] I have performed a self-review
|
|
- [ ] This PR is ready for human review
|
|
"""
|
|
|
|
report = module.validate_pull_request(_event(body))
|
|
|
|
assert report.valid is False
|
|
assert report.needs_author_action is True
|
|
assert module.AUTHOR_ACTION_LABEL in report.labels_to_add
|
|
assert any("Description" in problem for problem in report.problems)
|
|
assert any("Type of Change" in problem for problem in report.problems)
|
|
assert any("Test Output" in problem for problem in report.problems)
|
|
assert any("Real Behavior Proof" in problem for problem in report.problems)
|
|
|
|
|
|
def test_validate_pull_request_skips_bot_authored_prs() -> None:
|
|
module = _load_module()
|
|
|
|
report = module.validate_pull_request(_event("", login="dependabot[bot]"))
|
|
|
|
assert report.valid is True
|
|
assert report.is_bot_pr is True
|
|
assert report.needs_author_action is False
|
|
assert report.labels_to_add == []
|