4b6817381b
CI (OpenClaw E2E) / openclaw test (push) Has been cancelled
CI / coverage-report (push) Has been cancelled
CI / test-kubernetes (push) Has been cancelled
CI / should-run-thorough (push) Has been cancelled
CI / test-thorough (cloudwatch-demo) (push) Has been cancelled
CI / test-thorough (flink-ecs) (push) Has been cancelled
CI / test-thorough (upstream-lambda) (push) Has been cancelled
CI / test-thorough (prefect-ecs-fargate) (push) Has been cancelled
Release / build-binaries (zip, opensre.exe, onefile, windows-latest, windows-x64) (push) Has been cancelled
Benchmark image — build + push to ECR (any adapter) / build + push (push) Has been cancelled
CI / quality (ubuntu-latest) (push) Has been cancelled
CI / test (tools-runtime) (push) Has been cancelled
CI / test (e2e-general) (push) Has been cancelled
CI / test (cli-runtime) (push) Has been cancelled
CI / test (e2e-provider-and-openclaw) (push) Has been cancelled
CI / test (integrations-and-misc) (push) Has been cancelled
Release / verify (push) Has been cancelled
Release / build-python-dist (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-15-intel, darwin-x64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, macos-latest, darwin-arm64) (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04, linux-x64) (push) Has been cancelled
Release / publish-release (push) Has been cancelled
Release / publish-main-release (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-checks (no-LLM) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
Interactive Shell Live (PR + post-merge) / turn-live shard ${{ matrix.shard_index }} (push) Has been cancelled
Release / prepare (push) Has been cancelled
Release / build-binaries (tar.gz, opensre, onedir, ubuntu-22.04-arm, linux-arm64) (push) Has been cancelled
Synthetic Deterministic Tests / Synthetic offline (deterministic) (push) Has been cancelled
44 lines
1.4 KiB
Python
44 lines
1.4 KiB
Python
"""Tests for the investigation LLM usage observer."""
|
|
|
|
from __future__ import annotations
|
|
|
|
from core.llm.shared.usage import emit_usage, set_usage_hook
|
|
from surfaces.interactive_shell.utils.telemetry.investigation_llm_usage import (
|
|
observe_investigation_llm_usage,
|
|
)
|
|
|
|
|
|
def test_observe_accumulates_usage_and_clears_hook() -> None:
|
|
with observe_investigation_llm_usage() as usage:
|
|
emit_usage("claude-sonnet-4-5", 100, 20)
|
|
emit_usage("claude-sonnet-4-5", 50, 10)
|
|
assert usage.model == "claude-sonnet-4-5"
|
|
assert usage.input_tokens == 150
|
|
assert usage.output_tokens == 30
|
|
assert usage.observed
|
|
# Hook must be released so later owners can register.
|
|
set_usage_hook(lambda *_args: None)
|
|
set_usage_hook(None)
|
|
|
|
|
|
def test_observe_tolerates_already_registered_hook() -> None:
|
|
external: list[tuple[str, int, int]] = []
|
|
set_usage_hook(lambda model, inp, out: external.append((model, inp, out)))
|
|
try:
|
|
with observe_investigation_llm_usage() as usage:
|
|
emit_usage("m", 10, 5)
|
|
assert not usage.observed
|
|
assert external == [("m", 10, 5)]
|
|
# The pre-existing hook must survive the observer.
|
|
emit_usage("m", 1, 1)
|
|
assert len(external) == 2
|
|
finally:
|
|
set_usage_hook(None)
|
|
|
|
|
|
def test_observe_ignores_usage_outside_scope() -> None:
|
|
with observe_investigation_llm_usage() as usage:
|
|
pass
|
|
emit_usage("m", 10, 5)
|
|
assert not usage.observed
|