Files
wehub-resource-sync 5a558eb09e
Backend Tests / discover-tests (push) Waiting to run
Backend Tests / ${{ matrix.name }} (push) Blocked by required conditions
Build and Publish SDK / build-and-publish (push) Waiting to run
Build Opik Docker Images / set-version (push) Waiting to run
Build Opik Docker Images / build-backend (push) Blocked by required conditions
Build Opik Docker Images / build-sandbox-executor-python (push) Blocked by required conditions
Build Opik Docker Images / build-python-backend (push) Blocked by required conditions
Build Opik Docker Images / build-frontend (push) Blocked by required conditions
Build Opik Docker Images / create-git-tag (push) Blocked by required conditions
ClickHouse Migration Cluster Check / validate-clickhouse-migrations (push) Waiting to run
Docs - Publish / run (push) Waiting to run
E2E Tests - Post Merge (v2) / 🧪 E2E v2 Tests (${{ github.event.inputs.tier || 't1' }}) (push) Waiting to run
E2E Tests - Post Merge (v2) / 📢 Slack Notification (push) Blocked by required conditions
Frontend Unit Tests / Test on Node 20 (push) Waiting to run
Guardrails E2E Tests / Select Python version matrix (push) Waiting to run
Guardrails E2E Tests / Guardrails E2E Tests ${{matrix.python_version}} (push) Blocked by required conditions
Guardrails E2E Tests / 📢 Slack Notification (push) Blocked by required conditions
Guardrails Backend Unit Tests / Guardrails Backend Unit Tests (push) Waiting to run
Guardrails Backend Unit Tests / 📢 Slack Notification (push) Blocked by required conditions
Lint Opik Helm Chart / lint-helm-chart (Helm v3.21.0) (push) Waiting to run
Lint Opik Helm Chart / lint-helm-chart (Helm v4.2.0) (push) Waiting to run
Lint Opik Helm Chart / unittest-helm-chart (push) Waiting to run
Lint Opik Helm Chart / render-equality (push) Waiting to run
Opik Optimizer - Unit Tests / Opik Optimizer Unit Tests Python ${{matrix.python_version}} (push) Waiting to run
Python BE E2E Tests / Python BE E2E (push) Waiting to run
Python Backend Tests / run-python-backend-tests (push) Waiting to run
Python SDK Unit Tests / Python SDK Unit Tests ${{matrix.python_version}} (push) Waiting to run
Release Drafter / update_release_draft (push) Waiting to run
SDK E2E Libraries Integration Tests / Check Secrets (push) Waiting to run
SDK E2E Libraries Integration Tests / Missed OpenAI API Key Warning (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / build-opik (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / E2E Lib Integration Python ${{matrix.python_version}} (push) Blocked by required conditions
TypeScript SDK Integration Build & Publish / build-and-publish (opik-gemini) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-langchain) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-openai) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-otel) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-vercel) (push) Waiting to run
TypeScript SDK Build & Publish / build-and-publish (push) Waiting to run
TypeScript SDK Unit Tests / Test on Node ${{ matrix.node-version }} (push) Waiting to run
TypeScript SDK Compatibility V1.x E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / TypeScript SDK Compatibility V1.x E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
TypeScript SDK E2E Tests / TypeScript SDK E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Python SDK E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK E2E Tests / Python SDK E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK E2E Tests / build-opik (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Python SDK Compatibility V1.x E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK E2E Tests / build-opik (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer E2E Tests Python ${{matrix.python_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer Integration Smoke Tests (push) Has been cancelled
🐙 Code Quality / detect (push) Has been cancelled
🐙 Code Quality / lint (${{ matrix.leg.name }}) (push) Has been cancelled
🐙 Code Quality / summary (push) Has been cancelled
TypeScript SDK Library Integration Tests / Check Secrets (push) Has been cancelled
TypeScript SDK Library Integration Tests / opik-vercel (Vercel AI SDK / eve) (push) Has been cancelled
SDK Library Integration Tests Runner / Check Secrets (push) Has been cancelled
SDK Library Integration Tests Runner / Missed OpenAI API Key Warning (push) Has been cancelled
SDK Library Integration Tests Runner / Build (push) Has been cancelled
SDK Library Integration Tests Runner / openai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_legacy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / llama_index_tests (push) Has been cancelled
SDK Library Integration Tests Runner / anthropic_tests (push) Has been cancelled
SDK Library Integration Tests Runner / mistral_tests (push) Has been cancelled
SDK Library Integration Tests Runner / groq_tests (push) Has been cancelled
SDK Library Integration Tests Runner / aisuite_tests (push) Has been cancelled
SDK Library Integration Tests Runner / haystack_tests (push) Has been cancelled
SDK Library Integration Tests Runner / dspy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v1_tests (push) Has been cancelled
SDK Library Integration Tests Runner / genai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_legacy_1_3_0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / evaluation_metrics_tests (push) Has been cancelled
SDK Library Integration Tests Runner / bedrock_tests (push) Has been cancelled
SDK Library Integration Tests Runner / litellm_tests (push) Has been cancelled
SDK Library Integration Tests Runner / harbor_tests (push) Has been cancelled
SDK Library Integration Tests Runner / Slack Notification (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 13:25:44 +08:00

196 lines
5.5 KiB
Python

"""Happy-path e2e tests for the bridge command system.
Exec tests: echo, nonzero exit, background process.
File operation flow: write → list → search → edit → read, all via the API.
"""
import time
from opik.rest_api.errors.conflict_error import ConflictError
from opik.runner.bridge_auth import sign
from .conftest import RunnerInfo
_BRIDGE_READY_TIMEOUT = 15
def _submit_and_wait(api_client, runner_id, cmd_type, args, bridge_key=b""):
if bridge_key:
args = dict(args)
args["_hmac"] = sign(bridge_key, cmd_type, args)
deadline = time.monotonic() + _BRIDGE_READY_TIMEOUT
while True:
try:
resp = api_client.runners.create_bridge_command(
runner_id,
type=cmd_type,
args=args,
)
break
except ConflictError:
if time.monotonic() > deadline:
raise
time.sleep(1)
return api_client.runners.get_bridge_command(
runner_id,
resp.command_id,
wait=True,
timeout=15,
)
# ---------------------------------------------------------------------------
# Auth tests
# ---------------------------------------------------------------------------
def test_bridge_command__unsigned__fails_with_auth_failed(
api_client, bridge_runner_process: RunnerInfo
):
cmd = _submit_and_wait(
api_client,
bridge_runner_process.runner_id,
"Exec",
{"command": "echo should-not-run"},
)
assert cmd.status == "failed"
assert cmd.error["code"] == "auth_failed"
def test_bridge_command__invalid_hmac__fails_with_auth_failed(
api_client, bridge_runner_process: RunnerInfo
):
cmd = _submit_and_wait(
api_client,
bridge_runner_process.runner_id,
"Exec",
{"command": "echo should-not-run", "_hmac": "dGhpcyBpcyBub3QgYSB2YWxpZCBobWFj"},
)
assert cmd.status == "failed"
assert cmd.error["code"] == "auth_failed"
# ---------------------------------------------------------------------------
# Exec tests
# ---------------------------------------------------------------------------
def test_bridge_exec_echo(api_client, bridge_runner_process: RunnerInfo):
"""Submit a simple echo command and verify the result."""
marker = f"bridge-e2e-{int(time.time())}"
cmd = _submit_and_wait(
api_client,
bridge_runner_process.runner_id,
"Exec",
{"command": f"echo {marker}"},
bridge_key=bridge_runner_process.bridge_key,
)
assert cmd.status == "completed"
assert marker in cmd.result["stdout"]
assert cmd.result["exit_code"] == 0
def test_bridge_exec_nonzero_exit(api_client, bridge_runner_process: RunnerInfo):
"""Verify non-zero exit codes are returned correctly."""
cmd = _submit_and_wait(
api_client,
bridge_runner_process.runner_id,
"Exec",
{"command": "exit 42"},
bridge_key=bridge_runner_process.bridge_key,
)
assert cmd.status == "completed"
assert cmd.result["exit_code"] == 42
def test_bridge_exec_background(api_client, bridge_runner_process: RunnerInfo):
"""Submit a background command, verify PID is returned."""
cmd = _submit_and_wait(
api_client,
bridge_runner_process.runner_id,
"Exec",
{"command": "sleep 30", "background": True},
bridge_key=bridge_runner_process.bridge_key,
)
assert cmd.status == "completed"
assert "pid" in cmd.result
assert cmd.result["status"] == "running"
# ---------------------------------------------------------------------------
# File operation flow: write → list → search → edit → read
# ---------------------------------------------------------------------------
def test_bridge_file_operations(api_client, bridge_runner_process: RunnerInfo):
"""Write a file, find it with list/search, edit it, and read back."""
rid = bridge_runner_process.runner_id
bk = bridge_runner_process.bridge_key
marker = f"xyzzy_{int(time.time())}"
filename = f"bridge_e2e_{int(time.time())}.py"
original_content = f"# {marker}\n"
# 1. Write
cmd = _submit_and_wait(
api_client,
rid,
"WriteFile",
{"path": filename, "content": original_content},
bridge_key=bk,
)
assert cmd.status == "completed"
assert cmd.result["created"] is True
# 2. ListFiles — new file should appear in the root
cmd = _submit_and_wait(
api_client,
rid,
"ListFiles",
{"pattern": f"{filename}"},
bridge_key=bk,
)
assert cmd.status == "completed"
assert any(filename in f for f in cmd.result["files"]), (
f"{filename} not in {cmd.result['files']}"
)
# 3. EditFile — replace content
cmd = _submit_and_wait(
api_client,
rid,
"EditFile",
{
"path": filename,
"edits": [{"old_string": marker, "new_string": f"edited_{marker}"}],
},
bridge_key=bk,
)
assert cmd.status == "completed"
assert cmd.result["edits_applied"] == 1
# 4. ReadFile — verify the edit took effect
cmd = _submit_and_wait(
api_client,
rid,
"ReadFile",
{"path": filename},
bridge_key=bk,
)
assert cmd.status == "completed"
assert f"edited_{marker}" in cmd.result["content"]
# 5. Cleanup via Exec
_submit_and_wait(
api_client,
rid,
"Exec",
{"command": f"rm {filename}"},
bridge_key=bk,
)