Files
comet-ml--opik/sdks/python/tests/unit/cli/test_migrate_prompt_planner.py
wehub-resource-sync 5a558eb09e
Backend Tests / discover-tests (push) Waiting to run
Backend Tests / ${{ matrix.name }} (push) Blocked by required conditions
Build and Publish SDK / build-and-publish (push) Waiting to run
Build Opik Docker Images / set-version (push) Waiting to run
Build Opik Docker Images / build-backend (push) Blocked by required conditions
Build Opik Docker Images / build-sandbox-executor-python (push) Blocked by required conditions
Build Opik Docker Images / build-python-backend (push) Blocked by required conditions
Build Opik Docker Images / build-frontend (push) Blocked by required conditions
Build Opik Docker Images / create-git-tag (push) Blocked by required conditions
ClickHouse Migration Cluster Check / validate-clickhouse-migrations (push) Waiting to run
Docs - Publish / run (push) Waiting to run
E2E Tests - Post Merge (v2) / 🧪 E2E v2 Tests (${{ github.event.inputs.tier || 't1' }}) (push) Waiting to run
E2E Tests - Post Merge (v2) / 📢 Slack Notification (push) Blocked by required conditions
Frontend Unit Tests / Test on Node 20 (push) Waiting to run
Guardrails E2E Tests / Select Python version matrix (push) Waiting to run
Guardrails E2E Tests / Guardrails E2E Tests ${{matrix.python_version}} (push) Blocked by required conditions
Guardrails E2E Tests / 📢 Slack Notification (push) Blocked by required conditions
Guardrails Backend Unit Tests / Guardrails Backend Unit Tests (push) Waiting to run
Guardrails Backend Unit Tests / 📢 Slack Notification (push) Blocked by required conditions
Lint Opik Helm Chart / lint-helm-chart (Helm v3.21.0) (push) Waiting to run
Lint Opik Helm Chart / lint-helm-chart (Helm v4.2.0) (push) Waiting to run
Lint Opik Helm Chart / unittest-helm-chart (push) Waiting to run
Lint Opik Helm Chart / render-equality (push) Waiting to run
Opik Optimizer - Unit Tests / Opik Optimizer Unit Tests Python ${{matrix.python_version}} (push) Waiting to run
Python BE E2E Tests / Python BE E2E (push) Waiting to run
Python Backend Tests / run-python-backend-tests (push) Waiting to run
Python SDK Unit Tests / Python SDK Unit Tests ${{matrix.python_version}} (push) Waiting to run
Release Drafter / update_release_draft (push) Waiting to run
SDK E2E Libraries Integration Tests / Check Secrets (push) Waiting to run
SDK E2E Libraries Integration Tests / Missed OpenAI API Key Warning (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / build-opik (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / E2E Lib Integration Python ${{matrix.python_version}} (push) Blocked by required conditions
TypeScript SDK Integration Build & Publish / build-and-publish (opik-gemini) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-langchain) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-openai) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-otel) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-vercel) (push) Waiting to run
TypeScript SDK Build & Publish / build-and-publish (push) Waiting to run
TypeScript SDK Unit Tests / Test on Node ${{ matrix.node-version }} (push) Waiting to run
TypeScript SDK Compatibility V1.x E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / TypeScript SDK Compatibility V1.x E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
TypeScript SDK E2E Tests / TypeScript SDK E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Python SDK E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK E2E Tests / Python SDK E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK E2E Tests / build-opik (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Python SDK Compatibility V1.x E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK E2E Tests / build-opik (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer E2E Tests Python ${{matrix.python_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer Integration Smoke Tests (push) Has been cancelled
🐙 Code Quality / detect (push) Has been cancelled
🐙 Code Quality / lint (${{ matrix.leg.name }}) (push) Has been cancelled
🐙 Code Quality / summary (push) Has been cancelled
TypeScript SDK Library Integration Tests / Check Secrets (push) Has been cancelled
TypeScript SDK Library Integration Tests / opik-vercel (Vercel AI SDK / eve) (push) Has been cancelled
SDK Library Integration Tests Runner / Check Secrets (push) Has been cancelled
SDK Library Integration Tests Runner / Missed OpenAI API Key Warning (push) Has been cancelled
SDK Library Integration Tests Runner / Build (push) Has been cancelled
SDK Library Integration Tests Runner / openai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_legacy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / llama_index_tests (push) Has been cancelled
SDK Library Integration Tests Runner / anthropic_tests (push) Has been cancelled
SDK Library Integration Tests Runner / mistral_tests (push) Has been cancelled
SDK Library Integration Tests Runner / groq_tests (push) Has been cancelled
SDK Library Integration Tests Runner / aisuite_tests (push) Has been cancelled
SDK Library Integration Tests Runner / haystack_tests (push) Has been cancelled
SDK Library Integration Tests Runner / dspy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v1_tests (push) Has been cancelled
SDK Library Integration Tests Runner / genai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_legacy_1_3_0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / evaluation_metrics_tests (push) Has been cancelled
SDK Library Integration Tests Runner / bedrock_tests (push) Has been cancelled
SDK Library Integration Tests Runner / litellm_tests (push) Has been cancelled
SDK Library Integration Tests Runner / harbor_tests (push) Has been cancelled
SDK Library Integration Tests Runner / Slack Notification (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 13:25:44 +08:00

245 lines
8.1 KiB
Python

"""Planner tests for ``opik migrate prompt``.
The dataset planner tests are next door; this file tracks the same
patterns (happy-path action ordering, conflict detection, project-not-
found, source-not-found) for the prompt slice.
"""
from __future__ import annotations
import pytest
from click.testing import CliRunner
from opik.cli import cli
from opik.cli.migrate.errors import (
ConflictError,
ProjectNotFoundError,
PromptNotFoundError,
)
from opik.cli.migrate.prompts import planner as prompt_planner
from ._migrate_prompt_helpers import (
_Page,
_PromptRow,
_planner_client,
_planner_rest_client,
)
class TestMigratePromptHelp:
def test_migrate_group_help__lists_prompt_subcommand(self) -> None:
runner = CliRunner()
result = runner.invoke(cli, ["migrate", "--help"])
assert result.exit_code == 0
assert "prompt" in result.output
def test_migrate_prompt_help__lists_required_flags(self) -> None:
runner = CliRunner()
result = runner.invoke(cli, ["migrate", "prompt", "--help"])
assert result.exit_code == 0
assert "--to-project" in result.output
assert "--from-project" in result.output
assert "--dry-run" in result.output
class TestPlanBuilding:
def test_build_prompt_plan__default_flow__orders_rename_create_replay(
self,
) -> None:
# Action ordering invariant: the rename frees the workspace-unique
# name BEFORE the destination claims it, and the replay loop runs
# AFTER the destination container exists.
rest_client = _planner_rest_client(
[
_Page([_PromptRow(id="src-1", name="MyPrompt", description="d")]),
_Page([]), # rename-collision preflight finds nothing
]
)
plan = prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="B",
)
types = [type(a).__name__ for a in plan.actions]
assert types == ["RenameSource", "CreateDestination", "ReplayVersions"]
def test_build_prompt_plan__rename_re_passes_description_and_tags(
self,
) -> None:
# The BE rename PUT wipes description (UPDATE has no COALESCE on
# description); the planner forwards the source's description and
# tags into the RenameSource record so the executor re-passes them.
rest_client = _planner_rest_client(
[
_Page(
[
_PromptRow(
id="src-1",
name="MyPrompt",
description="orig description",
tags=["a", "b"],
)
]
),
_Page([]),
]
)
plan = prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="B",
)
rename = plan.actions[0]
assert isinstance(rename, prompt_planner.RenameSource)
assert rename.from_name == "MyPrompt"
assert rename.to_name == "MyPrompt_v1"
assert rename.description == "orig description"
assert rename.tags == ["a", "b"]
def test_build_prompt_plan__create_destination_carries_metadata(
self,
) -> None:
# CreateDestination forwards container-level metadata so the
# destination inherits description / tags / template_structure
# from the source.
rest_client = _planner_rest_client(
[
_Page(
[
_PromptRow(
id="src-1",
name="MyPrompt",
description="orig",
tags=["a"],
template_structure="chat",
)
]
),
_Page([]),
]
)
plan = prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="B",
)
create = plan.actions[1]
assert isinstance(create, prompt_planner.CreateDestination)
assert create.name == "MyPrompt"
assert create.project_name == "B"
assert create.description == "orig"
assert create.tags == ["a"]
assert create.template_structure == "chat"
def test_build_prompt_plan__replay_versions_carries_source_id_and_template_structure(
self,
) -> None:
rest_client = _planner_rest_client(
[
_Page(
[
_PromptRow(
id="src-1",
name="MyPrompt",
template_structure="chat",
)
]
),
_Page([]),
]
)
plan = prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="B",
)
replay = plan.actions[2]
assert isinstance(replay, prompt_planner.ReplayVersions)
assert replay.source_prompt_id == "src-1"
assert replay.source_name_after_rename == "MyPrompt_v1"
assert replay.dest_name == "MyPrompt"
assert replay.dest_project_name == "B"
assert replay.template_structure == "chat"
class TestPreflightErrors:
def test_build_prompt_plan__destination_project_missing__raises(
self,
) -> None:
rest_client = _planner_rest_client(
[], # no prompt lookups happen if project preflight fails
target_project_exists=False,
)
with pytest.raises(ProjectNotFoundError) as excinfo:
prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="DoesNotExist",
)
assert "DoesNotExist" in str(excinfo.value)
def test_build_prompt_plan__source_prompt_missing__raises(self) -> None:
rest_client = _planner_rest_client(
[_Page([])] # source lookup returns no matches
)
with pytest.raises(PromptNotFoundError) as excinfo:
prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="Missing",
to_project="B",
)
assert "Missing" in str(excinfo.value)
assert "workspace" in str(excinfo.value).lower()
def test_build_prompt_plan__from_project_set_and_missing__raises_with_project_scope(
self,
) -> None:
# When --from-project is passed and the source prompt is not in that
# project, the not-found error should name the project (not "the
# workspace") so the user knows where we looked.
rest_client = _planner_rest_client(
[_Page([])] # source lookup returns no matches in the project
)
with pytest.raises(PromptNotFoundError) as excinfo:
prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="B",
from_project="A",
)
assert "MyPrompt" in str(excinfo.value)
assert "project 'A'" in str(excinfo.value)
def test_build_prompt_plan__rename_collision__raises(self) -> None:
# Source resolves, but the rename target ``MyPrompt_v1`` is already
# taken by another prompt -> ConflictError.
rest_client = _planner_rest_client(
[
_Page([_PromptRow(id="src-1", name="MyPrompt")]),
_Page([_PromptRow(id="other-1", name="MyPrompt_v1")]),
]
)
with pytest.raises(ConflictError) as excinfo:
prompt_planner.build_prompt_plan(
client=_planner_client(rest_client),
name="MyPrompt",
to_project="B",
)
assert "MyPrompt_v1" in str(excinfo.value)