Files
wehub-resource-sync 5a558eb09e
TypeScript SDK Compatibility V1.x E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / TypeScript SDK Compatibility V1.x E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
TypeScript SDK E2E Tests / TypeScript SDK E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Python SDK E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK E2E Tests / Python SDK E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK E2E Tests / build-opik (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Python SDK Compatibility V1.x E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK E2E Tests / build-opik (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer E2E Tests Python ${{matrix.python_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer Integration Smoke Tests (push) Has been cancelled
🐙 Code Quality / detect (push) Has been cancelled
🐙 Code Quality / lint (${{ matrix.leg.name }}) (push) Has been cancelled
🐙 Code Quality / summary (push) Has been cancelled
TypeScript SDK Library Integration Tests / Check Secrets (push) Has been cancelled
TypeScript SDK Library Integration Tests / opik-vercel (Vercel AI SDK / eve) (push) Has been cancelled
SDK Library Integration Tests Runner / Check Secrets (push) Has been cancelled
SDK Library Integration Tests Runner / Missed OpenAI API Key Warning (push) Has been cancelled
SDK Library Integration Tests Runner / Build (push) Has been cancelled
SDK Library Integration Tests Runner / openai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_legacy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / llama_index_tests (push) Has been cancelled
SDK Library Integration Tests Runner / anthropic_tests (push) Has been cancelled
SDK Library Integration Tests Runner / mistral_tests (push) Has been cancelled
SDK Library Integration Tests Runner / groq_tests (push) Has been cancelled
SDK Library Integration Tests Runner / aisuite_tests (push) Has been cancelled
SDK Library Integration Tests Runner / haystack_tests (push) Has been cancelled
SDK Library Integration Tests Runner / dspy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v1_tests (push) Has been cancelled
SDK Library Integration Tests Runner / genai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_legacy_1_3_0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / evaluation_metrics_tests (push) Has been cancelled
SDK Library Integration Tests Runner / bedrock_tests (push) Has been cancelled
SDK Library Integration Tests Runner / litellm_tests (push) Has been cancelled
SDK Library Integration Tests Runner / harbor_tests (push) Has been cancelled
SDK Library Integration Tests Runner / Slack Notification (push) Has been cancelled
Lint Opik Helm Chart / render-equality (push) Has been cancelled
Opik Optimizer - Unit Tests / Opik Optimizer Unit Tests Python ${{matrix.python_version}} (push) Has been cancelled
Python BE E2E Tests / Python BE E2E (push) Has been cancelled
Python Backend Tests / run-python-backend-tests (push) Has been cancelled
Python SDK Unit Tests / Python SDK Unit Tests ${{matrix.python_version}} (push) Has been cancelled
Release Drafter / update_release_draft (push) Has been cancelled
SDK E2E Libraries Integration Tests / Check Secrets (push) Has been cancelled
SDK E2E Libraries Integration Tests / Missed OpenAI API Key Warning (push) Has been cancelled
SDK E2E Libraries Integration Tests / build-opik (push) Has been cancelled
SDK E2E Libraries Integration Tests / E2E Lib Integration Python ${{matrix.python_version}} (push) Has been cancelled
TypeScript SDK Integration Build & Publish / build-and-publish (opik-gemini) (push) Has been cancelled
TypeScript SDK Integration Build & Publish / build-and-publish (opik-langchain) (push) Has been cancelled
TypeScript SDK Integration Build & Publish / build-and-publish (opik-openai) (push) Has been cancelled
TypeScript SDK Integration Build & Publish / build-and-publish (opik-otel) (push) Has been cancelled
TypeScript SDK Integration Build & Publish / build-and-publish (opik-vercel) (push) Has been cancelled
TypeScript SDK Build & Publish / build-and-publish (push) Has been cancelled
TypeScript SDK Unit Tests / Test on Node ${{ matrix.node-version }} (push) Has been cancelled
Backend Tests / discover-tests (push) Has been cancelled
Backend Tests / ${{ matrix.name }} (push) Has been cancelled
Build and Publish SDK / build-and-publish (push) Has been cancelled
Build Opik Docker Images / set-version (push) Has been cancelled
Build Opik Docker Images / build-backend (push) Has been cancelled
Build Opik Docker Images / build-sandbox-executor-python (push) Has been cancelled
Build Opik Docker Images / build-python-backend (push) Has been cancelled
Build Opik Docker Images / build-frontend (push) Has been cancelled
Build Opik Docker Images / create-git-tag (push) Has been cancelled
ClickHouse Migration Cluster Check / validate-clickhouse-migrations (push) Has been cancelled
Docs - Publish / run (push) Has been cancelled
E2E Tests - Post Merge (v2) / 🧪 E2E v2 Tests (${{ github.event.inputs.tier || 't1' }}) (push) Has been cancelled
E2E Tests - Post Merge (v2) / 📢 Slack Notification (push) Has been cancelled
Frontend Unit Tests / Test on Node 20 (push) Has been cancelled
Guardrails E2E Tests / Select Python version matrix (push) Has been cancelled
Guardrails E2E Tests / Guardrails E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Guardrails E2E Tests / 📢 Slack Notification (push) Has been cancelled
Guardrails Backend Unit Tests / Guardrails Backend Unit Tests (push) Has been cancelled
Guardrails Backend Unit Tests / 📢 Slack Notification (push) Has been cancelled
Lint Opik Helm Chart / lint-helm-chart (Helm v3.21.0) (push) Has been cancelled
Lint Opik Helm Chart / lint-helm-chart (Helm v4.2.0) (push) Has been cancelled
Lint Opik Helm Chart / unittest-helm-chart (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 13:25:44 +08:00

129 lines
4.6 KiB
Python

"""Tests for PromptLibrary."""
import pytest
from opik_optimizer.utils.prompt_library import PromptLibrary
class TestPromptLibrary:
"""Tests for PromptLibrary class."""
def test_basic_initialization(self) -> None:
"""Should initialize with defaults."""
defaults = {"prompt1": "template1", "prompt2": "template2"}
lib = PromptLibrary(defaults)
assert lib.get("prompt1") == "template1"
assert lib.get("prompt2") == "template2"
def test_get_with_formatting(self) -> None:
"""Should format templates with kwargs."""
defaults = {"greeting": "Hello {name}!"}
lib = PromptLibrary(defaults)
result = lib.get("greeting", name="World")
assert result == "Hello World!"
def test_dict_overrides(self) -> None:
"""Should apply dict overrides."""
defaults = {"prompt1": "original", "prompt2": "original2"}
lib = PromptLibrary(defaults, overrides={"prompt1": "overridden"})
assert lib.get("prompt1") == "overridden"
assert lib.get("prompt2") == "original2"
def test_callable_overrides(self) -> None:
"""Should apply callable overrides (factory pattern)."""
defaults = {"prompt1": "original", "prompt2": "original2"}
def factory(prompts: PromptLibrary) -> None:
prompts.set("prompt1", "custom")
lib = PromptLibrary(defaults, overrides=factory)
assert lib.get("prompt1") == "custom"
assert lib.get("prompt2") == "original2"
def test_set_method(self) -> None:
"""Should set individual prompts."""
defaults = {"prompt1": "original"}
lib = PromptLibrary(defaults)
lib.set("prompt1", "updated")
assert lib.get("prompt1") == "updated"
def test_update_method(self) -> None:
"""Should update multiple prompts at once."""
defaults = {"prompt1": "original", "prompt2": "original2"}
lib = PromptLibrary(defaults)
lib.update({"prompt1": "new1", "prompt2": "new2"})
assert lib.get("prompt1") == "new1"
assert lib.get("prompt2") == "new2"
def test_keys_method(self) -> None:
"""Should list available keys."""
defaults = {"prompt1": "t1", "prompt2": "t2"}
lib = PromptLibrary(defaults)
keys = lib.keys()
assert sorted(keys) == ["prompt1", "prompt2"]
def test_get_default(self) -> None:
"""Should retrieve original defaults after overrides."""
defaults = {"prompt1": "original"}
lib = PromptLibrary(defaults, overrides={"prompt1": "overridden"})
assert lib.get("prompt1") == "overridden"
assert lib.get_default("prompt1") == "original"
# Error cases
def test_dict_override_unknown_key_raises_error(self) -> None:
"""Should raise ValueError for unknown keys in dict overrides."""
defaults = {"prompt1": "template"}
with pytest.raises(ValueError, match="Unknown prompt keys: \\['unknown'\\]"):
PromptLibrary(defaults, overrides={"unknown": "value"})
def test_invalid_override_type_raises_error(self) -> None:
"""Should raise TypeError for invalid override types."""
defaults = {"prompt1": "template"}
with pytest.raises(
TypeError, match="prompt_overrides must be dict or callable"
):
PromptLibrary(defaults, overrides="invalid") # type: ignore
def test_get_unknown_key_raises_error(self) -> None:
"""Should raise KeyError for unknown key in get()."""
defaults = {"prompt1": "template"}
lib = PromptLibrary(defaults)
with pytest.raises(KeyError, match="Unknown prompt 'unknown'"):
lib.get("unknown")
def test_set_unknown_key_raises_error(self) -> None:
"""Should raise KeyError for unknown key in set()."""
defaults = {"prompt1": "template"}
lib = PromptLibrary(defaults)
with pytest.raises(KeyError, match="Unknown prompt 'unknown'"):
lib.set("unknown", "value")
def test_update_unknown_key_raises_error(self) -> None:
"""Should raise KeyError for unknown keys in update()."""
defaults = {"prompt1": "template"}
lib = PromptLibrary(defaults)
with pytest.raises(KeyError, match="Unknown keys: \\['unknown'\\]"):
lib.update({"unknown": "value"})
def test_get_default_unknown_key_raises_error(self) -> None:
"""Should raise KeyError for unknown key in get_default()."""
defaults = {"prompt1": "template"}
lib = PromptLibrary(defaults)
with pytest.raises(KeyError, match="Unknown prompt 'unknown'"):
lib.get_default("unknown")