5a558eb09e
Backend Tests / discover-tests (push) Waiting to run
Backend Tests / ${{ matrix.name }} (push) Blocked by required conditions
Build and Publish SDK / build-and-publish (push) Waiting to run
Build Opik Docker Images / set-version (push) Waiting to run
Build Opik Docker Images / build-backend (push) Blocked by required conditions
Build Opik Docker Images / build-sandbox-executor-python (push) Blocked by required conditions
Build Opik Docker Images / build-python-backend (push) Blocked by required conditions
Build Opik Docker Images / build-frontend (push) Blocked by required conditions
Build Opik Docker Images / create-git-tag (push) Blocked by required conditions
ClickHouse Migration Cluster Check / validate-clickhouse-migrations (push) Waiting to run
Docs - Publish / run (push) Waiting to run
E2E Tests - Post Merge (v2) / 🧪 E2E v2 Tests (${{ github.event.inputs.tier || 't1' }}) (push) Waiting to run
E2E Tests - Post Merge (v2) / 📢 Slack Notification (push) Blocked by required conditions
Frontend Unit Tests / Test on Node 20 (push) Waiting to run
Guardrails E2E Tests / Select Python version matrix (push) Waiting to run
Guardrails E2E Tests / Guardrails E2E Tests ${{matrix.python_version}} (push) Blocked by required conditions
Guardrails E2E Tests / 📢 Slack Notification (push) Blocked by required conditions
Guardrails Backend Unit Tests / Guardrails Backend Unit Tests (push) Waiting to run
Guardrails Backend Unit Tests / 📢 Slack Notification (push) Blocked by required conditions
Lint Opik Helm Chart / lint-helm-chart (Helm v3.21.0) (push) Waiting to run
Lint Opik Helm Chart / lint-helm-chart (Helm v4.2.0) (push) Waiting to run
Lint Opik Helm Chart / unittest-helm-chart (push) Waiting to run
Lint Opik Helm Chart / render-equality (push) Waiting to run
Opik Optimizer - Unit Tests / Opik Optimizer Unit Tests Python ${{matrix.python_version}} (push) Waiting to run
Python BE E2E Tests / Python BE E2E (push) Waiting to run
Python Backend Tests / run-python-backend-tests (push) Waiting to run
Python SDK Unit Tests / Python SDK Unit Tests ${{matrix.python_version}} (push) Waiting to run
Release Drafter / update_release_draft (push) Waiting to run
SDK E2E Libraries Integration Tests / Check Secrets (push) Waiting to run
SDK E2E Libraries Integration Tests / Missed OpenAI API Key Warning (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / build-opik (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / E2E Lib Integration Python ${{matrix.python_version}} (push) Blocked by required conditions
TypeScript SDK Integration Build & Publish / build-and-publish (opik-gemini) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-langchain) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-openai) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-otel) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-vercel) (push) Waiting to run
TypeScript SDK Build & Publish / build-and-publish (push) Waiting to run
TypeScript SDK Unit Tests / Test on Node ${{ matrix.node-version }} (push) Waiting to run
TypeScript SDK Compatibility V1.x E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / TypeScript SDK Compatibility V1.x E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
TypeScript SDK E2E Tests / TypeScript SDK E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Python SDK E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK E2E Tests / Python SDK E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK E2E Tests / build-opik (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Python SDK Compatibility V1.x E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK E2E Tests / build-opik (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer E2E Tests Python ${{matrix.python_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer Integration Smoke Tests (push) Has been cancelled
🐙 Code Quality / detect (push) Has been cancelled
🐙 Code Quality / lint (${{ matrix.leg.name }}) (push) Has been cancelled
🐙 Code Quality / summary (push) Has been cancelled
TypeScript SDK Library Integration Tests / Check Secrets (push) Has been cancelled
TypeScript SDK Library Integration Tests / opik-vercel (Vercel AI SDK / eve) (push) Has been cancelled
SDK Library Integration Tests Runner / Check Secrets (push) Has been cancelled
SDK Library Integration Tests Runner / Missed OpenAI API Key Warning (push) Has been cancelled
SDK Library Integration Tests Runner / Build (push) Has been cancelled
SDK Library Integration Tests Runner / openai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_legacy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / llama_index_tests (push) Has been cancelled
SDK Library Integration Tests Runner / anthropic_tests (push) Has been cancelled
SDK Library Integration Tests Runner / mistral_tests (push) Has been cancelled
SDK Library Integration Tests Runner / groq_tests (push) Has been cancelled
SDK Library Integration Tests Runner / aisuite_tests (push) Has been cancelled
SDK Library Integration Tests Runner / haystack_tests (push) Has been cancelled
SDK Library Integration Tests Runner / dspy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v1_tests (push) Has been cancelled
SDK Library Integration Tests Runner / genai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_legacy_1_3_0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / evaluation_metrics_tests (push) Has been cancelled
SDK Library Integration Tests Runner / bedrock_tests (push) Has been cancelled
SDK Library Integration Tests Runner / litellm_tests (push) Has been cancelled
SDK Library Integration Tests Runner / harbor_tests (push) Has been cancelled
SDK Library Integration Tests Runner / Slack Notification (push) Has been cancelled
198 lines
5.2 KiB
Python
198 lines
5.2 KiB
Python
import base64
|
|
import dataclasses
|
|
import decimal
|
|
import importlib
|
|
import uuid
|
|
import warnings
|
|
from datetime import date, datetime, timezone
|
|
from threading import Lock
|
|
from typing import Any, Optional
|
|
|
|
import numpy as np
|
|
|
|
import pytest
|
|
|
|
import opik.jsonable_encoder as jsonable_encoder
|
|
from opik.rest_api.core import pydantic_utilities
|
|
|
|
|
|
@dataclasses.dataclass
|
|
class Node:
|
|
value: int
|
|
child: Optional["Node"] = None
|
|
|
|
|
|
def test_jsonable_encoder__cyclic_reference():
|
|
"""
|
|
Test that the encoder detects cyclic references and does not infinitely recurse.
|
|
"""
|
|
# Create a simple two-node cycle: A -> B -> A
|
|
node_a = Node(value=1)
|
|
node_b = Node(value=2)
|
|
node_a.child = node_b
|
|
node_b.child = node_a
|
|
|
|
encoded = jsonable_encoder.encode(node_a)
|
|
# The exact format of the cycle marker can vary; we check that:
|
|
# 1. We get some structure for node_a (like a dict).
|
|
# 2. Inside node_a, there's a reference to node_b (a dict).
|
|
# 3. Inside node_b, there's a "cyclic reference" marker instead of a full node_a object.
|
|
print("=" * 150)
|
|
print(encoded)
|
|
assert isinstance(encoded, dict)
|
|
assert "value" in encoded
|
|
assert "child" in encoded
|
|
|
|
# node_a.child (which is node_b) should be a dict
|
|
assert isinstance(encoded["child"], dict)
|
|
assert "value" in encoded["child"]
|
|
assert "child" in encoded["child"]
|
|
|
|
# node_b.child should be the cycle marker
|
|
cycle_marker = encoded["child"]["child"]
|
|
print("=" * 150)
|
|
print(cycle_marker)
|
|
assert isinstance(cycle_marker, str), (
|
|
"Expected a string marker for cyclic reference"
|
|
)
|
|
assert "<Cyclic reference to " in cycle_marker, (
|
|
"Should contain 'Cyclic reference' text"
|
|
)
|
|
|
|
|
|
def test_jsonable_encoder__repeated_objects_in_list():
|
|
"""
|
|
Test that the encoder handles a list of the same object repeated multiple times
|
|
without marking it as a cycle (because it isn't a cycle—just repeated references).
|
|
"""
|
|
node = Node(value=42)
|
|
|
|
# Put the same node object in a list multiple times
|
|
repeated_list = [node, node, node]
|
|
|
|
encoded = jsonable_encoder.encode(repeated_list)
|
|
# We expect a list of three items, each being a dict with `value` = 42, `child` = None
|
|
assert isinstance(encoded, list)
|
|
assert len(encoded) == 3
|
|
|
|
for item in encoded:
|
|
assert isinstance(item, dict)
|
|
assert item.get("value") == 42
|
|
assert item.get("child") is None
|
|
|
|
# They are distinct dictionary objects, but there is no cycle reference marker
|
|
# because there's no actual cycle. It's just repeated references of the same object.
|
|
assert all("Cyclic reference" not in str(item) for item in encoded)
|
|
|
|
|
|
@pytest.mark.parametrize(
|
|
"obj",
|
|
[
|
|
42,
|
|
42.000,
|
|
"42",
|
|
{
|
|
"p1": 42,
|
|
"p2": 42.000,
|
|
"p3": "42",
|
|
},
|
|
[
|
|
42,
|
|
42.000,
|
|
"42",
|
|
],
|
|
],
|
|
)
|
|
def test_jsonable_encoder__common_types(obj):
|
|
assert obj == jsonable_encoder.encode(obj)
|
|
|
|
|
|
@pytest.mark.parametrize(
|
|
"obj",
|
|
[
|
|
{42, 42.000, "42"},
|
|
(42, 42.000, "42"),
|
|
np.array([42, 42.000, "42"]),
|
|
],
|
|
)
|
|
def test_jsonable_encoder__converted_to_list(obj):
|
|
assert list(obj) == jsonable_encoder.encode(obj)
|
|
|
|
|
|
@pytest.mark.parametrize(
|
|
"obj,expected",
|
|
[
|
|
(
|
|
date(2020, 1, 1),
|
|
"2020-01-01",
|
|
),
|
|
(datetime(2020, 1, 1, 10, 20, 30, tzinfo=timezone.utc), "2020-01-01T10:20:30Z"),
|
|
],
|
|
)
|
|
def test_jsonable_encoder__datetime_to_text(obj, expected):
|
|
assert expected == jsonable_encoder.encode(obj)
|
|
|
|
|
|
def test_jsonable_encoder__non_serializable_to_text__class():
|
|
class SomeClass:
|
|
a = 1
|
|
b = 42.0
|
|
|
|
data = SomeClass()
|
|
|
|
assert "SomeClass object at 0x" in jsonable_encoder.encode(data)
|
|
|
|
|
|
def test_jsonable_encoder__non_serializable_to_text__lock():
|
|
data = Lock()
|
|
|
|
assert jsonable_encoder.encode(data).startswith(
|
|
"<unlocked _thread.lock object at 0x"
|
|
)
|
|
|
|
|
|
def test_jsonable_encoder__non_serializable_lock_inside_dataclass__lock_converted_to_text():
|
|
@dataclasses.dataclass
|
|
class SomeClass:
|
|
a: Any
|
|
b: Any
|
|
|
|
data = SomeClass(a=1, b=Lock())
|
|
|
|
encoded = jsonable_encoder.encode(data)
|
|
assert isinstance(encoded, dict)
|
|
assert encoded["a"] == 1
|
|
assert encoded["b"].startswith("<unlocked _thread.lock object at 0x")
|
|
|
|
|
|
def test_jsonable_encoder__non_serializable_to_text__bytes():
|
|
data = b"deadbeef"
|
|
|
|
assert base64.b64encode(data).decode("utf-8") == jsonable_encoder.encode(data)
|
|
|
|
|
|
def test_jsonable_encoder__uuid_and_decimal_remain_serializable():
|
|
payload = {
|
|
"id": uuid.UUID("12345678-1234-5678-1234-567812345678"),
|
|
"score": decimal.Decimal("1.23"),
|
|
}
|
|
|
|
encoded = jsonable_encoder.encode(payload)
|
|
|
|
assert encoded["id"] == "12345678-1234-5678-1234-567812345678"
|
|
assert encoded["score"] == "1.23"
|
|
|
|
|
|
def test_pydantic_utilities__import_does_not_emit_v1_py314_warning():
|
|
pytest.importorskip("pydantic")
|
|
|
|
with warnings.catch_warnings(record=True) as caught:
|
|
warnings.simplefilter("always")
|
|
importlib.reload(pydantic_utilities)
|
|
|
|
assert not any(
|
|
"Core Pydantic V1 functionality isn't compatible with Python 3.14 or greater."
|
|
in str(w.message)
|
|
for w in caught
|
|
)
|