5a558eb09e
Backend Tests / discover-tests (push) Waiting to run
Backend Tests / ${{ matrix.name }} (push) Blocked by required conditions
Build and Publish SDK / build-and-publish (push) Waiting to run
Build Opik Docker Images / set-version (push) Waiting to run
Build Opik Docker Images / build-backend (push) Blocked by required conditions
Build Opik Docker Images / build-sandbox-executor-python (push) Blocked by required conditions
Build Opik Docker Images / build-python-backend (push) Blocked by required conditions
Build Opik Docker Images / build-frontend (push) Blocked by required conditions
Build Opik Docker Images / create-git-tag (push) Blocked by required conditions
ClickHouse Migration Cluster Check / validate-clickhouse-migrations (push) Waiting to run
Docs - Publish / run (push) Waiting to run
E2E Tests - Post Merge (v2) / 🧪 E2E v2 Tests (${{ github.event.inputs.tier || 't1' }}) (push) Waiting to run
E2E Tests - Post Merge (v2) / 📢 Slack Notification (push) Blocked by required conditions
Frontend Unit Tests / Test on Node 20 (push) Waiting to run
Guardrails E2E Tests / Select Python version matrix (push) Waiting to run
Guardrails E2E Tests / Guardrails E2E Tests ${{matrix.python_version}} (push) Blocked by required conditions
Guardrails E2E Tests / 📢 Slack Notification (push) Blocked by required conditions
Guardrails Backend Unit Tests / Guardrails Backend Unit Tests (push) Waiting to run
Guardrails Backend Unit Tests / 📢 Slack Notification (push) Blocked by required conditions
Lint Opik Helm Chart / lint-helm-chart (Helm v3.21.0) (push) Waiting to run
Lint Opik Helm Chart / lint-helm-chart (Helm v4.2.0) (push) Waiting to run
Lint Opik Helm Chart / unittest-helm-chart (push) Waiting to run
Lint Opik Helm Chart / render-equality (push) Waiting to run
Opik Optimizer - Unit Tests / Opik Optimizer Unit Tests Python ${{matrix.python_version}} (push) Waiting to run
Python BE E2E Tests / Python BE E2E (push) Waiting to run
Python Backend Tests / run-python-backend-tests (push) Waiting to run
Python SDK Unit Tests / Python SDK Unit Tests ${{matrix.python_version}} (push) Waiting to run
Release Drafter / update_release_draft (push) Waiting to run
SDK E2E Libraries Integration Tests / Check Secrets (push) Waiting to run
SDK E2E Libraries Integration Tests / Missed OpenAI API Key Warning (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / build-opik (push) Blocked by required conditions
SDK E2E Libraries Integration Tests / E2E Lib Integration Python ${{matrix.python_version}} (push) Blocked by required conditions
TypeScript SDK Integration Build & Publish / build-and-publish (opik-gemini) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-langchain) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-openai) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-otel) (push) Waiting to run
TypeScript SDK Integration Build & Publish / build-and-publish (opik-vercel) (push) Waiting to run
TypeScript SDK Build & Publish / build-and-publish (push) Waiting to run
TypeScript SDK Unit Tests / Test on Node ${{ matrix.node-version }} (push) Waiting to run
TypeScript SDK Compatibility V1.x E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / TypeScript SDK Compatibility V1.x E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
TypeScript SDK E2E Tests / TypeScript SDK E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Python SDK E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK E2E Tests / Python SDK E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK E2E Tests / build-opik (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Select Python version matrix (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / Python SDK Compatibility V1.x E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Python SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
TypeScript SDK E2E Tests / Select Node version matrix (push) Has been cancelled
TypeScript SDK E2E Tests / build-opik (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer E2E Tests Python ${{matrix.python_version}} (push) Has been cancelled
Opik Optimizer - E2E Tests / Opik Optimizer Integration Smoke Tests (push) Has been cancelled
🐙 Code Quality / detect (push) Has been cancelled
🐙 Code Quality / lint (${{ matrix.leg.name }}) (push) Has been cancelled
🐙 Code Quality / summary (push) Has been cancelled
TypeScript SDK Library Integration Tests / Check Secrets (push) Has been cancelled
TypeScript SDK Library Integration Tests / opik-vercel (Vercel AI SDK / eve) (push) Has been cancelled
SDK Library Integration Tests Runner / Check Secrets (push) Has been cancelled
SDK Library Integration Tests Runner / Missed OpenAI API Key Warning (push) Has been cancelled
SDK Library Integration Tests Runner / Build (push) Has been cancelled
SDK Library Integration Tests Runner / openai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_tests (push) Has been cancelled
SDK Library Integration Tests Runner / langchain_legacy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / llama_index_tests (push) Has been cancelled
SDK Library Integration Tests Runner / anthropic_tests (push) Has been cancelled
SDK Library Integration Tests Runner / mistral_tests (push) Has been cancelled
SDK Library Integration Tests Runner / groq_tests (push) Has been cancelled
SDK Library Integration Tests Runner / aisuite_tests (push) Has been cancelled
SDK Library Integration Tests Runner / haystack_tests (push) Has been cancelled
SDK Library Integration Tests Runner / dspy_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / crewai_v1_tests (push) Has been cancelled
SDK Library Integration Tests Runner / genai_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_tests (push) Has been cancelled
SDK Library Integration Tests Runner / adk_legacy_1_3_0_tests (push) Has been cancelled
SDK Library Integration Tests Runner / evaluation_metrics_tests (push) Has been cancelled
SDK Library Integration Tests Runner / bedrock_tests (push) Has been cancelled
SDK Library Integration Tests Runner / litellm_tests (push) Has been cancelled
SDK Library Integration Tests Runner / harbor_tests (push) Has been cancelled
SDK Library Integration Tests Runner / Slack Notification (push) Has been cancelled
141 lines
4.7 KiB
Python
141 lines
4.7 KiB
Python
import sys
|
|
from unittest.mock import patch
|
|
|
|
from opik.configurator.interactive_helpers import (
|
|
ask_user_for_approval,
|
|
ask_user_for_approval_default_no,
|
|
is_interactive,
|
|
)
|
|
|
|
|
|
class TestIsInteractive:
|
|
@patch(
|
|
"opik.configurator.interactive_helpers._in_colab_environment",
|
|
return_value=False,
|
|
)
|
|
@patch(
|
|
"opik.configurator.interactive_helpers._in_ipython_environment",
|
|
return_value=False,
|
|
)
|
|
@patch(
|
|
"opik.configurator.interactive_helpers._in_jupyter_environment",
|
|
return_value=False,
|
|
)
|
|
@patch.object(sys.stdin, "isatty", return_value=True)
|
|
def test_is_interactive__true(
|
|
self,
|
|
isatty,
|
|
_in_jupyter_environment,
|
|
_in_ipython_environment,
|
|
_in_colab_environment,
|
|
):
|
|
assert is_interactive() is True
|
|
|
|
@patch(
|
|
"opik.configurator.interactive_helpers._in_colab_environment",
|
|
return_value=False,
|
|
)
|
|
@patch(
|
|
"opik.configurator.interactive_helpers._in_ipython_environment",
|
|
return_value=False,
|
|
)
|
|
@patch(
|
|
"opik.configurator.interactive_helpers._in_jupyter_environment",
|
|
return_value=False,
|
|
)
|
|
@patch.object(sys.stdin, "isatty", return_value=False)
|
|
def test_is_interactive__false(
|
|
self,
|
|
isatty,
|
|
_in_jupyter_environment,
|
|
_in_ipython_environment,
|
|
_in_colab_environment,
|
|
):
|
|
assert is_interactive() is False
|
|
|
|
|
|
class TestAskUserForApproval:
|
|
@patch("builtins.input", return_value="Y")
|
|
def test_user_approves_with_y(self, mock_input):
|
|
"""
|
|
Test that 'Y' returns True for approval.
|
|
"""
|
|
result = ask_user_for_approval("Do you approve?")
|
|
assert result is True
|
|
|
|
@patch("builtins.input", return_value="YES")
|
|
def test_user_approves_with_yes(self, mock_input):
|
|
"""
|
|
Test that 'YES' returns True for approval.
|
|
"""
|
|
result = ask_user_for_approval("Do you approve?")
|
|
assert result is True
|
|
|
|
@patch("builtins.input", return_value="")
|
|
def test_user_approves_with_empty_input(self, mock_input):
|
|
"""
|
|
Test that empty input returns True for approval.
|
|
"""
|
|
result = ask_user_for_approval("Do you approve?")
|
|
assert result is True
|
|
|
|
@patch("builtins.input", return_value="N")
|
|
def test_user_disapproves_with_n(self, mock_input):
|
|
"""
|
|
Test that 'N' returns False for disapproval.
|
|
"""
|
|
result = ask_user_for_approval("Do you disapprove?")
|
|
assert result is False
|
|
|
|
@patch("builtins.input", return_value="NO")
|
|
def test_user_disapproves_with_no(self, mock_input):
|
|
"""
|
|
Test that 'NO' returns False for disapproval.
|
|
"""
|
|
result = ask_user_for_approval("Do you disapprove?")
|
|
assert result is False
|
|
|
|
@patch("builtins.input", side_effect=["INVALID", "Y"])
|
|
@patch("opik.configurator.interactive_helpers.LOGGER.error")
|
|
def test_user_enters_invalid_choice_then_approves(
|
|
self, mock_logger_error, mock_input
|
|
):
|
|
"""
|
|
Test that invalid input triggers error logging and prompts again until valid input is entered.
|
|
"""
|
|
result = ask_user_for_approval("Do you approve?")
|
|
assert result is True
|
|
mock_logger_error.assert_called_once_with("Wrong choice. Please try again.")
|
|
|
|
@patch("builtins.input", side_effect=["INVALID", "NO"])
|
|
@patch("opik.configurator.interactive_helpers.LOGGER.error")
|
|
def test_user_enters_invalid_choice_then_disapproves(
|
|
self, mock_logger_error, mock_input
|
|
):
|
|
"""
|
|
Test that invalid input triggers error logging and prompts again until valid input is entered.
|
|
"""
|
|
result = ask_user_for_approval("Do you disapprove?")
|
|
assert result is False
|
|
mock_logger_error.assert_called_once_with("Wrong choice. Please try again.")
|
|
|
|
|
|
class TestAskUserForApprovalDefaultNo:
|
|
@patch("builtins.input", return_value="")
|
|
def test_empty_input__returns_false(self, mock_input):
|
|
assert ask_user_for_approval_default_no("Proceed?") is False
|
|
|
|
@patch("builtins.input", return_value="n")
|
|
def test_no__returns_false(self, mock_input):
|
|
assert ask_user_for_approval_default_no("Proceed?") is False
|
|
|
|
@patch("builtins.input", return_value="y")
|
|
def test_yes__returns_true(self, mock_input):
|
|
assert ask_user_for_approval_default_no("Proceed?") is True
|
|
|
|
@patch("builtins.input", side_effect=["maybe", "y"])
|
|
@patch("opik.configurator.interactive_helpers.LOGGER.error")
|
|
def test_invalid_then_yes__returns_true(self, mock_logger_error, mock_input):
|
|
assert ask_user_for_approval_default_no("Proceed?") is True
|
|
mock_logger_error.assert_called_once_with("Wrong choice. Please try again.")
|