wehub/comet-ml--opik
1
0
Fork 0
Code Issues Pull Requests Actions 1 Deployments Models Agent Notes Packages Projects Releases Wiki Activity
Files
5d4cec7c2b2640ecfa2daaaadb3ccc227a6b13bb
comet-ml--opik/apps/opik-documentation/documentation/fern/docs-v2/development/optimization-runs/changelog.mdx
T
wehub-resource-sync 5a558eb09e
TypeScript SDK Compatibility V1.x E2E Tests / Select Node version matrix (push) Has been cancelled
Details
TypeScript SDK Compatibility V1.x E2E Tests / TypeScript SDK Compatibility V1.x E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Details
TypeScript SDK E2E Tests / TypeScript SDK E2E Tests Node ${{matrix.node_version}} (push) Has been cancelled
Details
Opik Optimizer - E2E Tests / build-opik (push) Has been cancelled
Details
TypeScript SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Details
Python SDK E2E Tests / Select Python version matrix (push) Has been cancelled
Details
Python SDK E2E Tests / Python SDK E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Details
Python SDK E2E Tests / build-opik (push) Has been cancelled
Details
Python SDK Compatibility V1.x E2E Tests / Select Python version matrix (push) Has been cancelled
Details
Python SDK Compatibility V1.x E2E Tests / Python SDK Compatibility V1.x E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Details
Python SDK Compatibility V1.x E2E Tests / build-opik (push) Has been cancelled
Details
TypeScript SDK E2E Tests / Select Node version matrix (push) Has been cancelled
Details
TypeScript SDK E2E Tests / build-opik (push) Has been cancelled
Details
Opik Optimizer - E2E Tests / Opik Optimizer E2E Tests Python ${{matrix.python_version}} (push) Has been cancelled
Details
Opik Optimizer - E2E Tests / Opik Optimizer Integration Smoke Tests (push) Has been cancelled
Details
🐙 Code Quality / detect (push) Has been cancelled
Details
🐙 Code Quality / lint (${{ matrix.leg.name }}) (push) Has been cancelled
Details
🐙 Code Quality / summary (push) Has been cancelled
Details
TypeScript SDK Library Integration Tests / Check Secrets (push) Has been cancelled
Details
TypeScript SDK Library Integration Tests / opik-vercel (Vercel AI SDK / eve) (push) Has been cancelled
Details
SDK Library Integration Tests Runner / Check Secrets (push) Has been cancelled
Details
SDK Library Integration Tests Runner / Missed OpenAI API Key Warning (push) Has been cancelled
Details
SDK Library Integration Tests Runner / Build (push) Has been cancelled
Details
SDK Library Integration Tests Runner / openai_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / langchain_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / langchain_legacy_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / llama_index_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / anthropic_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / mistral_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / groq_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / aisuite_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / haystack_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / dspy_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / crewai_v0_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / crewai_v1_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / genai_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / adk_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / adk_legacy_1_3_0_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / evaluation_metrics_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / bedrock_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / litellm_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / harbor_tests (push) Has been cancelled
Details
SDK Library Integration Tests Runner / Slack Notification (push) Has been cancelled
Details
Lint Opik Helm Chart / render-equality (push) Has been cancelled
Details
Opik Optimizer - Unit Tests / Opik Optimizer Unit Tests Python ${{matrix.python_version}} (push) Has been cancelled
Details
Python BE E2E Tests / Python BE E2E (push) Has been cancelled
Details
Python Backend Tests / run-python-backend-tests (push) Has been cancelled
Details
Python SDK Unit Tests / Python SDK Unit Tests ${{matrix.python_version}} (push) Has been cancelled
Details
Release Drafter / update_release_draft (push) Has been cancelled
Details
SDK E2E Libraries Integration Tests / Check Secrets (push) Has been cancelled
Details
SDK E2E Libraries Integration Tests / Missed OpenAI API Key Warning (push) Has been cancelled
Details
SDK E2E Libraries Integration Tests / build-opik (push) Has been cancelled
Details
SDK E2E Libraries Integration Tests / E2E Lib Integration Python ${{matrix.python_version}} (push) Has been cancelled
Details
TypeScript SDK Integration Build & Publish / build-and-publish (opik-gemini) (push) Has been cancelled
Details
TypeScript SDK Integration Build & Publish / build-and-publish (opik-langchain) (push) Has been cancelled
Details
TypeScript SDK Integration Build & Publish / build-and-publish (opik-openai) (push) Has been cancelled
Details
TypeScript SDK Integration Build & Publish / build-and-publish (opik-otel) (push) Has been cancelled
Details
TypeScript SDK Integration Build & Publish / build-and-publish (opik-vercel) (push) Has been cancelled
Details
TypeScript SDK Build & Publish / build-and-publish (push) Has been cancelled
Details
TypeScript SDK Unit Tests / Test on Node ${{ matrix.node-version }} (push) Has been cancelled
Details
Backend Tests / discover-tests (push) Has been cancelled
Details
Backend Tests / ${{ matrix.name }} (push) Has been cancelled
Details
Build and Publish SDK / build-and-publish (push) Has been cancelled
Details
Build Opik Docker Images / set-version (push) Has been cancelled
Details
Build Opik Docker Images / build-backend (push) Has been cancelled
Details
Build Opik Docker Images / build-sandbox-executor-python (push) Has been cancelled
Details
Build Opik Docker Images / build-python-backend (push) Has been cancelled
Details
Build Opik Docker Images / build-frontend (push) Has been cancelled
Details
Build Opik Docker Images / create-git-tag (push) Has been cancelled
Details
ClickHouse Migration Cluster Check / validate-clickhouse-migrations (push) Has been cancelled
Details
Docs - Publish / run (push) Has been cancelled
Details
E2E Tests - Post Merge (v2) / 🧪 E2E v2 Tests (${{ github.event.inputs.tier || 't1' }}) (push) Has been cancelled
Details
E2E Tests - Post Merge (v2) / 📢 Slack Notification (push) Has been cancelled
Details
Frontend Unit Tests / Test on Node 20 (push) Has been cancelled
Details
Guardrails E2E Tests / Select Python version matrix (push) Has been cancelled
Details
Guardrails E2E Tests / Guardrails E2E Tests ${{matrix.python_version}} (push) Has been cancelled
Details
Guardrails E2E Tests / 📢 Slack Notification (push) Has been cancelled
Details
Guardrails Backend Unit Tests / Guardrails Backend Unit Tests (push) Has been cancelled
Details
Guardrails Backend Unit Tests / 📢 Slack Notification (push) Has been cancelled
Details
Lint Opik Helm Chart / lint-helm-chart (Helm v3.21.0) (push) Has been cancelled
Details
Lint Opik Helm Chart / lint-helm-chart (Helm v4.2.0) (push) Has been cancelled
Details
Lint Opik Helm Chart / unittest-helm-chart (push) Has been cancelled
Details
chore: import upstream snapshot with attribution
2026-07-13 13:25:44 +08:00

77 lines
9.5 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
---
description: Release notes focused on Agent Optimizer features.
headline: Changelog | Opik Documentation
og:description: Monitor Opik updates to stay informed about new features, improvements,
and fixes in the Agent Optimizer for efficient model training.
og:site_name: Opik Documentation
og:title: Changelog - Opik Updates and Enhancements
title: Changelog
---
Stay current on Agent Optimizer updates. Each entry below reflects a version bump in `sdks/opik_optimizer/pyproject.toml` on `main`. The compare links jump straight to the commits that landed in that release. As Opik is a monorepo, you will see other non-optimizer related changes in the commit links below.
## Version 3.x
Highlights: Full public, production-ready release designed to work alongside Optimization Studio. MCP/tool optimization is temporarily removed in `3.0.0`–`3.0.1` due to compatibility reasons.
### Version 3 highlights
- First fully native multi-agent and multi-prompt optimization support end-to-end across optimizers.
- Specific reasoning models separate from training supported across all optimizers.
- Multimodal optimization supported across all optimizers.
- Pass@k evaluation across all optimizers via the `n` parameter and selection policies.
- Full refactor and normalization of all optimizers for simpler code and better performance.
| Date | Version | Highlights |
| --- | --- | --- |
| **2026-02-24** | `3.1.0` | Reintroduced MCP/tool optimization across optimizers, added optimizer benchmark runtime/engine refactor, improved multi-metric span wiring and fail-fast scoring behavior, and added Python 3.14 support. [Commits →](https://github.com/comet-ml/opik/compare/0bdabe06505db3cbe50fb12f8d0ee9d055448fef...7a7c15ff2593faad503ef18324ae730433fe9cd6) |
| **2026-01-28** | `3.0.1` | Suppress noisy Hugging Face notebook warnings, fix HotpotQA multihop agent with new LiteLLM calls + JSON mode, map missing error enum so UI shows “Error”, HRPO rich output fixes and performance improvements, sanitize attachment spans to prevent output errors, fix HRPO async in notebooks. |
| **2026-01-26** | `3.0.0` | Major rewrite: native multi-agent/multi-prompt optimization, reasoning model support, pass@k evaluation, and optimizer refactor. Breaking change: MCP-based optimizers removed. [Commits →](https://github.com/comet-ml/opik/compare/105f3ef0340d3e2c7c2e8d342766576c3519f748...98434bb3374280054ef6d8902b0cdc887bab25aa) |
## Version 2.x
Highlights: Introduced new optimizers including HRPO and GEPA, tool optimization and expanding coverage beyond early prompt-only workflows. Breaking change includes dropping MIPRO in favour of GEPA.
| Date | Version | Highlights |
| --- | --- | --- |
| **2026-01-22** | `2.3.12` | Fixes for optimizer breaking issues. [Commits →](https://github.com/comet-ml/opik/compare/a327fa3c2fb4f7a9fac2d9bba05c02c8cc234a1e...105f3ef0340d3e2c7c2e8d342766576c3519f748) |
| **2026-01-06** | `2.3.11` | Fixed hierarchical optimizer reason handling and numeric equals. [Commits →](https://github.com/comet-ml/opik/compare/fe02947b0843f28d8f0e67eee55e6ba377a3cc42...a327fa3c2fb4f7a9fac2d9bba05c02c8cc234a1e) |
| **2025-12-24** | `2.3.10` | Added missing model parameter in HRPO. [Commits →](https://github.com/comet-ml/opik/compare/2735ea6fcaf06d1dd275fbe0ef8297b0d5e5f490...fe02947b0843f28d8f0e67eee55e6ba377a3cc42) |
| **2025-12-19** | `2.3.9` | Fixed hierarchical optimizer recreating optimizations when ID is provided. [Commits →](https://github.com/comet-ml/opik/compare/2f51ca37d072b91e0c6e1611884e254bfa95556a...2735ea6fcaf06d1dd275fbe0ef8297b0d5e5f490) |
| **2025-12-15** | `2.3.8` | Fixed Evolutionary Optimizer with OpenAI Responses API, added validation in GEPA, updated multimodal example. [Commits →](https://github.com/comet-ml/opik/compare/f1cd349e30a1ec8672733f0219ec5304cf6e4bc3...2f51ca37d072b91e0c6e1611884e254bfa95556a) |
| **2025-12-15** | `2.3.7` | Renamed Hierarchical optimizer to HAPO, fixed MetaPrompt inheritance, lint cleanup. [Commits →](https://github.com/comet-ml/opik/compare/f98b169510ae185b269990d01995fe1594dbc6a5...f1cd349e30a1ec8672733f0219ec5304cf6e4bc3) |
| **2025-12-02** | `2.3.6` | Bumped opik_optimizer, added optimization_id skip, cost/latency metrics, GEPA API/log fixes. [Commits →](https://github.com/comet-ml/opik/compare/68b46e0af5cd362b1ba80a83f8187e6596680d78...f98b169510ae185b269990d01995fe1594dbc6a5) |
| **2025-11-24** | `2.3.5` | Version mismatch fix and Few-Shot Optimizer improvements. [Commits →](https://github.com/comet-ml/opik/compare/04e8bab7b96d7cf94551bfc41bd44620813a8a6b...68b46e0af5cd362b1ba80a83f8187e6596680d78) |
| **2025-11-24** | `2.3.4` | Optimizer tests, benchmarks, and MetaPrompt improvements. [Commits →](https://github.com/comet-ml/opik/compare/6a1bdba25642f4e5a1d3d54c4572b356b1d4f6b8...04e8bab7b96d7cf94551bfc41bd44620813a8a6b) |
| **2025-11-22** | `2.3.3` | Benchmarks refactor, fixed validation dataset support in Few-Shot Optimizer. [Commits →](https://github.com/comet-ml/opik/compare/5aa839b303c260b682f84693bbb60bbd10c7f5f3...6a1bdba25642f4e5a1d3d54c4572b356b1d4f6b8) |
| **2025-11-21** | `2.3.2` | Agent examples fixes. [Commits →](https://github.com/comet-ml/opik/compare/57aca7223afccabad482a9a1fcc9223f7e1d887f...5aa839b303c260b682f84693bbb60bbd10c7f5f3) |
| **2025-11-21** | `2.3.1` | Fixed validation datasets, refactored optimizers to dedicated prompts modules. [Commits →](https://github.com/comet-ml/opik/compare/eaea2994b870c8e587e01bc6cdc23832bb70e462...57aca7223afccabad482a9a1fcc9223f7e1d887f) |
| **2025-11-21** | `2.3.0` | Validation dataset support, better logging and eval traces, optimizer version bump. [Commits →](https://github.com/comet-ml/opik/compare/8e27945686005acf5e7c0e60e7fc0ce9ba58e4e8...eaea2994b870c8e587e01bc6cdc23832bb70e462) |
| **2025-11-21** | `2.2.7` | Cache/speed improvements for e2e and workflows, GEPA adapter fixes. [Commits →](https://github.com/comet-ml/opik/compare/aa39d0bab2b03d85de99cebc96275c497efffe84...8e27945686005acf5e7c0e60e7fc0ce9ba58e4e8) |
| **2025-11-20** | `2.2.6` | Refactored Datasets API. [Commits →](https://github.com/comet-ml/opik/compare/670dc8e0318719a9a133d527544babedd77671f9...aa39d0bab2b03d85de99cebc96275c497efffe84) |
| **2025-11-20** | `2.2.5` | Ensured OptimizableAgent support, minor fixes. [Commits →](https://github.com/comet-ml/opik/compare/15c079f39785320d8e7ca7f0353452ffc94d2be7...670dc8e0318719a9a133d527544babedd77671f9) |
| **2025-11-19** | `2.2.4` | Added multimodal optimization e2e test. [Commits →](https://github.com/comet-ml/opik/compare/edc874c1905fe3b2bc6ad532ae8d3f992567accd...15c079f39785320d8e7ca7f0353452ffc94d2be7) |
| **2025-11-19** | `2.2.3` | Manifest-based task support, extra benchmark datasets. [Commits →](https://github.com/comet-ml/opik/compare/7d545959ad198c3ba3a9474c5e9e18b4fe3b938d...edc874c1905fe3b2bc6ad532ae8d3f992567accd) |
| **2025-11-18** | `2.2.2` | Multimodal input support for HRPO, algorithms package refactor, custom run names. [Commits →](https://github.com/comet-ml/opik/compare/582646e0c8da8d8ea74c3424e1aca94c18cc3666...7d545959ad198c3ba3a9474c5e9e18b4fe3b938d) |
| **2025-11-08** | `2.2.1` | Removed cache, added MCP agent prompt, benchmarks, fixed GEPA e2e tests. [Commits →](https://github.com/comet-ml/opik/compare/54eeef28c7eb0ddfd25bd471c3e33d8c95d3a57f...582646e0c8da8d8ea74c3424e1aca94c18cc3666) |
| **2025-10-23** | `2.2.0` | Public method refactor and optimizer cleanup. [Commits →](https://github.com/comet-ml/opik/compare/ae4eb603337cd298013dfc54e3f3c3eb3084e102...54eeef28c7eb0ddfd25bd471c3e33d8c95d3a57f) |
| **2025-10-23** | `2.1.3` | Multi-metric optimization objectives, HRPO logging improvements, public method refactor. [Commits →](https://github.com/comet-ml/opik/compare/a0d049f8a45a010f8ae1f6eecc73ff4c2c1ba29f...ae4eb603337cd298013dfc54e3f3c3eb3084e102) |
| **2025-10-11** | `2.1.2` | Fixed missing optimizer names across metadata. [Commits →](https://github.com/comet-ml/opik/compare/04e0937e26bead34a70421057025bc182bf957e3...a0d049f8a45a010f8ae1f6eecc73ff4c2c1ba29f) |
| **2025-10-10** | `2.1.1` | Introduced the Hierarchical Reflective Optimizer. [Commits →](https://github.com/comet-ml/opik/compare/47354f6d41123acd45330a0e3969892f86281ece...04e0937e26bead34a70421057025bc182bf957e3) |
| **2025-10-09** | `2.1.0` | Pinned LiteLLM, shipped optimizer API docs, added parameter-only tuning. [Commits →](https://github.com/comet-ml/opik/compare/516ba494ffeeaf7ba9d49337f336ac7cd360a4f2...47354f6d41123acd45330a0e3969892f86281ece) |
| **2025-10-02** | `2.0.1` | Added GEPA dependency and test package init files. [Commits →](https://github.com/comet-ml/opik/compare/c2230e13a2d956635f588bc0a52df16421507b6f...516ba494ffeeaf7ba9d49337f336ac7cd360a4f2) |
| **2025-10-01** | `2.0.0` | Updated pyproject.toml for v2.0 release. [Commits →](https://github.com/comet-ml/opik/compare/69dd9e6e61d3cd8aabe30a1ef814a5a57d74ef50...c2230e13a2d956635f588bc0a52df16421507b6f) |
## Version 1.x
Highlights: Initial research release for testing early internal optimizers MetaPrompter, Evolutionary and support for MIPRO.
| Date | Version | Highlights |
| --- | --- | --- |
| **2025-10-01** | `1.1.0` | Optimizer MCP with EO, signature refactor, docs and dotfiles for optimizer release. [Commits →](https://github.com/comet-ml/opik/compare/67d147a8be9ad8ae70dea37fe2f649cda3a34ad3...69dd9e6e61d3cd8aabe30a1ef814a5a57d74ef50) |
| **2025-09-24** | `1.0.6` | Initial optimizer packaging cleanup. [Commit →](https://github.com/comet-ml/opik/commit/67d147a8be9ad8ae70dea37fe2f649cda3a34ad3) |
<Info>
Looking for older updates? Browse the [full Opik changelog](/changelog) and filter by the **Agent Optimization** tag.
</Info>
Reference in New Issue View Git Blame Copy Permalink