chore: import upstream snapshot with attribution
CodeQL / Analyze (python) (push) Has been cancelled
Update Platform Components Table / update (push) Has been cancelled
Docker image release / Build base image (push) Has been cancelled
Sync docs with Docusaurus / sync (push) Has been cancelled
Tests / Check if changed (push) Has been cancelled
Tests / format (push) Has been cancelled
Tests / check-imports (push) Has been cancelled
Tests / Unit / macos-latest (push) Has been cancelled
Tests / Unit / ubuntu-latest (push) Has been cancelled
Tests / Unit / windows-latest (push) Has been cancelled
Tests / mypy (push) Has been cancelled
Tests / Integration / ubuntu-latest (push) Has been cancelled
Tests / Integration / macos-latest (push) Has been cancelled
Tests / Integration / windows-latest (push) Has been cancelled
Tests / notify-slack-on-failure (push) Has been cancelled
Tests / Mark tests as completed (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
Update Platform Components Table / update (push) Has been cancelled
Docker image release / Build base image (push) Has been cancelled
Sync docs with Docusaurus / sync (push) Has been cancelled
Tests / Check if changed (push) Has been cancelled
Tests / format (push) Has been cancelled
Tests / check-imports (push) Has been cancelled
Tests / Unit / macos-latest (push) Has been cancelled
Tests / Unit / ubuntu-latest (push) Has been cancelled
Tests / Unit / windows-latest (push) Has been cancelled
Tests / mypy (push) Has been cancelled
Tests / Integration / ubuntu-latest (push) Has been cancelled
Tests / Integration / macos-latest (push) Has been cancelled
Tests / Integration / windows-latest (push) Has been cancelled
Tests / notify-slack-on-failure (push) Has been cancelled
Tests / Mark tests as completed (push) Has been cancelled
This commit is contained in:
wehub-resource-sync
@@ -0,0 +1,88 @@
|
||||
---
|
||||
title: "Breaking Change Policy"
|
||||
id: breaking-change-policy
|
||||
slug: "/breaking-change-policy"
|
||||
description: "This document outlines the breaking change policy for Haystack, including the definition of breaking changes, versioning conventions, and the deprecation process for existing features."
|
||||
---
|
||||
|
||||
# Breaking Change Policy
|
||||
|
||||
This document outlines the breaking change policy for Haystack, including the definition of breaking changes, versioning conventions, and the deprecation process for existing features.
|
||||
|
||||
Haystack is under active development, which means that functionalities are being added, deprecated, or removed rather frequently. This policy aims to minimize the impact of these changes on current users and deployments. It provides a clear schedule and outlines the necessary steps before upgrading to a new Haystack version.
|
||||
|
||||
## Breaking Change Definition
|
||||
|
||||
A breaking change occurs when:
|
||||
|
||||
- A Component is removed, renamed, or the Python import path is changed.
|
||||
- A parameter is renamed, removed, or changed from optional to mandatory.
|
||||
- A new mandatory parameter is added.
|
||||
|
||||
Existing deployments might break, and the change is deemed a _breaking change_. The decision to declare a change as breaking has nothing to do with its potential impact: while the change might only impact a tiny subset of applications using a specific Haystack feature, it would still be treated as a breaking change.
|
||||
|
||||
The following cases are **not** considered a breaking change:
|
||||
|
||||
- A new functionality is added (for example, a new Component).
|
||||
- A component, class, or utility function gets a new optional parameter.
|
||||
- An existing parameter gets changed from mandatory to optional.
|
||||
|
||||
Existing deployments are not impacted, and the change is deemed non-breaking. Release notes will mention the change and possibly provide an upgrade path, but upgrading Haystack won’t break existing applications.
|
||||
|
||||
## Versioning
|
||||
|
||||
Haystack releases are labeled with a series of three numbers separated by dots, for example, `2.0.1`. Each number has a specific meaning:
|
||||
|
||||
- `2` is the Major version
|
||||
- `0` is the Minor version
|
||||
- `1` is the Patch version
|
||||
|
||||
:::info
|
||||
Albeit similar, Haystack DOES NOT follow the principles of [Semantic Versioning](https://semver.org). Read on to see the differences.
|
||||
:::
|
||||
|
||||
Given a Haystack release with a version number of type `MAJOR.MINOR.PATCH`, you should expect:
|
||||
|
||||
1. **For Major version change:** fundamental, incompatible API changes. In this case, you would most likely need a migration process before being able to update Haystack. Major releases happen no more than once a year, changes are extensively documented, and a migration path is provided.
|
||||
2. **For Minor version change:** addition or removal of functionalities that might not be backward compatible. Most of the time, you will be able to upgrade your Haystack installation seamlessly, but always refer to the [release notes](https://github.com/deepset-ai/haystack/releases) for guidance. Deprecated components are the most common breaking change shipped in a Minor version release.
|
||||
3. **For Patch version change:** bugfixes. You can safely upgrade Haystack to the new version without concerns that your program will break.
|
||||
|
||||
## Deprecation of Existing Features
|
||||
|
||||
Haystack strives for robustness. To achieve this, we clean up our code by removing old features that are no longer used. This helps us maintain the codebase, improve security, and make it easier to keep everything running smoothly. Before we remove a feature, component, class, or utility function, we go through a process called deprecation.
|
||||
|
||||
A Major or Minor (but not Patch) version may deprecate certain features from previous releases, and this is what you should expect:
|
||||
|
||||
- If a feature is deprecated in Haystack version `X.Y`, it will continue to work but the Python code will raise warnings detailing the steps to take in order to upgrade.
|
||||
- Features deprecated in Haystack version `X.Y` will be removed in Haystack `X.Y+1`, giving affected users a timeframe of roughly a month to prepare the upgrade.
|
||||
|
||||
### Example
|
||||
|
||||
To clarify the process, here’s an example:
|
||||
|
||||
At some point, we decide to remove a `FooComponent` and declare it deprecated in Haystack version `2.99.0`. This is what will happen:
|
||||
|
||||
1. `FooComponent` keeps working as usual In Haystack `2.99.0`, but using the component raises a `FutureWarning` message in the code.
|
||||
2. In Haystack version `2.100.0`, we remove the `FooComponent` from the codebase. Trying to use it produces an error.
|
||||
|
||||
## Discontinuing an Integration
|
||||
|
||||
When existing features are changed or removed, integrations go through the same deprecation process as detailed on this page for Haystack. It’s important to note that integrations are independent and distributed with their own packages. In certain cases, a special form of deprecation may occur where the integration is discontinued and subsequently removed from the Core Integrations repository.
|
||||
|
||||
To give our community the opportunity to take over the integration and keep it maintained before being discontinued Core Integrations gradually go through different states, as detailed below:
|
||||
|
||||
- **Staged**
|
||||
- The source code of the integration is moved from `main` to a special `staging` branch of the Core Integrations repository.
|
||||
- The documentation pages are removed from the Haystack documentation website.
|
||||
- The main README of the Core Integrations repository shows a disclaimer explaining how the integration can be adopted from the community.
|
||||
- The integration tile is removed (it can be re-added later by the maintainer who adopted the integration).
|
||||
- The integration package on PyPI remains available.
|
||||
- A grace period of 3 months starts.
|
||||
- **Adopted**
|
||||
- An organization or an individual from the community accepts to take over the ownership of the Staged integration.
|
||||
- The adopter creates their own repository, and the source code of the discontinued integration is removed from the `staging` branch.
|
||||
- Ownership of the PyPI package is transferred to the new maintainer.
|
||||
- The adopter will create a new integration tile in [haystack-integrations](https://github.com/deepset-ai/haystack-integrations).
|
||||
- **Discontinued**
|
||||
- If the grace period expires and nobody adopts the Staged Integration, its source code is removed from the `staging` branch.
|
||||
- The PyPI package of the integration won’t be removed but won’t be further updated.
|
||||
@@ -0,0 +1,88 @@
|
||||
---
|
||||
title: "Using Haystack Docs in Your Coding Agent"
|
||||
id: docs-mcp-server
|
||||
slug: "/docs-mcp-server"
|
||||
description: "Connect your coding agent to the Haystack documentation through the public MCP server. Includes setup instructions for Claude Code, Cursor, and GitHub Copilot."
|
||||
---
|
||||
|
||||
import Tabs from '@theme/Tabs';
|
||||
import TabItem from '@theme/TabItem';
|
||||
|
||||
# Using Haystack Docs in Your Coding Agent
|
||||
|
||||
Haystack publishes a public [Model Context Protocol (MCP)](https://modelcontextprotocol.io) server that lets coding agents search the official Haystack documentation. Pointing your agent at it means it answers questions from up-to-date docs instead of relying on training data, which can lag behind the framework.
|
||||
|
||||
The server exposes a single tool, `search_haystack_docs`, that returns relevant documentation sections with source URLs. No API key or sign-up is needed.
|
||||
|
||||
## Server URL
|
||||
|
||||
```
|
||||
https://docs.haystack.deepset.ai/api/mcp
|
||||
```
|
||||
|
||||
The server speaks **HTTP** transport. Most agents auto-detect this. If yours asks you to choose, pick `http`.
|
||||
|
||||
## Setup
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="claude-code" label="Claude Code" default>
|
||||
|
||||
Add the server with the `claude mcp` CLI:
|
||||
|
||||
```shell
|
||||
claude mcp add --transport http haystack-docs https://docs.haystack.deepset.ai/api/mcp
|
||||
```
|
||||
|
||||
Restart your Claude Code session. Verify it's connected by running `/mcp` — you should see `haystack-docs` listed with the `search_haystack_docs` tool.
|
||||
|
||||
For more options (project vs. user scope, SSE transport, headers), see the [Claude Code MCP docs](https://code.claude.com/docs/en/mcp).
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="cursor" label="Cursor">
|
||||
|
||||
Open Cursor settings → **Tools & MCPs** → **Add new MCP server**, or edit `~/.cursor/mcp.json` (global) or `.cursor/mcp.json` (per-project) directly:
|
||||
|
||||
```json
|
||||
{
|
||||
"mcpServers": {
|
||||
"haystack-docs": {
|
||||
"url": "https://docs.haystack.deepset.ai/api/mcp"
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
Save the file and reload Cursor. The tool appears in the **Available Tools** list inside the chat panel.
|
||||
|
||||
See the [Cursor MCP docs](https://cursor.com/docs/context/mcp) for the full configuration reference.
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="copilot" label="GitHub Copilot">
|
||||
|
||||
In VS Code, create or edit `.vscode/mcp.json` in your workspace:
|
||||
|
||||
```json
|
||||
{
|
||||
"servers": {
|
||||
"haystack-docs": {
|
||||
"type": "http",
|
||||
"url": "https://docs.haystack.deepset.ai/api/mcp"
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
Open the Copilot Chat panel, switch to **Agent** mode, then click the tools icon and enable `haystack-docs`. You can also register the server globally from the command palette via **MCP: Add Server**.
|
||||
|
||||
See [Add and manage MCP servers in VS Code](https://code.visualstudio.com/docs/copilot/chat/mcp-servers) for the full configuration reference.
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
## Verifying it works
|
||||
|
||||
Ask your agent a question that requires current Haystack knowledge, for example:
|
||||
|
||||
> What are the required methods on a Haystack custom component?
|
||||
|
||||
The agent should call `search_haystack_docs` and cite source URLs under `docs.haystack.deepset.ai` in its answer. If it answers without calling the tool, prompt it explicitly: *"Use the haystack-docs MCP server to answer."*
|
||||
@@ -0,0 +1,44 @@
|
||||
---
|
||||
title: "FAQ"
|
||||
id: faq
|
||||
slug: "/faq"
|
||||
description: "Here are the answers to the questions people frequently ask about Haystack."
|
||||
---
|
||||
|
||||
# FAQ
|
||||
|
||||
Here are the answers to the questions people frequently ask about Haystack.
|
||||
|
||||
### How can I make sure that my GPU is being engaged when I use Haystack?
|
||||
|
||||
You will want to ensure that a CUDA enabled GPU is being engaged when Haystack is running (you can check by running `nvidia-smi -l` on your command line). Components which can be sped up by GPU have a `device` argument in their constructor. For more details, check the [Device Management](../concepts/device-management.mdx) page.
|
||||
|
||||
### Are you tracking my Haystack usage?
|
||||
|
||||
We only collect _anonymous_ usage statistics of Haystack pipeline components. Read more about telemetry in Haystack or how you can opt out on the [Telemetry](telemetry.mdx) page.
|
||||
|
||||
### How can I ask my questions around Haystack?
|
||||
|
||||
For general questions, we recommend joining the [Haystack Discord ](https://discord.com/invite/xYvH6drSmA)or using [GitHub discussions](https://github.com/deepset-ai/haystack/discussions), where the community and maintainers can help. You can also explore [tutorials](https://haystack.deepset.ai/tutorials/40_building_chat_application_with_function_calling) and [examples](https://haystack.deepset.ai/cookbook/tools_support) on website to find more info.
|
||||
|
||||
### How can I get expert support for Haystack?
|
||||
|
||||
If you’re a team running Haystack in production or want to move faster and scale with confidence, we recommend [Haystack Enterprise Starter](https://haystack.deepset.ai/blog/announcing-haystack-enterprise). It gives you direct access to the Haystack team, proven best practices, and hands-on support to help you go from prototype to production smoothly.
|
||||
|
||||
👉 [Get in touch with our team to explore Haystack Enterprise Starter](https://www.deepset.ai/products-and-services/haystack-enterprise)
|
||||
|
||||
### Where can I find documentation for older Haystack versions?
|
||||
|
||||
The website only hosts documentation for the 5 most recent Haystack versions.
|
||||
|
||||
For older versions (up to 2.18), you can access the documentation on GitHub: https://github.com/deepset-ai/haystack/tree/main/docs-website/versioned_docs.
|
||||
|
||||
### Where can I find tutorials and documentation for Haystack 1.x?
|
||||
|
||||
You can access old tutorials in the [GitHub history](https://github.com/deepset-ai/haystack-tutorials/tree/5917718cbfbb61410aab4121ee6fe754040a5dc7) and download the Haystack 1.x documentation as a [ZIP file](https://core-engineering.s3.eu-central-1.amazonaws.com/public/docs/haystack-v1-docs.zip).
|
||||
|
||||
The ZIP file contains documentation for all minor releases from version 1.0 to 1.26.
|
||||
|
||||
To download documentation for a specific release, replace the version number in the following URL: `https://core-engineering.s3.eu-central-1.amazonaws.com/public/docs/v1.26.zip`.
|
||||
|
||||
Learn how to migrate to Haystack version 2.x with our [migration guide](migration.mdx).
|
||||
@@ -0,0 +1,581 @@
|
||||
---
|
||||
title: "Get Started"
|
||||
id: get-started
|
||||
slug: "/get-started"
|
||||
description: "Learn how to quickly get up and running with Haystack. Build your first RAG pipeline and tool-calling Agent with step-by-step examples for multiple LLM providers."
|
||||
---
|
||||
|
||||
import Tabs from '@theme/Tabs';
|
||||
import TabItem from '@theme/TabItem';
|
||||
|
||||
# Get Started
|
||||
|
||||
Have a look at this page to learn how to quickly get up and running with Haystack. It contains instructions for installing Haystack, building your first RAG pipeline, and creating a tool-calling Agent.
|
||||
|
||||
## Build your first RAG application
|
||||
|
||||
Let's build your first Retrieval Augmented Generation (RAG) pipeline and see how Haystack answers questions.
|
||||
|
||||
First, install the minimal form of Haystack:
|
||||
|
||||
```shell
|
||||
pip install haystack-ai
|
||||
```
|
||||
|
||||
In the examples below, we show how to set an API key using a Haystack [Secret](../concepts/secret-management.mdx). Choose your preferred LLM provider from the tabs below. For easier use, you can also set the API key as an environment variable.
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="openai" label="OpenAI" default>
|
||||
|
||||
[OpenAIChatGenerator](../pipeline-components/generators/openaichatgenerator.mdx) is included in the `haystack-ai` package.
|
||||
|
||||
```python
|
||||
from haystack import Pipeline, Document
|
||||
from haystack.components.generators.chat import OpenAIChatGenerator
|
||||
from haystack.components.retrievers import InMemoryBM25Retriever
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.builders import ChatPromptBuilder
|
||||
from haystack.utils import Secret
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="My name is Jean and I live in Paris."),
|
||||
Document(content="My name is Mark and I live in Berlin."),
|
||||
Document(content="My name is Giorgio and I live in Rome."),
|
||||
],
|
||||
)
|
||||
|
||||
prompt_template = [
|
||||
ChatMessage.from_system(
|
||||
"""
|
||||
Given these documents, answer the question.
|
||||
Documents:
|
||||
{% for doc in documents %}
|
||||
{{ doc.content }}
|
||||
{% endfor %}
|
||||
""",
|
||||
),
|
||||
ChatMessage.from_user("{{question}}"),
|
||||
]
|
||||
|
||||
retriever = InMemoryBM25Retriever(document_store=document_store)
|
||||
prompt_builder = ChatPromptBuilder(template=prompt_template, required_variables="*")
|
||||
llm = OpenAIChatGenerator(
|
||||
api_key=Secret.from_env_var("OPENAI_API_KEY"),
|
||||
model="gpt-4o-mini",
|
||||
)
|
||||
|
||||
rag_pipeline = Pipeline()
|
||||
rag_pipeline.add_component("retriever", retriever)
|
||||
rag_pipeline.add_component("prompt_builder", prompt_builder)
|
||||
rag_pipeline.add_component("llm", llm)
|
||||
rag_pipeline.connect("retriever", "prompt_builder.documents")
|
||||
rag_pipeline.connect("prompt_builder", "llm")
|
||||
|
||||
question = "Who lives in Paris?"
|
||||
results = rag_pipeline.run(
|
||||
{
|
||||
"retriever": {"query": question},
|
||||
"prompt_builder": {"question": question},
|
||||
},
|
||||
)
|
||||
|
||||
print(results["llm"]["replies"])
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="huggingface" label="Hugging Face">
|
||||
|
||||
[HuggingFaceAPIChatGenerator](../pipeline-components/generators/huggingfaceapichatgenerator.mdx) is included in the `huggingface-api-haystack` package. You can get a [free Hugging Face token](https://huggingface.co/settings/tokens) to use the Serverless Inference API.
|
||||
|
||||
The examples on this page use the Hugging Face API components and the SerperDev web search component, which have moved to the `huggingface-api-haystack` and `serperdev-haystack` packages. Install them to run the examples:
|
||||
|
||||
```shell
|
||||
pip install huggingface-api-haystack serperdev-haystack
|
||||
```
|
||||
|
||||
```python
|
||||
from haystack import Pipeline, Document
|
||||
from haystack_integrations.components.generators.huggingface_api import (
|
||||
HuggingFaceAPIChatGenerator,
|
||||
)
|
||||
from haystack.components.retrievers import InMemoryBM25Retriever
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.builders import ChatPromptBuilder
|
||||
from haystack.utils import Secret
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="My name is Jean and I live in Paris."),
|
||||
Document(content="My name is Mark and I live in Berlin."),
|
||||
Document(content="My name is Giorgio and I live in Rome."),
|
||||
],
|
||||
)
|
||||
|
||||
prompt_template = [
|
||||
ChatMessage.from_system(
|
||||
"""
|
||||
Given these documents, answer the question.
|
||||
Documents:
|
||||
{% for doc in documents %}
|
||||
{{ doc.content }}
|
||||
{% endfor %}
|
||||
""",
|
||||
),
|
||||
ChatMessage.from_user("{{question}}"),
|
||||
]
|
||||
|
||||
retriever = InMemoryBM25Retriever(document_store=document_store)
|
||||
prompt_builder = ChatPromptBuilder(template=prompt_template, required_variables="*")
|
||||
llm = HuggingFaceAPIChatGenerator(
|
||||
api_type="serverless_inference_api",
|
||||
api_params={"model": "Qwen/Qwen2.5-72B-Instruct"},
|
||||
token=Secret.from_env_var("HF_API_TOKEN"),
|
||||
)
|
||||
|
||||
rag_pipeline = Pipeline()
|
||||
rag_pipeline.add_component("retriever", retriever)
|
||||
rag_pipeline.add_component("prompt_builder", prompt_builder)
|
||||
rag_pipeline.add_component("llm", llm)
|
||||
rag_pipeline.connect("retriever", "prompt_builder.documents")
|
||||
rag_pipeline.connect("prompt_builder", "llm")
|
||||
|
||||
question = "Who lives in Paris?"
|
||||
results = rag_pipeline.run(
|
||||
{
|
||||
"retriever": {"query": question},
|
||||
"prompt_builder": {"question": question},
|
||||
},
|
||||
)
|
||||
|
||||
print(results["llm"]["replies"])
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="anthropic" label="Anthropic">
|
||||
|
||||
Install the [Anthropic integration](https://haystack.deepset.ai/integrations/anthropic):
|
||||
|
||||
```bash
|
||||
pip install anthropic-haystack
|
||||
```
|
||||
|
||||
See the [AnthropicChatGenerator](../pipeline-components/generators/anthropicchatgenerator.mdx) docs for more details.
|
||||
|
||||
```python
|
||||
from haystack import Pipeline, Document
|
||||
from haystack_integrations.components.generators.anthropic import AnthropicChatGenerator
|
||||
from haystack.components.retrievers import InMemoryBM25Retriever
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.builders import ChatPromptBuilder
|
||||
from haystack.utils import Secret
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="My name is Jean and I live in Paris."),
|
||||
Document(content="My name is Mark and I live in Berlin."),
|
||||
Document(content="My name is Giorgio and I live in Rome."),
|
||||
],
|
||||
)
|
||||
|
||||
prompt_template = [
|
||||
ChatMessage.from_system(
|
||||
"""
|
||||
Given these documents, answer the question.
|
||||
Documents:
|
||||
{% for doc in documents %}
|
||||
{{ doc.content }}
|
||||
{% endfor %}
|
||||
""",
|
||||
),
|
||||
ChatMessage.from_user("{{question}}"),
|
||||
]
|
||||
|
||||
retriever = InMemoryBM25Retriever(document_store=document_store)
|
||||
prompt_builder = ChatPromptBuilder(template=prompt_template, required_variables="*")
|
||||
llm = AnthropicChatGenerator(
|
||||
api_key=Secret.from_env_var("ANTHROPIC_API_KEY"),
|
||||
model="claude-sonnet-4-5-20250929",
|
||||
)
|
||||
|
||||
rag_pipeline = Pipeline()
|
||||
rag_pipeline.add_component("retriever", retriever)
|
||||
rag_pipeline.add_component("prompt_builder", prompt_builder)
|
||||
rag_pipeline.add_component("llm", llm)
|
||||
rag_pipeline.connect("retriever", "prompt_builder.documents")
|
||||
rag_pipeline.connect("prompt_builder", "llm")
|
||||
|
||||
question = "Who lives in Paris?"
|
||||
results = rag_pipeline.run(
|
||||
{
|
||||
"retriever": {"query": question},
|
||||
"prompt_builder": {"question": question},
|
||||
},
|
||||
)
|
||||
|
||||
print(results["llm"]["replies"])
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="amazon-bedrock" label="Amazon Bedrock">
|
||||
|
||||
Install the [Amazon Bedrock integration](https://haystack.deepset.ai/integrations/amazon-bedrock):
|
||||
|
||||
```bash
|
||||
pip install amazon-bedrock-haystack
|
||||
```
|
||||
|
||||
See the [AmazonBedrockChatGenerator](../pipeline-components/generators/amazonbedrockchatgenerator.mdx) docs for more details.
|
||||
|
||||
```python
|
||||
import os
|
||||
from haystack import Pipeline, Document
|
||||
from haystack_integrations.components.generators.amazon_bedrock import (
|
||||
AmazonBedrockChatGenerator,
|
||||
)
|
||||
from haystack.components.retrievers import InMemoryBM25Retriever
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.builders import ChatPromptBuilder
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
os.environ["AWS_ACCESS_KEY_ID"] = "YOUR_AWS_ACCESS_KEY_ID"
|
||||
os.environ["AWS_SECRET_ACCESS_KEY"] = "YOUR_AWS_SECRET_ACCESS_KEY"
|
||||
os.environ["AWS_DEFAULT_REGION"] = "YOUR_AWS_REGION"
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="My name is Jean and I live in Paris."),
|
||||
Document(content="My name is Mark and I live in Berlin."),
|
||||
Document(content="My name is Giorgio and I live in Rome."),
|
||||
],
|
||||
)
|
||||
|
||||
prompt_template = [
|
||||
ChatMessage.from_system(
|
||||
"""
|
||||
Given these documents, answer the question.
|
||||
Documents:
|
||||
{% for doc in documents %}
|
||||
{{ doc.content }}
|
||||
{% endfor %}
|
||||
""",
|
||||
),
|
||||
ChatMessage.from_user("{{question}}"),
|
||||
]
|
||||
|
||||
retriever = InMemoryBM25Retriever(document_store=document_store)
|
||||
prompt_builder = ChatPromptBuilder(template=prompt_template, required_variables="*")
|
||||
llm = AmazonBedrockChatGenerator(model="anthropic.claude-3-5-sonnet-20240620-v1:0")
|
||||
|
||||
rag_pipeline = Pipeline()
|
||||
rag_pipeline.add_component("retriever", retriever)
|
||||
rag_pipeline.add_component("prompt_builder", prompt_builder)
|
||||
rag_pipeline.add_component("llm", llm)
|
||||
rag_pipeline.connect("retriever", "prompt_builder.documents")
|
||||
rag_pipeline.connect("prompt_builder", "llm")
|
||||
|
||||
question = "Who lives in Paris?"
|
||||
results = rag_pipeline.run(
|
||||
{
|
||||
"retriever": {"query": question},
|
||||
"prompt_builder": {"question": question},
|
||||
},
|
||||
)
|
||||
|
||||
print(results["llm"]["replies"])
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="google-gemini" label="Google Gemini">
|
||||
|
||||
Install the [Google Gen AI integration](https://haystack.deepset.ai/integrations/google-genai):
|
||||
|
||||
```bash
|
||||
pip install google-genai-haystack
|
||||
```
|
||||
|
||||
See the [GoogleGenAIChatGenerator](../pipeline-components/generators/googlegenaichatgenerator.mdx) docs for more details.
|
||||
|
||||
```python
|
||||
from haystack import Pipeline, Document
|
||||
from haystack_integrations.components.generators.google_genai import (
|
||||
GoogleGenAIChatGenerator,
|
||||
)
|
||||
from haystack.components.retrievers import InMemoryBM25Retriever
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.builders import ChatPromptBuilder
|
||||
from haystack.utils import Secret
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="My name is Jean and I live in Paris."),
|
||||
Document(content="My name is Mark and I live in Berlin."),
|
||||
Document(content="My name is Giorgio and I live in Rome."),
|
||||
],
|
||||
)
|
||||
|
||||
prompt_template = [
|
||||
ChatMessage.from_system(
|
||||
"""
|
||||
Given these documents, answer the question.
|
||||
Documents:
|
||||
{% for doc in documents %}
|
||||
{{ doc.content }}
|
||||
{% endfor %}
|
||||
""",
|
||||
),
|
||||
ChatMessage.from_user("{{question}}"),
|
||||
]
|
||||
|
||||
retriever = InMemoryBM25Retriever(document_store=document_store)
|
||||
prompt_builder = ChatPromptBuilder(template=prompt_template, required_variables="*")
|
||||
llm = GoogleGenAIChatGenerator(
|
||||
api_key=Secret.from_env_var("GOOGLE_API_KEY"),
|
||||
model="gemini-2.5-flash",
|
||||
)
|
||||
|
||||
rag_pipeline = Pipeline()
|
||||
rag_pipeline.add_component("retriever", retriever)
|
||||
rag_pipeline.add_component("prompt_builder", prompt_builder)
|
||||
rag_pipeline.add_component("llm", llm)
|
||||
rag_pipeline.connect("retriever", "prompt_builder.documents")
|
||||
rag_pipeline.connect("prompt_builder", "llm")
|
||||
|
||||
question = "Who lives in Paris?"
|
||||
results = rag_pipeline.run(
|
||||
{
|
||||
"retriever": {"query": question},
|
||||
"prompt_builder": {"question": question},
|
||||
},
|
||||
)
|
||||
|
||||
print(results["llm"]["replies"])
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="more-providers" label="More Providers">
|
||||
|
||||
<div style={{backgroundColor: 'var(--ifm-color-emphasis-100)', padding: '1.5rem', borderRadius: '8px'}}>
|
||||
|
||||
Haystack supports many more model providers including **Cohere**, **Mistral**, **NVIDIA**, **Ollama**, and others—both cloud-hosted and local options.
|
||||
|
||||
Browse the full list of supported models and chat generators in the [Generators documentation](../pipeline-components/generators.mdx).
|
||||
|
||||
You can also explore all available integrations on the [Haystack Integrations](https://haystack.deepset.ai/integrations) page.
|
||||
|
||||
</div>
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
### Next Steps
|
||||
|
||||
Ready to dive deeper? Check out the [Creating Your First QA Pipeline with Retrieval-Augmentation](https://haystack.deepset.ai/tutorials/27_first_rag_pipeline) tutorial for a step-by-step guide on building a complete RAG pipeline with your own data.
|
||||
|
||||
## Build your first Agent
|
||||
|
||||
Agents are AI systems that can use tools to gather information, perform actions, and interact with external systems. Let's build an agent that can search the web to answer questions.
|
||||
|
||||
This example requires a [SerperDev API key](https://serper.dev/) for web search. Set it as the `SERPERDEV_API_KEY` environment variable.
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="openai" label="OpenAI" default>
|
||||
|
||||
[OpenAIChatGenerator](../pipeline-components/generators/openaichatgenerator.mdx) is included in the `haystack-ai` package.
|
||||
|
||||
```python
|
||||
from haystack.components.agents import Agent
|
||||
from haystack.components.generators.chat import OpenAIChatGenerator
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack.tools import ComponentTool
|
||||
from haystack_integrations.components.websearch.serperdev import SerperDevWebSearch
|
||||
from haystack.utils import Secret
|
||||
|
||||
search_tool = ComponentTool(component=SerperDevWebSearch())
|
||||
|
||||
agent = Agent(
|
||||
chat_generator=OpenAIChatGenerator(
|
||||
api_key=Secret.from_env_var("OPENAI_API_KEY"),
|
||||
model="gpt-4o-mini",
|
||||
),
|
||||
tools=[search_tool],
|
||||
system_prompt="You are a helpful assistant that can search the web for information.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[ChatMessage.from_user("What is Haystack AI?")])
|
||||
|
||||
print(result["last_message"].text)
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="huggingface" label="Hugging Face">
|
||||
|
||||
[HuggingFaceAPIChatGenerator](../pipeline-components/generators/huggingfaceapichatgenerator.mdx) is included in the `huggingface-api-haystack` package. You can get a [free Hugging Face token](https://huggingface.co/settings/tokens) to use the Serverless Inference API.
|
||||
|
||||
```python
|
||||
from haystack.components.agents import Agent
|
||||
from haystack_integrations.components.generators.huggingface_api import (
|
||||
HuggingFaceAPIChatGenerator,
|
||||
)
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack.tools import ComponentTool
|
||||
from haystack_integrations.components.websearch.serperdev import SerperDevWebSearch
|
||||
from haystack.utils import Secret
|
||||
|
||||
search_tool = ComponentTool(component=SerperDevWebSearch())
|
||||
|
||||
agent = Agent(
|
||||
chat_generator=HuggingFaceAPIChatGenerator(
|
||||
api_type="serverless_inference_api",
|
||||
api_params={"model": "Qwen/Qwen2.5-72B-Instruct"},
|
||||
token=Secret.from_env_var("HF_API_TOKEN"),
|
||||
),
|
||||
tools=[search_tool],
|
||||
system_prompt="You are a helpful assistant that can search the web for information.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[ChatMessage.from_user("What is Haystack AI?")])
|
||||
|
||||
print(result["last_message"].text)
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="anthropic" label="Anthropic">
|
||||
|
||||
Install the [Anthropic integration](https://haystack.deepset.ai/integrations/anthropic):
|
||||
|
||||
```bash
|
||||
pip install anthropic-haystack
|
||||
```
|
||||
|
||||
See the [AnthropicChatGenerator](../pipeline-components/generators/anthropicchatgenerator.mdx) docs for more details.
|
||||
|
||||
```python
|
||||
from haystack.components.agents import Agent
|
||||
from haystack_integrations.components.generators.anthropic import AnthropicChatGenerator
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack.tools import ComponentTool
|
||||
from haystack_integrations.components.websearch.serperdev import SerperDevWebSearch
|
||||
from haystack.utils import Secret
|
||||
|
||||
search_tool = ComponentTool(component=SerperDevWebSearch())
|
||||
|
||||
agent = Agent(
|
||||
chat_generator=AnthropicChatGenerator(
|
||||
api_key=Secret.from_env_var("ANTHROPIC_API_KEY"),
|
||||
model="claude-sonnet-4-5-20250929",
|
||||
),
|
||||
tools=[search_tool],
|
||||
system_prompt="You are a helpful assistant that can search the web for information.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[ChatMessage.from_user("What is Haystack AI?")])
|
||||
|
||||
print(result["last_message"].text)
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="amazon-bedrock" label="Amazon Bedrock">
|
||||
|
||||
Install the [Amazon Bedrock integration](https://haystack.deepset.ai/integrations/amazon-bedrock):
|
||||
|
||||
```bash
|
||||
pip install amazon-bedrock-haystack
|
||||
```
|
||||
|
||||
See the [AmazonBedrockChatGenerator](../pipeline-components/generators/amazonbedrockchatgenerator.mdx) docs for more details.
|
||||
|
||||
```python
|
||||
import os
|
||||
from haystack.components.agents import Agent
|
||||
from haystack_integrations.components.generators.amazon_bedrock import (
|
||||
AmazonBedrockChatGenerator,
|
||||
)
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack.tools import ComponentTool
|
||||
from haystack_integrations.components.websearch.serperdev import SerperDevWebSearch
|
||||
|
||||
os.environ["AWS_ACCESS_KEY_ID"] = "YOUR_AWS_ACCESS_KEY_ID"
|
||||
os.environ["AWS_SECRET_ACCESS_KEY"] = "YOUR_AWS_SECRET_ACCESS_KEY"
|
||||
os.environ["AWS_DEFAULT_REGION"] = "YOUR_AWS_REGION"
|
||||
|
||||
search_tool = ComponentTool(component=SerperDevWebSearch())
|
||||
|
||||
agent = Agent(
|
||||
chat_generator=AmazonBedrockChatGenerator(
|
||||
model="anthropic.claude-3-5-sonnet-20240620-v1:0",
|
||||
),
|
||||
tools=[search_tool],
|
||||
system_prompt="You are a helpful assistant that can search the web for information.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[ChatMessage.from_user("What is Haystack AI?")])
|
||||
|
||||
print(result["last_message"].text)
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="google-gemini" label="Google Gemini">
|
||||
|
||||
Install the [Google Gen AI integration](https://haystack.deepset.ai/integrations/google-genai):
|
||||
|
||||
```bash
|
||||
pip install google-genai-haystack
|
||||
```
|
||||
|
||||
See the [GoogleGenAIChatGenerator](../pipeline-components/generators/googlegenaichatgenerator.mdx) docs for more details.
|
||||
|
||||
```python
|
||||
from haystack.components.agents import Agent
|
||||
from haystack_integrations.components.generators.google_genai import (
|
||||
GoogleGenAIChatGenerator,
|
||||
)
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack.tools import ComponentTool
|
||||
from haystack_integrations.components.websearch.serperdev import SerperDevWebSearch
|
||||
from haystack.utils import Secret
|
||||
|
||||
search_tool = ComponentTool(component=SerperDevWebSearch())
|
||||
|
||||
agent = Agent(
|
||||
chat_generator=GoogleGenAIChatGenerator(
|
||||
api_key=Secret.from_env_var("GOOGLE_API_KEY"),
|
||||
model="gemini-2.5-flash",
|
||||
),
|
||||
tools=[search_tool],
|
||||
system_prompt="You are a helpful assistant that can search the web for information.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[ChatMessage.from_user("What is Haystack AI?")])
|
||||
|
||||
print(result["last_message"].text)
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="more-providers" label="More Providers">
|
||||
|
||||
<div style={{backgroundColor: 'var(--ifm-color-emphasis-100)', padding: '1.5rem', borderRadius: '8px'}}>
|
||||
|
||||
Haystack supports many more model providers including **Cohere**, **Mistral**, **NVIDIA**, **Ollama**, and others—both cloud-hosted and local options.
|
||||
|
||||
Browse the full list of supported models and chat generators in the [Generators documentation](../pipeline-components/generators.mdx).
|
||||
|
||||
You can also explore all available integrations on the [Haystack Integrations](https://haystack.deepset.ai/integrations) page.
|
||||
|
||||
</div>
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
### Next Steps
|
||||
|
||||
For a hands-on guide on creating a tool-calling agent that can use both components and pipelines as tools, check out the [Build a Tool-Calling Agent](https://haystack.deepset.ai/tutorials/43_building_a_tool_calling_agent) tutorial.
|
||||
@@ -0,0 +1,51 @@
|
||||
---
|
||||
title: "Installation"
|
||||
id: installation
|
||||
slug: "/installation"
|
||||
description: "See how to quickly install Haystack with pip, uv, or conda."
|
||||
---
|
||||
|
||||
# Installation
|
||||
|
||||
See how to quickly install Haystack with pip, uv, or conda.
|
||||
|
||||
## Package Installation
|
||||
|
||||
Use [pip](https://github.com/pypa/pip) to install the [Haystack PyPI package](https://pypi.org/project/haystack-ai/):
|
||||
|
||||
```shell
|
||||
pip install haystack-ai
|
||||
```
|
||||
|
||||
Alternatively, you can use [uv](https://docs.astral.sh/uv/) to install Haystack:
|
||||
|
||||
```shell
|
||||
uv pip install haystack-ai
|
||||
```
|
||||
|
||||
Or add it as a dependency to your project:
|
||||
|
||||
```shell
|
||||
uv add haystack-ai
|
||||
```
|
||||
|
||||
You can also use [conda](https://docs.conda.io/projects/conda/en/stable/) to install the [Haystack conda package](https://anaconda.org/conda-forge/haystack-ai):
|
||||
|
||||
```shell
|
||||
conda install conda-forge::haystack-ai
|
||||
```
|
||||
|
||||
### Optional Dependencies
|
||||
|
||||
Some components in Haystack rely on additional optional dependencies.
|
||||
To keep the installation lightweight, these are not included by default – only the essentials are installed.
|
||||
If you use a feature that requires an optional dependency that hasn't been installed, Haystack will raise an error that instructs you to install missing dependencies, for example:
|
||||
|
||||
```shell
|
||||
ImportError: "Haystack failed to import the optional dependency 'pypdf'. Run 'pip install pypdf'.
|
||||
```
|
||||
|
||||
## Contributing to Haystack
|
||||
|
||||
If you would like to contribute to the Haystack, check our [Contributor Guidelines](https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md) first
|
||||
and follow the instructions [here](https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md#setting-up-your-development-environment) to set up your development environment.
|
||||
@@ -0,0 +1,669 @@
|
||||
---
|
||||
title: "Migrating from LangGraph/LangChain to Haystack"
|
||||
id: migrating-from-langgraphlangchain-to-haystack
|
||||
slug: "/migrating-from-langgraphlangchain-to-haystack"
|
||||
description: "Whether you're planning to migrate to Haystack or just comparing LangChain/LangGraph and Haystack to choose the proper framework for your AI application, this guide will help you map common patterns between frameworks."
|
||||
---
|
||||
|
||||
import CodeBlock from '@theme/CodeBlock';
|
||||
|
||||
# Migrating from LangGraph/LangChain to Haystack
|
||||
|
||||
Whether you're planning to migrate to Haystack or just comparing **LangChain/LangGraph** and **Haystack** to choose the proper framework for your AI application, this guide will help you map common patterns between frameworks.
|
||||
|
||||
In this guide, you'll learn how to translate core LangGraph concepts, like nodes, edges, and state, into Haystack components, pipelines, and agents. The goal is to preserve your existing logic while leveraging Haystack's flexible, modular ecosystem.
|
||||
|
||||
It's most accurate to think of Haystack as covering both **LangChain** and **LangGraph** territory: Haystack provides the building blocks for everything from simple sequential flows to fully agentic workflows with custom logic.
|
||||
|
||||
## Why you might explore or migrate to Haystack
|
||||
|
||||
You might consider Haystack if you want to build your AI applications on a **stable, actively maintained foundation** with an intuitive developer experience.
|
||||
|
||||
* **Unified orchestration framework.** Haystack supports both deterministic pipelines and adaptive agentic flows, letting you combine them with the right level of autonomy in a single system.
|
||||
* **High-quality codebase and design.** Haystack is engineered for clarity and reliability with well-tested components, predictable APIs, and a modular architecture that simply works.
|
||||
* **Ease of customization.** Extend core components, add your own logic, or integrate custom tools with minimal friction.
|
||||
* **Reduced cognitive overhead.** Haystack extends familiar ideas rather than introducing new abstractions, helping you stay focused on applying concepts, not learning them.
|
||||
* **Comprehensive documentation and learning resources.** Every concept, from components and pipelines to agents and tools, is supported by detailed and well-maintained docs, tutorials, and educational content.
|
||||
* **Frequent release cycles.** New features, improvements, and bug fixes are shipped regularly, ensuring that the framework evolves quickly while maintaining backward compatibility.
|
||||
* **Scalable from prototype to production.** Start small and expand easily. The same code you use for a proof of concept can power enterprise-grade deployments through the whole Haystack ecosystem.
|
||||
|
||||
## Concept mapping: LangGraph/LangChain → Haystack
|
||||
|
||||
Here's a table of key concepts and their approximate equivalents between the two frameworks. Use this when auditing your LangGraph/Langchain architecture and planning the migration.
|
||||
|
||||
| LangGraph/LangChain concept | Haystack equivalent | Notes |
|
||||
| --- | --- | --- |
|
||||
| Node | Component | A unit of logic in both frameworks. In Haystack, a [Component](../concepts/components.mdx) can run standalone, in a pipeline, or as a tool with agent. You can [create custom components](../concepts/components/custom-components.mdx) or use built-in ones like Generators and Retrievers. |
|
||||
| Edge / routing logic | Connection / Branching / Looping | [Pipelines](../concepts/pipelines.mdx) connect component inputs and outputs with type-checked links. They support branching, routing, and loops for flexible flow control. |
|
||||
| Graph / Workflow (nodes + edges) | Pipeline or Agent | LangGraph explicitly defines graphs; Haystack achieves similar orchestration through pipelines or [Agents](../concepts/agents.mdx) when adaptive logic is needed. |
|
||||
| Subgraphs | SuperComponent | A [SuperComponent](../concepts/components/supercomponents.mdx) wraps a full pipeline and exposes it as a single reusable component |
|
||||
| Models / LLMs | ChatGenerator Components | Haystack's [ChatGenerators](../pipeline-components/generators.mdx) unify access to open and proprietary models, with support for streaming, structured outputs, and multimodal data. |
|
||||
| Agent Creation (`create_agent`, multi-agent from LangChain) | Agent Component | Haystack provides a simple, pipeline-based [Agent](../concepts/agents.mdx) abstraction that handles reasoning, tool use, and multi-step execution. |
|
||||
| Tool (Langchain) | [Tool](../tools/tool.mdx) / [PipelineTool](../tools/pipelinetool.mdx) / [ComponentTool](../tools/componenttool.mdx) / [MCPTool](../tools/mcptool.mdx) | Haystack exposes Python functions, pipelines, components, external APIs and MCP servers as agent tools. |
|
||||
| Multi-Agent Collaboration (LangChain) | Multi-Agent System | Using [`ComponentTool`](../tools/componenttool.mdx), agents can use other agents as tools, enabling [multi-agent architectures](https://haystack.deepset.ai/tutorials/45_creating_a_multi_agent_system) within one framework. |
|
||||
| Model Context Protocol `load_mcp_tools` `MultiServerMCPClient` | Model Context Protocol - `MCPTool`, `MCPToolset`, `StdioServerInfo`, `StreamableHttpServerInfo` | Haystack provides [various MCP primitives](https://haystack.deepset.ai/integrations/mcp) for connecting multiple MCP servers and organizing MCP toolsets. |
|
||||
| Memory (State, short-term, long-term) | Memory (Agent State, short-term, long-term) | Agent [State](../pipeline-components/agents-1/state.mdx) provides a structured way to share data between tools and store intermediate results during agent execution. For short-term memory, Haystack offers a [ChatMessage Store](/reference/experimental-chatmessage-store-api) to persist chat history. More memory options are coming soon. |
|
||||
| Time travel (Checkpoints) | Breakpoints (Breakpoint, PipelineSnapshot) | [Breakpoints](../concepts/pipelines/pipeline-breakpoints.mdx) let you pause, inspect, modify, and resume a pipeline for debugging or iterative development. |
|
||||
| Human-in-the-Loop (Interrupts / Commands) | Human-in-the-loop (`ConfirmationHook` with confirmation strategies) | Haystack applies [confirmation strategies](https://haystack.deepset.ai/tutorials/47_human_in_the_loop_agent) through a `ConfirmationHook` registered under the Agent's `before_tool` [hook point](../pipeline-components/agents-1/hooks.mdx) to pause or block the execution to gather user feedback |
|
||||
|
||||
## Ecosystem and Tooling Mapping: LangChain → Haystack
|
||||
|
||||
At deepset, we're building the tools to make LLMs truly usable in production, open source and beyond.
|
||||
|
||||
* [Haystack, AI Orchestration Framework](https://github.com/deepset-ai/haystack) → Open Source AI framework for building production-ready, AI-powered agents and applications, on your own or with community support.
|
||||
* [Haystack Enterprise Starter](https://www.deepset.ai/products-and-services/haystack-enterprise) → Private and secure engineering support, advanced pipeline templates, deployment guides, and early access features for teams needing more support and guidance.
|
||||
* [Haystack Enterprise Platform](https://www.deepset.ai/products-and-services/deepset-ai-platform) → An enterprise-ready platform for teams running Gen AI apps in production, with security, governance, and scalability built in with [a free version](https://www.deepset.ai/deepset-studio).
|
||||
|
||||
Here's the product equivalent of two ecosystems:
|
||||
|
||||
| **LangChain Ecosystem** | **Haystack Ecosystem** | **Notes** |
|
||||
| --- | --- | --- |
|
||||
| **LangChain, LangGraph, Deep Agents** | **Haystack** | **Core AI orchestration framework for components, pipelines, and agents**. Supports deterministic workflows and agentic execution with explicit, modular building blocks. |
|
||||
| **LangSmith (Observability)** | **Haystack Enterprise Platform** | **Integrated tooling for building, debugging and iterating.** Assemble agents and pipelines visually with the **Builder**, which includes component validation, testing and debugging. The **Prompt Explorer** is used to iterate and evaluate models and prompts. Built-in chat interfaces to enable fast SME and stakeholder feedback. Collaborative building environment for engineers and business. |
|
||||
| **LangSmith (Deployment)** | **Hayhooks** **Haystack Enterprise Starter** (deployment guides + advanced best practice templates) **Haystack Enterprise Platform** (1-click deployment, on-prem/VPC options) | Multiple deployment paths: lightweight API exposure via [Hayhooks](https://github.com/deepset-ai/hayhooks), structured enterprise deployment patterns through Haystack Enterprise Starter, and full managed or self-hosted deployment through the Haystack Enterprise Platform. |
|
||||
|
||||
## Code Comparison
|
||||
|
||||
### Agentic Flows with Haystack vs LangGraph
|
||||
|
||||
Here's an example **graph-based agent** with access to a list of tools, comparing the LangGraph and Haystack APIs.
|
||||
|
||||
**Step 1: Define tools**
|
||||
|
||||
Both frameworks use a `@tool` decorator to expose Python functions as tools the LLM can call. The function signature and docstring define the tool's interface, which the LLM uses to understand when and how to invoke each tool.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`# pip install haystack-ai anthropic-haystack
|
||||
|
||||
from haystack.tools import tool
|
||||
|
||||
# Define tools
|
||||
@tool
|
||||
def multiply(a: int, b: int) -> int:
|
||||
"""Multiply \`a\` and \`b\`.
|
||||
|
||||
Args:
|
||||
a: First int
|
||||
b: Second int
|
||||
"""
|
||||
return a * b
|
||||
|
||||
@tool
|
||||
def add(a: int, b: int) -> int:
|
||||
"""Adds \`a\` and \`b\`.
|
||||
|
||||
Args:
|
||||
a: First int
|
||||
b: Second int
|
||||
"""
|
||||
return a + b
|
||||
|
||||
@tool
|
||||
def divide(a: int, b: int) -> float:
|
||||
"""Divide \`a\` and \`b\`.
|
||||
|
||||
Args:
|
||||
a: First int
|
||||
b: Second int
|
||||
"""
|
||||
return a / b`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`# pip install langchain-anthropic langgraph langchain
|
||||
|
||||
from langchain.tools import tool
|
||||
|
||||
# Define tools
|
||||
@tool
|
||||
def multiply(a: int, b: int) -> int:
|
||||
"""Multiply \`a\` and \`b\`.
|
||||
|
||||
Args:
|
||||
a: First int
|
||||
b: Second int
|
||||
"""
|
||||
return a * b
|
||||
|
||||
@tool
|
||||
def add(a: int, b: int) -> int:
|
||||
"""Adds \`a\` and \`b\`.
|
||||
|
||||
Args:
|
||||
a: First int
|
||||
b: Second int
|
||||
"""
|
||||
return a + b
|
||||
|
||||
@tool
|
||||
def divide(a: int, b: int) -> float:
|
||||
"""Divide \`a\` and \`b\`.
|
||||
|
||||
Args:
|
||||
a: First int
|
||||
b: Second int
|
||||
"""
|
||||
return a / b`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 2: Initialize the LLM with tools**
|
||||
|
||||
Both frameworks connect tools to the LLM, but with different APIs. In Haystack, tools are passed directly to the `ChatGenerator` component during initialization. In LangGraph, you first initialize the model, then bind tools using `.bind_tools()` to create a tool-enabled LLM instance.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`from haystack_integrations.components.generators.anthropic import AnthropicChatGenerator
|
||||
|
||||
# Augment the LLM with tools
|
||||
tools = [add, multiply, divide]
|
||||
model = AnthropicChatGenerator(
|
||||
model="claude-sonnet-4-5-20250929",
|
||||
generation_kwargs={"temperature": 0},
|
||||
tools=tools,
|
||||
)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`from langchain.chat_models import init_chat_model
|
||||
|
||||
# Augment the LLM with tools
|
||||
model = init_chat_model(
|
||||
"claude-sonnet-4-5-20250929",
|
||||
temperature=0,
|
||||
)
|
||||
tools = [add, multiply, divide]
|
||||
tools_by_name = {tool.name: tool for tool in tools}
|
||||
llm_with_tools = model.bind_tools(tools)`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 3: Set up message handling and LLM invocation**
|
||||
|
||||
This is where the frameworks diverge more significantly. In Haystack you'll use a custom component (`MessageCollector`) to accumulate conversation history across the agentic loop. LangGraph instead defines a node function (`llm_call`) that operates on `MessagesState` - a built-in state container that automatically manages message history.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`from typing import Any, Dict, List
|
||||
|
||||
from haystack import component
|
||||
from haystack.core.component.types import Variadic
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
# Components
|
||||
|
||||
# Custom component to temporarily store the messages
|
||||
@component()
|
||||
class MessageCollector:
|
||||
def __init__(self):
|
||||
self._messages = []
|
||||
|
||||
@component.output_types(messages=List[ChatMessage])
|
||||
def run(self, messages: Variadic[List[ChatMessage]]) -> Dict[str, Any]:
|
||||
self._messages.extend([msg for inner in messages for msg in inner])
|
||||
return {"messages": self._messages}
|
||||
|
||||
def clear(self):
|
||||
self._messages = []
|
||||
|
||||
message_collector = MessageCollector()`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`from langgraph.graph import MessagesState
|
||||
from langchain.messages import SystemMessage, ToolMessage
|
||||
from typing import Literal
|
||||
|
||||
# Nodes
|
||||
def llm_call(state: MessagesState):
|
||||
# LLM decides whether to call a tool or not
|
||||
|
||||
return {
|
||||
"messages": [
|
||||
llm_with_tools.invoke(
|
||||
[
|
||||
SystemMessage(
|
||||
content="You are a helpful assistant tasked with performing arithmetic on a set of inputs."
|
||||
)
|
||||
]
|
||||
+ state["messages"]
|
||||
)
|
||||
]
|
||||
}`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 4: Execute tool calls**
|
||||
|
||||
When the LLM decides to use a tool, it must be invoked and its result returned. Haystack provides a built-in `ToolInvoker` component that handles this automatically. LangGraph requires you to define a custom node function that iterates over tool calls, invokes each tool, and wraps the results in `ToolMessage` objects.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`from haystack.components.tools import ToolInvoker
|
||||
|
||||
# Tool invoker component to execute a tool call
|
||||
tool_invoker = ToolInvoker(tools=tools)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`def tool_node(state: dict):
|
||||
# Performs the tool call
|
||||
result = []
|
||||
for tool_call in state["messages"][-1].tool_calls:
|
||||
tool = tools_by_name[tool_call["name"]]
|
||||
observation = tool.invoke(tool_call["args"])
|
||||
result.append(ToolMessage(content=observation, tool_call_id=tool_call["id"]))
|
||||
return {"messages": result}`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 5: Implement conditional routing logic**
|
||||
|
||||
After the LLM responds, we need to decide whether to continue the loop (if tools were called) or finish (if the LLM provided a final answer). Haystack uses a `ConditionalRouter` component with declarative route conditions written in Jinja2 templates. LangGraph uses a conditional edge function (`should_continue`) that inspects the state and returns the next node or `END`.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`from haystack.components.routers import ConditionalRouter
|
||||
|
||||
# ConditionalRouter component to route to the tool invoker or end user based upon whether the LLM made a tool call
|
||||
routes = [
|
||||
{
|
||||
"condition": "{{replies[0].tool_calls | length > 0}}",
|
||||
"output": "{{replies}}",
|
||||
"output_name": "there_are_tool_calls",
|
||||
"output_type": List[ChatMessage],
|
||||
},
|
||||
{
|
||||
"condition": "{{replies[0].tool_calls | length == 0}}",
|
||||
"output": "{{replies}}",
|
||||
"output_name": "final_replies",
|
||||
"output_type": List[ChatMessage],
|
||||
},
|
||||
]
|
||||
router = ConditionalRouter(routes, unsafe=True)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`from langgraph.graph import END
|
||||
|
||||
# Conditional edge function to route to the tool node or end based upon whether the LLM made a tool call
|
||||
def should_continue(state: MessagesState) -> Literal["tool_node", END]:
|
||||
# Decide if we should continue the loop or stop based upon whether the LLM made a tool call
|
||||
|
||||
messages = state["messages"]
|
||||
last_message = messages[-1]
|
||||
|
||||
# If the LLM makes a tool call, then perform an action
|
||||
if last_message.tool_calls:
|
||||
return "tool_node"
|
||||
|
||||
# Otherwise, we stop (reply to the user)
|
||||
return END`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 6: Assemble the workflow**
|
||||
|
||||
This is where you wire together all the components or nodes. Haystack uses a `Pipeline` where you explicitly add components and connect their inputs and outputs, creating a directed graph with loops. LangGraph uses a `StateGraph` where you add nodes and edges, then compile the graph into an executable agent. Both approaches achieve the same agentic loop, but with different levels of explicitness.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`from haystack import Pipeline
|
||||
|
||||
# Build pipeline
|
||||
agent_pipe = Pipeline()
|
||||
|
||||
# Add components
|
||||
agent_pipe.add_component("message_collector", message_collector)
|
||||
agent_pipe.add_component("llm", model)
|
||||
agent_pipe.add_component("router", router)
|
||||
agent_pipe.add_component("tool_invoker", tool_invoker)
|
||||
|
||||
# Add connections
|
||||
agent_pipe.connect("message_collector", "llm.messages")
|
||||
agent_pipe.connect("llm.replies", "router")
|
||||
agent_pipe.connect("router.there_are_tool_calls", "tool_invoker") # If there are tool calls, send them to the ToolInvoker
|
||||
agent_pipe.connect("router.there_are_tool_calls", "message_collector")
|
||||
agent_pipe.connect("tool_invoker.tool_messages", "message_collector")`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`from langgraph.graph import StateGraph, START
|
||||
|
||||
# Build workflow
|
||||
agent_builder = StateGraph(MessagesState)
|
||||
|
||||
# Add nodes
|
||||
agent_builder.add_node("llm_call", llm_call)
|
||||
agent_builder.add_node("tool_node", tool_node)
|
||||
|
||||
# Add edges to connect nodes
|
||||
agent_builder.add_edge(START, "llm_call")
|
||||
agent_builder.add_conditional_edges(
|
||||
"llm_call",
|
||||
should_continue,
|
||||
["tool_node", END]
|
||||
)
|
||||
agent_builder.add_edge("tool_node", "llm_call")
|
||||
|
||||
# Compile the agent
|
||||
agent = agent_builder.compile()`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 7: Run the agent**
|
||||
|
||||
Finally, we execute the agent with a user message. Haystack calls `.run()` on the pipeline with initial messages, while LangGraph calls `.invoke()` on the compiled agent. Both return the conversation history.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`# Run the pipeline
|
||||
messages = [
|
||||
ChatMessage.from_system(text="You are a helpful assistant tasked with performing arithmetic on a set of inputs."),
|
||||
ChatMessage.from_user(text="Add 3 and 4.")
|
||||
]
|
||||
result = agent_pipe.run({"messages": messages})
|
||||
result`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`from langchain.messages import HumanMessage
|
||||
|
||||
# Invoke
|
||||
messages = [
|
||||
HumanMessage(content="Add 3 and 4.")
|
||||
]
|
||||
messages = agent.invoke({"messages": messages})
|
||||
for m in messages["messages"]:
|
||||
m.pretty_print()`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
### Creating Agents
|
||||
|
||||
The [Agentic Flows](#agentic-flows-with-haystack-vs-langgraph) walkthrough above showed how to assemble an agent loop manually from pipeline primitives. Haystack also provides a high-level `Agent` class that wraps the full loop - LLM calls, tool invocation, and iteration - into a single component. LangGraph offers an equivalent shortcut through `create_react_agent` in `langgraph.prebuilt`. Both produce a ReAct-style agent that handles tool calling and multi-step reasoning automatically.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`# pip install haystack-ai anthropic-haystack
|
||||
|
||||
from haystack.components.agents import Agent
|
||||
from haystack_integrations.components.generators.anthropic import AnthropicChatGenerator
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack.tools import tool
|
||||
|
||||
@tool
|
||||
def multiply(a: int, b: int) -> int:
|
||||
"""Multiply \`a\` and \`b\`."""
|
||||
return a * b
|
||||
|
||||
@tool
|
||||
def add(a: int, b: int) -> int:
|
||||
"""Add \`a\` and \`b\`."""
|
||||
return a + b
|
||||
|
||||
# Create an agent - the agentic loop is handled automatically
|
||||
agent = Agent(
|
||||
chat_generator=AnthropicChatGenerator(
|
||||
model="claude-sonnet-4-5-20250929",
|
||||
generation_kwargs={"temperature": 0},
|
||||
),
|
||||
tools=[multiply, add],
|
||||
system_prompt="You are a helpful assistant that performs arithmetic.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[
|
||||
ChatMessage.from_user("What is 3 multiplied by 7, then add 5?")
|
||||
])
|
||||
print(result["messages"][-1].text) # or print(result["last_message"].text)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`# pip install langchain-anthropic langgraph
|
||||
|
||||
from langchain_anthropic import ChatAnthropic
|
||||
from langchain_core.tools import tool
|
||||
from langchain.agents import create_agent
|
||||
from langchain_core.messages import HumanMessage, SystemMessage
|
||||
|
||||
@tool
|
||||
def multiply(a: int, b: int) -> int:
|
||||
"""Multiply \`a\` and \`b\`."""
|
||||
return a * b
|
||||
|
||||
@tool
|
||||
def add(a: int, b: int) -> int:
|
||||
"""Add \`a\` and \`b\`."""
|
||||
return a + b
|
||||
|
||||
# Create an agent - the agentic loop is handled automatically
|
||||
model = ChatAnthropic(
|
||||
model="claude-sonnet-4-5-20250929",
|
||||
temperature=0,
|
||||
)
|
||||
agent = create_agent(
|
||||
model,
|
||||
tools=[multiply, add],
|
||||
system_prompt=SystemMessage(
|
||||
content="You are a helpful assistant that performs arithmetic."
|
||||
),
|
||||
)
|
||||
|
||||
result = agent.invoke({
|
||||
"messages": [HumanMessage(content="What is 3 multiplied by 7, then add 5?")]
|
||||
})
|
||||
print(result["messages"][-1].content)`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
### Connecting to Document Stores
|
||||
|
||||
Document stores are the foundation of retrieval-augmented generation (RAG). In Haystack, document stores integrate natively with pipeline components like Retrievers and Prompt Builders via explicit typed connections. LangChain centers retrieval around its vector store abstraction composed using LCEL (LangChain Expression Language).
|
||||
|
||||
Both frameworks offer in-memory stores for prototyping and a wide range of production backends (Elasticsearch, Qdrant, Weaviate, Pinecone, and more) via integrations.
|
||||
|
||||
**Step 1: Create a document store and add documents**
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`# pip install haystack-ai sentence-transformers-haystack
|
||||
|
||||
from haystack import Document
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack_integrations.components.embedders.sentence_transformers import SentenceTransformersDocumentEmbedder
|
||||
|
||||
# Embed and write documents to the document store
|
||||
document_store = InMemoryDocumentStore()
|
||||
|
||||
doc_embedder = SentenceTransformersDocumentEmbedder(
|
||||
model="sentence-transformers/all-MiniLM-L6-v2"
|
||||
)
|
||||
|
||||
docs = [
|
||||
Document(content="Paris is the capital of France."),
|
||||
Document(content="Berlin is the capital of Germany."),
|
||||
Document(content="Tokyo is the capital of Japan."),
|
||||
]
|
||||
docs_with_embeddings = doc_embedder.run(docs)["documents"]
|
||||
document_store.write_documents(docs_with_embeddings)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangChain">{`# pip install langchain-community langchain-huggingface sentence-transformers
|
||||
|
||||
from langchain_huggingface import HuggingFaceEmbeddings
|
||||
from langchain_community.vectorstores import InMemoryVectorStore
|
||||
from langchain_core.documents import Document
|
||||
|
||||
# Embed and add documents to the vector store
|
||||
embeddings = HuggingFaceEmbeddings(
|
||||
model_name="sentence-transformers/all-MiniLM-L6-v2"
|
||||
)
|
||||
vectorstore = InMemoryVectorStore(embedding=embeddings)
|
||||
vectorstore.add_documents([
|
||||
Document(page_content="Paris is the capital of France."),
|
||||
Document(page_content="Berlin is the capital of Germany."),
|
||||
Document(page_content="Tokyo is the capital of Japan."),
|
||||
])`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
**Step 2: Build a RAG pipeline**
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`from haystack import Pipeline
|
||||
from haystack_integrations.components.embedders.sentence_transformers import SentenceTransformersTextEmbedder
|
||||
from haystack.components.retrievers.in_memory import InMemoryEmbeddingRetriever
|
||||
from haystack.components.builders import ChatPromptBuilder
|
||||
from haystack.dataclasses import ChatMessage
|
||||
from haystack_integrations.components.generators.anthropic import AnthropicChatGenerator
|
||||
|
||||
# ChatPromptBuilder expects a List[ChatMessage] as template
|
||||
template = [ChatMessage.from_user("""
|
||||
Given the following documents, answer the question.
|
||||
{% for doc in documents %}{{ doc.content }}{% endfor %}
|
||||
Question: {{ question }}
|
||||
""")]
|
||||
|
||||
rag_pipeline = Pipeline()
|
||||
rag_pipeline.add_component(
|
||||
"text_embedder",
|
||||
SentenceTransformersTextEmbedder(model="sentence-transformers/all-MiniLM-L6-v2")
|
||||
)
|
||||
rag_pipeline.add_component(
|
||||
"retriever", InMemoryEmbeddingRetriever(document_store=document_store)
|
||||
)
|
||||
rag_pipeline.add_component(
|
||||
"prompt_builder", ChatPromptBuilder(template=template)
|
||||
)
|
||||
rag_pipeline.add_component(
|
||||
"llm", AnthropicChatGenerator(model="claude-sonnet-4-5-20250929")
|
||||
)
|
||||
|
||||
rag_pipeline.connect("text_embedder.embedding", "retriever.query_embedding")
|
||||
rag_pipeline.connect("retriever.documents", "prompt_builder.documents")
|
||||
rag_pipeline.connect("prompt_builder.prompt", "llm.messages")
|
||||
|
||||
result = rag_pipeline.run({
|
||||
"text_embedder": {"text": "What is the capital of France?"},
|
||||
"prompt_builder": {"question": "What is the capital of France?"},
|
||||
})
|
||||
print(result["llm"]["replies"][0].text)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangChain">{`from langchain_anthropic import ChatAnthropic
|
||||
from langchain_core.prompts import ChatPromptTemplate
|
||||
from langchain_core.output_parsers import StrOutputParser
|
||||
from langchain_core.runnables import RunnablePassthrough
|
||||
|
||||
def format_docs(docs):
|
||||
return "\\n".join(doc.page_content for doc in docs)
|
||||
|
||||
retriever = vectorstore.as_retriever()
|
||||
model = ChatAnthropic(model="claude-sonnet-4-5-20250929")
|
||||
|
||||
template = """
|
||||
Given the following documents, answer the question.
|
||||
{context}
|
||||
Question: {question}
|
||||
"""
|
||||
prompt = ChatPromptTemplate.from_template(template)
|
||||
|
||||
rag_chain = (
|
||||
{"context": retriever | format_docs, "question": RunnablePassthrough()}
|
||||
| prompt
|
||||
| model
|
||||
| StrOutputParser()
|
||||
)
|
||||
|
||||
result = rag_chain.invoke("What is the capital of France?")
|
||||
print(result)`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
### Using MCP Tools
|
||||
|
||||
Both frameworks support the [Model Context Protocol (MCP)](https://modelcontextprotocol.io), letting agents connect to external tools and services exposed by MCP servers. Haystack provides [`MCPTool`](https://docs.haystack.deepset.ai/docs/mcptool) and [`MCPToolset`](https://docs.haystack.deepset.ai/docs/mcptoolset) through the `mcp-haystack` integration package, which plug directly into the `Agent` component. LangChain's MCP support relies on the separate `langchain-mcp-adapters` package and requires an async workflow throughout.
|
||||
|
||||
<div className="code-comparison">
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="Haystack">{`# pip install haystack-ai mcp-haystack anthropic-haystack
|
||||
|
||||
from haystack_integrations.tools.mcp import MCPToolset, StdioServerInfo
|
||||
from haystack.components.agents import Agent
|
||||
from haystack_integrations.components.generators.anthropic import AnthropicChatGenerator
|
||||
from haystack.dataclasses import ChatMessage
|
||||
|
||||
# Connect to an MCP server - tools are auto-discovered
|
||||
toolset = MCPToolset(
|
||||
server_info=StdioServerInfo(
|
||||
command="uvx",
|
||||
args=["mcp-server-fetch"],
|
||||
)
|
||||
)
|
||||
|
||||
agent = Agent(
|
||||
chat_generator=AnthropicChatGenerator(model="claude-sonnet-4-5-20250929"),
|
||||
tools=toolset,
|
||||
system_prompt="You are a helpful assistant that can fetch web content.",
|
||||
)
|
||||
|
||||
result = agent.run(messages=[
|
||||
ChatMessage.from_user("Fetch the content from https://haystack.deepset.ai")
|
||||
])
|
||||
print(result["messages"][-1].text) # or print(result["last_message"].text)`}</CodeBlock>
|
||||
</div>
|
||||
<div className="code-comparison__column">
|
||||
<CodeBlock language="python" title="LangGraph + LangChain">{`# pip install langchain-mcp-adapters langgraph langchain-anthropic
|
||||
|
||||
import asyncio
|
||||
from langchain_mcp_adapters.client import MultiServerMCPClient
|
||||
from langchain.agents import create_agent
|
||||
from langchain_anthropic import ChatAnthropic
|
||||
from langchain_core.messages import HumanMessage, SystemMessage
|
||||
|
||||
model = ChatAnthropic(model="claude-sonnet-4-5-20250929")
|
||||
|
||||
async def run():
|
||||
client = MultiServerMCPClient(
|
||||
{
|
||||
"fetch": {
|
||||
"command": "uvx",
|
||||
"args": ["mcp-server-fetch"],
|
||||
"transport": "stdio",
|
||||
}
|
||||
}
|
||||
)
|
||||
tools = await client.get_tools()
|
||||
agent = create_agent(
|
||||
model,
|
||||
tools,
|
||||
system_prompt=SystemMessage(
|
||||
content="You are a helpful assistant that can fetch web content."
|
||||
),
|
||||
)
|
||||
result = await agent.ainvoke(
|
||||
{
|
||||
"messages": [
|
||||
HumanMessage(content="Fetch the content from https://haystack.deepset.ai")
|
||||
]
|
||||
}
|
||||
)
|
||||
print(result["messages"][-1].content)
|
||||
|
||||
|
||||
asyncio.run(run())`}</CodeBlock>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
## Hear from Haystack Users
|
||||
|
||||
See how teams across industries use Haystack to power their production AI systems, from RAG applications to agentic workflows.
|
||||
|
||||
> "_Haystack allows its users a production ready, easy to use framework that covers just about all of your needs, and allows you to write integrations easily for those it doesn't._"
|
||||
> **- Josh Longenecker, GenAI Specialist at AWS**
|
||||
>
|
||||
> _"Haystack's design philosophy significantly accelerates development and improves the robustness of AI applications, especially when heading towards production. The emphasis on explicit, modular components truly pays off in the long run."_
|
||||
> **- Rima Hajou, Data & AI Technical Lead at Accenture**
|
||||
|
||||
### Featured Stories
|
||||
|
||||
* [TELUS Agriculture & Consumer Goods Built an Agentic Chatbot with Haystack to Transform Trade Promotions Workflows](https://haystack.deepset.ai/blog/telus-user-story)
|
||||
* [Lufthansa Industry Solutions Uses Haystack to Power Enterprise RAG](https://haystack.deepset.ai/blog/lufthansa-user-story)
|
||||
|
||||
## Start Building with Haystack
|
||||
|
||||
**👉 Thinking about migrating or evaluating Haystack?** Jump right in with the [Haystack Get Started guide](https://haystack.deepset.ai/overview/quick-start) or [contact our team](https://www.deepset.ai/products-and-services/haystack-enterprise-starter), we'd love to support you.
|
||||
@@ -0,0 +1,508 @@
|
||||
---
|
||||
title: "Migration Guide"
|
||||
id: migration
|
||||
slug: "/migration"
|
||||
description: "Learn how to make the move to Haystack 2.x from Haystack 1.x."
|
||||
---
|
||||
|
||||
# Migration Guide
|
||||
|
||||
Learn how to make the move to Haystack 2.x from Haystack 1.x.
|
||||
|
||||
This guide is designed for those with previous experience with Haystack and who are interested in understanding the differences between Haystack 1.x and Haystack 2.x. If you're new to Haystack, skip this page and proceed directly to Haystack 2.x [documentation](get-started.mdx).
|
||||
|
||||
## Major Changes
|
||||
|
||||
Haystack 2.x represents a significant overhaul of Haystack 1.x, and it's important to note that certain key concepts outlined in this section don't have a direct correlation between the two versions.
|
||||
|
||||
### Package Name
|
||||
|
||||
Haystack 1.x was distributed with a package called `farm-haystack`. To migrate your application, you must uninstall `farm-haystack` and install the new `haystack-ai` package for Haystack 2.x.
|
||||
|
||||
:::warning
|
||||
Two versions of the project cannot coexist in the same Python environment.
|
||||
|
||||
One of the options is to remove both packages if they are installed in the same environment, followed by installing only one of them:
|
||||
|
||||
```bash
|
||||
pip uninstall -y farm-haystack haystack-ai
|
||||
pip install haystack-ai
|
||||
```
|
||||
:::
|
||||
|
||||
### Nodes
|
||||
|
||||
While Haystack 2.x continues to rely on the `Pipeline` abstraction, the elements linked in a pipeline graph are now referred to as just _components_, replacing the terms _nodes_ and _pipeline components_ used in the previous versions. The [_Migrating Components_](#migrating-components) paragraph below outlines which component in Haystack 2.x can be used as a replacement for a specific 1.x node.
|
||||
|
||||
### Pipelines
|
||||
|
||||
Pipelines continue to serve as the fundamental structure of all Haystack applications. While the concept of `Pipeline` abstraction remains consistent, Haystack 2.x introduces significant enhancements that address various limitations of its predecessor. For instance, the pipelines now support loops. Pipelines also offer greater flexibility in their input, which is no longer restricted to queries. The pipeline now allows to route the output of a component to multiple recipients. This increases flexibility, however, comes with notable differences in the pipeline definition process in Haystack 2.x compared to the previous version.
|
||||
|
||||
In Haystack 1.x, a pipeline was built by adding one node after the other. In the resulting pipeline graph, edges are automatically added to connect those nodes in the order they were added.
|
||||
|
||||
Building a pipeline in Haystack 2.x is a two-step process:
|
||||
|
||||
1. Initially, components are added to the pipeline without any specific order by calling the `add_component` method.
|
||||
2. Subsequently, the components must be explicitly connected by calling the `connect` method to define the final graph.
|
||||
|
||||
To migrate an existing pipeline, the first step is to go through the nodes and identify their counterparts in Haystack 2.x (see the following section, [_Migrating Components_](#migrating-components), for guidance). If all the nodes can be replaced by corresponding components, they have to be added to the pipeline with `add_component` and explicitly connected with the appropriate calls to `connect`. Here is an example:
|
||||
|
||||
**Haystack 1.x**
|
||||
|
||||
```python
|
||||
pipeline = Pipeline()
|
||||
|
||||
node_1 = SomeNode()
|
||||
node_2 = AnotherNode()
|
||||
|
||||
pipeline.add_node(node_1, name="Node_1", inputs=["Query"])
|
||||
pipeline.add_node(node_2, name="Node_2", inputs=["Node_1"])
|
||||
```
|
||||
|
||||
**Haystack 2.x**
|
||||
|
||||
```python
|
||||
pipeline = Pipeline()
|
||||
|
||||
component_1 = SomeComponent()
|
||||
component_2 = AnotherComponent()
|
||||
|
||||
pipeline.add_component("Comp_1", component_1)
|
||||
pipeline.add_component("Comp_2", component_2)
|
||||
|
||||
pipeline.connect("Comp_1", "Comp_2")
|
||||
```
|
||||
|
||||
In case a specific replacement component is not available for one of your nodes, migrating the pipeline might still be possible by:
|
||||
|
||||
- Either [creating a custom component](../concepts/components/custom-components.mdx), or
|
||||
- Changing the pipeline logic, as the last resort.
|
||||
|
||||
:::info
|
||||
Check out the [Pipelines](../concepts/pipelines.mdx) section of our 2.x documentation to understand how new pipelines work more granularly.
|
||||
:::
|
||||
|
||||
### Document Stores
|
||||
|
||||
The fundamental concept of Document Stores as gateways to access text and metadata stored in a database didn’t change in Haystack 2.x, but there are significant differences against Haystack 1.x.
|
||||
|
||||
In Haystack 1.x, Document Stores were a special type of node that you can use in two ways:
|
||||
|
||||
- As the last node in an indexing pipeline (such as a pipeline whose ultimate goal is storing data in a database).
|
||||
- As a normal Python instance passed to a Retriever node.
|
||||
|
||||
In Haystack 2.x, the Document Store is not a component, so to migrate the two use cases above to version 2.x, you can respectively:
|
||||
|
||||
- Replace the Document Store at the end of the pipeline with a [`DocumentWriter`](../pipeline-components/writers/documentwriter.mdx) component.
|
||||
- Identify the right Retriever component and create it passing the Document Store instance, same as it is in Haystack 1.x.
|
||||
|
||||
### Retrievers
|
||||
|
||||
Haystack 1.x provided a set of nodes that filter relevant documents from different data sources according to a given query. Each of those nodes implements a certain retrieval algorithm and supports one or more types of Document Stores. For example, the `BM25Retriever` node in Haystack 1.x can work seamlessly with OpenSearch and Elasticsearch but not with Qdrant; the `EmbeddingRetriever`, on the contrary, can work with all the three databases.
|
||||
|
||||
In Haystack 2.x, the concept is flipped, and each Document Store provides one or more retriever components, depending on which retrieval methods the underlying vector database supports. For example, the `OpenSearchDocumentStore` comes with [two Retriever components](../document-stores/opensearch-document-store.mdx#supported-retrievers), one relying on BM25, and the other on vector similarity.
|
||||
|
||||
To migrate a 1.x retrieval pipeline to 2.x, the first step is to identify the Document Store being used and replace the Retriever node with the corresponding Retriever component from Haystack 2.x with the Document Store of choice. For example, a `BM25Retriever` node using Elasticsearch in a Haystack 1.x pipeline should be replaced with the [`ElasticsearchBM25Retriever`](../pipeline-components/retrievers/elasticsearchbm25retriever.mdx) component.
|
||||
|
||||
### PromptNode
|
||||
|
||||
The `PromptNode` in Haystack 1.x represented the gateway to any Large Language Model (LLM) inference provider, whether it is locally available or remote. Based on the name of the model, Haystack infers the right provider to call and forward the query.
|
||||
|
||||
In Haystack 2.x, the task of using LLMs is assigned to [Generators](../pipeline-components/generators.mdx). These are a set of components that are highly specialized and tailored for each inference provider.
|
||||
|
||||
The first step when migrating a pipeline with a `PromptNode` is to identify the model provider used and to replace the node with two components:
|
||||
|
||||
- A Generator component for the model provider of choice,
|
||||
- A `PromptBuilder` or `ChatPromptBuilder` component to build the prompt to be used.
|
||||
|
||||
The [_Migration examples_](#migration-examples) section below shows how to port a `PromptNode` using OpenAI with a prompt template to a corresponding Haystack 2.x pipeline using the `OpenAIGenerator` in conjunction with a `PromptBuilder` component.
|
||||
|
||||
### Agents
|
||||
|
||||
The agentic approach facilitates the answering of questions that are significantly more complex than those typically addressed by extractive or generative question answering techniques.
|
||||
|
||||
Haystack 1.x provided Agents, enabling the use of LLMs in a loop.
|
||||
|
||||
Currently in Haystack 2.x, you can build Agents using three main elements in a pipeline: Chat Generators, ToolInvoker component, and Tools. A standalone Agent abstraction in Haystack 2.x is in an experimental phase.
|
||||
|
||||
:::note[Agents Documentation Page]
|
||||
|
||||
Take a look at our 2.x [Agents](../concepts/agents.mdx) documentation page for more information and detailed examples.
|
||||
:::
|
||||
|
||||
### REST API
|
||||
|
||||
Haystack 1.x enabled the deployment of pipelines through a RESTful API over HTTP. This feature is facilitated by a separate application named `rest_api` which is exclusively accessible in the form of a [source code on GitHub](https://github.com/deepset-ai/haystack/tree/v1.x/rest_api).
|
||||
|
||||
Haystack 2.x takes the same RESTful approach, but in this case, the application to be used to deploy pipelines is called [Hayhooks](../development/hayhooks.mdx) and can be installed with `pip install hayhooks`.
|
||||
|
||||
At the moment, porting an existing Haystack 1.x deployment using the `rest_api` project to Hayhooks would require a complete rewrite of the application.
|
||||
|
||||
## Dependencies
|
||||
|
||||
In order to minimize runtime errors, Haystack 1.x was distributed in a package that’s quite large, as it tries to set up the Python environment with as many dependencies as possible.
|
||||
|
||||
In contrast, Haystack 2.x strives for a more streamlined approach, offering a minimal set of dependencies right out of the box. It features a system that issues a warning when an additional dependency is required, thereby providing the user with the necessary instructions.
|
||||
|
||||
To make sure all the dependencies are satisfied when migrating a Haystack 1.x application to version 2.x, a good strategy is to run end-to-end tests and cover all the execution paths to ensure all the required dependencies are available in the target Python environment.
|
||||
|
||||
## Migrating Components
|
||||
|
||||
This table outlines which component (or a group of components) can be used to replace a certain node when porting a Haystack 1.x pipeline to the latest 2.x version. It’s important to note that when a Haystack 2.x replacement is not available, this doesn’t necessarily mean we are planning this feature.
|
||||
|
||||
If you need help migrating a 1.x node without a 2.x counterpart, open an [issue](https://github.com/deepset-ai/haystack/issues) in Haystack GitHub repository.
|
||||
|
||||
### Data Handling
|
||||
|
||||
| Haystack 1.x | Description | Haystack 2.x |
|
||||
| --- | --- | --- |
|
||||
| Crawler | Scrapes text from websites. **Example usage:** To run searches on your website content. | Not Available |
|
||||
| DocumentClassifier | Classifies documents by attaching metadata to them. **Example usage:** Labeling documents by their characteristic (for example, sentiment). | [TransformersZeroShotDocumentClassifier](../pipeline-components/classifiers/transformerszeroshotdocumentclassifier.mdx) |
|
||||
| DocumentLanguageClassifier | Detects the language of the documents you pass to it and adds it to the document metadata. | [DocumentLanguageClassifier](../pipeline-components/classifiers/documentlanguageclassifier.mdx) |
|
||||
| EntityExtractor | Extracts predefined entities out of a piece of text. **Example usage:** Named entity extraction (NER). | [NamedEntityExtractor](../pipeline-components/extractors/transformersnamedentityextractor.mdx) |
|
||||
| FileClassifier | Distinguishes between text, PDF, Markdown, Docx, and HTML files. **Example usage:** Routing files to appropriate converters (for example, it routes PDF files to `PDFToTextConverter`). | [FileTypeRouter](../pipeline-components/routers/filetyperouter.mdx) |
|
||||
| FileConverter | Cleans and splits documents in different formats. **Example usage:** In indexing pipelines, extracting text from a file and casting it into the Document class format. | [Converters](../pipeline-components/converters.mdx) |
|
||||
| PreProcessor | Cleans and splits documents. **Example usage:** Normalizing white spaces, getting rid of headers and footers, splitting documents into smaller ones. | [PreProcessors](../pipeline-components/preprocessors.mdx) |
|
||||
|
||||
### Semantic Search
|
||||
|
||||
| Haystack 1.x | Description | Haystack 2.x |
|
||||
| --- | --- | --- |
|
||||
| Ranker | Orders documents based on how relevant they are to the query. **Example usage:** In a query pipeline, after a keyword-based Retriever to rank the documents it returns. | [Rankers](../pipeline-components/rankers.mdx) |
|
||||
| Reader | Finds an answer by selecting a text span in documents. **Example usage:** In a query pipeline when you want to know the location of the answer. | [TransformersExtractiveReader](../pipeline-components/readers/transformersextractivereader.mdx) |
|
||||
| Retriever | Fetches relevant documents from the Document Store. **Example usage:** Coupling Retriever with a Reader in a query pipeline to speed up the search (the Reader only goes through the documents it gets from the Retriever). | [Retrievers](../pipeline-components/retrievers.mdx) |
|
||||
| QuestionGenerator | When given a document, it generates questions this document can answer. **Example usage:** Auto-suggested questions in your search app. | Prompt [Builders](../pipeline-components/builders.mdx) with dedicated prompt, [Generators](../pipeline-components/generators.mdx) |
|
||||
|
||||
### Prompts and LLMs
|
||||
|
||||
| Haystack 1.x | Description | Haystack 2.x |
|
||||
| --- | --- | --- |
|
||||
| PromptNode | Uses large language models to perform various NLP tasks in a pipeline or on its own. **Example usage:** It's a very versatile component that can perform tasks like summarization, question answering, translation, and more. | Prompt [Builders](../pipeline-components/builders.mdx),[Generators](../pipeline-components/generators.mdx) |
|
||||
|
||||
### Routing
|
||||
|
||||
| Haystack 1.x | Description | Haystack 2.x |
|
||||
| --- | --- | --- |
|
||||
| QueryClassifier | Categorizes queries. **Example usage:** Distinguishing between keyword queries and natural language questions and routing them to the Retrievers that can handle them best. | [TransformersZeroShotTextRouter](../pipeline-components/routers/transformerszeroshottextrouter.mdx) <br />[TransformersTextRouter](../pipeline-components/routers/transformerstextrouter.mdx) |
|
||||
| RouteDocuments | Routes documents to different branches of your pipeline based on their content type or metadata field. **Example usage:** Routing table data to `TableReader` and text data to `TransfomersReader` for better handling. | [Routers](../pipeline-components/routers.mdx) |
|
||||
|
||||
### Utility Components
|
||||
|
||||
| Haystack 1.x | Description | Haystack 2.x |
|
||||
| --- | --- | --- |
|
||||
| DocumentMerger | Concatenates multiple documents into a single one. **Example usage: **Merge the documents to summarize in a summarization pipeline. | Prompt [Builders](../pipeline-components/builders.mdx) |
|
||||
| Docs2Answers | Converts Documents into Answers. **Example usage:** When using REST API for document retrieval. REST API expects Answer as output, you can use `Doc2Answer` as the last node to convert the retrieved documents to answers. | [AnswerBuilder](../pipeline-components/builders/answerbuilder.mdx) |
|
||||
| JoinAnswers | Takes answers returned by multiple components and joins them in a single list of answers. **Example usage:** For running queries on different document types (for example, tables and text), where the documents are routed to different readers, and each reader returns a separate list of answers. | [AnswerJoiner](../pipeline-components/joiners/answerjoiner.mdx) |
|
||||
| JoinDocuments | Takes documents returned by different components and joins them to form one list of documents. **Example usage:** In document retrieval pipelines, where there are different types of documents, each routed to a different Retriever. Each Retriever returns a separate list of documents, and you can join them into one list using `JoinDocuments`. | [DocumentJoiner](../pipeline-components/joiners/documentjoiner.mdx) |
|
||||
| Shaper | Currently functions mostly as `PromptNode` helper making sure the `PromptNode` input or output is correct. **Example usage:** In a question answering pipeline using `PromptNode`, where the `PromptTemplate` expects questions as input, while Haystack pipelines use query. You can use Shaper to rename queries to questions. | Prompt [Builders](../pipeline-components/builders.mdx) |
|
||||
| Summarizer | Creates an overview of a document. **Example usage:** To get a glimpse of the documents the Retriever is returning. | Prompt [Builders](../pipeline-components/builders.mdx) with dedicated prompt, [Generators](../pipeline-components/generators.mdx) |
|
||||
| TransformersImageToText | Generates captions for images. **Example usage:** Automatically generate captions for a list of images that you can later use in your knowledge base. | [VertexAIImageQA](../pipeline-components/generators/vertexaiimageqa.mdx) |
|
||||
| Translator | Translates text from one language into another. **Example usage:** Running searches on documents in other languages. | Prompt [Builders](../pipeline-components/builders.mdx) with dedicated prompt, [Generators](../pipeline-components/generators.mdx) |
|
||||
|
||||
### Extras
|
||||
|
||||
| Haystack 1.x | Description | Haystack 2.x |
|
||||
| --- | --- | --- |
|
||||
| AnswerToSpeech | Converts text answers into speech answers. **Example usage:** Improving accessibility of your search system by providing a way to have the answer and its context read out loud. | [ElevenLabs](https://haystack.deepset.ai/integrations/elevenlabs) Integration |
|
||||
| DocumentToSpeech | Converts text documents to speech documents. **Example usage:** Improving accessibility of a document retrieval pipeline by providing the option to read documents out loud. | [ElevenLabs](https://haystack.deepset.ai/integrations/elevenlabs) Integration |
|
||||
|
||||
## Migration examples
|
||||
|
||||
:::info
|
||||
This section might grow as we assist users with their use cases.
|
||||
:::
|
||||
|
||||
### Indexing Pipeline
|
||||
|
||||
<details>
|
||||
|
||||
<summary>Haystack 1.x</summary>
|
||||
|
||||
```python
|
||||
from haystack.document_stores import InMemoryDocumentStore
|
||||
from haystack.nodes.file_classifier import FileTypeClassifier
|
||||
from haystack.nodes.file_converter import TextConverter
|
||||
from haystack.nodes.preprocessor import PreProcessor
|
||||
from haystack.pipelines import Pipeline
|
||||
|
||||
# Initialize a DocumentStore
|
||||
document_store = InMemoryDocumentStore()
|
||||
|
||||
# Indexing Pipeline
|
||||
indexing_pipeline = Pipeline()
|
||||
|
||||
# Makes sure the file is a TXT file (FileTypeClassifier node)
|
||||
classifier = FileTypeClassifier()
|
||||
indexing_pipeline.add_node(classifier, name="Classifier", inputs=["File"])
|
||||
|
||||
# Converts a file into text and performs basic cleaning (TextConverter node)
|
||||
text_converter = TextConverter(remove_numeric_tables=True)
|
||||
indexing_pipeline.add_node(
|
||||
text_converter,
|
||||
name="Text_converter",
|
||||
inputs=["Classifier.output_1"],
|
||||
)
|
||||
|
||||
# Pre-processes the text by performing splits and adding metadata to the text (Preprocessor node)
|
||||
preprocessor = PreProcessor(
|
||||
clean_whitespace=True,
|
||||
clean_empty_lines=True,
|
||||
split_length=100,
|
||||
split_overlap=50,
|
||||
split_respect_sentence_boundary=True,
|
||||
)
|
||||
indexing_pipeline.add_node(preprocessor, name="Preprocessor", inputs=["Text_converter"])
|
||||
|
||||
# - Writes the resulting documents into the document store
|
||||
indexing_pipeline.add_node(
|
||||
document_store,
|
||||
name="Document_Store",
|
||||
inputs=["Preprocessor"],
|
||||
)
|
||||
|
||||
# Then we run it with the documents and their metadata as input
|
||||
result = indexing_pipeline.run(file_paths=file_paths, meta=files_metadata)
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
<details>
|
||||
|
||||
<summary>Haystack 2.x</summary>
|
||||
|
||||
```python
|
||||
from haystack import Pipeline
|
||||
from haystack.components.routers import FileTypeRouter
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.converters import TextFileToDocument
|
||||
from haystack.components.preprocessors import DocumentCleaner, DocumentSplitter
|
||||
from haystack.components.writers import DocumentWriter
|
||||
|
||||
# Initialize a DocumentStore
|
||||
document_store = InMemoryDocumentStore()
|
||||
|
||||
# Indexing Pipeline
|
||||
indexing_pipeline = Pipeline()
|
||||
|
||||
# Makes sure the file is a TXT file (FileTypeRouter component)
|
||||
classifier = FileTypeRouter(mime_types=["text/plain"])
|
||||
indexing_pipeline.add_component("file_type_router", classifier)
|
||||
|
||||
# Converts a file into a Document (TextFileToDocument component)
|
||||
text_converter = TextFileToDocument()
|
||||
indexing_pipeline.add_component("text_converter", text_converter)
|
||||
|
||||
# Performs basic cleaning (DocumentCleaner component)
|
||||
cleaner = DocumentCleaner(
|
||||
remove_empty_lines=True,
|
||||
remove_extra_whitespaces=True,
|
||||
)
|
||||
indexing_pipeline.add_component("cleaner", cleaner)
|
||||
|
||||
# Pre-processes the text by performing splits and adding metadata to the text (DocumentSplitter component)
|
||||
preprocessor = DocumentSplitter(split_by="passage", split_length=100, split_overlap=50)
|
||||
indexing_pipeline.add_component("preprocessor", preprocessor)
|
||||
|
||||
# - Writes the resulting documents into the document store
|
||||
indexing_pipeline.add_component("writer", DocumentWriter(document_store))
|
||||
|
||||
# Connect all the components
|
||||
indexing_pipeline.connect("file_type_router.text/plain", "text_converter")
|
||||
indexing_pipeline.connect("text_converter", "cleaner")
|
||||
indexing_pipeline.connect("cleaner", "preprocessor")
|
||||
indexing_pipeline.connect("preprocessor", "writer")
|
||||
|
||||
# Then we run it with the documents and their metadata as input
|
||||
result = indexing_pipeline.run({"file_type_router": {"sources": file_paths}})
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
### Query Pipeline
|
||||
|
||||
<details>
|
||||
|
||||
<summary>Haystack 1.x</summary>
|
||||
|
||||
```python
|
||||
from haystack.document_stores import InMemoryDocumentStore
|
||||
from haystack.pipelines import ExtractiveQAPipeline
|
||||
from haystack import Document
|
||||
from haystack.nodes import BM25Retriever
|
||||
from haystack.nodes import FARMReader
|
||||
|
||||
document_store = InMemoryDocumentStore(use_bm25=True)
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="Paris is the capital of France."),
|
||||
Document(content="Berlin is the capital of Germany."),
|
||||
Document(content="Rome is the capital of Italy."),
|
||||
Document(content="Madrid is the capital of Spain."),
|
||||
],
|
||||
)
|
||||
|
||||
retriever = BM25Retriever(document_store=document_store)
|
||||
reader = FARMReader(model_name_or_path="deepset/roberta-base-squad2")
|
||||
extractive_qa_pipeline = ExtractiveQAPipeline(reader, retriever)
|
||||
|
||||
query = "What is the capital of France?"
|
||||
result = extractive_qa_pipeline.run(
|
||||
query=query,
|
||||
params={"Retriever": {"top_k": 10}, "Reader": {"top_k": 5}},
|
||||
)
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
<details>
|
||||
|
||||
<summary>Haystack 2.x</summary>
|
||||
|
||||
```python
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack import Document, Pipeline
|
||||
from haystack.components.retrievers.in_memory import InMemoryBM25Retriever
|
||||
from haystack.components.readers import ExtractiveReader
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
document_store.write_documents(
|
||||
[
|
||||
Document(content="Paris is the capital of France."),
|
||||
Document(content="Berlin is the capital of Germany."),
|
||||
Document(content="Rome is the capital of Italy."),
|
||||
Document(content="Madrid is the capital of Spain."),
|
||||
],
|
||||
)
|
||||
|
||||
retriever = InMemoryBM25Retriever(document_store)
|
||||
reader = ExtractiveReader(model="deepset/roberta-base-squad2")
|
||||
extractive_qa_pipeline = Pipeline()
|
||||
extractive_qa_pipeline.add_component("retriever", retriever)
|
||||
extractive_qa_pipeline.add_component("reader", reader)
|
||||
extractive_qa_pipeline.connect("retriever", "reader")
|
||||
|
||||
query = "What is the capital of France?"
|
||||
result = extractive_qa_pipeline.run(
|
||||
data={
|
||||
"retriever": {"query": query, "top_k": 3},
|
||||
"reader": {"query": query, "top_k": 2},
|
||||
},
|
||||
)
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
### RAG Pipeline
|
||||
|
||||
<details>
|
||||
|
||||
<summary>Haystack 1.x</summary>
|
||||
|
||||
```python
|
||||
from datasets import load_dataset
|
||||
|
||||
from haystack.pipelines import Pipeline
|
||||
from haystack.document_stores import InMemoryDocumentStore
|
||||
from haystack.nodes import EmbeddingRetriever, PromptNode, PromptTemplate, AnswerParser
|
||||
|
||||
document_store = InMemoryDocumentStore(embedding_dim=384)
|
||||
dataset = load_dataset("bilgeyucel/seven-wonders", split="train")
|
||||
document_store.write_documents(dataset)
|
||||
retriever = EmbeddingRetriever(
|
||||
embedding_model="sentence-transformers/all-MiniLM-L6-v2",
|
||||
document_store=document_store,
|
||||
top_k=2,
|
||||
)
|
||||
document_store.update_embeddings(retriever)
|
||||
|
||||
rag_prompt = PromptTemplate(
|
||||
prompt="""Synthesize a comprehensive answer from the following text for the given question.
|
||||
Provide a clear and concise response that summarizes the key points and information presented in the text.
|
||||
Your answer should be in your own words and be no longer than 50 words.
|
||||
\n\n Related text: {join(documents)} \n\n Question: {query} \n\n Answer:""",
|
||||
output_parser=AnswerParser(),
|
||||
)
|
||||
|
||||
prompt_node = PromptNode(
|
||||
model_name_or_path="gpt-3.5-turbo",
|
||||
api_key=OPENAI_API_KEY,
|
||||
default_prompt_template=rag_prompt,
|
||||
)
|
||||
|
||||
pipe = Pipeline()
|
||||
pipe.add_node(component=retriever, name="retriever", inputs=["Query"])
|
||||
pipe.add_node(component=prompt_node, name="prompt_node", inputs=["retriever"])
|
||||
|
||||
output = pipe.run(query="What does Rhodes Statue look like?")
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
<details>
|
||||
|
||||
<summary>Haystack 2.x</summary>
|
||||
|
||||
```python
|
||||
from datasets import load_dataset
|
||||
|
||||
from haystack import Document, Pipeline
|
||||
from haystack.document_stores.in_memory import InMemoryDocumentStore
|
||||
from haystack.components.builders import PromptBuilder
|
||||
from haystack.components.generators import OpenAIGenerator
|
||||
from haystack.components.embedders import SentenceTransformersDocumentEmbedder
|
||||
from haystack.components.embedders import SentenceTransformersTextEmbedder
|
||||
from haystack.components.retrievers import InMemoryEmbeddingRetriever
|
||||
|
||||
document_store = InMemoryDocumentStore()
|
||||
dataset = load_dataset("bilgeyucel/seven-wonders", split="train")
|
||||
embedder = SentenceTransformersDocumentEmbedder(
|
||||
"sentence-transformers/all-MiniLM-L6-v2",
|
||||
)
|
||||
embedder.warm_up()
|
||||
output = embedder.run([Document(**ds) for ds in dataset])
|
||||
document_store.write_documents(output.get("documents"))
|
||||
|
||||
template = """
|
||||
Given the following information, answer the question.
|
||||
|
||||
Context:
|
||||
{% for document in documents %}
|
||||
{{ document.content }}
|
||||
{% endfor %}
|
||||
|
||||
Question: {{question}}
|
||||
Answer:
|
||||
"""
|
||||
prompt_builder = PromptBuilder(template=template)
|
||||
|
||||
retriever = InMemoryEmbeddingRetriever(document_store=document_store, top_k=2)
|
||||
generator = OpenAIGenerator(model="gpt-3.5-turbo")
|
||||
query_embedder = SentenceTransformersTextEmbedder(
|
||||
model="sentence-transformers/all-MiniLM-L6-v2",
|
||||
)
|
||||
|
||||
basic_rag_pipeline = Pipeline()
|
||||
basic_rag_pipeline.add_component("text_embedder", query_embedder)
|
||||
basic_rag_pipeline.add_component("retriever", retriever)
|
||||
basic_rag_pipeline.add_component("prompt_builder", prompt_builder)
|
||||
basic_rag_pipeline.add_component("llm", generator)
|
||||
|
||||
basic_rag_pipeline.connect("text_embedder.embedding", "retriever.query_embedding")
|
||||
basic_rag_pipeline.connect("retriever", "prompt_builder.documents")
|
||||
basic_rag_pipeline.connect("prompt_builder", "llm")
|
||||
|
||||
query = "What does Rhodes Statue look like?"
|
||||
output = basic_rag_pipeline.run(
|
||||
{"text_embedder": {"text": query}, "prompt_builder": {"question": query}},
|
||||
)
|
||||
```
|
||||
|
||||
</details>
|
||||
|
||||
## Documentation and Tutorials for Haystack 1.x
|
||||
|
||||
You can access old tutorials in the [GitHub history](https://github.com/deepset-ai/haystack-tutorials/tree/5917718cbfbb61410aab4121ee6fe754040a5dc7) and download the Haystack 1.x documentation as a [ZIP file](https://core-engineering.s3.eu-central-1.amazonaws.com/public/docs/haystack-v1-docs.zip).
|
||||
|
||||
The ZIP file contains documentation for all minor releases from version 1.0 to 1.26.
|
||||
|
||||
To download documentation for a specific release, replace the version number in the following URL: `https://core-engineering.s3.eu-central-1.amazonaws.com/public/docs/v1.26.zip`.
|
||||
@@ -0,0 +1,514 @@
|
||||
---
|
||||
title: "Haystack Enterprise Components"
|
||||
id: platform-components
|
||||
slug: "/platform-components"
|
||||
description: "A complete list of Haystack components available on the Haystack Enterprise Platform, grouped by integration partner."
|
||||
---
|
||||
|
||||
# Haystack Enterprise Components
|
||||
|
||||
The Haystack Enterprise Platform currently supports **224 components** and **55 integrations**. The following table lists them grouped by integration partner.
|
||||
|
||||
## Core Components
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [Agent](https://docs.haystack.deepset.ai/docs/agent) | Component | ✅ Available |
|
||||
| [AnswerBuilder](https://docs.haystack.deepset.ai/docs/answerbuilder) | Builder | ✅ Available |
|
||||
| [AnswerJoiner](https://docs.haystack.deepset.ai/docs/answerjoiner) | Joiner | ✅ Available |
|
||||
| [AutoMergingRetriever](https://docs.haystack.deepset.ai/docs/automergingretriever) | Retriever | ✅ Available |
|
||||
| [AzureOCRDocumentConverter](https://docs.haystack.deepset.ai/docs/azureocrdocumentconverter) | Converter | ✅ Available |
|
||||
| [AzureOpenAIChatGenerator](https://docs.haystack.deepset.ai/docs/azureopenaichatgenerator) | Generator | ✅ Available |
|
||||
| [AzureOpenAIDocumentEmbedder](https://docs.haystack.deepset.ai/docs/azureopenaidocumentembedder) | Embedder | ✅ Available |
|
||||
| [AzureOpenAIResponsesChatGenerator](https://docs.haystack.deepset.ai/docs/azureopenairesponseschatgenerator) | Generator | ✅ Available |
|
||||
| [AzureOpenAITextEmbedder](https://docs.haystack.deepset.ai/docs/azureopenaitextembedder) | Embedder | ✅ Available |
|
||||
| [BranchJoiner](https://docs.haystack.deepset.ai/docs/branchjoiner) | Joiner | ✅ Available |
|
||||
| [CacheChecker](https://docs.haystack.deepset.ai/docs/cachechecker) | Component | ✅ Available |
|
||||
| [ChatPromptBuilder](https://docs.haystack.deepset.ai/docs/chatpromptbuilder) | Builder | ✅ Available |
|
||||
| [ConditionalRouter](https://docs.haystack.deepset.ai/docs/conditionalrouter) | Router | ✅ Available |
|
||||
| [CSVDocumentCleaner](https://docs.haystack.deepset.ai/docs/csvdocumentcleaner) | Preprocessor | ✅ Available |
|
||||
| [CSVDocumentSplitter](https://docs.haystack.deepset.ai/docs/csvdocumentsplitter) | Preprocessor | ✅ Available |
|
||||
| [CSVToDocument](https://docs.haystack.deepset.ai/docs/csvtodocument) | Converter | ✅ Available |
|
||||
| [DocumentCleaner](https://docs.haystack.deepset.ai/docs/documentcleaner) | Preprocessor | ✅ Available |
|
||||
| [DocumentJoiner](https://docs.haystack.deepset.ai/docs/documentjoiner) | Joiner | ✅ Available |
|
||||
| [DocumentLanguageClassifier](https://docs.haystack.deepset.ai/docs/documentlanguageclassifier) | Classifier | ✅ Available |
|
||||
| [DocumentLengthRouter](https://docs.haystack.deepset.ai/docs/documentlengthrouter) | Router | ✅ Available |
|
||||
| [DocumentPreprocessor](https://docs.haystack.deepset.ai/docs/documentpreprocessor) | Preprocessor | ✅ Available |
|
||||
| [DocumentSplitter](https://docs.haystack.deepset.ai/docs/documentsplitter) | Preprocessor | ✅ Available |
|
||||
| [DocumentToImageContent](https://docs.haystack.deepset.ai/docs/documenttoimagecontent) | Converter | ✅ Available |
|
||||
| [DocumentTypeRouter](https://docs.haystack.deepset.ai/docs/documenttyperouter) | Router | ✅ Available |
|
||||
| [DocumentWriter](https://docs.haystack.deepset.ai/docs/documentwriter) | Writer | ✅ Available |
|
||||
| [DOCXToDocument](https://docs.haystack.deepset.ai/docs/docxtodocument) | Converter | ✅ Available |
|
||||
| [EmbeddingBasedDocumentSplitter](https://docs.haystack.deepset.ai/docs/embeddingbaseddocumentsplitter) | Preprocessor | ✅ Available |
|
||||
| [FallbackChatGenerator](https://docs.haystack.deepset.ai/docs/fallbackchatgenerator) | Generator | ✅ Available |
|
||||
| [FileToFileContent](https://docs.haystack.deepset.ai/docs/filetofilecontent) | Converter | ✅ Available |
|
||||
| [FileTypeRouter](https://docs.haystack.deepset.ai/docs/filetyperouter) | Router | ✅ Available |
|
||||
| [FilterRetriever](https://docs.haystack.deepset.ai/docs/filterretriever) | Retriever | ✅ Available |
|
||||
| [HierarchicalDocumentSplitter](https://docs.haystack.deepset.ai/docs/hierarchicaldocumentsplitter) | Preprocessor | ✅ Available |
|
||||
| [HTMLToDocument](https://docs.haystack.deepset.ai/docs/htmltodocument) | Converter | ✅ Available |
|
||||
| [HuggingFaceAPIChatGenerator](https://docs.haystack.deepset.ai/docs/huggingfaceapichatgenerator) | Generator | ✅ Available |
|
||||
| [HuggingFaceAPIDocumentEmbedder](https://docs.haystack.deepset.ai/docs/huggingfaceapidocumentembedder) | Embedder | ✅ Available |
|
||||
| [HuggingFaceAPITextEmbedder](https://docs.haystack.deepset.ai/docs/huggingfaceapitextembedder) | Embedder | ✅ Available |
|
||||
| [HuggingFaceLocalChatGenerator](https://docs.haystack.deepset.ai/docs/huggingfacelocalchatgenerator) | Generator | ✅ Available |
|
||||
| [HuggingFaceTEIRanker](https://docs.haystack.deepset.ai/docs/huggingfaceteiranker) | Ranker | ✅ Available |
|
||||
| [ImageFileToDocument](https://docs.haystack.deepset.ai/docs/imagefiletodocument) | Converter | ✅ Available |
|
||||
| [ImageFileToImageContent](https://docs.haystack.deepset.ai/docs/imagefiletoimagecontent) | Converter | ✅ Available |
|
||||
| [JSONConverter](https://docs.haystack.deepset.ai/docs/jsonconverter) | Converter | ✅ Available |
|
||||
| [JsonSchemaValidator](https://docs.haystack.deepset.ai/docs/jsonschemavalidator) | Validator | ✅ Available |
|
||||
| [LinkContentFetcher](https://docs.haystack.deepset.ai/docs/linkcontentfetcher) | Fetcher | ✅ Available |
|
||||
| [ListJoiner](https://docs.haystack.deepset.ai/docs/listjoiner) | Joiner | ✅ Available |
|
||||
| [LLMDocumentContentExtractor](https://docs.haystack.deepset.ai/docs/llmdocumentcontentextractor) | Extractor | ✅ Available |
|
||||
| [LLMMessagesRouter](https://docs.haystack.deepset.ai/docs/llmmessagesrouter) | Router | ✅ Available |
|
||||
| [LLMMetadataExtractor](https://docs.haystack.deepset.ai/docs/llmmetadataextractor) | Extractor | ✅ Available |
|
||||
| [LLMRanker](https://docs.haystack.deepset.ai/docs/llmranker) | Ranker | ✅ Available |
|
||||
| [LostInTheMiddleRanker](https://docs.haystack.deepset.ai/docs/lostinthemiddleranker) | Ranker | ✅ Available |
|
||||
| [MarkdownHeaderSplitter](https://docs.haystack.deepset.ai/docs/markdownheadersplitter) | Preprocessor | ✅ Available |
|
||||
| [MarkdownToDocument](https://docs.haystack.deepset.ai/docs/markdowntodocument) | Converter | ✅ Available |
|
||||
| [MetadataRouter](https://docs.haystack.deepset.ai/docs/metadatarouter) | Router | ✅ Available |
|
||||
| [MetaFieldGroupingRanker](https://docs.haystack.deepset.ai/docs/metafieldgroupingranker) | Ranker | ✅ Available |
|
||||
| [MetaFieldRanker](https://docs.haystack.deepset.ai/docs/metafieldranker) | Ranker | ✅ Available |
|
||||
| [MSGToDocument](https://docs.haystack.deepset.ai/docs/msgtodocument) | Converter | ✅ Available |
|
||||
| [MultiFileConverter](https://docs.haystack.deepset.ai/docs/multifileconverter) | Converter | ✅ Available |
|
||||
| [MultiQueryEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/multiqueryembeddingretriever) | Retriever | ✅ Available |
|
||||
| [MultiQueryTextRetriever](https://docs.haystack.deepset.ai/docs/multiquerytextretriever) | Retriever | ✅ Available |
|
||||
| [MultiRetriever](https://docs.haystack.deepset.ai/docs/multiretriever) | Retriever | ✅ Available |
|
||||
| [NamedEntityExtractor](https://docs.haystack.deepset.ai/docs/namedentityextractor) | Extractor | ✅ Available |
|
||||
| [OpenAIChatGenerator](https://docs.haystack.deepset.ai/docs/openaichatgenerator) | Generator | ✅ Available |
|
||||
| [OpenAIDocumentEmbedder](https://docs.haystack.deepset.ai/docs/openaidocumentembedder) | Embedder | ✅ Available |
|
||||
| [OpenAIResponsesChatGenerator](https://docs.haystack.deepset.ai/docs/openairesponseschatgenerator) | Generator | ✅ Available |
|
||||
| [OpenAITextEmbedder](https://docs.haystack.deepset.ai/docs/openaitextembedder) | Embedder | ✅ Available |
|
||||
| [OpenAPIConnector](https://docs.haystack.deepset.ai/docs/openapiconnector) | Connector | ✅ Available |
|
||||
| [OpenAPIServiceConnector](https://docs.haystack.deepset.ai/docs/openapiserviceconnector) | Connector | ✅ Available |
|
||||
| [OpenAPIServiceToFunctions](https://docs.haystack.deepset.ai/docs/openapiservicetofunctions) | Converter | ✅ Available |
|
||||
| [OutputAdapter](https://docs.haystack.deepset.ai/docs/outputadapter) | Converter | ✅ Available |
|
||||
| [PDFMinerToDocument](https://docs.haystack.deepset.ai/docs/pdfminertodocument) | Converter | ✅ Available |
|
||||
| [PDFToImageContent](https://docs.haystack.deepset.ai/docs/pdftoimagecontent) | Converter | ✅ Available |
|
||||
| [PPTXToDocument](https://docs.haystack.deepset.ai/docs/pptxtodocument) | Converter | ✅ Available |
|
||||
| [PromptBuilder](https://docs.haystack.deepset.ai/docs/promptbuilder) | Builder | ✅ Available |
|
||||
| [PyPDFToDocument](https://docs.haystack.deepset.ai/docs/pypdftodocument) | Converter | ✅ Available |
|
||||
| [PythonCodeSplitter](https://docs.haystack.deepset.ai/docs/pythoncodesplitter) | Preprocessor | ✅ Available |
|
||||
| [QueryExpander](https://docs.haystack.deepset.ai/docs/queryexpander) | Component | ✅ Available |
|
||||
| [RecursiveDocumentSplitter](https://docs.haystack.deepset.ai/docs/recursivesplitter) | Preprocessor | ✅ Available |
|
||||
| [RegexTextExtractor](https://docs.haystack.deepset.ai/docs/regextextextractor) | Extractor | ✅ Available |
|
||||
| [RemoteWhisperTranscriber](https://docs.haystack.deepset.ai/docs/remotewhispertranscriber) | Audio | ✅ Available |
|
||||
| [SearchApiWebSearch](https://docs.haystack.deepset.ai/docs/searchapiwebsearch) | Component | ✅ Available |
|
||||
| [SentenceTransformersDiversityRanker](https://docs.haystack.deepset.ai/docs/sentencetransformersdiversityranker) | Ranker | ✅ Available |
|
||||
| [SentenceTransformersDocumentEmbedder](https://docs.haystack.deepset.ai/docs/sentencetransformersdocumentembedder) | Embedder | ✅ Available |
|
||||
| [SentenceTransformersDocumentImageEmbedder](https://docs.haystack.deepset.ai/docs/sentencetransformersdocumentimageembedder) | Embedder | ✅ Available |
|
||||
| [SentenceTransformersSimilarityRanker](https://docs.haystack.deepset.ai/docs/sentencetransformerssimilarityranker) | Ranker | ✅ Available |
|
||||
| [SentenceTransformersSparseDocumentEmbedder](https://docs.haystack.deepset.ai/docs/sentencetransformerssparsedocumentembedder) | Embedder | ✅ Available |
|
||||
| [SentenceTransformersSparseTextEmbedder](https://docs.haystack.deepset.ai/docs/sentencetransformerssparsetextembedder) | Embedder | ✅ Available |
|
||||
| [SentenceTransformersTextEmbedder](https://docs.haystack.deepset.ai/docs/sentencetransformerstextembedder) | Embedder | ✅ Available |
|
||||
| [SentenceWindowRetriever](https://docs.haystack.deepset.ai/docs/sentencewindowretriever) | Retriever | ✅ Available |
|
||||
| [SerperDevWebSearch](https://docs.haystack.deepset.ai/docs/serperdevwebsearch) | Component | ✅ Available |
|
||||
| [StringJoiner](https://docs.haystack.deepset.ai/docs/stringjoiner) | Joiner | ✅ Available |
|
||||
| [TextCleaner](https://docs.haystack.deepset.ai/docs/textcleaner) | Preprocessor | ✅ Available |
|
||||
| [TextEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/textembeddingretriever) | Retriever | ✅ Available |
|
||||
| [TextFileToDocument](https://docs.haystack.deepset.ai/docs/textfiletodocument) | Converter | ✅ Available |
|
||||
| [TextLanguageRouter](https://docs.haystack.deepset.ai/docs/textlanguagerouter) | Router | ✅ Available |
|
||||
| [TikaDocumentConverter](https://docs.haystack.deepset.ai/docs/tikadocumentconverter) | Converter | ✅ Available |
|
||||
| [ToolInvoker](https://docs.haystack.deepset.ai/docs/toolinvoker) | Component | ✅ Available |
|
||||
| [TopPSampler](https://docs.haystack.deepset.ai/docs/toppsampler) | Sampler | ✅ Available |
|
||||
| [TransformersExtractiveReader](https://docs.haystack.deepset.ai/docs/transformersextractivereader) | Reader | ✅ Available |
|
||||
| [TransformersSimilarityRanker](https://docs.haystack.deepset.ai/docs/transformerssimilarityranker) | Ranker | ✅ Available |
|
||||
| [TransformersTextRouter](https://docs.haystack.deepset.ai/docs/transformerstextrouter) | Router | ✅ Available |
|
||||
| [TransformersZeroShotDocumentClassifier](https://docs.haystack.deepset.ai/docs/transformerszeroshotdocumentclassifier) | Classifier | ✅ Available |
|
||||
| [TransformersZeroShotTextRouter](https://docs.haystack.deepset.ai/docs/transformerszeroshottextrouter) | Router | ✅ Available |
|
||||
| [XLSXToDocument](https://docs.haystack.deepset.ai/docs/xlsxtodocument) | Converter | ✅ Available |
|
||||
|
||||
## AIML API
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AIMLAPIChatGenerator](https://docs.haystack.deepset.ai/docs/aimllapichatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## AlloyDB
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AlloyDBEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/alloydbembeddingretriever) | Retriever | ✅ Available |
|
||||
| [AlloyDBKeywordRetriever](https://docs.haystack.deepset.ai/docs/alloydbkeywordretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Amazon Bedrock
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AmazonBedrockChatGenerator](https://docs.haystack.deepset.ai/docs/amazonbedrockchatgenerator) | Generator | ✅ Available |
|
||||
| [AmazonBedrockDocumentEmbedder](https://docs.haystack.deepset.ai/docs/amazonbedrockdocumentembedder) | Embedder | ✅ Available |
|
||||
| [AmazonBedrockDocumentImageEmbedder](https://docs.haystack.deepset.ai/docs/amazonbedrockdocumentimageembedder) | Embedder | ✅ Available |
|
||||
| [AmazonBedrockRanker](https://docs.haystack.deepset.ai/docs/amazonbedrockranker) | Ranker | ✅ Available |
|
||||
| [AmazonBedrockTextEmbedder](https://docs.haystack.deepset.ai/docs/amazonbedrocktextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Amazon S3
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [S3Downloader](https://docs.haystack.deepset.ai/docs/s3downloader) | Component | ✅ Available |
|
||||
|
||||
## Amazon Textract
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AmazonTextractConverter](https://docs.haystack.deepset.ai/docs/amazontextractconverter) | Converter | ✅ Available |
|
||||
|
||||
## Anthropic
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AnthropicChatGenerator](https://docs.haystack.deepset.ai/docs/anthropicchatgenerator) | Generator | ✅ Available |
|
||||
| [AnthropicFoundryChatGenerator](https://docs.haystack.deepset.ai/docs/anthropicfoundrychatgenerator) | Generator | ✅ Available |
|
||||
| [AnthropicVertexChatGenerator](https://docs.haystack.deepset.ai/docs/anthropicvertexchatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## ArcadeDB
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [ArcadeDBEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/arcadedbembeddingretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Astra
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AstraEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/astraretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Azure AI Search
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AzureAISearchBM25Retriever](https://docs.haystack.deepset.ai/docs/azureaisearchbm25retriever) | Retriever | ✅ Available |
|
||||
| [AzureAISearchEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/azureaisearchembeddingretriever) | Retriever | ✅ Available |
|
||||
| [AzureAISearchHybridRetriever](https://docs.haystack.deepset.ai/docs/azureaisearchhybridretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Azure Document Intelligence
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [AzureDocumentIntelligenceConverter](https://docs.haystack.deepset.ai/docs/azuredocumentintelligenceconverter) | Converter | ✅ Available |
|
||||
|
||||
## Brave
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [BraveWebSearch](https://docs.haystack.deepset.ai/docs/bravewebsearch) | Component | ✅ Available |
|
||||
|
||||
## Chroma
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [ChromaEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/chromaembeddingretriever) | Retriever | ✅ Available |
|
||||
| [ChromaQueryTextRetriever](https://docs.haystack.deepset.ai/docs/chromaqueryretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Cohere
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [CohereChatGenerator](https://docs.haystack.deepset.ai/docs/coherechatgenerator) | Generator | ✅ Available |
|
||||
| [CohereDocumentEmbedder](https://docs.haystack.deepset.ai/docs/coheredocumentembedder) | Embedder | ✅ Available |
|
||||
| [CohereRanker](https://docs.haystack.deepset.ai/docs/cohereranker) | Ranker | ✅ Available |
|
||||
| [CohereTextEmbedder](https://docs.haystack.deepset.ai/docs/coheretextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Docling
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [DoclingConverter](https://docs.haystack.deepset.ai/docs/doclingconverter) | Converter | ✅ Available |
|
||||
| [DoclingServeConverter](https://docs.haystack.deepset.ai/docs/doclingserveconverter) | Converter | ✅ Available |
|
||||
|
||||
## Elasticsearch
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [ElasticsearchBM25Retriever](https://docs.haystack.deepset.ai/docs/elasticsearchbm25retriever) | Retriever | ✅ Available |
|
||||
| [ElasticsearchEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/elasticsearchembeddingretriever) | Retriever | ✅ Available |
|
||||
| [ElasticsearchHybridRetriever](https://docs.haystack.deepset.ai/docs/elasticsearchhybridretriever) | Retriever | ✅ Available |
|
||||
| [ElasticsearchSQLRetriever](https://docs.haystack.deepset.ai/docs/elasticsearchsqlretriever) | Retriever | ✅ Available |
|
||||
|
||||
## FalkorDB
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [FalkorDBCypherRetriever](https://docs.haystack.deepset.ai/docs/falkordbcypherretriever) | Retriever | ✅ Available |
|
||||
| [FalkorDBEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/falkordbembeddingretriever) | Retriever | ✅ Available |
|
||||
|
||||
## FastEmbed
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [FastembedDocumentEmbedder](https://docs.haystack.deepset.ai/docs/fastembeddocumentembedder) | Embedder | ✅ Available |
|
||||
| [FastembedRanker](https://docs.haystack.deepset.ai/docs/fastembedranker) | Ranker | ✅ Available |
|
||||
| [FastembedSparseDocumentEmbedder](https://docs.haystack.deepset.ai/docs/fastembedsparsedocumentembedder) | Embedder | ✅ Available |
|
||||
| [FastembedSparseTextEmbedder](https://docs.haystack.deepset.ai/docs/fastembedsparsetextembedder) | Embedder | ✅ Available |
|
||||
| [FastembedTextEmbedder](https://docs.haystack.deepset.ai/docs/fastembedtextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Firecrawl
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [FirecrawlCrawler](https://docs.haystack.deepset.ai/docs/firecrawlcrawler) | Fetcher | ✅ Available |
|
||||
| [FirecrawlWebSearch](https://docs.haystack.deepset.ai/docs/firecrawlwebsearch) | Component | ✅ Available |
|
||||
|
||||
## GitHub
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [GitHubFileEditor](https://docs.haystack.deepset.ai/docs/githubfileeditor) | Connector | ✅ Available |
|
||||
| [GitHubIssueCommenter](https://docs.haystack.deepset.ai/docs/githubissuecommenter) | Connector | ✅ Available |
|
||||
| [GitHubIssueViewer](https://docs.haystack.deepset.ai/docs/githubissueviewer) | Connector | ✅ Available |
|
||||
| [GitHubPRCreator](https://docs.haystack.deepset.ai/docs/githubprcreator) | Connector | ✅ Available |
|
||||
| [GitHubRepoForker](https://docs.haystack.deepset.ai/docs/githubrepoforker) | Connector | ✅ Available |
|
||||
| [GitHubRepoViewer](https://docs.haystack.deepset.ai/docs/githubrepoviewer) | Connector | ✅ Available |
|
||||
|
||||
## Google Generative AI
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [GoogleGenAIChatGenerator](https://docs.haystack.deepset.ai/docs/googlegenaichatgenerator) | Generator | ✅ Available |
|
||||
| [GoogleGenAIDocumentEmbedder](https://docs.haystack.deepset.ai/docs/googlegenaidocumentembedder) | Embedder | ✅ Available |
|
||||
| [GoogleGenAITextEmbedder](https://docs.haystack.deepset.ai/docs/googlegenaitextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Hugging Face API
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [HuggingFaceAPIChatGenerator](https://docs.haystack.deepset.ai/docs/huggingfaceapichatgenerator) | Generator | ✅ Available |
|
||||
| [HuggingFaceAPIDocumentEmbedder](https://docs.haystack.deepset.ai/docs/huggingfaceapidocumentembedder) | Embedder | ✅ Available |
|
||||
| [HuggingFaceAPITextEmbedder](https://docs.haystack.deepset.ai/docs/huggingfaceapitextembedder) | Embedder | ✅ Available |
|
||||
| [HuggingFaceTEIRanker](https://docs.haystack.deepset.ai/docs/huggingfaceteiranker) | Ranker | ✅ Available |
|
||||
|
||||
## Jina AI
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [JinaDocumentEmbedder](https://docs.haystack.deepset.ai/docs/jinadocumentembedder) | Embedder | ✅ Available |
|
||||
| [JinaRanker](https://docs.haystack.deepset.ai/docs/jinaranker) | Ranker | ✅ Available |
|
||||
| [JinaReaderConnector](https://docs.haystack.deepset.ai/docs/jinareaderconnector) | Connector | ✅ Available |
|
||||
| [JinaTextEmbedder](https://docs.haystack.deepset.ai/docs/jinatextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Langfuse
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [LangfuseConnector](https://docs.haystack.deepset.ai/docs/langfuseconnector) | Connector | ✅ Available |
|
||||
|
||||
## Lara
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [LaraDocumentTranslator](https://docs.haystack.deepset.ai/docs/laradocumenttranslator) | Component | ✅ Available |
|
||||
|
||||
## LiteLLM
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [LiteLLMChatGenerator](https://docs.haystack.deepset.ai/docs/litellmchatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## Llama Stack
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [LlamaStackChatGenerator](https://docs.haystack.deepset.ai/docs/llamastackchatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## Llama.cpp
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [LlamaCppChatGenerator](https://docs.haystack.deepset.ai/docs/llamacppchatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## MarkItDown
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [MarkItDownConverter](https://docs.haystack.deepset.ai/docs/markitdownconverter) | Converter | ✅ Available |
|
||||
|
||||
## Mem0
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [Mem0MemoryRetriever](https://docs.haystack.deepset.ai/docs/mem0memoryretriever) | Retriever | ✅ Available |
|
||||
| [Mem0MemoryWriter](https://docs.haystack.deepset.ai/docs/mem0memorywriter) | Writer | ✅ Available |
|
||||
|
||||
## Meta Llama
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [MetaLlamaChatGenerator](https://docs.haystack.deepset.ai/docs/metallamachatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## Mistral
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [MistralChatGenerator](https://docs.haystack.deepset.ai/docs/mistralchatgenerator) | Generator | ✅ Available |
|
||||
| [MistralDocumentEmbedder](https://docs.haystack.deepset.ai/docs/mistraldocumentembedder) | Embedder | ✅ Available |
|
||||
| [MistralOCRDocumentConverter](https://docs.haystack.deepset.ai/docs/mistralocrdocumentconverter) | Converter | ✅ Available |
|
||||
| [MistralTextEmbedder](https://docs.haystack.deepset.ai/docs/mistraltextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## MongoDB Atlas
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [MongoDBAtlasEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/mongodbatlasembeddingretriever) | Retriever | ✅ Available |
|
||||
| [MongoDBAtlasFullTextRetriever](https://docs.haystack.deepset.ai/docs/mongodbatlasfulltextretriever) | Retriever | ✅ Available |
|
||||
|
||||
## NVIDIA
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [NvidiaChatGenerator](https://docs.haystack.deepset.ai/docs/nvidiachatgenerator) | Generator | ✅ Available |
|
||||
| [NvidiaDocumentEmbedder](https://docs.haystack.deepset.ai/docs/nvidiadocumentembedder) | Embedder | ✅ Available |
|
||||
| [NvidiaRanker](https://docs.haystack.deepset.ai/docs/nvidiaranker) | Ranker | ✅ Available |
|
||||
| [NvidiaTextEmbedder](https://docs.haystack.deepset.ai/docs/nvidiatextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Ollama
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [OllamaChatGenerator](https://docs.haystack.deepset.ai/docs/ollamachatgenerator) | Generator | ✅ Available |
|
||||
| [OllamaDocumentEmbedder](https://docs.haystack.deepset.ai/docs/ollamadocumentembedder) | Embedder | ✅ Available |
|
||||
| [OllamaTextEmbedder](https://docs.haystack.deepset.ai/docs/ollamatextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## OpenRouter
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [OpenRouterChatGenerator](https://docs.haystack.deepset.ai/docs/openrouterchatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## OpenSearch
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [OpenSearchBM25Retriever](https://docs.haystack.deepset.ai/docs/opensearchbm25retriever) | Retriever | ✅ Available |
|
||||
| [OpenSearchEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/opensearchembeddingretriever) | Retriever | ✅ Available |
|
||||
| [OpenSearchHybridRetriever](https://docs.haystack.deepset.ai/docs/opensearchhybridretriever) | Retriever | ✅ Available |
|
||||
| [OpenSearchMetadataRetriever](https://docs.haystack.deepset.ai/docs/opensearchmetadataretriever) | Retriever | ✅ Available |
|
||||
| [OpenSearchSQLRetriever](https://docs.haystack.deepset.ai/docs/opensearchsqlretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Oracle
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [OracleEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/oracleembeddingretriever) | Retriever | ✅ Available |
|
||||
| [OracleKeywordRetriever](https://docs.haystack.deepset.ai/docs/oraclekeywordretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Perplexity
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [PerplexityChatGenerator](https://docs.haystack.deepset.ai/docs/perplexitychatgenerator) | Generator | ✅ Available |
|
||||
| [PerplexityDocumentEmbedder](https://docs.haystack.deepset.ai/docs/perplexitydocumentembedder) | Embedder | ✅ Available |
|
||||
| [PerplexityTextEmbedder](https://docs.haystack.deepset.ai/docs/perplexitytextembedder) | Embedder | ✅ Available |
|
||||
| [PerplexityWebSearch](https://docs.haystack.deepset.ai/docs/perplexitywebsearch) | Component | ✅ Available |
|
||||
|
||||
## pgvector
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [PgvectorEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/pgvectorembeddingretriever) | Retriever | ✅ Available |
|
||||
| [PgvectorKeywordRetriever](https://docs.haystack.deepset.ai/docs/pgvectorkeywordretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Pinecone
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [PineconeEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/pineconedenseretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Presidio
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [PresidioDocumentCleaner](https://docs.haystack.deepset.ai/docs/presidiodocumentcleaner) | Preprocessor | ✅ Available |
|
||||
| [PresidioEntityExtractor](https://docs.haystack.deepset.ai/docs/presidioentityextractor) | Extractor | ✅ Available |
|
||||
| [PresidioTextCleaner](https://docs.haystack.deepset.ai/docs/presidiotextcleaner) | Preprocessor | ✅ Available |
|
||||
|
||||
## Pyversity
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [PyversityRanker](https://docs.haystack.deepset.ai/docs/pyversityranker) | Ranker | ✅ Available |
|
||||
|
||||
## Qdrant
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [QdrantEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/qdrantembeddingretriever) | Retriever | ✅ Available |
|
||||
| [QdrantHybridRetriever](https://docs.haystack.deepset.ai/docs/qdranthybridretriever) | Retriever | ✅ Available |
|
||||
| [QdrantSparseEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/qdrantsparseembeddingretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Snowflake
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [SnowflakeTableRetriever](https://docs.haystack.deepset.ai/docs/snowflaketableretriever) | Retriever | ✅ Available |
|
||||
|
||||
## SQLAlchemy
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| SQLAlchemyTableRetriever | Retriever | ✅ Available |
|
||||
|
||||
## STACKIT
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [STACKITChatGenerator](https://docs.haystack.deepset.ai/docs/stackitchatgenerator) | Generator | ✅ Available |
|
||||
| [STACKITDocumentEmbedder](https://docs.haystack.deepset.ai/docs/stackitdocumentembedder) | Embedder | ✅ Available |
|
||||
| [STACKITTextEmbedder](https://docs.haystack.deepset.ai/docs/stackittextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Supabase
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [SupabasePgvectorEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/supabasepgvectorembeddingretriever) | Retriever | ✅ Available |
|
||||
| [SupabasePgvectorKeywordRetriever](https://docs.haystack.deepset.ai/docs/supabasepgvectorkeywordretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Tavily
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [TavilyWebSearch](https://docs.haystack.deepset.ai/docs/tavilywebsearch) | Component | ✅ Available |
|
||||
|
||||
## TogetherAI
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [TogetherAIChatGenerator](https://docs.haystack.deepset.ai/docs/togetheraichatgenerator) | Generator | ✅ Available |
|
||||
|
||||
## Unstructured
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [UnstructuredFileConverter](https://docs.haystack.deepset.ai/docs/unstructuredfileconverter) | Converter | ✅ Available |
|
||||
|
||||
## Valkey
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [ValkeyEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/valkeyembeddingretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Vespa
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [VespaEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/vespaembeddingretriever) | Retriever | ✅ Available |
|
||||
| [VespaKeywordRetriever](https://docs.haystack.deepset.ai/docs/vespakeywordretriever) | Retriever | ✅ Available |
|
||||
|
||||
## vLLM
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [VLLMChatGenerator](https://docs.haystack.deepset.ai/docs/vllmchatgenerator) | Generator | ✅ Available |
|
||||
| [VLLMDocumentEmbedder](https://docs.haystack.deepset.ai/docs/vllmdocumentembedder) | Embedder | ✅ Available |
|
||||
| [VLLMRanker](https://docs.haystack.deepset.ai/docs/vllmranker) | Ranker | ✅ Available |
|
||||
| [VLLMTextEmbedder](https://docs.haystack.deepset.ai/docs/vllmtextembedder) | Embedder | ✅ Available |
|
||||
|
||||
## Weaviate
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [WeaviateBM25Retriever](https://docs.haystack.deepset.ai/docs/weaviatebm25retriever) | Retriever | ✅ Available |
|
||||
| [WeaviateEmbeddingRetriever](https://docs.haystack.deepset.ai/docs/weaviateembeddingretriever) | Retriever | ✅ Available |
|
||||
|
||||
## Weights & Biases (Weave)
|
||||
|
||||
| Component | Type | Haystack Enterprise Platform |
|
||||
|-----------|------|------------------------------|
|
||||
| [WeaveConnector](https://docs.haystack.deepset.ai/docs/weaveconnector) | Connector | ✅ Available |
|
||||
@@ -0,0 +1,76 @@
|
||||
---
|
||||
title: "Telemetry"
|
||||
id: telemetry
|
||||
slug: "/telemetry"
|
||||
description: "Haystack relies on anonymous usage statistics to continuously improve. That's why some basic information, like the type of Document Store used, is shared automatically."
|
||||
---
|
||||
|
||||
# Telemetry
|
||||
|
||||
Haystack relies on anonymous usage statistics to continuously improve. That's why some basic information, like the type of Document Store used, is shared automatically.
|
||||
|
||||
## What Information Is Shared?
|
||||
|
||||
Telemetry in Haystack comprises anonymous usage statistics of base components, such as `DocumentStore`, `Retriever`, `Reader`, or any other pipeline component. We receive an event every time these components are initialized. This way, we know which components are most relevant to our community. For the same reason, an event is also sent when one of the tutorials is executed.
|
||||
|
||||
Each event contains an anonymous, randomly generated user ID (`uuid`) and a collection of properties about your execution environment. They **never** contain properties that can be used to identify you, such as:
|
||||
|
||||
- IP addresses
|
||||
- Hostnames
|
||||
- File paths
|
||||
- Queries
|
||||
- Document contents
|
||||
|
||||
By taking the above steps, we ensure that only anonymized data is transmitted to our telemetry server.
|
||||
|
||||
Here is an exemplary event that is sent when tutorial 1 is executed by running `Tutorial1_Basic_QA_Pipeline.py`:
|
||||
|
||||
```json
|
||||
{
|
||||
"event": "tutorial 1 executed",
|
||||
"distinct_id": "9baab867-3bc8-438c-9974-a192c9d53cd1",
|
||||
"properties": {
|
||||
"os_family": "Darwin",
|
||||
"os_machine": "arm64",
|
||||
"os_version": "21.3.0",
|
||||
"haystack_version": "1.0.0",
|
||||
"python_version": "3.9.6",
|
||||
"torch_version": "1.9.0",
|
||||
"transformers_version": "4.13.0",
|
||||
"execution_env": "script",
|
||||
"n_gpu": 0,
|
||||
},
|
||||
}
|
||||
```
|
||||
|
||||
Our telemetry code can be directly inspected on [GitHub](https://github.com/deepset-ai/haystack/blob/5d66d040cc303ab49225587cd61290f1987a5d1f/haystack/telemetry/_telemetry.py).
|
||||
|
||||
## How Does Telemetry Help?
|
||||
|
||||
Thanks to telemetry, we can understand the needs of the community: _"What pipeline nodes are most popular?", "Should we focus on supporting one specific Document Store?", "How many people use Haystack on Windows?"_ are some of the questions telemetry helps us answer. Metadata about the operating system and installed dependencies allows us to quickly identify and address issues caused by specific setups.
|
||||
|
||||
In short, by sharing this information, you enable us to continuously improve Haystack for everyone.
|
||||
|
||||
## How Can I Opt Out?
|
||||
|
||||
You can disable telemetry with one of the following methods:
|
||||
|
||||
### Through an Environment Variable
|
||||
|
||||
You can disable telemetry by setting the environment variable `HAYSTACK_TELEMETRY_ENABLED` to `"False"` .
|
||||
|
||||
### Using a Bash Shell
|
||||
|
||||
If you are using a bash shell, add the following line to the file `~/.bashrc` to disable telemetry: `export HAYSTACK_TELEMETRY_ENABLED=False`.
|
||||
|
||||
### Using zsh
|
||||
|
||||
If you are using zsh as your shell, for example, on macOS, add the following line to the file `~/.zshrc`: `export HAYSTACK_TELEMETRY_ENABLED=False`.
|
||||
|
||||
### On Windows
|
||||
|
||||
To disable telemetry on Windows, set a user-level environment variable by running this command in the standard command prompt: `setx HAYSTACK_TELEMETRY_ENABLED "False"`.
|
||||
|
||||
Alternatively, run the following command in Windows PowerShell: `[Environment]::SetEnvironmentVariable("HAYSTACK_TELEMETRY_ENABLED","False","User")`.
|
||||
|
||||
You might need to restart the operating system for the command to take effect.
|
||||
Reference in New Issue
Block a user