c56bef871b
Sync docs with Docusaurus / sync (push) Waiting to run
Tests / Check if changed (push) Waiting to run
Tests / format (push) Blocked by required conditions
Tests / check-imports (push) Blocked by required conditions
Tests / Unit / macos-latest (push) Blocked by required conditions
Tests / Unit / ubuntu-latest (push) Blocked by required conditions
Tests / Unit / windows-latest (push) Blocked by required conditions
Tests / mypy (push) Blocked by required conditions
Tests / Integration / ubuntu-latest (push) Blocked by required conditions
Tests / Integration / macos-latest (push) Blocked by required conditions
Tests / Integration / windows-latest (push) Blocked by required conditions
Tests / notify-slack-on-failure (push) Blocked by required conditions
Tests / Mark tests as completed (push) Blocked by required conditions
Docker image release / Build base image (push) Waiting to run
CodeQL / Analyze (python) (push) Has been cancelled
Update Platform Components Table / update (push) Has been cancelled
144 lines
4.0 KiB
Markdown
144 lines
4.0 KiB
Markdown
---
|
||
title: "SerperDev"
|
||
id: integrations-serperdev
|
||
description: "SerperDev integration for Haystack"
|
||
slug: "/integrations-serperdev"
|
||
---
|
||
|
||
|
||
## haystack_integrations.components.websearch.serperdev.websearch
|
||
|
||
### SerperDevWebSearch
|
||
|
||
Uses [Serper](https://serper.dev/) to search the web for relevant documents.
|
||
|
||
See the [Serper Dev website](https://serper.dev/) for more details.
|
||
|
||
Usage example:
|
||
|
||
```python
|
||
from haystack.utils import Secret
|
||
|
||
from haystack_integrations.components.websearch.serperdev import SerperDevWebSearch
|
||
|
||
serper_dev_api = Secret.from_env_var("SERPERDEV_API_KEY")
|
||
|
||
websearch = SerperDevWebSearch(top_k=10, api_key=serper_dev_api)
|
||
results = websearch.run(query="Who is the boyfriend of Olivia Wilde?")
|
||
|
||
assert results["documents"]
|
||
assert results["links"]
|
||
|
||
# Example with domain filtering - exclude subdomains
|
||
websearch_filtered = SerperDevWebSearch(
|
||
top_k=10,
|
||
allowed_domains=["example.com"],
|
||
exclude_subdomains=True, # Only results from example.com, not blog.example.com
|
||
api_key=serper_dev_api,
|
||
)
|
||
results_filtered = websearch_filtered.run(query="search query")
|
||
```
|
||
|
||
#### __init__
|
||
|
||
```python
|
||
__init__(
|
||
api_key: Secret = Secret.from_env_var("SERPERDEV_API_KEY"),
|
||
top_k: int | None = 10,
|
||
allowed_domains: list[str] | None = None,
|
||
search_params: dict[str, Any] | None = None,
|
||
*,
|
||
exclude_subdomains: bool = False
|
||
) -> None
|
||
```
|
||
|
||
Initialize the SerperDevWebSearch component.
|
||
|
||
**Parameters:**
|
||
|
||
- **api_key** (<code>Secret</code>) – API key for the Serper API.
|
||
- **top_k** (<code>int | None</code>) – Number of documents to return.
|
||
- **allowed_domains** (<code>list\[str\] | None</code>) – List of domains to limit the search to.
|
||
- **exclude_subdomains** (<code>bool</code>) – Whether to exclude subdomains when filtering by allowed_domains.
|
||
If True, only results from the exact domains in allowed_domains will be returned.
|
||
If False, results from subdomains will also be included. Defaults to False.
|
||
- **search_params** (<code>dict\[str, Any\] | None</code>) – Additional parameters passed to the Serper API.
|
||
For example, you can set 'num' to 20 to increase the number of search results.
|
||
See the [Serper website](https://serper.dev/) for more details.
|
||
|
||
#### to_dict
|
||
|
||
```python
|
||
to_dict() -> dict[str, Any]
|
||
```
|
||
|
||
Serializes the component to a dictionary.
|
||
|
||
**Returns:**
|
||
|
||
- <code>dict\[str, Any\]</code> – Dictionary with serialized data.
|
||
|
||
#### from_dict
|
||
|
||
```python
|
||
from_dict(data: dict[str, Any]) -> SerperDevWebSearch
|
||
```
|
||
|
||
Deserializes the component from a dictionary.
|
||
|
||
**Parameters:**
|
||
|
||
- **data** (<code>dict\[str, Any\]</code>) – The dictionary to deserialize from.
|
||
|
||
**Returns:**
|
||
|
||
- <code>SerperDevWebSearch</code> – The deserialized component.
|
||
|
||
#### run
|
||
|
||
```python
|
||
run(query: str) -> dict[str, list[Document] | list[str]]
|
||
```
|
||
|
||
Use [Serper](https://serper.dev/) to search the web.
|
||
|
||
**Parameters:**
|
||
|
||
- **query** (<code>str</code>) – Search query.
|
||
|
||
**Returns:**
|
||
|
||
- <code>dict\[str, list\[Document\] | list\[str\]\]</code> – A dictionary with the following keys:
|
||
- "documents": List of documents returned by the search engine.
|
||
- "links": List of links returned by the search engine.
|
||
|
||
**Raises:**
|
||
|
||
- <code>SerperDevError</code> – If an error occurs while querying the SerperDev API.
|
||
- <code>TimeoutError</code> – If the request to the SerperDev API times out.
|
||
|
||
#### run_async
|
||
|
||
```python
|
||
run_async(query: str) -> dict[str, list[Document] | list[str]]
|
||
```
|
||
|
||
Asynchronously uses [Serper](https://serper.dev/) to search the web.
|
||
|
||
This is the asynchronous version of the `run` method with the same parameters and return values.
|
||
|
||
**Parameters:**
|
||
|
||
- **query** (<code>str</code>) – Search query.
|
||
|
||
**Returns:**
|
||
|
||
- <code>dict\[str, list\[Document\] | list\[str\]\]</code> – A dictionary with the following keys:
|
||
- "documents": List of documents returned by the search engine.
|
||
- "links": List of links returned by the search engine.
|
||
|
||
**Raises:**
|
||
|
||
- <code>SerperDevError</code> – If an error occurs while querying the SerperDev API.
|
||
- <code>TimeoutError</code> – If the request to the SerperDev API times out.
|