97e91a83f3
Ruff / Ruff (push) Has been cancelled
Test / Core Tests (push) Has been cancelled
Test / Offline Coverage Tests (Python 3.10) (push) Has been cancelled
Test / Offline Coverage Tests (Python 3.11) (push) Has been cancelled
Test / Offline Coverage Tests (Python 3.12) (push) Has been cancelled
Test / Offline Coverage Tests (Python 3.13) (push) Has been cancelled
Test / Offline Coverage Tests (Python 3.9) (push) Has been cancelled
Test / Full Coverage (Python 3.11) (push) Has been cancelled
Test / Core Provider Tests (OpenAI) (push) Has been cancelled
Test / Core Provider Tests (Anthropic) (push) Has been cancelled
Test / Core Provider Tests (Google) (push) Has been cancelled
Test / Core Provider Tests (Other) (push) Has been cancelled
Test / Anthropic Tests (push) Has been cancelled
Test / Gemini Tests (push) Has been cancelled
Test / Google GenAI Tests (push) Has been cancelled
Test / Vertex AI Tests (push) Has been cancelled
Test / OpenAI Tests (push) Has been cancelled
Test / Writer Tests (push) Has been cancelled
Test / Auto Client Tests (push) Has been cancelled
ty / type-check (push) Has been cancelled
80 lines
1.7 KiB
Markdown
80 lines
1.7 KiB
Markdown
---
|
|
title: SambaNova
|
|
description: Use Instructor with SambaNova's LLM API for structured outputs.
|
|
---
|
|
|
|
## See Also
|
|
|
|
- [Getting Started](../getting-started.md) - Quick start guide
|
|
- [from_provider Guide](../concepts/from_provider.md) - Detailed client configuration
|
|
- [Provider Examples](../index.md#provider-examples) - Quick examples for all providers
|
|
- [Enterprise Integration](../examples/index.md#enterprise-integration) - More enterprise examples
|
|
|
|
# SambaNova Integration
|
|
|
|
Instructor supports SambaNova's LLM API, allowing you to use structured outputs with their models.
|
|
|
|
## Installation
|
|
|
|
```bash
|
|
pip install "instructor[openai]"
|
|
```
|
|
|
|
## Basic Usage
|
|
|
|
```python
|
|
import instructor
|
|
from pydantic import BaseModel
|
|
|
|
client = instructor.from_provider("sambanova/Meta-Llama-3.1-405B-Instruct")
|
|
|
|
class User(BaseModel):
|
|
name: str
|
|
age: int
|
|
|
|
user = client.create(
|
|
messages=[
|
|
{"role": "user", "content": "Ivan is 28"},
|
|
],
|
|
response_model=User,
|
|
)
|
|
|
|
print(user)
|
|
# > User(name='Ivan', age=28)
|
|
```
|
|
|
|
## Async Usage
|
|
|
|
```python
|
|
import instructor
|
|
from pydantic import BaseModel
|
|
|
|
client = instructor.from_provider(
|
|
"sambanova/Meta-Llama-3.1-405B-Instruct",
|
|
async_client=True,
|
|
)
|
|
|
|
class User(BaseModel):
|
|
name: str
|
|
age: int
|
|
|
|
async def get_user():
|
|
user = await client.create(
|
|
messages=[
|
|
{"role": "user", "content": "Ivan is 28"},
|
|
],
|
|
response_model=User,
|
|
)
|
|
return user
|
|
|
|
# Run with asyncio
|
|
import asyncio
|
|
user = asyncio.run(get_user())
|
|
print(user)
|
|
# > User(name='Ivan', age=28)
|
|
```
|
|
|
|
## Available Models
|
|
|
|
Check the [SambaNova documentation](https://docs.sambanova.ai/cloud/docs/get-started/supported-models) for the latest model offerings and capabilities.
|