wehub-resource-sync
e768098d0e
Flake8 Lint / flake8 (push) Waiting to run
Spell check CI / Spell_Check (push) Waiting to run
tools_continuous_delivery / Private PyPI non-main branch release (push) Has been skipped
tools_continuous_delivery / Private PyPI main branch release (push) Failing after 2m42s
Publish Promptflow Doc / Build (push) Has been cancelled
Publish Promptflow Doc / Deploy (push) Has been cancelled
25 lines
658 B
Markdown
25 lines
658 B
Markdown
# Basic Eval
|
|
Basic evaluator prompt for QA scenario
|
|
|
|
## Prerequisites
|
|
|
|
Install `promptflow-devkit`:
|
|
```bash
|
|
pip install promptflow-devkit
|
|
```
|
|
|
|
## Run prompty
|
|
|
|
- Prepare your Azure OpenAI resource follow this [instruction](https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/create-resource?pivots=web-portal) and get your `api_key` if you don't have one.
|
|
- Setup environment variables
|
|
|
|
Ensure you have put your azure OpenAI endpoint key in [.env](../.env) file. You can create one refer to this [example file](../.env.example).
|
|
|
|
```bash
|
|
cat ../.env
|
|
```
|
|
|
|
- Test flow
|
|
```bash
|
|
pf flow test --flow eval.prompty --env --inputs sample.json
|
|
``` |