chore: import upstream snapshot with attribution
tools_continuous_delivery / Private PyPI non-main branch release (push) Has been skipped
tools_continuous_delivery / Private PyPI main branch release (push) Failing after 2m42s
Publish Promptflow Doc / Build (push) Has been cancelled
Publish Promptflow Doc / Deploy (push) Has been cancelled
Flake8 Lint / flake8 (push) Has been cancelled
Spell check CI / Spell_Check (push) Has been cancelled
tools_continuous_delivery / Private PyPI non-main branch release (push) Has been skipped
tools_continuous_delivery / Private PyPI main branch release (push) Failing after 2m42s
Publish Promptflow Doc / Build (push) Has been cancelled
Publish Promptflow Doc / Deploy (push) Has been cancelled
Flake8 Lint / flake8 (push) Has been cancelled
Spell check CI / Spell_Check (push) Has been cancelled
This commit is contained in:
@@ -0,0 +1,36 @@
|
||||
# Eval chat math
|
||||
|
||||
This example shows how to evaluate the answer of math questions, which can compare the output results with the standard answers numerically.
|
||||
|
||||
Learn more on corresponding [tutorials](../../../tutorials/flow-fine-tuning-evaluation/promptflow-quality-improvement.md)
|
||||
|
||||
Tools used in this flow:
|
||||
- `python` tool
|
||||
|
||||
## Prerequisites
|
||||
|
||||
Install promptflow sdk and other dependencies in this folder:
|
||||
```bash
|
||||
pip install -r requirements.txt
|
||||
```
|
||||
|
||||
### 1. Test flow with single line data
|
||||
|
||||
Testing flow/node:
|
||||
```bash
|
||||
# test with default input value in flow.dag.yaml
|
||||
pf flow test --flow .
|
||||
|
||||
# test with flow inputs
|
||||
pf flow test --flow . --inputs groundtruth=123 prediction=123
|
||||
|
||||
# test node with inputs
|
||||
pf flow test --flow . --node line_process --inputs groundtruth=123 prediction=123
|
||||
```
|
||||
|
||||
### 2. create flow run with multi line data
|
||||
There are two ways to evaluate an classification flow.
|
||||
|
||||
```bash
|
||||
pf run create --flow . --data ./data.jsonl --stream
|
||||
```
|
||||
Reference in New Issue
Block a user