e768098d0e
Flake8 Lint / flake8 (push) Waiting to run
Spell check CI / Spell_Check (push) Waiting to run
tools_continuous_delivery / Private PyPI non-main branch release (push) Has been skipped
tools_continuous_delivery / Private PyPI main branch release (push) Failing after 2m42s
Publish Promptflow Doc / Build (push) Has been cancelled
Publish Promptflow Doc / Deploy (push) Has been cancelled
24 lines
717 B
Python
24 lines
717 B
Python
"""
|
|
Aggregation function for eval-basic.
|
|
|
|
Extracted from the original `aggregate.py` PromptFlow node.
|
|
- `@tool` decorator removed (not needed in MAF).
|
|
- `log_metric()` replaced with returning metrics as a dict.
|
|
"""
|
|
|
|
from typing import Dict, List
|
|
|
|
|
|
def aggregate(processed_results: List[str]) -> Dict[str, int]:
|
|
"""Aggregate per-row results into batch-level metrics.
|
|
|
|
:param processed_results: List of "Correct"/"Incorrect" strings from all rows.
|
|
:returns: Dict with metric name → value.
|
|
"""
|
|
results_num = len(processed_results)
|
|
correct_num = processed_results.count("Correct")
|
|
return {
|
|
"results_num": results_num,
|
|
"correct_num": correct_num,
|
|
}
|