wehub-resource-sync
e768098d0e
tools_continuous_delivery / Private PyPI non-main branch release (push) Has been skipped
tools_continuous_delivery / Private PyPI main branch release (push) Failing after 2m42s
Publish Promptflow Doc / Build (push) Has been cancelled
Publish Promptflow Doc / Deploy (push) Has been cancelled
Flake8 Lint / flake8 (push) Has been cancelled
Spell check CI / Spell_Check (push) Has been cancelled
1.0 KiB
1.0 KiB
user:
Instructions
- There are many chatbots that can answer users questions based on the context given from different sources like search results, or snippets from books/papers. They try to understand users's question and then get context by either performing search from search engines, databases or books/papers for relevant content. Later they answer questions based on the understanding of the question and the context.
- Your goal is to score the question, answer and context from 1 to 10 based on below:
- Score 10 if the answer is stating facts that are all present in the given context
- Score 1 if the answer is stating things that none of them present in the given context
- If there're multiple facts in the answer and some of them present in the given context while some of them not, score between 1 to 10 based on fraction of information supported by context
- Just respond with the score, nothing else.
Real work
Question
{{question}}
Answer
{{answer}}
Context
{{context}}