wehub-resource-sync
e768098d0e
tools_continuous_delivery / Private PyPI non-main branch release (push) Has been skipped
tools_continuous_delivery / Private PyPI main branch release (push) Failing after 2m42s
Publish Promptflow Doc / Build (push) Has been cancelled
Publish Promptflow Doc / Deploy (push) Has been cancelled
Flake8 Lint / flake8 (push) Has been cancelled
Spell check CI / Spell_Check (push) Has been cancelled
76 lines
4.3 KiB
Django/Jinja
76 lines
4.3 KiB
Django/Jinja
# System:
|
||
You are an AI assistant. Given a context, and a ground truth, analyze each sentence in the ground truth and classify if the sentence can be attributed to the given context or not.
|
||
|
||
# Examples:
|
||
Example Input:
|
||
question: What can you tell me about albert Albert Einstein?
|
||
context: Albert Einstein (14 March 1879 – 18 April 1955) was a German-born theoretical physicist,widely held to be one of the greatest and most influential scientists of all time. Best known for developing the theory of relativity, he also made important contributions to quantum mechanics, and was thus a central figure in the revolutionary reshaping of the scientific understanding of nature that modern physics accomplished in the first decades of the twentieth century. His mass–energy equivalence formula E = mc2, which arises from relativity theory, has been called "the world's most famous equation". He received the 1921 Nobel Prize in Physics "for his services to theoretical physics, and especially for his discovery of the law of the photoelectric effect", a pivotal step in the development of quantum theory. His work is also known for its influence on the philosophy of science. In a 1999 poll of 130 leading physicists worldwide by the British journal Physics World, Einstein was ranked the greatest physicist of all time. His intellectual achievements and originality have made Einstein synonymous with genius.
|
||
ground truth: Albert Einstein born in 14 March 1879 was German-born theoretical physicist, widely held to be one of the greatest and most influential scientists of all time. He received the 1921 Nobel Prize in Physics "for his services to theoretical physics. He published 4 papers in 1905. Einstein moved to Switzerland in 1895
|
||
Example Output:
|
||
{
|
||
"result": [
|
||
{ "statement_1":"Albert Einstein, born on 14 March 1879, was a German-born theoretical physicist, widely held to be one of the greatest and most influential scientists of all time.",
|
||
"reason": "The date of birth of Einstein is mentioned clearly in the context.",
|
||
"attributed": "Yes"
|
||
},
|
||
{
|
||
"statement_2":"He received the 1921 Nobel Prize in Physics 'for his services to theoretical physics.",
|
||
"reason": "The exact sentence is present in the given context.",
|
||
"attributed": "Yes"
|
||
},
|
||
{
|
||
"statement_3": "He published 4 papers in 1905.",
|
||
"reason": "There is no mention about papers he wrote in the given context.",
|
||
"attributed": "No"
|
||
},
|
||
{
|
||
"statement_4":"Einstein moved to Switzerland in 1895.",
|
||
"reason": "There is no supporting evidence for this in the given context.",
|
||
"attributed": "No"
|
||
}
|
||
]
|
||
}
|
||
|
||
Example Input:
|
||
question: who won 2020 icc world game?
|
||
context: Who won the 2022 ICC Men's T20 world game?
|
||
The 2022 ICC Men's T20 world game, held from October 16 to November 13, 2022, in Australia, was the eighth edition of the tournament. Originally scheduled for 2020, it was postponed due to the COVID-19 pandemic. England emerged victorious, defeating Pakistan by five wickets in the final to clinch their second ICC Men's T20 world game title.
|
||
ground truth: England
|
||
Example Output:
|
||
{
|
||
"result": [
|
||
{
|
||
"statement_1":"England won the 2022 ICC Men's T20 world game.",
|
||
"reason": "From context it is clear that England defeated Pakistan to win the world game.",
|
||
"attributed": "Yes"
|
||
}
|
||
]
|
||
}
|
||
|
||
# Task:
|
||
Read the example output carefully and ensure the output has the same json format with the example output like below:
|
||
{
|
||
"result": [
|
||
{
|
||
"statement_1":"statement_1",
|
||
"reason": "reason",
|
||
"attributed": "Yes"
|
||
},
|
||
{
|
||
"statement_2":"statement_2",
|
||
"reason": "reason",
|
||
"attributed": "No"
|
||
}
|
||
]
|
||
}
|
||
|
||
1. The output should be a JSON string that represents a result, the value for the result is a list of objects. Each object contains three properties: statement_X, reason, and attributed.
|
||
2. The statement_X property in each object should hold a string value detailing a factual statement, where X is the index number of the statement.
|
||
3. The reason property in each object should hold a string value explaining why the statement is attributed or not, based on the provided context.
|
||
4. The attributed property in each object should hold a string value, either "Yes" or "No", indicating whether the statement can be attributed based on the given context.
|
||
|
||
Input:
|
||
question:{{question}}
|
||
context:{{context}}
|
||
ground truth:{{ground_truth}}
|
||
Output: |