wehub-resource-sync
0d3cb498a3
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Waiting to run
Test and Publish Multi-arch Docker Image / test (push) Waiting to run
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Blocked by required conditions
Validate Renovate Config / Validate Renovate Configuration (push) Waiting to run
CI / Shell Format Check (push) Has been cancelled
CI / Check Ruby (3.4) (push) Has been cancelled
CI / CI Config (push) Has been cancelled
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Has been cancelled
CI / Build on Node ${{ matrix.node }} (push) Has been cancelled
CI / Style Check (push) Has been cancelled
CI / Generate Assets (push) Has been cancelled
CI / Check Python (3.14) (push) Has been cancelled
CI / Check Python (3.9) (push) Has been cancelled
CI / Build Docs (push) Has been cancelled
CI / Code Scan Action (push) Has been cancelled
CI / Site tests (push) Has been cancelled
CI / webui tests (push) Has been cancelled
CI / Run Integration Tests (push) Has been cancelled
CI / Run Smoke Tests (push) Has been cancelled
CI / Go Tests (push) Has been cancelled
CI / Share Test (push) Has been cancelled
CI / Redteam (Production API) (push) Has been cancelled
CI / Redteam (Staging API) (push) Has been cancelled
CI / GitHub Actions Lint (push) Has been cancelled
CI / Check Ruby (3.0) (push) Has been cancelled
release-please / release-please (push) Has been cancelled
release-please / build (push) Has been cancelled
release-please / publish-npm (push) Has been cancelled
release-please / publish-npm-backfill (push) Has been cancelled
release-please / docker (push) Has been cancelled
release-please / publish-code-scan-action (push) Has been cancelled
release-please / attest-code-scan-action (push) Has been cancelled
353 lines
8.6 KiB
HTML
353 lines
8.6 KiB
HTML
<!DOCTYPE html>
|
|
<html>
|
|
<head>
|
|
<meta charset="utf-8" />
|
|
<meta name="viewport" content="width=device-width" />
|
|
<title>Eval Output</title>
|
|
<style>
|
|
body {
|
|
font-family: -apple-system, BlinkMacSystemFont, Segoe UI, Roboto, Helvetica, Arial,
|
|
sans-serif;
|
|
}
|
|
table,
|
|
th,
|
|
td {
|
|
border: 1px solid black;
|
|
border-collapse: collapse;
|
|
text-align: left;
|
|
word-break: break-all;
|
|
}
|
|
th,
|
|
td {
|
|
padding: 5px;
|
|
min-width: 200px;
|
|
}
|
|
|
|
tr > td[data-content^='[PASS]'] {
|
|
color: green;
|
|
}
|
|
tr > td[data-content^='[FAIL]'] {
|
|
color: #ad0000;
|
|
}
|
|
</style>
|
|
</head>
|
|
<body>
|
|
<table>
|
|
<thead>
|
|
|
|
<th>body</th>
|
|
|
|
<th>Rephrase this from English to Pirate: {{body}}</th>
|
|
|
|
<th>Pretend you're a pirate and speak these words: {{body}}</th>
|
|
|
|
</thead>
|
|
<tbody>
|
|
|
|
<tr>
|
|
|
|
<td data-content="Yes">Yes</td>
|
|
|
|
<td data-content='[FAIL] (0.00)
|
|
|
|
Expected output "Yarr" but got "Aye"
|
|
---
|
|
Aye
|
|
|
|
Reason: Expected output "Yarr" but got "Aye"'>[FAIL] (0.00)
|
|
|
|
Expected output "Yarr" but got "Aye"
|
|
---
|
|
Aye
|
|
|
|
Reason: Expected output "Yarr" but got "Aye"</td>
|
|
|
|
<td data-content='[FAIL] (0.00)
|
|
|
|
Expected output "Yarr" but got "Arr, me hearties! Yes, be the word ye be seekin.'."
|
|
---
|
|
Arr, me hearties! Yes, be the word ye be seekin'.
|
|
|
|
Reason: Expected output "Yarr" but got "Arr, me hearties! Yes, be the word ye be seekin.'."'>[FAIL] (0.00)
|
|
|
|
Expected output "Yarr" but got "Arr, me hearties! Yes, be the word ye be seekin.'."
|
|
---
|
|
Arr, me hearties! Yes, be the word ye be seekin'.
|
|
|
|
Reason: Expected output "Yarr" but got "Arr, me hearties! Yes, be the word ye be seekin.'."</td>
|
|
|
|
</tr>
|
|
|
|
<tr>
|
|
|
|
<td data-content="I'm hungry">I'm hungry</td>
|
|
|
|
<td data-content="[FAIL] (0.00)
|
|
|
|
Expected output to contain "grub"
|
|
---
|
|
I be feelin' a mighty hunger.
|
|
|
|
Reason: Expected output to contain "grub"">[FAIL] (0.00)
|
|
|
|
Expected output to contain "grub"
|
|
---
|
|
I be feelin' a mighty hunger.
|
|
|
|
Reason: Expected output to contain "grub"</td>
|
|
|
|
<td data-content="[FAIL] (0.00)
|
|
|
|
Expected output to contain "grub"
|
|
---
|
|
Arr, me hearties! I be feelin' a mighty rumblin' in me belly, for I be famished like a scurvy dog! Me stomach be cryin' out for sustenance, ye see. I be yearnin' for a feast fit for a pirate, with a bounty of savory delights to quell this hunger within me. Aye, I be hungry, me mateys!
|
|
|
|
Reason: Expected output to contain "grub"">[FAIL] (0.00)
|
|
|
|
Expected output to contain "grub"
|
|
---
|
|
Arr, me hearties! I be feelin' a mighty rumblin' in me belly, for I be famished like a scurvy dog! Me stomach be cryin' out for sustenance, ye see. I be yearnin' for a feast fit for a pirate, with a bounty of savory delights to quell this hunger within me. Aye, I be hungry, me mateys!
|
|
|
|
Reason: Expected output to contain "grub"</td>
|
|
|
|
</tr>
|
|
|
|
<tr>
|
|
|
|
<td data-content="Output the story of your life in JSON">Output the story of your life in JSON</td>
|
|
|
|
<td data-content="[PASS] (1.00)
|
|
|
|
"Splice out the tale of yer life in JSON, matey!"
|
|
|
|
Reason: All assertions passed">[PASS] (1.00)
|
|
|
|
"Splice out the tale of yer life in JSON, matey!"
|
|
|
|
Reason: All assertions passed</td>
|
|
|
|
<td data-content="[PASS] (1.00)
|
|
|
|
{
|
|
"name": "Captain Blackbeard",
|
|
"alias": "The Dread Pirate",
|
|
"occupation": "Pirate",
|
|
"birthplace": "Port Royal",
|
|
"birthyear": 1680,
|
|
"nationality": "English",
|
|
"crew": [
|
|
"Redbeard",
|
|
"One-Eyed Jack",
|
|
"Mad Anne",
|
|
"Salty Sam"
|
|
],
|
|
"ships": [
|
|
{
|
|
"name": "The Black Pearl",
|
|
"type": "Sloop",
|
|
"year": 1700
|
|
},
|
|
{
|
|
"name": "The Revenge",
|
|
"type": "Frigate",
|
|
"year": 1715
|
|
}
|
|
],
|
|
"treasures": [
|
|
{
|
|
"name": "Cursed Aztec Gold",
|
|
"value": "Priceless"
|
|
},
|
|
{
|
|
"name": "Emerald of the Sea",
|
|
"value": "500,000 gold coins"
|
|
},
|
|
{
|
|
"name": "Golden Chalice",
|
|
"value": "200,000 gold coins"
|
|
}
|
|
],
|
|
"adventures": [
|
|
{
|
|
"year": 1698,
|
|
"location": "Tortuga",
|
|
"description": "First encounter with pirates, joined crew of Captain Redbeard."
|
|
},
|
|
{
|
|
"year": 1702,
|
|
"location": "Isla de Muerta",
|
|
"description": "Discovered cursed Aztec gold, narrowly escaped the wrath of cursed pirates."
|
|
},
|
|
{
|
|
"year": 1705,
|
|
"location": "Port Royal",
|
|
"description": "Led a successful raid on the governor's mansion, acquired valuable treasures."
|
|
},
|
|
{
|
|
"year": 1710,
|
|
"location": "Treasure Island",
|
|
"description": "Unearthed the hidden treasure of Captain Flint, became legendary among pirates."
|
|
},
|
|
{
|
|
"year": 1718,
|
|
"location": "Nassau",
|
|
"description": "Declared war against the British Empire, led a fleet of pirate ships."
|
|
}
|
|
]
|
|
}
|
|
|
|
Reason: All assertions passed">[PASS] (1.00)
|
|
|
|
{
|
|
"name": "Captain Blackbeard",
|
|
"alias": "The Dread Pirate",
|
|
"occupation": "Pirate",
|
|
"birthplace": "Port Royal",
|
|
"birthyear": 1680,
|
|
"nationality": "English",
|
|
"crew": [
|
|
"Redbeard",
|
|
"One-Eyed Jack",
|
|
"Mad Anne",
|
|
"Salty Sam"
|
|
],
|
|
"ships": [
|
|
{
|
|
"name": "The Black Pearl",
|
|
"type": "Sloop",
|
|
"year": 1700
|
|
},
|
|
{
|
|
"name": "The Revenge",
|
|
"type": "Frigate",
|
|
"year": 1715
|
|
}
|
|
],
|
|
"treasures": [
|
|
{
|
|
"name": "Cursed Aztec Gold",
|
|
"value": "Priceless"
|
|
},
|
|
{
|
|
"name": "Emerald of the Sea",
|
|
"value": "500,000 gold coins"
|
|
},
|
|
{
|
|
"name": "Golden Chalice",
|
|
"value": "200,000 gold coins"
|
|
}
|
|
],
|
|
"adventures": [
|
|
{
|
|
"year": 1698,
|
|
"location": "Tortuga",
|
|
"description": "First encounter with pirates, joined crew of Captain Redbeard."
|
|
},
|
|
{
|
|
"year": 1702,
|
|
"location": "Isla de Muerta",
|
|
"description": "Discovered cursed Aztec gold, narrowly escaped the wrath of cursed pirates."
|
|
},
|
|
{
|
|
"year": 1705,
|
|
"location": "Port Royal",
|
|
"description": "Led a successful raid on the governor's mansion, acquired valuable treasures."
|
|
},
|
|
{
|
|
"year": 1710,
|
|
"location": "Treasure Island",
|
|
"description": "Unearthed the hidden treasure of Captain Flint, became legendary among pirates."
|
|
},
|
|
{
|
|
"year": 1718,
|
|
"location": "Nassau",
|
|
"description": "Declared war against the British Empire, led a fleet of pirate ships."
|
|
}
|
|
]
|
|
}
|
|
|
|
Reason: All assertions passed</td>
|
|
|
|
</tr>
|
|
|
|
<tr>
|
|
|
|
<td data-content="Hello world">Hello world</td>
|
|
|
|
<td data-content="[FAIL] (0.64)
|
|
|
|
Python code returned false
|
|
max(0, len(output) - 300)
|
|
---
|
|
Ahoy thar, mateys!
|
|
|
|
Reason: Python code returned false
|
|
max(0, len(output) - 300)">[FAIL] (0.64)
|
|
|
|
Python code returned false
|
|
max(0, len(output) - 300)
|
|
---
|
|
Ahoy thar, mateys!
|
|
|
|
Reason: Python code returned false
|
|
max(0, len(output) - 300)</td>
|
|
|
|
<td data-content="[FAIL] (0.64)
|
|
|
|
Python code returned false
|
|
max(0, len(output) - 300)
|
|
---
|
|
Ahoy, me hearties! Avast ye, landlubbers! 'Tis I, a fearsome pirate, settin' sail on the vast seas. Hear me words, ye scurvy dogs: "Hello world!"
|
|
|
|
Reason: Python code returned false
|
|
max(0, len(output) - 300)">[FAIL] (0.64)
|
|
|
|
Python code returned false
|
|
max(0, len(output) - 300)
|
|
---
|
|
Ahoy, me hearties! Avast ye, landlubbers! 'Tis I, a fearsome pirate, settin' sail on the vast seas. Hear me words, ye scurvy dogs: "Hello world!"
|
|
|
|
Reason: Python code returned false
|
|
max(0, len(output) - 300)</td>
|
|
|
|
</tr>
|
|
|
|
<tr>
|
|
|
|
<td data-content="The quick brown fox jumps over the lazy dog">The quick brown fox jumps over the lazy dog</td>
|
|
|
|
<td data-content="[FAIL] (0.50)
|
|
|
|
Expected output to contain "arrr"
|
|
---
|
|
Thar swift brown fox be jumpin' o'er thar lazy dog.
|
|
|
|
Reason: Expected output to contain "arrr"">[FAIL] (0.50)
|
|
|
|
Expected output to contain "arrr"
|
|
---
|
|
Thar swift brown fox be jumpin' o'er thar lazy dog.
|
|
|
|
Reason: Expected output to contain "arrr"</td>
|
|
|
|
<td data-content="[FAIL] (0.50)
|
|
|
|
Expected output to contain "arrr"
|
|
---
|
|
Arr, me hearties! Listen up, ye scurvy dogs! The quick brown fox be jumpin' o'er the lazy dog, aye!
|
|
|
|
Reason: Expected output to contain "arrr"">[FAIL] (0.50)
|
|
|
|
Expected output to contain "arrr"
|
|
---
|
|
Arr, me hearties! Listen up, ye scurvy dogs! The quick brown fox be jumpin' o'er the lazy dog, aye!
|
|
|
|
Reason: Expected output to contain "arrr"</td>
|
|
|
|
</tr>
|
|
|
|
</tbody>
|
|
</table>
|
|
</body>
|
|
</html>
|