wehub/unstructured-io--unstructured
1
0
Fork 0
Code Issues Pull Requests Actions Deployments Models Agent Notes Packages Projects Releases Wiki Activity

chore: import upstream snapshot with attribution
CI / lint (3.11) (push) Has been cancelled
Details
CI / lint (3.12) (push) Has been cancelled
Details
CI / lint (3.13) (push) Has been cancelled
Details
CI / shellcheck (push) Has been cancelled
Details
CI / shfmt (push) Has been cancelled
Details
CI / setup (3.11) (push) Has been cancelled
Details
CI / setup (3.12) (push) Has been cancelled
Details
CI / setup (3.13) (push) Has been cancelled
Details
CI / check-licenses (3.12) (push) Has been cancelled
Details
CI / test_unit (3.11) (push) Has been cancelled
Details
CI / test_unit (3.12) (push) Has been cancelled
Details
CI / test_unit (3.13) (push) Has been cancelled
Details
CI / test_unit_no_extras (3.11) (push) Has been cancelled
Details
CI / test_unit_no_extras (3.12) (push) Has been cancelled
Details
CI / test_json_to_html (3.12) (push) Has been cancelled
Details
CI / test_unit_no_extras (3.13) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (csv, 3.12, --extra csv) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (xlsx, 3.11, --extra xlsx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (xlsx, 3.12, --extra xlsx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (csv, 3.11, --extra csv) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (csv, 3.13, --extra csv) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (docx, 3.11, --extra docx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (docx, 3.12, --extra docx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (docx, 3.13, --extra docx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (markdown, 3.11, --extra md) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (markdown, 3.12, --extra md) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (markdown, 3.13, --extra md) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (odt, 3.11, --extra odt) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (odt, 3.12, --extra odt) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (odt, 3.13, --extra odt) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pdf-image, 3.11, --extra pdf --extra image --extra paddleocr) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pdf-image, 3.12, --extra pdf --extra image --extra paddleocr) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pdf-image, 3.13, --extra pdf --extra image --extra paddleocr) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pptx, 3.11, --extra pptx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pptx, 3.12, --extra pptx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pptx, 3.13, --extra pptx) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pypandoc, 3.11, --extra epub --extra org --extra rtf --extra rst) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pypandoc, 3.12, --extra epub --extra org --extra rtf --extra rst) (push) Has been cancelled
Details
CI / test_unit_dependency_extras (pypandoc, 3.13, --extra epub --extra org --extra rtf --extra rst) (push) Has been cancelled
Details
Build And Push Docker Image / set-short-sha (push) Has been cancelled
Details
Partition Benchmark / setup (push) Has been cancelled
Details
Partition Benchmark / Measure and compare partition() runtime (push) Has been cancelled
Details
CI / test_unit_dependency_extras (xlsx, 3.13, --extra xlsx) (push) Has been cancelled
Details
CI / test_ingest_src (3.12) (push) Has been cancelled
Details
CI / test_json_to_markdown (3.12) (push) Has been cancelled
Details
CI / changelog (push) Has been cancelled
Details
CI / test_dockerfile (push) Has been cancelled
Details
CodeQL / Analyze (python) (push) Has been cancelled
Details
Build And Push Docker Image / build-images (linux/amd64, opensource-linux-8core) (push) Has been cancelled
Details
Build And Push Docker Image / build-images (linux/arm64, ubuntu-24.04-arm) (push) Has been cancelled
Details
Build And Push Docker Image / publish-images (push) Has been cancelled
Details

Browse Source
This commit is contained in:
wehub-resource-sync
2026-07-13 13:33:56 +08:00
commit 461bf6fd40
1313 changed files with 1079898 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
example-docs/test_evaluate_files/unstructured_output/Bank Good Credit Loan.pptx.json
+420
View File
@@ -0,0 +1,420 @@
[
{
"type": "Title",
"element_id": "0405351ac64213c7b1e40e31aff7d21b",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 1
},
"text": "Bank Good Credit "
},
{
"type": "NarrativeText",
"element_id": "214987ebee9fd615365185fb3d692253",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "0405351ac64213c7b1e40e31aff7d21b",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 1
},
"text": "Accredited with IABAC\u2122"
},
{
"type": "Title",
"element_id": "fc3d53b1d173c5c72205914ea331b052",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 1
},
"text": "( International Association of Business Analytics Certifications)`"
},
{
"type": "Title",
"element_id": "b952b3e6d0e34020f1f48b5d9243d0a4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 1
},
"text": "\u00a9 DataMites\u2122. All Rights Reserved | www.datamites.com"
},
{
"type": "Title",
"element_id": "2dc308bd8d3a5c745dfacc3bdccd81db",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 2
},
"text": "Objective & Background"
},
{
"type": "ListItem",
"element_id": "5a0a7e2a14285297ff3752656cb6df44",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "2dc308bd8d3a5c745dfacc3bdccd81db",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 2
},
"text": "Classify credit card customers as good / bad, based on information from internal and external sources. "
},
{
"type": "ListItem",
"element_id": "5eb6ec96e6a3493c1ae56747ae457b7f",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "2dc308bd8d3a5c745dfacc3bdccd81db",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 2
},
"text": "Data provided"
},
{
"type": "ListItem",
"element_id": "adec2b6c75369165b1d87dccdfd2dab8",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "5eb6ec96e6a3493c1ae56747ae457b7f",
"category_depth": 2,
"languages": [
"eng"
],
"page_number": 2
},
"text": "Demographic: Base file of with credit card history details. Only one record for every customer."
},
{
"type": "ListItem",
"element_id": "c26d6dc6982b7f42045f4ffee951f8e0",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "5eb6ec96e6a3493c1ae56747ae457b7f",
"category_depth": 2,
"languages": [
"eng"
],
"page_number": 2
},
"text": "Account: Contians data for various loans availed by the customer. Not related to credit card. Multiple records for every customer."
},
{
"type": "ListItem",
"element_id": "be3fc5cb3da83e6c22d1906330ee9f96",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "5eb6ec96e6a3493c1ae56747ae457b7f",
"category_depth": 2,
"languages": [
"eng"
],
"page_number": 2
},
"text": "Enquiries: Enquired made by customers for different loan purposes. Multiple records for every customer.\t"
},
{
"type": "Title",
"element_id": "b952b3e6d0e34020f1f48b5d9243d0a4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "2dc308bd8d3a5c745dfacc3bdccd81db",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 2
},
"text": "\u00a9 DataMites\u2122. All Rights Reserved | www.datamites.com"
},
{
"type": "Title",
"element_id": "0072e6b934945d5ba08f9729e0084739",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 3
},
"text": "Design"
},
{
"type": "ListItem",
"element_id": "af14c0ecaaa7ac1d2bca5cdfbcc32ec7",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "0072e6b934945d5ba08f9729e0084739",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 3
},
"text": "Data to be downloaded using SQL queries."
},
{
"type": "ListItem",
"element_id": "51d8e67259ab8a11d2fdfc5cb9bcf45e",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "0072e6b934945d5ba08f9729e0084739",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 3
},
"text": "Required information to be extracted from Account and Enquiry files and converted to one-to-one files."
},
{
"type": "ListItem",
"element_id": "6165e3bc219556f6ec397adc7240386b",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "0072e6b934945d5ba08f9729e0084739",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 3
},
"text": "The columns from the two files should be merged with Demographic file using Left Join with \u201ccustomer no\u201d as key column, to create a final file. The final file should contain all the records in demographic and additional columns/features from Account and Enquiry files will get added to Demographic file."
},
{
"type": "ListItem",
"element_id": "31930936fc3bad2175b05e324e9923e4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "0072e6b934945d5ba08f9729e0084739",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 3
},
"text": "There will be many customers in account and enquiry file who will get left out. This is fine as we anyway don\u2019t know their good/bad label for training purpose. "
},
{
"type": "Title",
"element_id": "b952b3e6d0e34020f1f48b5d9243d0a4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "0072e6b934945d5ba08f9729e0084739",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 3
},
"text": "\u00a9 DataMites\u2122. All Rights Reserved | www.datamites.com"
},
{
"type": "Title",
"element_id": "ed83647ab77addbea9e4dca5f7d8f216",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 4
},
"text": "Analysis of Data"
},
{
"type": "ListItem",
"element_id": "d936f750c577a228ebabd9ed2cec9a70",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "ed83647ab77addbea9e4dca5f7d8f216",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 4
},
"text": "Show using Excel File"
},
{
"type": "Title",
"element_id": "b952b3e6d0e34020f1f48b5d9243d0a4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "ed83647ab77addbea9e4dca5f7d8f216",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 4
},
"text": "\u00a9 DataMites\u2122. All Rights Reserved | www.datamites.com"
},
{
"type": "Title",
"element_id": "7207da66fd1c6771ee1a5705dc41c0c7",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"category_depth": 0,
"languages": [
"eng"
],
"page_number": 5
},
"text": "Explain Coding / outcomes "
},
{
"type": "ListItem",
"element_id": "815ef1753a8bcb1ce21d59819bdc6834",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "7207da66fd1c6771ee1a5705dc41c0c7",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 5
},
"text": "Show using Jupyter"
},
{
"type": "Title",
"element_id": "b952b3e6d0e34020f1f48b5d9243d0a4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "7207da66fd1c6771ee1a5705dc41c0c7",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 5
},
"text": "\u00a9 DataMites\u2122. All Rights Reserved | www.datamites.com"
},
{
"type": "Title",
"element_id": "2034ce6155036f8a009ef33985209e88",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "7207da66fd1c6771ee1a5705dc41c0c7",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 6
},
"text": "Thank You"
},
{
"type": "Title",
"element_id": "b952b3e6d0e34020f1f48b5d9243d0a4",
"metadata": {
"filename": "Bank Good Credit Loan.pptx",
"file_directory": "tmpdocs",
"last_modified": "2023-11-02T15:16:14",
"filetype": "application/vnd.openxmlformats-officedocument.presentationml.presentation",
"parent_id": "7207da66fd1c6771ee1a5705dc41c0c7",
"category_depth": 1,
"languages": [
"eng"
],
"page_number": 6
},
"text": "\u00a9 DataMites\u2122. All Rights Reserved | www.datamites.com"
}
]
example-docs/test_evaluate_files/unstructured_output/IRS-form-1987.pdf.json
+3176
View File
File diff suppressed because it is too large Load Diff
example-docs/test_evaluate_files/unstructured_output/Performance-Audit-Discussion.pdf.json
+2029
View File
File diff suppressed because it is too large Load Diff
example-docs/test_evaluate_files/unstructured_output/currency.csv.json
+17
View File
File diff suppressed because one or more lines are too long
example-docs/test_evaluate_files/unstructured_output/form.json
+149
View File
@@ -0,0 +1,149 @@
[
{
"type": "FormKeysValues",
"element_id": "MOCK_FORM_ID",
"text": "",
"metadata": {
"coordinates": {
"points": [
[
35.15625,
95.556640625
],
[
710.357666015625,
95.556640625
],
[
710.357666015625,
887.890625
],
[
35.15625,
887.890625
]
],
"system": "PixelSpace",
"layout_width": 754,
"layout_height": 1000
},
"page_number": 1,
"key_value_pairs": [
{
"key": {
"text": "MOCK KEY",
"custom_element": {
"type": "UncategorizedText",
"element_id": "MOCK_KEY_ID_1",
"text": "MOCK KEY",
"metadata": {
"coordinates": {
"points": [
[
503.271484375,
96.3897705078125
],
[
503.271484375,
107.5164794921875
],
[
606.103515625,
107.5164794921875
],
[
606.103515625,
96.3897705078125
]
],
"system": "PixelSpace",
"layout_width": 754,
"layout_height": 1000
},
"page_number": 1
}
},
"layout_element_id": null
},
"value": {
"text": "MOCK VALUE",
"custom_element": {
"type": "UncategorizedText",
"element_id": "MOCK_VALUE_ID",
"text": "MOCK VALUE",
"metadata": {
"coordinates": {
"points": [
[
557.568359375,
124.8626708984375
],
[
557.568359375,
136.6607666015625
],
[
595.556640625,
136.6607666015625
],
[
595.556640625,
124.8626708984375
]
],
"system": "PixelSpace",
"layout_width": 754,
"layout_height": 1000
},
"page_number": 1
}
},
"layout_element_id": null
},
"confidence": 0.0
},
{
"key": {
"text": "MOCK KEY 2",
"custom_element": {
"type": "UncategorizedText",
"element_id": "MOCK_KEY_ID_2",
"text": "MOCK KEY 2",
"metadata": {
"coordinates": {
"points": [
[
428.52783203125,
124.0478515625
],
[
428.52783203125,
136.6943359375
],
[
473.81591796875,
136.6943359375
],
[
473.81591796875,
124.0478515625
]
],
"system": "PixelSpace",
"layout_width": 754,
"layout_height": 1000
},
"page_number": 1
}
},
"layout_element_id": null
},
"value": null,
"confidence": 0.0
}
],
"file_directory": "dataset/testing_data/images",
"filename": "MOCK.png"
}
}
]