wehub-resource-sync
70 lines
3.2 KiB
Markdown
70 lines
3.2 KiB
Markdown
---
|
|
layout: default
|
|
title: Parsing
|
|
parent: Examples
|
|
nav_order: 4
|
|
description: overview of the major modules and classes of LLMWare
|
|
permalink: /examples/parsing
|
|
---
|
|
# Parsing - Introduction by Examples
|
|
We introduce ``llmware`` through self-contained examples.
|
|
|
|
|
|
🚀 Parsing Examples 🚀
|
|
===============
|
|
|
|
**Parsing is the Humble Hero of Good RAG Pipelines**
|
|
|
|
LLMWare supports parsing of a wide range of unstructured content types, and views parsing, text chunking and indexing as the first step in the pipeline, and like any pipeline, care and attention to getting "great input" is usually the key to "great output."
|
|
|
|
In this repository, we show several key features of parsing with llmware:
|
|
|
|
|
|
**Parsing PDFs like a Pro**
|
|
|
|
- Configuring text chunking and extraction parameters - [**PDF Configuration**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/pdf_parser_new_configs.py)
|
|
|
|
- PDF Table extraction - [**PDF Table**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/pdf_table_extraction.py)
|
|
|
|
- Fallback to OCR - [**PDF-by-OCR**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_pdf_by_ocr.py)
|
|
|
|
|
|
**Parsing Office Documents (Powerpoints, Word, Excel)**
|
|
|
|
- Configuring text chunking and extraction parameters - [**Office Configuration**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/office_parser_new_configs.py)
|
|
|
|
- Handling ZIPs and mixed file types - [**Microsoft IR Documents**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parsing_microsoft_ir_docs.py)
|
|
|
|
- Running OCR on Images Extracted - [**OCR Embedded Doc Images**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/ocr_embedded_doc_images.py)
|
|
|
|
|
|
**Parsing without a Database**
|
|
|
|
- Parse in Memory - [**Parse in Memory**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_in_memory.py)
|
|
|
|
- Parse directly into a Prompt - [**Parse in Prompt**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_into_prompt.py)
|
|
|
|
- Parse to JSON file - [**Parse to JSON**](https://www.github.com/llmware-ai/llmware/tree/main/examples/main/examples/Parsing/parse_to_json.py)
|
|
|
|
|
|
**Other Content Types**
|
|
|
|
- Custom CSV - [**Custom CSV files**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_csv_custom.py)
|
|
|
|
- Custom JSON - [**Custom JSON files**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_jsonl_custom.py)
|
|
|
|
- Images - [**OCR on Images**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_images.py)
|
|
|
|
- Web/HTML - [**Website Extraction**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/parse_web_sources_in_memory.py)
|
|
|
|
- Voice (WAV) - in Use_Cases - [**Parsing Great Speeches**](https://www.github.com/llmware-ai/llmware/tree/main/examples/Use_Cases/parsing_great_speeches.py)
|
|
|
|
For more examples, see the [parsing examples]((https://www.github.com/llmware-ai/llmware/tree/main/examples/Parsing/) in the main repo.
|
|
|
|
Check back often - we are updating these examples regularly - and many of these examples have companion videos as well.
|
|
|
|
|
|
### **Let's get started! 🚀**
|
|
|
|
|