wehub-resource-sync
4.0 KiB
Llama 3P Integrations
This folder contains example scripts and tutorials showcasing the integration of Meta Llama models with popular platforms, frameworks, and tools in the LLM ecosystem. These integrations demonstrate how to leverage Llama's capabilities across different environments and use cases.
Each folder is maintained by the respective platform-owner and contains specific examples, tutorials, and documentation for using Llama with that platform.
Note
If you'd like to add your platform here, please open a new issue with details of your examples.
Available Integrations
AWS
Examples for using Llama 3 on Amazon Bedrock, including getting started guides, prompt engineering, and React integration.
Azure
Recipes for running Llama model inference on Azure's serverless API offerings (MaaS).
Crusoe
Recipes for deploying Llama workflows on Crusoe's high-performance, sustainable cloud, including serving Llama3.1 in FP8 with vLLM.
E2B AI Analyst
AI-powered code and data analysis tool using Meta Llama and the E2B SDK, supporting data analysis, CSV uploads, and interactive charts.
Groq
Examples and templates for using Llama models with Groq's high-performance inference API.
Lamini
Integration examples with Lamini's platform, including text2sql with memory tuning.
LangChain
Cookbooks for building agents with Llama 3 and LangChain, including tool-calling agents and RAG agents using LangGraph.
LlamaIndex
Examples of using Llama with LlamaIndex for advanced RAG applications and agentic RAG.
Modal
Integration with Modal's cloud platform for running Llama models, including human evaluation examples.
TGI
Guide for serving fine-tuned Llama models with HuggingFace's text-generation-inference server, including weight merging for LoRA models.
TogetherAI
Comprehensive demos for building LLM applications using Llama on Together AI, including multimodal RAG, contextual RAG, PDF-to-podcast conversion, knowledge graphs, and structured text extraction.
vLLM
Examples for high-throughput and memory-efficient inference using vLLM with Llama models.
Additional Resources
Using Externally Hosted LLMs
Guide for working with Llama models hosted on external platforms.
Llama On-Prem
Information about on-premises deployment of Llama models.