Local ChatGPT

This project leverages Llama 3.2 vision and Chainlit to create a 100% locally running ChatGPT app.

Installation and setup

Setup Ollama:

# setup ollama on linux 
curl -fsSL https://ollama.com/install.sh | sh
# pull llama 3.2 vision model
ollama pull llama3.2-vision

Install Dependencies: Ensure you have Python 3.11 or later installed.

pip install pydantic==2.10.1 chainlit ollama

Run the app:

Run the chainlit app as follows:

chainlit run app.py -w

Demo Video

Click below to watch the demo video of the AI Assistant in action:

Watch the video

Get a FREE Data Science eBook 📖 with 150+ essential lessons in Data Science when you subscribe to our newsletter! Stay in the loop with the latest tutorials, insights, and exclusive resources. Subscribe now!

Contribution

Contributions are welcome! Please fork the repository and submit a pull request with your improvements.

README.md

Local ChatGPT

Installation and setup

Demo Video

📬 Stay Updated with Our Newsletter!

Contribution