wehub-resource-sync
5.2 KiB
🌟 Vibe Models 🌟
Welcome to the Vibe Models page! Here you can find a curated list of suggested models to use with Vibe. To install a model, use the "Magic Setup" link to open it in Vibe, or copy and paste the direct download link in Vibe settings.
Available Models
🌱 Tiny Model
A compact and efficient version, suitable for quick tasks and limited-resource environments.
👉 Magic Setup
🔽 Direct Download
🌿 Small Model
A small yet capable model for a balance of efficiency and performance.
👉 Magic Setup
🔽 Direct Download
⚖️ Medium Model
Balances performance and resource usage, making it ideal for most general applications.
👉 Magic Setup
🔽 Direct Download
🚀 Large Model (v3)
For high accuracy and more computational resources, excels in complex scenarios.
👉 Magic Setup
🔽 Direct Download
🚀 Large v3 Turbo (Recommended)
👉 Magic Setup
🔽 Direct Download
🦜 Parakeet TDT 0.6B v3
Supports streaming and is best suited for dictation.
👉 View Model
🔽 Download Q4_K_M
⚡ Nemotron 3.5 ASR Streaming 0.6B
Supports streaming and is best suited for dictation.
👉 View Model
🔽 Download Q4_K_M
Models optimised for other languages
✡️ Hebrew (Ivrit)
Specialized for Hebrew (Ivrit) language data, optimized for high speed and accuracy in Hebrew tasks.
👉 Magic Setup (Large v3 Turbo)
🔽 Direct Download (Large v3 Turbo)
🇳🇴 Norwegian
Optimised for Norwegian by the AI Lab at the National Library of Norway.
👉 Magic Setup (medium)
🔽 Direct Download (medium)
👉 Magic Setup (large)
🔽 Direct Download (large)
More models of smaller sizes are available via their huggingface download page.
Find the size you want, download the ggml-model.bin file, rename the file, and palce it in vibe's model folder.
🇸🇪 Swedish
Optimised for Swedish by the Data Lab at the National Library of Sweden.
👉 Magic Setup (medium)
🔽 Direct Download (medium)
👉 Magic Setup (large v3)
🔽 Direct Download (large v3)
More models of smaller sizes are available via their huggingface download page.
Find the size you want, download the ggml-model.bin file, rename the file, and palce it in vibe's model folder.
Enjoy exploring these models and enhancing your Vibe! 🌐✨
Want More?
Find additional models here:
Prepare your own models
Convert transformers to GGML
# Setup environment
curl -LsSf https://astral.sh/uv/install.sh | sh
source ~/.bashrc
uv venv
uv pip install torch transformers huggingface_hub
huggingface-cli login --token "token" # https://huggingface.co/settings/tokens
# Convert and upload
git clone https://github.com/openai/whisper
git clone https://github.com/ggml-org/whisper.cpp
git clone https://huggingface.co/ivrit-ai/whisper-large-v3-turbo
uv run ./whisper.cpp/models/convert-h5-to-ggml.py ./whisper-large-v3-turbo/ ./whisper .
uv run huggingface-cli upload --repo-type model whisper-large-v3-turbo-ivrit ./ggml-model.bin ./ggml-model.bin
# Quantize
sudo apt install cmake build-essential -y
cd whisper.cpp
cmake -B build
cmake --build build --config Release
cd ..
./whisper.cpp/build/bin/quantize ggml-model.bin ./ggml-model.int8.bin q8_0 # fp32/fp16/q8_0/q5_0