OptiQ alternatives
OptiQ is an MLX-native toolkit designed to run large language models on Apple Silicon. It focuses on mixed-precision quantization, assigning different bit-widths to model layers based on their sensitivity. This approach allows for efficient performance while maintaining accuracy, especially in sparse models. It also supports LoRA fine-tuning and serving with features like prompt caching and tool-call healing.
Alternatives
- Ollama
- Jan.ai
- GPT4ALL
- Ensu
- Open WebUI
- AnythingLLM
- Alpaca - Ollama Client
- LM Studio
- LibreChat
- PocketPal
- Ollama App
- Cherry Studio
- Google AI Edge Gallery
- Pinokio
- Khoj
- Private GPT
- llama.cpp
- Onit AI
- local.ai
- Rodel Downloader
- Off Grid AI
- KoboldCpp
- NodeTool
- LocalAI
- Backyard AI
- NVIDIA ChatRTX
- Warden
- Text generation web UI
- Typing Mind
- Osaurus
- RWKV Chat
- Msty AI
- oMLX
- ANIE
- FastFlowLM
- Nexa Studio
- AI00 RWKV Server
- RWKV Runner
- MNN Chat
- MLC LLM
- Inferencer
- ArgalAI
- Follamac
- GPTMobile
- Cortex.cpp
- Gai
- LM-Kit Maestro
- LM-Kit.NET
- HugstonOne
- Greenative Studio
- Cloudflare Workers AI
- Jellybox