Serge alternatives
Serge is an open-source chat interface that utilizes llama.cpp to run GGUF models. It is self-hosted, requiring no API keys, and features a SvelteKit frontend, Redis for storing chat history, and FastAPI with LangChain for the API layer.