KoboldCpp alternatives

KoboldCpp is a free, open-source application designed to facilitate text generation using GGML-format language models. Built upon llama.cpp, it provides a user interface and API, incorporating features from previous Kobold software, to enable creative writing and conversational AI experiences. The software is available for multiple operating systems and can be run locally on user-controlled hardware.

Alternatives