Unsloth

Unsloth lets you train, run, and export large language models on your own hardware through an open-source Python library and a local Desktop app. You chat