SMOL-GPT alternatives
SMOL-GPT is a minimal PyTorch implementation for training small LLMs from scratch. It is designed for educational use, offering efficient training with flash attention and modern sampling methods. The project supports multiple platforms and is open source.