GLaM

The GLaM (Generalist Language Model) is a family of language models that use a sparsely activated mixture-of-experts architecture to efficiently scale mod