The History of Open-Source LLMs: Early Days (Part One)
Understanding GPT-Neo, GPT-J, GLM, OPT, BLOOM, and more…
Published in
20 min readNov 7, 2023
Research on language modeling has a long history that dates back to models like GTP and GPT-2 or even RNN-based techniques (e.g., ULMFit) that predate modern, transformer-based language models. Despite this long history, however, language models have only become popular…
