Large Language Models Just Got A Whole Lot Smaller

And how this might change the game for software startups

LLMs are getting smaller and more efficient! Image inspired by Benjamin Marie

This piece was co-written with David Meiborg.

TLDR: Large Language Models (LLMs for short) are currently huge, costly to run, and have a significant carbon footprint. Recent advancements in model compression and system-level optimization methods might…