Meet M6 — 10 Trillion Parameters at 1% GPT-3’s Energy Cost

Smaller players can now enter the game of large AI models

Photo by vs148 on Shutterstock (edited)

I can confidently say artificial intelligence is advancing fast when a neural network 50 times larger than another can be trained at a 100 times less energy cost — with just one year in between!