GPT vs BERT: Which is Better?

Comparing two large-language models: Approach and example

Pranay Dave
Towards Data Science
6 min readJun 23, 2023

--

Image created by DALLE and PPT by author (https://labs.openai.com/s/qQgpAQbLi0srYlZHOHQjGKWh)

The rise in popularity of generative AI has also led to an increase in the number of large language models. In this story, I will make a comparison between two of them: GPT and BERT. GPT (Generative Pre-trained Transformer) is developed by OpenAI and is based on decoder-only architecture. On the other hand, BERT…

--

--