Hierarchical Transformers — part 1
More efficient language models
Published in
9 min readOct 4, 2023
In this article, we look at hierarchical transformers: what they are, how they work, how they differ from standard Transformers and what are their benefits. Let’s get started.
What Are Hierarchical Transformers
The “hierarchical Transformer” refers to a transformer architecture…
