Hands-on Tutorials

How to Apply Transformers to Any Length of Text

Restore the power of NLP for long sequences

James Briggs
Towards Data Science
10 min readMar 10, 2021

--

Photo by Sebastian Staines on Unsplash

The de-facto standard in many natural language processing (NLP) tasks nowadays is to use a transformer. Text generation? Transformer. Question-and-answering? Transformer. Language classification? Transformer!

--

--