Practical guide to Attention mechanism for NLU tasks

Tested hands-on strategies to tackle attention for improving sequence to sequence models

Michel Kana, Ph.D
Towards Data Science
10 min readSep 8, 2019

--

Chatbots, virtual assistants, augmented analytic systems typically receive user queries such as “Find me an action movie by Steven Spielberg”. The system should correctly detect the intent “find_movie” while filling the slots “genre” with value “action” and “directed_by” with value “Steven Spielberg”. This is a Natural Language Understanding (NLU) task kown as Intent Classification & Slot

--

--

Husband & Dad. Mental health advocate. Top Medium Writer. 20 years in IT. AI Expert @Harvard. Empowering human-centered organizations with high-tech.