Practical guide to Attention mechanism for NLU tasks
Tested hands-on strategies to tackle attention for improving sequence to sequence models
Published in
10 min readSep 8, 2019
Chatbots, virtual assistants, augmented analytic systems typically receive user queries such as “Find me an action movie by Steven Spielberg”. The system should correctly detect the intent “find_movie” while filling the slots “genre” with value “action” and “directed_by” with value “Steven Spielberg”. This is a Natural Language Understanding (NLU) task kown as Intent Classification & Slot…