Inside AI
Illustrated: Self-Attention
A step-by-step guide to self-attention with illustrations and code
Published in
9 min readNov 18, 2019
The illustrations are best viewed on the Desktop. A Colab version can be found here (thanks to Manuel Romero!).
Changelog:
30 Dec 2022 — Use Medium’s new code block for syntax highlighting
12 Jan 2022 — Improve clarity
5 Jan 2022 — Fix…
