On the Expressive Power of Self-Attention Matrices
Published in Arxiv, 2021
https://arxiv.org/pdf/2111.12993
Valerii Likhosherstov, Krzysztof Choromanski, and Adrian Weller.
Valerii Likhosherstov
PhD student @ Cambridge Machine Learning Group. Graduated from UrFU SESC (high school), UrFU (B.S.), Yandex Data School, Skoltech & HSE (M.S.).
- Cambridge, The United Kingdom
- Github
- Google Scholar