Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin
00
2017-06-12
transformersnlp
Abstract
This paper introduces and evaluates the idea described in “Attention Is All You Need”, and reports empirical results that helped shape subsequent work in transformers, nlp.