BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Abstract

This paper introduces and evaluates the idea described in “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”, and reports empirical results that helped shape subsequent work in transformers, nlp.