Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

Abstract

This paper introduces and evaluates the idea described in “Swin Transformer: Hierarchical Vision Transformer using Shifted Windows”, and reports empirical results that helped shape subsequent work in vision, transformers.