transformer综述

Transformer-XL

https://arxiv.org/abs/1901.02860v3

RoFormer

https://arxiv.org/pdf/2104.09864.pdf

google2020出品的transformer的综述

https://arxiv.org/pdf/2009.06732.pdf