ELECTRA, Pre-Training Text Encoders as Discriminators Rather Than Generators Note

CTRL 论文 + 实践 + 源码

Bert, Pre-training of Deep Bidirectional Transformers for Language Understanding Note

Attention Is All You Need Note