Paddle implementation of

Fastformer: Additive Attention is All You Need

使用 Fastformer 结构做情感主题分类

Amazon Electronic Product Review Rating Classification

文本分类任务， 5 分类

• 第一列，Amazon

• MacroF

使用 Amazon Product Data 并随机抽取 Electronics 子类中 45k 的数据集

• 40k train
• 5k eval

• initial_params for Paddle

https://aistudio.baidu.com/aistudio/projectdetail/2559430?shared=1

check with torch

• https://github.com/rainyBJ/fast-transformer-paddle

• https://github.com/wilile26811249/Fastformer-PyTorch

• https://github.com/wuch15/Fastformer