KimRass / Transformer Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

PyTorch implementation of 'Transformer' (Vaswani et al., 2017)

1 star 0 forks Branches Tags Activity

Name		Name	Last commit message	Last commit date
Latest commit History 16 Commits
papers		papers
vis		vis
.gitignore		.gitignore
README.md		README.md
model.py		model.py
pos_encoding.jpg		pos_encoding.jpg
set_pythonpath.sh		set_pythonpath.sh
utils.py		utils.py

Repository files navigation

Attention Is All You Need

1. Visualization

1) Position Encoding

dim=512, max_len=1024