Skip to content

Transformer: PyTorch Implementation of "Attention Is All You Need"

Notifications You must be signed in to change notification settings

hyunwoongko/transformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Transformer - Pytorch

My own implementation Transformer model (Attention is All You Need - Google Brain, 2017)

img

Reference

Reference
Attention is All You Need, 2017 - Google
The Illustrated Transformer - Jay Alammar



Licence

Copyright 2019 Hyunwoong Go.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http:https://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.