Skip to content

Transformer Model implementation from the ground using keras and core tensorflow

Notifications You must be signed in to change notification settings

NusretOzates/TransformerFromTheGround

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TransformerFromTheGround

Transformer Model implementation from the ground using keras and core tensorflow

I get the codes from https://colab.research.google.com/github/tensorflow/docs/blob/master/site/en/tutorials/text/transformer.ipynb and learn how to build a transformer model from the ground the problem with this notebook is, it is hard to save and reuse. Also, with my redesign you can use model.fit() function to train your model.

This is not a professional implementation and made for fun and study purposes! You are welcome to suggest all kind of improvements:)

TODO: Add more comment!

About

Transformer Model implementation from the ground using keras and core tensorflow

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages