Skip to content

A Simple implementation of the Transformer model from scratch

Notifications You must be signed in to change notification settings

rushizirpe/transformer-from-zero

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Transformer from Scratch (In Progress...)

Open In Colab

Overview

This project is a simple implementation of the Transformer model from scratch using Python. It is intended for educational purposes to deepen understanding of the Transformer architecture. Feel free to experiment and modify the code for your learning purposes.

Usage

  1. Clone the repository:

    git clone https://github.com/rushizirpe/transformer-from-zero.git
    cd transformer-from-zero
  2. Run the main script:

    python train.py

Notes

  • This project is not optimized for production use.

About

A Simple implementation of the Transformer model from scratch

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages