Skip to content

Train a word-level GPT on text data from scratch

Notifications You must be signed in to change notification settings

Mainakdeb/train-gpt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Training a word-level GPT (work in progress)

I tried the prompt "I looked above the dark" on a minimal gpt architecture trained on Lovecraft Novels, output from gpt shown below ⬇️

I looked above the dark, without the means of striking a light, crashing against the table, overturning a chair, and finally groping my way to the place where the blackness screamed with shocking music. To save myself and the outer hellish thing had seized me, and I knew I must have gained the roof, or at least some kind of floor. In the darkness I raised my free hand and tested the barrier, finding it stone and immovable. Then came a deadly circuit of the tower, clinging

About

Train a word-level GPT on text data from scratch

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published