Merge pull request #16 from VE-FORBRYDERNE/staging

Fix compatibility with UI2

Merge pull request #13 from VE-FORBRYDERNE/staging

Fix for GPT-J models with `vocab_size % 8 != 0`

Merge pull request #12 from VE-FORBRYDERNE/staging

Fix aria2 model downloads

Merge pull request #8 from VE-FORBRYDERNE/staging

Fix failing tests

Merge pull request #7 from VE-FORBRYDERNE/staging

Fix various issues related to OPT models

Merge pull request #6 from VE-FORBRYDERNE/staging

Don't run tests in mtj_softtuner/kobold

Merge pull request #5 from VE-FORBRYDERNE/staging

Add support for fractional number of epochs

Add in a previously missing `utils.bar.update(1)` call

Add OPT support

Soft embedding is now added before learned pos embs