Commits

Commits on Jul 14, 2020

Include nccl
rewonc
committedJul 14, 2020

Commits on Jul 19, 2019

just some work in progress conv/self attention kernenls
scott-gray
committedJul 19, 2019

Commits on May 5, 2019

minor fix for compute of clipped loss in fp16 softmax_cross_entropy
scott-gray
committedMay 5, 2019

Commits on May 4, 2019

updated tests
scott-gray
committedMay 4, 2019

Commits on Apr 24, 2019

enwik8.py: increased memory savings by forced late casting
scott-gray
committedApr 24, 2019
added more comments to enwik8 transformer example
scott-gray
committedApr 24, 2019
updated examples/transformer/enwik8.py example
scott-gray
committedApr 24, 2019

Commits on Apr 23, 2019

bumped version number to allow pypi upload
scott-gray
committedApr 23, 2019
fixed gpu version detection bug in fp32 version of bst ops
scott-gray
committedApr 23, 2019
updated code to support sparse transformer paper.
scott-gray
committedApr 23, 2019

Commits on Nov 22, 2018

Merge pull request #17 from christopherhesse/update-readme
scott-gray
committedNov 22, 2018
update README with repo status
christopherhesse
committedNov 22, 2018

Commits on Nov 19, 2018

added support for asymetric query/key dimensions for use in down/up sampling bst layers
scott-gray
committedNov 19, 2018

Commits on Oct 30, 2018

added support for blocksize 8 in blocksparse transformer
scott-gray
committedOct 30, 2018

Commits on Oct 21, 2018

changed memory format between qk product and softmax to be bfloat16 to accomidate higher dynamic range than in fp16
scott-gray
committedOct 21, 2018

Commits on Oct 16, 2018

lots of fixes + blocksparse transformer ops for volta fp16 (see enwiki8 example)
scott-gray
committedOct 16, 2018

Commits on Sep 7, 2018

added missing time import
scott-gray
committedSep 7, 2018

Commits on Aug 23, 2018

Added a bunch of new stuff and enhancments. Will provide better docs soon.
scott-gray
committedAug 23, 2018

Commits on Jan 25, 2018

Merge pull request #8 from dchichkov/patch-1
scott-gray
committedJan 25, 2018
handle tf passing an unintialized shape handle (probably a tf bug)
scott-gray
committedJan 25, 2018

Commits on Jan 24, 2018

detect the value of _GLIBCXX_USE_CXX11_ABI to compile with
scott-gray
committedJan 24, 2018
Merge pull request #9 from dchichkov/patch-2
scott-gray
committedJan 24, 2018
np.fromfile instead of np.fromstring is shorter and doesn't throw an assertion in python 2.7.
dchichkov
committedJan 24, 2018

Commits on Jan 23, 2018

added missing __init__.py file
scott-gray
committedJan 23, 2018
SyntaxError: invalid syntax in the def fused_lstm_gates - #6 in python 2.7
dchichkov
committedJan 23, 2018

Commits on Dec 6, 2017

updated readme

Scott Gray
authored and
Scott Gray
committedDec 6, 2017
1.0.0
openai-sys-okta-integration
committedDec 6, 2017
initial
jonasschneider
committedDec 6, 2017