Commits

History for

Commits on Apr 16, 2024

adding script to fix the style and adding modified/fixed files with line length 125
ssusie
committedApr 16, 2024

Commits on Feb 13, 2024

[MLPerf GPT3] add c4_mlperf input pipeline and eval step
ZhiyuLi-goog
committedFeb 13, 2024

Commits on Feb 5, 2024

Copybara import of the project:

aireenmei
authored and
maxtex authors
committedFeb 5, 2024

Commits on Nov 15, 2023

data loading changes
khatwanimohit
committedNov 15, 2023

Commits on Jun 20, 2023

Avoid deprecated imports
Rafi Witten
committedJun 20, 2023

Commits on May 25, 2023

Update import since partition_spec and Mesh is no longer in experimental folder.
tonyjohnchen
committedMay 25, 2023

Commits on May 1, 2023

Call jax.device_count at start to solve TPU already registered issue (#21 )
gobbleturk
committedMay 1, 2023

Commits on Apr 24, 2023

Add multiple retries to load data in multihost_dataloading (#13 )
gobbleturk
committedApr 24, 2023

Commits on Apr 22, 2023

Add retry to dataset loading (#10 )
gobbleturk
committedApr 22, 2023

Commits on Mar 28, 2023

Adding License, CONTRIBUTING.md, fixing pylintrc (#84 )
khatwanimohit
committedMar 28, 2023

Commits on Feb 28, 2023

Switching GDA to jax.Array (#59 )
khatwanimohit
committedFeb 28, 2023

Commits on Feb 27, 2023

batch sharded data loading (#50 )
khatwanimohit
committedFeb 27, 2023

Commits on Feb 13, 2023

Added logging indirection to make it easier to change logging in the future.
Rafi Witten
committedFeb 13, 2023

Commits on Jan 31, 2023

Supporting work for Multipod
Rafi Witten
committedJan 31, 2023

Commits on Dec 28, 2022

Made final Pylint changes, including setting a 125 character width.
Rafi Witten
committedDec 28, 2022
Lint Changes to get score 10.0 (#6 )
khatwanimohit
committedDec 28, 2022

Commits on Dec 19, 2022

Adopting Multihost Dataloading
Rafi Witten
committedDec 19, 2022

Loading