What's Changed

• Add embedding layernorm for BLOOM (007950d)
• Clip optax version to <= 0.1.2 to fix failing tests by @vfbd in #9
• Fix missing requirements by @vfbd in #10
• Fix loading of base OPT-125M model and finetuned OPT models by @vfbd in #11
• Fix aria2 model downloads by @vfbd in #12

Full Changelog: v1.3.3...v1.3.4