tivek
Follow
Stars
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
A simple but complete full-attention transformer with a set of promising experimental features from various papers
A minimal pytorch implementation of VAE, IWAE, MIWAE
Implements a fixed-capacity stack-allocated Vec alternative backed by an array, using const generics.
Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
Tools to assist modeling and training with PyTorch.
⭐️ Companies that don't have a broken hiring process
RPM specfiles and patches to install linux-gpib on Fedora
Extra iterator adaptors, iterator methods, free functions, and macros.
A Python module for decorators, wrappers and monkey patching.
Efficiently computes derivatives of numpy code.
This is an Old School horizontal scroller 'Shoot Them All' game in bash. With multiplayer modes team and duel. You have to defeat 100 aliens to fight with Boss. I'm using netcat for client-server e…
Real-time stream processing for python
multithreading/multiprocessing with ipywidgets and jupyter notebooks
An extension for IPython that help to run AsyncIO code in your interactive session
A repository which has all the basic and advanced Algorithms and Data Structures implemented for reference in C++ and C#.
Bitmap & tilemap generation from a single example with the help of ideas from quantum mechanics
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
Godot Engine – Multi-platform 2D and 3D game engine