small experiments with AR image modeling with Mamba.

install with poetry lock && poetry install or use conda and install things by hand. mostly just the standard torch stuff + wandb.

Current best: python main.py --batch-size 64 --lr 1e-3 --n-layer 16 --d-model 512 --clip-grad-val 1

logged in wandb.