Vim bf16 training

[chokevin8]

If anyone has done bf16 training on Vim, can you let me know your environment for CUDA version, pytorch, causal_conv1d, and mamba_ssm? I cannot seem to get the environment right for bf16 training without getting various errors. I'm currently using:

torch==2.1.1 torchvision==0.16.1 torchaudio==2.1.1
CUDA 11.8
causal_conv1d==1.1.1
mamba-ssm==1.2.0.post1