knotgrass / attention Star 35 Code Issues Pull requests several types of attention modules written in PyTorch transformers pytorch transformer attention attention-mechanism softmax-layer multi-head-attention multi-query-attention grouped-query-attention scale-dot-product-attention Updated May 13, 2024 Python
reshalfahsi / image-captioning-mobilenet-llama3 Star 2 Code Issues Pull requests Image Captioning With MobileNet-LLaMA 3 nlp cnn pytorch transformer image-captioning image-text flickr8k-dataset mobilenetv3 pytorch-lightning kv-cache rotary-position-embedding grouped-query-attention rms-norm llama3 Updated Jun 23, 2024 Jupyter Notebook
prajeshshrestha / Llama-2.0-architecture-and-inference-from-scratch-with-PyTorch Star 0 Code Issues Pull requests pytorch pytorch-implementation kv-cache llama2 grouped-query-attention rotary-positional-embedding Updated Aug 5, 2024 Python