#

grouped-query-attention

Here are 3 public repositories matching this topic...

knotgrass / attention

several types of attention modules written in PyTorch

transformers pytorch transformer attention attention-mechanism softmax-layer multi-head-attention multi-query-attention grouped-query-attention scale-dot-product-attention

Updated May 13, 2024
Python

reshalfahsi / image-captioning-mobilenet-llama3

Image Captioning With MobileNet-LLaMA 3

nlp cnn pytorch transformer image-captioning image-text flickr8k-dataset mobilenetv3 pytorch-lightning kv-cache rotary-position-embedding grouped-query-attention rms-norm llama3

Updated Jun 23, 2024
Jupyter Notebook

prajeshshrestha / Llama-2.0-architecture-and-inference-from-scratch-with-PyTorch

pytorch pytorch-implementation kv-cache llama2 grouped-query-attention rotary-positional-embedding

Updated Aug 5, 2024
Python

Improve this page

Add a description, image, and links to the grouped-query-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the grouped-query-attention topic, visit your repo's landing page and select "manage topics."