Skip to content

Commit

Permalink
Update LLaVA-NeXT.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kcz358 authored May 9, 2024
1 parent a97a86d commit 72f0580
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/LLaVA-NeXT.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ eval_model(args)
```

### Inference code
Here is a quick inference code using `llavanext-llama3-8B` as an example. You will need to install [`flash-attn`](https://github.com/Dao-AILab/flash-attention) to use this code snippet. If you don't want to install it, you can set ` attn_implementation=None` when load_pretrained_model
Here is a quick inference code using [`llavanext-llama3-8B`](https://huggingface.co/lmms-lab/llama3-llava-next-8b) as an example. You will need to install [`flash-attn`](https://github.com/Dao-AILab/flash-attention) to use this code snippet. If you don't want to install it, you can set `attn_implementation=None` when load_pretrained_model
```python
from llava.model.builder import load_pretrained_model
from llava.mm_utils import get_model_name_from_path, process_images, tokenizer_image_token
Expand Down

0 comments on commit 72f0580

Please sign in to comment.