Llama can now see and run on your device - welcome Llama 3.2
•
157
Merve Noyan PRO
merve
AI & ML interests
VLMs, vision & co
Articles
Organizations
Posts
68
Post
205
Another great week in open ML!
Here's a small recap 🫰🏻
Model releases
⏯️ Video Language Models
AI at Meta released Vision-CAIR/LongVU_Qwen2_7B, a new state-of-the-art long video LM model based on DINOv2, SigLIP, Qwen2 and Llama 3.2
💬 Small language models
Hugging Face released HuggingFaceTB/SmolLM2-1.7B, a family of new smol language models with Apache 2.0 license that come in sizes 135M, 360M and 1.7B, along with datasets.
Meta released facebook/MobileLLM-1B, a new family of on-device LLMs of sizes 125M, 350M and 600M
🖼️ Image Generation
Stability AI released stabilityai/stable-diffusion-3.5-medium, a 2B model with commercially permissive license
🖼️💬Any-to-Any
gpt-omni/mini-omni2 is closest reproduction to GPT-4o, a new LLM that can take image-text-audio input and output speech is released!
Dataset releases
🖼️ Spawning/PD12M, a new captioning dataset of 12.4 million examples generated using Florence-2
Here's a small recap 🫰🏻
Model releases
⏯️ Video Language Models
AI at Meta released Vision-CAIR/LongVU_Qwen2_7B, a new state-of-the-art long video LM model based on DINOv2, SigLIP, Qwen2 and Llama 3.2
💬 Small language models
Hugging Face released HuggingFaceTB/SmolLM2-1.7B, a family of new smol language models with Apache 2.0 license that come in sizes 135M, 360M and 1.7B, along with datasets.
Meta released facebook/MobileLLM-1B, a new family of on-device LLMs of sizes 125M, 350M and 600M
🖼️ Image Generation
Stability AI released stabilityai/stable-diffusion-3.5-medium, a 2B model with commercially permissive license
🖼️💬Any-to-Any
gpt-omni/mini-omni2 is closest reproduction to GPT-4o, a new LLM that can take image-text-audio input and output speech is released!
Dataset releases
🖼️ Spawning/PD12M, a new captioning dataset of 12.4 million examples generated using Florence-2
Post
4427
Hugging Face Hub Python library now comes with easy inference for vision language models! ✨
$ pip install huggingface_hub 🤗
$ pip install huggingface_hub 🤗
Collections
33
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 71 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 18 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 44 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 99
spaces
104
models
88
merve/google-ckpts
Updated
merve/google-tokenizers
Updated
merve/siglip-so400m-patch16-256-i18n
Updated
•
27
•
8
merve/idefics3-llama-vqav2
Updated
merve/idefics3llama-vqav2
Updated
•
8
merve/flux-dreambooth-lora
Updated
•
1
merve/trained-flux-lora-lego
Text-to-Image
•
Updated
•
22
•
•
1
merve/flux-lego-lora-dreambooth
Text-to-Image
•
Updated
•
1k
•
•
13
merve/sam2-hiera-large
Mask Generation
•
Updated
•
890k
•
2
merve/sam2-hiera-base-plus
Mask Generation
•
Updated
•
96
datasets
26
merve/model-test-inputs
Updated
•
48
merve/vqav2-small
Viewer
•
Updated
•
21.4k
•
868
•
7
merve/SGinW
Preview
•
Updated
•
139
merve/pascal-voc
Viewer
•
Updated
•
336k
•
245
merve/YouCook2
Viewer
•
Updated
•
2k
•
53
merve/faiss_embeddings
Updated
•
12
merve/pokemon-ds-embeddings
Viewer
•
Updated
•
833
•
53
•
4
merve/tr-h4-norobots
Updated
•
65
•
10
merve/lego_sets_latest
Viewer
•
Updated
•
61
•
155
•
2
merve/ai-tube-dummy
Updated
•
49