Pinned Loading

1. Image-Retrieval-From-Text Image-Retrieval-From-Text Public

   This research project has constructed a two-stage clustering-based retrieval framework, as well as a deep learning-based retrieval algorithm using the CLIP model, which demonstrates zero-shot abili…

   Python 3

2. UI-Img-Txt-Contrastive-Learning UI-Img-Txt-Contrastive-Learning Public

   AI4SE UI Multimodal Framework This framework introduces multimodal pretraining for software UIs in AI4SE, enabling tasks like UI captioning, retrieval, and localization. It uniquely combines Grad-…

   Python 1

3. Data_Scoring_Model Data_Scoring_Model Public

   A demo implement of Quality Comparison Model. This Model aims to evalute image-text precomputed embeddings and sample better data for feeding LLM/MLLM training.

   Python

4. LLaVA_Factory LLaVA_Factory Public

   This work contributes on training/finetuning LLaVA-type MLLM. And tis work mainly borrows from TinyLLaVA_Factory.

   Python

5. MLLM_Scenario_Understanding MLLM_Scenario_Understanding Public

   Python