{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":808716789,"defaultBranch":"main","name":"VideoLLaMA2","ownerLogin":"DAMO-NLP-SG","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2024-05-31T16:58:53.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/130957594?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1717174733.0","currentOid":""},"activityList":{"items":[{"before":"7e83e667b2d863178653b57212b2fd6514ee2c3a","after":"f61d182169268d16786671a25d86766e1ce65624","ref":"refs/heads/main","pushedAt":"2024-07-19T03:27:01.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"⭐ [Feat] Supporting qwen2. (#31)\n\n* update requirements for supporting qwen2.\r\n\r\n* Modify flash attention version.\r\n\r\n* Add videollama2qwen2 transformer model.\r\n\r\n* Fix script typos.\r\n\r\n* Fix typos.\r\n\r\n* Add qwen-base model.\r\n\r\n* Update finetune scripts.\r\n\r\n* Anchoring qwen2 required packages.\r\n\r\n* Add qwen preprocess & related conversation template.\r\n\r\n* Fix requirements.\r\n\r\n* Downgrade torch version for compatibility.\r\n\r\n* Fix tokenizer paralleism bug.\r\n\r\n* Update transformers version.\r\n\r\n* Qwen2 requires torch2.2\r\n\r\n* Modify version.\r\n\r\n* Set default model base.\r\n\r\n* cancel wandb use for compatibility.\r\n\r\n* Add example qwen2 training scripts based on videollava dataset.","shortMessageHtmlLink":"⭐ [Feat] Supporting qwen2. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2386584951\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/31\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/31/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/31\">#31</a>)"}},{"before":"11c1c20e4a60b7d1eadb9336217527b85afd33a6","after":"7e83e667b2d863178653b57212b2fd6514ee2c3a","ref":"refs/heads/main","pushedAt":"2024-07-19T03:19:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Refine installation environment.","shortMessageHtmlLink":"Refine installation environment."}},{"before":"4b93fe257822cc9f1c5ace489ef3553a58d641bf","after":"11c1c20e4a60b7d1eadb9336217527b85afd33a6","ref":"refs/heads/main","pushedAt":"2024-07-17T12:07:17.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix load_4bit bug.","shortMessageHtmlLink":"Fix load_4bit bug."}},{"before":"55942aed3e977937c78b94dc05325872b72fd175","after":"4b93fe257822cc9f1c5ace489ef3553a58d641bf","ref":"refs/heads/main","pushedAt":"2024-07-17T12:06:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"🔧 [Fix] Standardizing conversation template name. (#55)\n\n* Refine scripts.\r\n\r\n* Refine evaluation scripts.\r\n\r\n* Standardize conversation template name.","shortMessageHtmlLink":"🔧 [Fix] Standardizing conversation template name. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2413381696\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/55\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/55/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/55\">#55</a>)"}},{"before":"451ec9e2cd799cefca58bcc88f6b583301988213","after":"55942aed3e977937c78b94dc05325872b72fd175","ref":"refs/heads/main","pushedAt":"2024-07-15T08:22:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Add logging code.","shortMessageHtmlLink":"Add logging code."}},{"before":"08d91fcf2a55d5f1dc71d9db2629512c660e4db6","after":"451ec9e2cd799cefca58bcc88f6b583301988213","ref":"refs/heads/main","pushedAt":"2024-07-15T08:18:00.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"🐛 [BUG] Update videollama2_trainer.py (#48)\n\nWhen avoiding the use of LoRA for multi-GPU training to obtain the state_dict, if tensors are distributed across multiple GPUs, it can lead to a situation where they cannot be retrieved, causing the process to stall.","shortMessageHtmlLink":"🐛 [BUG] Update videollama2_trainer.py (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2402419760\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/48\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/48/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/48\">#48</a>)"}},{"before":"80185efb105bf06a0a521b3e53a7202b92e4bbd1","after":"08d91fcf2a55d5f1dc71d9db2629512c660e4db6","ref":"refs/heads/main","pushedAt":"2024-07-09T11:51:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix evaluation bugs.","shortMessageHtmlLink":"Fix evaluation bugs."}},{"before":"a7ca2eadb9e3c9357c3a11ef56530706055a31e6","after":"80185efb105bf06a0a521b3e53a7202b92e4bbd1","ref":"refs/heads/main","pushedAt":"2024-07-09T09:39:54.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"import torch must before import transformers.","shortMessageHtmlLink":"import torch must before import transformers."}},{"before":"c310ae30bfde3a72b1e277eb1d79e0aecdae9662","after":"a7ca2eadb9e3c9357c3a11ef56530706055a31e6","ref":"refs/heads/main","pushedAt":"2024-07-09T03:10:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix default model name.","shortMessageHtmlLink":"Fix default model name."}},{"before":"a284baca86944a502068f0d91e9572793aa0fd5b","after":"c310ae30bfde3a72b1e277eb1d79e0aecdae9662","ref":"refs/heads/main","pushedAt":"2024-07-08T08:37:03.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"⭐ [Feat] Supporting qlora finetuning. (#37)\n\n* Supporting qlora finetuning.\r\n\r\n* Update qlora finetuning scripts\r\n\r\n* Fix qlora inference bugs.\r\n\r\n* Fix qwen bug.\r\n\r\n* Fix qlora bugs.\r\n\r\n* Update package version.\r\n\r\n* Update quantization config for qlora.","shortMessageHtmlLink":"⭐ [Feat] Supporting qlora finetuning. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2394145878\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/37\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/37/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/37\">#37</a>)"}},{"before":"2edd931d2530286cdc7bd9c27491c0268b5ca981","after":"a284baca86944a502068f0d91e9572793aa0fd5b","ref":"refs/heads/main","pushedAt":"2024-07-08T07:28:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Align pyproject.toml and requirements.txt","shortMessageHtmlLink":"Align pyproject.toml and requirements.txt"}},{"before":"c54a0cc2207e9b26ca9011e7469d9ffac3743b07","after":"2edd931d2530286cdc7bd9c27491c0268b5ca981","ref":"refs/heads/main","pushedAt":"2024-07-08T07:22:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix bracket typos.","shortMessageHtmlLink":"Fix bracket typos."}},{"before":"4e8bec6b2bba2f673cf7b869214bef8159ab4d2e","after":"c54a0cc2207e9b26ca9011e7469d9ffac3743b07","ref":"refs/heads/main","pushedAt":"2024-07-08T07:19:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"🐛 [Bug] Fix mistral tokenizer bug and related issues. (#39)\n\n* Fix mistral tokenizer bug.\r\n\r\n* Update readme","shortMessageHtmlLink":"🐛 [Bug] Fix mistral tokenizer bug and related issues. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2394802814\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/39\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/39/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/39\">#39</a>)"}},{"before":"7cd7ec57d6a2aeea72411456666e76568b25b58b","after":"4e8bec6b2bba2f673cf7b869214bef8159ab4d2e","ref":"refs/heads/main","pushedAt":"2024-07-08T05:39:16.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix qwen bug.","shortMessageHtmlLink":"Fix qwen bug."}},{"before":"4d1a77c2462a7f5c9dfe49268a7a0d23d5579481","after":"7cd7ec57d6a2aeea72411456666e76568b25b58b","ref":"refs/heads/main","pushedAt":"2024-07-07T16:52:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Add some debug string in lora scripts.","shortMessageHtmlLink":"Add some debug string in lora scripts."}},{"before":"4c5c87fe012b6c7ea6104b3f664963c4c17c4449","after":"4d1a77c2462a7f5c9dfe49268a7a0d23d5579481","ref":"refs/heads/main","pushedAt":"2024-07-06T09:24:49.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix egoschema evaluation bugs.","shortMessageHtmlLink":"Fix egoschema evaluation bugs."}},{"before":"eac5db427e54ce016e2b60c73770c52194ce6026","after":"4c5c87fe012b6c7ea6104b3f664963c4c17c4449","ref":"refs/heads/main","pushedAt":"2024-07-05T17:48:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix mistral tokenizer bug.","shortMessageHtmlLink":"Fix mistral tokenizer bug."}},{"before":"e725c6249b97b5f06d9538ae8641f22b63354caf","after":"eac5db427e54ce016e2b60c73770c52194ce6026","ref":"refs/heads/main","pushedAt":"2024-07-04T09:20:35.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"⭐ [Feat] Supporting Lora finetuning (#36)\n\n* Support lora & qlora.\r\n“\r\n\r\n* Modify lora scripts.\r\n\r\n* Support lora training and inference.\r\n\r\n* remove some debug code.","shortMessageHtmlLink":"⭐ [Feat] Supporting Lora finetuning (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2390292213\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/36\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/36/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/36\">#36</a>)"}},{"before":"8e45049fccf19e9b7f04d6226aefb714fe0c9565","after":"e725c6249b97b5f06d9538ae8641f22b63354caf","ref":"refs/heads/main","pushedAt":"2024-07-04T07:50:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"LengSicong","name":"Sicong","path":"/LengSicong","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/55685981?s=80&v=4"},"commit":{"message":"Update README.md\n\ngoogle drive link for videollava_pt data","shortMessageHtmlLink":"Update README.md"}},{"before":"3690788e04668eb36e4ae6ad08d5b7527961da28","after":"8e45049fccf19e9b7f04d6226aefb714fe0c9565","ref":"refs/heads/main","pushedAt":"2024-07-04T04:00:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"The qlora is hard to be compatible with high version transformers.","shortMessageHtmlLink":"The qlora is hard to be compatible with high version transformers."}},{"before":"c53d1d84cc89157e1af2df45a6c3ab19a480da8a","after":"3690788e04668eb36e4ae6ad08d5b7527961da28","ref":"refs/heads/main","pushedAt":"2024-07-03T09:35:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Refine requirements package.","shortMessageHtmlLink":"Refine requirements package."}},{"before":"6deb64692fc41c7486f536d41e31e7cf96c589bb","after":"c53d1d84cc89157e1af2df45a6c3ab19a480da8a","ref":"refs/heads/main","pushedAt":"2024-07-03T09:22:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Update gradio demo.","shortMessageHtmlLink":"Update gradio demo."}},{"before":"2d4c7753bb74a1e949adbcbff6db6e05b26944ca","after":"6deb64692fc41c7486f536d41e31e7cf96c589bb","ref":"refs/heads/main","pushedAt":"2024-07-03T08:54:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Fix scripts bug.","shortMessageHtmlLink":"Fix scripts bug."}},{"before":"2b85705c2d61a7653747e4b11beb3d4db9d1ff08","after":"2d4c7753bb74a1e949adbcbff6db6e05b26944ca","ref":"refs/heads/main","pushedAt":"2024-07-02T08:50:28.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Update install packages for evaluation.","shortMessageHtmlLink":"Update install packages for evaluation."}},{"before":"8aa9fe743ec0c80d7f2c1ca32a4e851525c89b18","after":"2b85705c2d61a7653747e4b11beb3d4db9d1ff08","ref":"refs/heads/main","pushedAt":"2024-07-01T12:39:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Support lora & qlora. (#27)","shortMessageHtmlLink":"Support lora &amp; qlora. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2383742221\" data-permission-text=\"Title is private\" data-url=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/issues/27\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/DAMO-NLP-SG/VideoLLaMA2/pull/27/hovercard\" href=\"https://github.com/DAMO-NLP-SG/VideoLLaMA2/pull/27\">#27</a>)"}},{"before":"1f9566317d2479aaaaa5e6944563261147ac6cac","after":"8aa9fe743ec0c80d7f2c1ca32a4e851525c89b18","ref":"refs/heads/main","pushedAt":"2024-06-26T08:21:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"lixin4ever","name":"LI XIN","path":"/lixin4ever","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/18526640?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"fb63bcdce79f9930f36cada54157cbff1b8bb2a2","after":"1f9566317d2479aaaaa5e6944563261147ac6cac","ref":"refs/heads/main","pushedAt":"2024-06-24T11:58:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"mcqa debug.","shortMessageHtmlLink":"mcqa debug."}},{"before":"c0644f1219ec025c9259a2201c795c76a87e78e2","after":"fb63bcdce79f9930f36cada54157cbff1b8bb2a2","ref":"refs/heads/main","pushedAt":"2024-06-19T03:34:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"lixin4ever","name":"LI XIN","path":"/lixin4ever","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/18526640?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"91d303b248de64ecca86ee7d0ee73d3d28690a24","after":"c0644f1219ec025c9259a2201c795c76a87e78e2","ref":"refs/heads/main","pushedAt":"2024-06-19T02:15:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Clean videochatgpt evaluation old scripts.","shortMessageHtmlLink":"Clean videochatgpt evaluation old scripts."}},{"before":"aeb0e4e60390e204897fcd958f8ccbad114eb1cc","after":"91d303b248de64ecca86ee7d0ee73d3d28690a24","ref":"refs/heads/main","pushedAt":"2024-06-19T01:48:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"clownrat6","name":"🤡🐀","path":"/clownrat6","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/58427300?s=80&v=4"},"commit":{"message":"Clean old style code.","shortMessageHtmlLink":"Clean old style code."}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEg4QskwA","startCursor":null,"endCursor":null}},"title":"Activity · DAMO-NLP-SG/VideoLLaMA2"}