{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":397143325,"defaultBranch":"master","name":"MolGen","ownerLogin":"eyalmazuz","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2021-08-17T06:59:48.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/34383384?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1719657371.0","currentOid":""},"activityList":{"items":[{"before":"e9c94f355f19313d279f64fb4280385faf9f994a","after":"82c94008e65530c31f699ecd9611a17e0f33faed","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-18T12:50:38.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"- debugging sampling first step + add attention to the previous states in generation\n- fix dtypes for generation","shortMessageHtmlLink":"- debugging sampling first step + add attention to the previous state…"}},{"before":"8975047f5d12326314d2a6c3892302153e3787ba","after":"e9c94f355f19313d279f64fb4280385faf9f994a","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-17T20:31:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"- fix shape bug","shortMessageHtmlLink":"- fix shape bug"}},{"before":"d8186f68d8c3a1af6ac26665590e1a94fee20872","after":"8975047f5d12326314d2a6c3892302153e3787ba","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-16T19:11:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"- working on generation loop for evaluation","shortMessageHtmlLink":"- working on generation loop for evaluation"}},{"before":"8dc70f5b1e2e64b52b2b09c31c6fa49232c5a63a","after":"d8186f68d8c3a1af6ac26665590e1a94fee20872","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-11T19:52:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"- debugging sampling","shortMessageHtmlLink":"- debugging sampling"}},{"before":"141e863dd8ad3b3a39b279866ebab99b86d2bf48","after":"8dc70f5b1e2e64b52b2b09c31c6fa49232c5a63a","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-11T14:27:18.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"- expand the attention mask to (block_size, seq_len) for mean_pooling\n- fix mean_pooling to the correct shapes","shortMessageHtmlLink":"- expand the attention mask to (block_size, seq_len) for mean_pooling"}},{"before":"56022fa48be153af12401cfbd41a499f4e3cc10b","after":"141e863dd8ad3b3a39b279866ebab99b86d2bf48","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-08T19:27:16.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"- replace state encoder with mean pooling\n- update env for cluster training\n- increase vocab size by # special tokens when running on cpu","shortMessageHtmlLink":"- replace state encoder with mean pooling"}},{"before":"97bd0f6373613e5ca4e13e91b9ed453192bef204","after":"56022fa48be153af12401cfbd41a499f4e3cc10b","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-02T21:10:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"try to improve memory handling in cuda","shortMessageHtmlLink":"try to improve memory handling in cuda"}},{"before":"4b88c03a4644e58ca3d53037b7d1c9fe2e604184","after":"97bd0f6373613e5ca4e13e91b9ed453192bef204","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-02T21:05:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"add toy dataset for fast debugging","shortMessageHtmlLink":"add toy dataset for fast debugging"}},{"before":"c8e4abe729f2f99fc0f55f4117502990e293b47b","after":"4b88c03a4644e58ca3d53037b7d1c9fe2e604184","ref":"refs/heads/decision_transformer","pushedAt":"2024-07-02T21:04:39.000Z","pushType":"push","commitsCount":11,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"fit architecture to SMILES data","shortMessageHtmlLink":"fit architecture to SMILES data"}},{"before":"7123d12cd5295327a2c1b658783cc0ff0d1b0948","after":"c8e4abe729f2f99fc0f55f4117502990e293b47b","ref":"refs/heads/decision_transformer","pushedAt":"2024-06-29T19:03:51.000Z","pushType":"push","commitsCount":11,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"add rewards to dt_config.toml that are needed to define rtg in the dataset construction\nadd the reward func to dataset in train_single_gpu.py.\nadd new train_dt.py where the decision transformer training loop will be","shortMessageHtmlLink":"add rewards to dt_config.toml that are needed to define rtg in the da…"}},{"before":"df6d54649679a798aecb64c797e9ecfb01f027d2","after":"7123d12cd5295327a2c1b658783cc0ff0d1b0948","ref":"refs/heads/decision_transformer","pushedAt":"2024-06-29T13:08:59.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"add Dataset Class for DecisionTransformer with reward_to_go","shortMessageHtmlLink":"add Dataset Class for DecisionTransformer with reward_to_go"}},{"before":null,"after":"df6d54649679a798aecb64c797e9ecfb01f027d2","ref":"refs/heads/decision_transformer","pushedAt":"2024-06-29T10:36:11.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Or-Gindes","name":null,"path":"/Or-Gindes","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/60705251?s=80&v=4"},"commit":{"message":"prepare dataset for decision transformer","shortMessageHtmlLink":"prepare dataset for decision transformer"}},{"before":"b90b3796a79546cb7d05089d5f606327aaba8796","after":"c6fa52c79af04106ee5126888350da68ea82e12b","ref":"refs/heads/v2","pushedAt":"2024-06-28T09:44:34.000Z","pushType":"push","commitsCount":27,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Merge branch 'v2' into refactor/training","shortMessageHtmlLink":"Merge branch 'v2' into refactor/training"}},{"before":null,"after":"6d56d5e406986b20e602621bb743e3d47d06645e","ref":"refs/heads/refactor/training","pushedAt":"2024-06-22T05:51:27.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Single GPU training WIP- training loop completed","shortMessageHtmlLink":"Single GPU training WIP- training loop completed"}},{"before":"ba61dde1df48e7be487f558f14c1d1a89cea2721","after":null,"ref":"refs/heads/tests","pushedAt":"2024-06-14T06:23:15.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"}},{"before":"24b247c60d27dc56e9543c219e7fd784e83e729d","after":null,"ref":"refs/heads/multi_sample","pushedAt":"2024-06-14T06:23:08.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"}},{"before":"e9514515f8864b7953e45c083879b935ae498517","after":null,"ref":"refs/heads/refactor/tokenizers","pushedAt":"2024-06-14T06:23:05.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"}},{"before":"16f6669fa5459f2443d88a86e9f3d182fc212eab","after":null,"ref":"refs/heads/refactor/reward","pushedAt":"2024-06-14T06:23:05.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"}},{"before":"b90b3796a79546cb7d05089d5f606327aaba8796","after":null,"ref":"refs/heads/refactor/model","pushedAt":"2024-06-14T06:23:02.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"}},{"before":null,"after":"b90b3796a79546cb7d05089d5f606327aaba8796","ref":"refs/heads/v2","pushedAt":"2024-06-14T06:22:48.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"mypy and ruff fixes","shortMessageHtmlLink":"mypy and ruff fixes"}},{"before":"d2f68dc4f4c0af006fbc044f6937dbbf339b7a5d","after":"b90b3796a79546cb7d05089d5f606327aaba8796","ref":"refs/heads/refactor/model","pushedAt":"2024-05-30T06:10:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"mypy and ruff fixes","shortMessageHtmlLink":"mypy and ruff fixes"}},{"before":"77b0a7f0d105da94b8208c4eba696c70147a4dda","after":"d2f68dc4f4c0af006fbc044f6937dbbf339b7a5d","ref":"refs/heads/refactor/model","pushedAt":"2024-05-28T16:59:27.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Merge branch 'refactor/model' of github.com:eyalmazuz/MolGen into refactor/model","shortMessageHtmlLink":"Merge branch 'refactor/model' of github.com:eyalmazuz/MolGen into ref…"}},{"before":"97fac78cade3f8c47daf4a771c67226258472f95","after":"77b0a7f0d105da94b8208c4eba696c70147a4dda","ref":"refs/heads/refactor/model","pushedAt":"2024-05-28T16:27:55.000Z","pushType":"push","commitsCount":8,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Merge branch 'refactor/reward' into refactor/model","shortMessageHtmlLink":"Merge branch 'refactor/reward' into refactor/model"}},{"before":"cab6a15947ae9dcb94baab80139b4ed6b4048e51","after":"16f6669fa5459f2443d88a86e9f3d182fc212eab","ref":"refs/heads/refactor/reward","pushedAt":"2024-05-28T12:56:28.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Added the ability to add different aggregation strategies for multi reward","shortMessageHtmlLink":"Added the ability to add different aggregation strategies for multi r…"}},{"before":null,"after":"cab6a15947ae9dcb94baab80139b4ed6b4048e51","ref":"refs/heads/refactor/reward","pushedAt":"2024-05-27T07:14:35.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Changed scale to be a string or dict then one can define custom scales from the TOML config file","shortMessageHtmlLink":"Changed scale to be a string or dict then one can define custom scale…"}},{"before":null,"after":"97fac78cade3f8c47daf4a771c67226258472f95","ref":"refs/heads/refactor/model","pushedAt":"2024-05-27T07:14:10.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Transformer and bug fixes","shortMessageHtmlLink":"Transformer and bug fixes"}},{"before":"eed4e943c64ea689c41cfc917c8a546fb16f06bc","after":"e9514515f8864b7953e45c083879b935ae498517","ref":"refs/heads/refactor/tokenizers","pushedAt":"2024-04-23T10:32:53.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Major Tokenizer changes\nBPE Tokenizer, Abstract Tokenizer changes and fixed tests\n\nImplemented BPE tokenizer based on Andrej Karpathy's minbpe repo\nChanged Abstract Tokenizer to not include model_max_length anymore since\nit's not a state tokenizer should know.\n\nIn addition, removed the save_pretrained method from all tokenziers\nsince creating tokenizer with a trainer saves all needed information. In\nthe main script there shouldn't be a reason to suddenly save the\ntokenizer again so this method is not needed\n\nFixed char tokenizer and tokenizer factory tests based on the new\nchanges made above","shortMessageHtmlLink":"Major Tokenizer changes"}},{"before":"e9514515f8864b7953e45c083879b935ae498517","after":"eed4e943c64ea689c41cfc917c8a546fb16f06bc","ref":"refs/heads/refactor/tokenizers","pushedAt":"2024-04-23T10:09:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Added regex split pattern to the BPE tokenizer","shortMessageHtmlLink":"Added regex split pattern to the BPE tokenizer"}},{"before":"7f3e12d2f95cbea24e3c0e99b06ae7fee464b140","after":"e9514515f8864b7953e45c083879b935ae498517","ref":"refs/heads/refactor/tokenizers","pushedAt":"2024-04-08T18:01:44.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Major Tokenizer changes\nBPE Tokenizer, Abstract Tokenizer changes and fixed tests\n\nImplemented BPE tokenizer based on Andrej Karpathy's minbpe repo\nChanged Abstract Tokenizer to not include model_max_length anymore since\nit's not a state tokenizer should know.\n\nIn addition, removed the save_pretrained method from all tokenziers\nsince creating tokenizer with a trainer saves all needed information. In\nthe main script there shouldn't be a reason to suddenly save the\ntokenizer again so this method is not needed\n\nFixed char tokenizer and tokenizer factory tests based on the new\nchanges made above","shortMessageHtmlLink":"Major Tokenizer changes"}},{"before":"52a8f87c4c13e1066a6d97d260771b401ab5e251","after":"7f3e12d2f95cbea24e3c0e99b06ae7fee464b140","ref":"refs/heads/refactor/tokenizers","pushedAt":"2024-04-08T17:24:52.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"eyalmazuz","name":null,"path":"/eyalmazuz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/34383384?s=80&v=4"},"commit":{"message":"Major Tokenizer changes\nBPE Tokenizer, Abstract Tokenizer changes and fixed tests\n\nImplemented BPE tokenizer based on Andrej Karpathy's minbpe repo\nChanged Abstract Tokenizer to not include model_max_length anymore since\nit's not a state tokenizer should know.\n\nIn addition, removed the save_pretrained method from all tokenziers\nsince creating tokenizer with a trainer saves all needed information. In\nthe main script there shouldn't be a reason to suddenly save the\ntokenizer again so this method is not needed\n\nFixed char tokenizer and tokenizer factory tests based on the new\nchanges made above","shortMessageHtmlLink":"Major Tokenizer changes"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEgul2VgA","startCursor":null,"endCursor":null}},"title":"Activity · eyalmazuz/MolGen"}