{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":759861801,"defaultBranch":"main","name":"flashinfer","ownerLogin":"esmeetu","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2024-02-19T13:31:14.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/6694539?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1714140552.0","currentOid":""},"activityList":{"items":[{"before":null,"after":"60b60e7c397059004191f275c2dca8e29ac28628","ref":"refs/heads/fix-pagesize","pushedAt":"2024-04-26T14:09:12.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"fix page size","shortMessageHtmlLink":"fix page size"}},{"before":"b20a460a82a457824182056aaa2c45d5d156791e","after":"f978e02565d7157d57803eb4153369e046fc4106","ref":"refs/heads/main","pushedAt":"2024-04-26T14:05:59.000Z","pushType":"push","commitsCount":18,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"ci: add pytorch 2.3 to matrix (#216)\n\nRelease pytorch 2.3 version in next release.","shortMessageHtmlLink":"ci: add pytorch 2.3 to matrix (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2265070404\" data-permission-text=\"Title is private\" data-url=\"https://github.com/flashinfer-ai/flashinfer/issues/216\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/flashinfer-ai/flashinfer/pull/216/hovercard\" href=\"https://github.com/flashinfer-ai/flashinfer/pull/216\">flashinfer-ai#216</a>)"}},{"before":"4206782f4d1554d052051dbbf88d26de3cd132c6","after":"c9b2460de4c4e516089eed5b8039091307c6634e","ref":"refs/heads/fix-setup","pushedAt":"2024-04-05T03:01:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"fix","shortMessageHtmlLink":"fix"}},{"before":null,"after":"4206782f4d1554d052051dbbf88d26de3cd132c6","ref":"refs/heads/fix-setup","pushedAt":"2024-04-05T03:00:22.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"fix","shortMessageHtmlLink":"fix"}},{"before":"e8f163ce604c4534e92d80ca9b15938a21b4dd81","after":null,"ref":"refs/heads/fix-setup","pushedAt":"2024-04-05T02:58:28.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"}},{"before":"1df641f8781a3eb8e82e57488a93e4e45bb0ae75","after":"b20a460a82a457824182056aaa2c45d5d156791e","ref":"refs/heads/main","pushedAt":"2024-04-05T02:57:58.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"[TVMWrapper] Support auxiliary DLTensor with byte offset (#193)\n\nThis PR adds the `byte_offset` support to the auxiliary DLTensors. This\r\nis necessary when all the auxiliary DLTensors are slices of a large\r\nstorage.","shortMessageHtmlLink":"[TVMWrapper] Support auxiliary DLTensor with byte offset (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2216200559\" data-permission-text=\"Title is private\" data-url=\"https://github.com/flashinfer-ai/flashinfer/issues/193\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/flashinfer-ai/flashinfer/pull/193/hovercard\" href=\"https://github.com/flashinfer-ai/flashinfer/pull/193\">flashinfer-…</a>"}},{"before":"4f65fbcee74b4897a50e712bdd6a4aef576e17cd","after":"1df641f8781a3eb8e82e57488a93e4e45bb0ae75","ref":"refs/heads/main","pushedAt":"2024-03-26T13:07:18.000Z","pushType":"push","commitsCount":31,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"example: add example of using BatchPrefillWithRaggedKVCacheWrapper c++ api (#190)\n\nPer request in issue #189","shortMessageHtmlLink":"example: add example of using BatchPrefillWithRaggedKVCacheWrapper c+…"}},{"before":null,"after":"e8f163ce604c4534e92d80ca9b15938a21b4dd81","ref":"refs/heads/fix-setup","pushedAt":"2024-02-23T11:53:43.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"revert path & support python3.8","shortMessageHtmlLink":"revert path &amp; support python3.8"}},{"before":"1b758740a525876bd931ecc66fc56b2919f67aa3","after":"4f65fbcee74b4897a50e712bdd6a4aef576e17cd","ref":"refs/heads/main","pushedAt":"2024-02-23T11:48:13.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"support Turing arch (#128)\n\nAs I want to push this feature forward, so i tried to work based on #109\r\n, and did some small changes. But there is also some problem here.\r\n\r\nFor Tests:\r\n1 .`python/tests/test_batch_decode_kernels.py` **passed**\r\n2. `python/tests/test_batch_prefill_kernels.py` **passed**\r\n3. `python/tests/test_shared_prefix_kernels.py` **failed** on\r\n`test_batch_decode_with_shared_prefix_padded_kv_cache` test case. The\r\nerror is `Unsupported max_frags_z: 0` and might be `max_smem_per_sm`\r\nvalue is smaller than `sm_80`? And i tried to make each sm execute two\r\nthreadblocks: `max_smem_per_threadblock = max_smem_per_sm`. The error\r\nwas gone but test still failed.\r\n\r\nFor changes:\r\n1. `decode.cuh`: On my T4 (Turing) GPU, It seems there is not two much\r\nshared memory, so i decrease the `num_threads` by half. This works for\r\nme.\r\n2. `setup.py`: I cannot install from source `cd python && pip install -e\r\n.`, because it cannot parse relative path in `version.txt` file.\r\n\r\nI am looking forward to hear some advices about this. Thanks! @yzh119\r\n\r\n---------\r\n\r\nCo-authored-by: yzh119 <expye@outlook.com>","shortMessageHtmlLink":"support Turing arch (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2144273502\" data-permission-text=\"Title is private\" data-url=\"https://github.com/flashinfer-ai/flashinfer/issues/128\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/flashinfer-ai/flashinfer/pull/128/hovercard\" href=\"https://github.com/flashinfer-ai/flashinfer/pull/128\">flashinfer-ai#128</a>)"}},{"before":"0c674b0aa8b96532bb17938ae1dc35626b7bcc66","after":"267b8dbe20128c13a2112273e01caf482d277a9b","ref":"refs/heads/sm_75_new","pushedAt":"2024-02-22T23:54:59.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"resolve soft link","shortMessageHtmlLink":"resolve soft link"}},{"before":"2024256e77dfb15013e352919160329a79b506d2","after":"0c674b0aa8b96532bb17938ae1dc35626b7bcc66","ref":"refs/heads/sm_75_new","pushedAt":"2024-02-20T12:33:20.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"fix typo","shortMessageHtmlLink":"fix typo"}},{"before":"b188977e6a05304064eb116c2f5aa8e0be12835e","after":"2024256e77dfb15013e352919160329a79b506d2","ref":"refs/heads/sm_75_new","pushedAt":"2024-02-19T14:09:35.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"fix decode","shortMessageHtmlLink":"fix decode"}},{"before":"5c6c034a7fe42eba3c5b9bcea5e5bee3c7151d50","after":"b188977e6a05304064eb116c2f5aa8e0be12835e","ref":"refs/heads/sm_75_new","pushedAt":"2024-02-19T13:52:30.000Z","pushType":"push","commitsCount":13,"pusher":{"login":"esmeetu","name":"Roy","path":"/esmeetu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6694539?s=80&v=4"},"commit":{"message":"Merge remote-tracking branch 'origin/main' into sm_75_new","shortMessageHtmlLink":"Merge remote-tracking branch 'origin/main' into sm_75_new"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEOzoXIgA","startCursor":null,"endCursor":null}},"title":"Activity · esmeetu/flashinfer"}