{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":613909480,"defaultBranch":"main","name":"esgf-download","ownerLogin":"ESGF","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-03-14T14:10:16.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/1236619?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1721137145.0","currentOid":""},"activityList":{"items":[{"before":"e4f5df18021008914f7d4ce2b52e36ee00e4f12a","after":"3a1da984074018186cba14c6f5d74781b284363a","ref":"refs/heads/main","pushedAt":"2024-07-17T14:54:54.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"Greatly improve database performance for `esgpull update` (#47)\n\n* feat(db): faster insertions for new items\r\n\r\n* feat(cli.update): faster link/unlink query & file\r\n\r\nnew(db): Database.commit_context for bulk transactions\r\nchanged(cli.update): direct insert/delete into query_file table\r\nchanged(cli.update): bulk insert/delete instead of per file\r\n\r\n* feat(cli.update): show current query in progress bar\r\n\r\n* test(cli.update): less than 30 seconds to fetch ~6k files\r\n\r\n* fix: renamed\r\n\r\n* test(cli.update): proper setup for test installs\r\n\r\n* test(selection): proper teardown fixtures, avoids messing other tests","shortMessageHtmlLink":"Greatly improve database performance for <code>esgpull update</code> (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2411220567\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ESGF/esgf-download/issues/47\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ESGF/esgf-download/pull/47/hovercard\" href=\"https://github.com/ESGF/esgf-download/pull/47\">#47</a>)"}},{"before":"c583ff8d94e910530d6f7c5cca832ea9cad96d93","after":"c9f546785a6c20e7ff33b71ae1cb961e78a25050","ref":"refs/heads/dev-db-perf","pushedAt":"2024-07-17T14:52:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"test(selection): proper teardown fixtures, avoids messing other tests","shortMessageHtmlLink":"test(selection): proper teardown fixtures, avoids messing other tests"}},{"before":"b5f91e559670659b52072ed07c1e2fa731ba5004","after":"c583ff8d94e910530d6f7c5cca832ea9cad96d93","ref":"refs/heads/dev-db-perf","pushedAt":"2024-07-17T14:23:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"test(cli.update): proper setup for test installs","shortMessageHtmlLink":"test(cli.update): proper setup for test installs"}},{"before":"521305dd563f47ccba4709dc5b76e2fc374233c5","after":"b5f91e559670659b52072ed07c1e2fa731ba5004","ref":"refs/heads/dev-db-perf","pushedAt":"2024-07-17T12:11:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"fix: renamed","shortMessageHtmlLink":"fix: renamed"}},{"before":"432b7a3fbf324ac28c6d125476d543ef682bf76b","after":"521305dd563f47ccba4709dc5b76e2fc374233c5","ref":"refs/heads/dev-db-perf","pushedAt":"2024-07-17T12:06:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"test(cli.update): less than 30 seconds to fetch ~6k files","shortMessageHtmlLink":"test(cli.update): less than 30 seconds to fetch ~6k files"}},{"before":"25349969394252fa1e4970c7d16c8cf2ca1b3ffb","after":"fb064b3d521958f5b9ee680a7305c3bad7e8e037","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-17T11:27:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"lint: apply ruff (marginally different from black)","shortMessageHtmlLink":"lint: apply ruff (marginally different from black)"}},{"before":"9c41c91f73ba7c6b8190288bd2141485afc60d9a","after":"25349969394252fa1e4970c7d16c8cf2ca1b3ffb","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-17T11:17:57.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"ci: use python 3.11","shortMessageHtmlLink":"ci: use python 3.11"}},{"before":"85d81f9aca9bbae1fd58f8043cb15ec729ac104e","after":"9c41c91f73ba7c6b8190288bd2141485afc60d9a","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-17T11:12:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"update lock","shortMessageHtmlLink":"update lock"}},{"before":"7d01dace87c1b3f71c23dabe956039130e23490a","after":"85d81f9aca9bbae1fd58f8043cb15ec729ac104e","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-17T11:04:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"fix: remove setup.cfg reference (pytest-cov)","shortMessageHtmlLink":"fix: remove setup.cfg reference (pytest-cov)"}},{"before":"2d9e381cf605aac248ba89c0b15476589ae337f3","after":"7d01dace87c1b3f71c23dabe956039130e23490a","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-17T09:45:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"pdm(test): pytest-cov >= 5.0.0","shortMessageHtmlLink":"pdm(test): pytest-cov &gt;= 5.0.0"}},{"before":"96192f7f9e4f71b0759fbe37ac2b8af43463c3f6","after":"2d9e381cf605aac248ba89c0b15476589ae337f3","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-17T09:41:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"remove black/isort/flake8","shortMessageHtmlLink":"remove black/isort/flake8"}},{"before":"ae71ae5e7fb99aae6701dc1e679e0b5e79a147d6","after":"432b7a3fbf324ac28c6d125476d543ef682bf76b","ref":"refs/heads/dev-db-perf","pushedAt":"2024-07-16T17:09:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"feat(cli.update): show current query in progress bar","shortMessageHtmlLink":"feat(cli.update): show current query in progress bar"}},{"before":"9eeb285953cb2da3e9a47cebe0320c40733f2045","after":"96192f7f9e4f71b0759fbe37ac2b8af43463c3f6","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-16T13:42:16.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"pdm: add profiling/debug modules to dev groups","shortMessageHtmlLink":"pdm: add profiling/debug modules to dev groups"}},{"before":null,"after":"9eeb285953cb2da3e9a47cebe0320c40733f2045","ref":"refs/heads/dev-ruff-precommit","pushedAt":"2024-07-16T13:39:05.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"rm dead code","shortMessageHtmlLink":"rm dead code"}},{"before":null,"after":"ae71ae5e7fb99aae6701dc1e679e0b5e79a147d6","ref":"refs/heads/dev-db-perf","pushedAt":"2024-07-16T10:54:16.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"feat(cli.update): faster link/unlink query & file\n\n* new(db): Database.commit_context for bulk transactions\n* changed(cli.update): direct insert/delete into query_file table\n* changed(cli.update): bulk insert/delete instead of per file","shortMessageHtmlLink":"feat(cli.update): faster link/unlink query &amp; file"}},{"before":null,"after":"8ee5735256be3d4220ac1095e283d1351b9b487f","ref":"refs/heads/dev-dataset-complete","pushedAt":"2024-07-11T13:42:46.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"feat(cli): add datasets command (per query)","shortMessageHtmlLink":"feat(cli): add datasets command (per query)"}},{"before":"58046709a16878d1316efa85b186a347747a4a63","after":"e4f5df18021008914f7d4ce2b52e36ee00e4f12a","ref":"refs/heads/main","pushedAt":"2024-07-09T14:33:09.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"bump to 0.6.5","shortMessageHtmlLink":"bump to 0.6.5"}},{"before":"b6702732857e836d33c8d0338ec7906b422de785","after":"58046709a16878d1316efa85b186a347747a4a63","ref":"refs/heads/main","pushedAt":"2024-07-09T11:53:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"ci: publish releases to PyPI","shortMessageHtmlLink":"ci: publish releases to PyPI"}},{"before":"e2277de0aacd5872781e72ee760a4cd68dfcff6c","after":"b6702732857e836d33c8d0338ec7906b422de785","ref":"refs/heads/main","pushedAt":"2024-07-09T09:06:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"bump to 0.6.4","shortMessageHtmlLink":"bump to 0.6.4"}},{"before":"f2a0ee053406446b805895f88deb0d161cb27212","after":"e2277de0aacd5872781e72ee760a4cd68dfcff6c","ref":"refs/heads/main","pushedAt":"2024-07-09T09:00:17.000Z","pushType":"pr_merge","commitsCount":4,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"Merge pull request #45 from ESGF/fix-leak\n\nFix memory increase during download (leak)","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2396080598\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ESGF/esgf-download/issues/45\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ESGF/esgf-download/pull/45/hovercard\" href=\"https://github.com/ESGF/esgf-download/pull/45\">#45</a> from ESGF/fix-leak"}},{"before":"b63b2aaaba988c816037ffbb404f72caac0f22bd","after":"eda9d21dab02387badb71787798351d56c1f1b77","ref":"refs/heads/fix-leak","pushedAt":"2024-07-08T16:48:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"test: create AsyncClient inside test function","shortMessageHtmlLink":"test: create AsyncClient inside test function"}},{"before":"78897879114dab235efcad6e78766ece99a20c06","after":"f2a0ee053406446b805895f88deb0d161cb27212","ref":"refs/heads/main","pushedAt":"2024-07-08T16:34:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"fix: add FileNotFoundError to caught exceptions","shortMessageHtmlLink":"fix: add FileNotFoundError to caught exceptions"}},{"before":null,"after":"b63b2aaaba988c816037ffbb404f72caac0f22bd","ref":"refs/heads/fix-leak","pushedAt":"2024-07-08T16:32:47.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"fix: release ctx.chunk after it has been written\n\nAfter any completed download on a single File, the last chunk was not\nreleased and lived in memory until all files have been downloaded.\nThis fix releases any chunk from memory (rather marks it as garbage for\nlater collection) right after it has been written to the temporary file.","shortMessageHtmlLink":"fix: release ctx.chunk after it has been written"}},{"before":"a64e1907fadfdd98402b99b3220ffe4d0caac9fb","after":"78897879114dab235efcad6e78766ece99a20c06","ref":"refs/heads/main","pushedAt":"2024-06-13T10:04:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"AtefBN","name":"Atef","path":"/AtefBN","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/15193639?s=80&v=4"},"commit":{"message":"Bump 0.6.3","shortMessageHtmlLink":"Bump 0.6.3"}},{"before":"648f411420aa9ce56cfd8968f1ee00df476ba403","after":"a64e1907fadfdd98402b99b3220ffe4d0caac9fb","ref":"refs/heads/main","pushedAt":"2024-06-13T09:55:46.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"AtefBN","name":"Atef","path":"/AtefBN","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/15193639?s=80&v=4"},"commit":{"message":"Bump 0.6.3","shortMessageHtmlLink":"Bump 0.6.3"}},{"before":"90e0c1f639c96d1dbbf156889c22d6303ae24136","after":null,"ref":"refs/heads/master","pushedAt":"2024-06-13T09:39:47.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"AtefBN","name":"Atef","path":"/AtefBN","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/15193639?s=80&v=4"}},{"before":null,"after":"90e0c1f639c96d1dbbf156889c22d6303ae24136","ref":"refs/heads/master","pushedAt":"2024-06-13T09:38:40.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"AtefBN","name":"Atef","path":"/AtefBN","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/15193639?s=80&v=4"},"commit":{"message":"test","shortMessageHtmlLink":"test"}},{"before":"e54c4cb176954a1185944d5dfb6fe989699e5e4d","after":"648f411420aa9ce56cfd8968f1ee00df476ba403","ref":"refs/heads/main","pushedAt":"2024-05-14T15:04:26.000Z","pushType":"pr_merge","commitsCount":5,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"Merge pull request #40 from ESGF/fix-synda-status-waiting\n\nfix(import_synda): map synda status names to esgpull status names, waiting->queued, running->started","shortMessageHtmlLink":"Merge pull request <a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2120489659\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ESGF/esgf-download/issues/40\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ESGF/esgf-download/pull/40/hovercard\" href=\"https://github.com/ESGF/esgf-download/pull/40\">#40</a> from ESGF/fix-synda-status-waiting"}},{"before":"9b9cf2c5b7a967eade83ed1f569f833929b3c8e0","after":"46f334807d7076f2aeb79faf1be9d50435da7c43","ref":"refs/heads/fix-synda-status-waiting","pushedAt":"2024-05-14T14:58:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"fix: remove dead code","shortMessageHtmlLink":"fix: remove dead code"}},{"before":"dbc729adcac512a3c0af0c68fc2e67f4dffb2b93","after":"9b9cf2c5b7a967eade83ed1f569f833929b3c8e0","ref":"refs/heads/fix-synda-status-waiting","pushedAt":"2024-05-14T14:04:39.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"svenrdz","name":null,"path":"/svenrdz","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/23420779?s=80&v=4"},"commit":{"message":"fix: add `waiting -> Started` map, impl FileStatus.contains","shortMessageHtmlLink":"fix: add <code>waiting -&gt; Started</code> map, impl FileStatus.contains"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEgffQdQA","startCursor":null,"endCursor":null}},"title":"Activity · ESGF/esgf-download"}