Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Restore colab links #2197

Merged
merged 2 commits into from
Jun 5, 2024
Merged

[Doc] Restore colab links #2197

merged 2 commits into from
Jun 5, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jun 3, 2024

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jun 3, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2197

Note: Links to docs will display an error until the docs builds have been completed.

❌ 12 New Failures, 6 Unrelated Failures

As of commit a516216 with merge base 3e6cb84 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 3, 2024
This was linked to issues Jun 3, 2024
[BUG] "Run in Colab" button in tutorials not working #2134
Closed
[BUG] broken link in docs #2174
Closed
@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 3, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1121s 59.3944ms 16.8366 Ops/s 17.3297 Ops/s $\color{#d91a1a}-2.85\%$
test_sync 36.7342ms 31.2497ms 32.0003 Ops/s 31.0415 Ops/s $\color{#35bf28}+3.09\%$
test_async 56.8700ms 29.1372ms 34.3204 Ops/s 35.2072 Ops/s $\color{#d91a1a}-2.52\%$
test_simple 0.4482s 0.3899s 2.5648 Ops/s 2.5503 Ops/s $\color{#35bf28}+0.57\%$
test_transformed 0.5378s 0.5359s 1.8660 Ops/s 1.7844 Ops/s $\color{#35bf28}+4.57\%$
test_serial 1.3335s 1.2822s 0.7799 Ops/s 0.7661 Ops/s $\color{#35bf28}+1.80\%$
test_parallel 1.1520s 1.0866s 0.9203 Ops/s 0.9120 Ops/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[True-True-True-True-True] 0.2346ms 21.7911μs 45.8903 KOps/s 46.4350 KOps/s $\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-True-True-True-False] 72.4750μs 13.2717μs 75.3483 KOps/s 75.7345 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[True-True-True-False-True] 0.1412ms 13.0756μs 76.4782 KOps/s 79.8835 KOps/s $\color{#d91a1a}-4.26\%$
test_step_mdp_speed[True-True-True-False-False] 25.6880μs 7.7229μs 129.4843 KOps/s 131.1339 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[True-True-False-True-True] 47.3580μs 23.0799μs 43.3277 KOps/s 43.6946 KOps/s $\color{#d91a1a}-0.84\%$
test_step_mdp_speed[True-True-False-True-False] 63.4580μs 14.6511μs 68.2545 KOps/s 69.5358 KOps/s $\color{#d91a1a}-1.84\%$
test_step_mdp_speed[True-True-False-False-True] 58.6290μs 14.0506μs 71.1716 KOps/s 71.4344 KOps/s $\color{#d91a1a}-0.37\%$
test_step_mdp_speed[True-True-False-False-False] 42.9000μs 9.0311μs 110.7291 KOps/s 112.0118 KOps/s $\color{#d91a1a}-1.15\%$
test_step_mdp_speed[True-False-True-True-True] 54.8820μs 24.6275μs 40.6050 KOps/s 41.1194 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-False-True-True-False] 0.1353ms 15.9148μs 62.8345 KOps/s 63.2953 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[True-False-True-False-True] 0.1209ms 14.1846μs 70.4988 KOps/s 71.8840 KOps/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-False-True-False-False] 33.1020μs 9.0621μs 110.3497 KOps/s 111.5738 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-False-False-True-True] 86.7520μs 25.9261μs 38.5711 KOps/s 39.4569 KOps/s $\color{#d91a1a}-2.24\%$
test_step_mdp_speed[True-False-False-True-False] 50.3740μs 17.2316μs 58.0328 KOps/s 59.1698 KOps/s $\color{#d91a1a}-1.92\%$
test_step_mdp_speed[True-False-False-False-True] 50.7050μs 15.1953μs 65.8098 KOps/s 66.6862 KOps/s $\color{#d91a1a}-1.31\%$
test_step_mdp_speed[True-False-False-False-False] 40.9260μs 10.2569μs 97.4952 KOps/s 99.6738 KOps/s $\color{#d91a1a}-2.19\%$
test_step_mdp_speed[False-True-True-True-True] 0.1228ms 24.7727μs 40.3670 KOps/s 41.2227 KOps/s $\color{#d91a1a}-2.08\%$
test_step_mdp_speed[False-True-True-True-False] 43.3410μs 15.9048μs 62.8740 KOps/s 63.8256 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[False-True-True-False-True] 79.8590μs 16.5803μs 60.3125 KOps/s 61.5272 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-True-True-False-False] 29.9760μs 10.3720μs 96.4135 KOps/s 98.7191 KOps/s $\color{#d91a1a}-2.34\%$
test_step_mdp_speed[False-True-False-True-True] 56.4050μs 25.8507μs 38.6836 KOps/s 39.0665 KOps/s $\color{#d91a1a}-0.98\%$
test_step_mdp_speed[False-True-False-True-False] 41.9280μs 17.1849μs 58.1906 KOps/s 58.0734 KOps/s $\color{#35bf28}+0.20\%$
test_step_mdp_speed[False-True-False-False-True] 57.5580μs 17.6843μs 56.5473 KOps/s 57.5028 KOps/s $\color{#d91a1a}-1.66\%$
test_step_mdp_speed[False-True-False-False-False] 45.3040μs 11.4310μs 87.4817 KOps/s 87.7366 KOps/s $\color{#d91a1a}-0.29\%$
test_step_mdp_speed[False-False-True-True-True] 57.8070μs 27.2365μs 36.7154 KOps/s 36.9020 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-False-True-True-False] 45.0240μs 18.3419μs 54.5201 KOps/s 54.4778 KOps/s $\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-False-True-False-True] 65.7830μs 17.8453μs 56.0373 KOps/s 56.8367 KOps/s $\color{#d91a1a}-1.41\%$
test_step_mdp_speed[False-False-True-False-False] 36.2380μs 11.5582μs 86.5183 KOps/s 87.4177 KOps/s $\color{#d91a1a}-1.03\%$
test_step_mdp_speed[False-False-False-True-True] 54.4520μs 29.0033μs 34.4789 KOps/s 34.6333 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[False-False-False-True-False] 53.6100μs 19.7919μs 50.5257 KOps/s 51.0905 KOps/s $\color{#d91a1a}-1.11\%$
test_step_mdp_speed[False-False-False-False-True] 48.6610μs 18.9486μs 52.7743 KOps/s 54.0938 KOps/s $\color{#d91a1a}-2.44\%$
test_step_mdp_speed[False-False-False-False-False] 52.9880μs 12.7008μs 78.7354 KOps/s 80.3360 KOps/s $\color{#d91a1a}-1.99\%$
test_values[generalized_advantage_estimate-True-True] 12.4275ms 9.7221ms 102.8585 Ops/s 106.1664 Ops/s $\color{#d91a1a}-3.12\%$
test_values[vec_generalized_advantage_estimate-True-True] 55.3092ms 36.2604ms 27.5783 Ops/s 28.0450 Ops/s $\color{#d91a1a}-1.66\%$
test_values[td0_return_estimate-False-False] 0.2840ms 0.1711ms 5.8451 KOps/s 5.9985 KOps/s $\color{#d91a1a}-2.56\%$
test_values[td1_return_estimate-False-False] 27.2269ms 24.2973ms 41.1568 Ops/s 41.9322 Ops/s $\color{#d91a1a}-1.85\%$
test_values[vec_td1_return_estimate-False-False] 38.5537ms 35.9772ms 27.7954 Ops/s 27.9018 Ops/s $\color{#d91a1a}-0.38\%$
test_values[td_lambda_return_estimate-True-False] 38.4331ms 35.0575ms 28.5246 Ops/s 28.7255 Ops/s $\color{#d91a1a}-0.70\%$
test_values[vec_td_lambda_return_estimate-True-False] 39.2750ms 36.1170ms 27.6878 Ops/s 27.9542 Ops/s $\color{#d91a1a}-0.95\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.8704ms 8.4618ms 118.1784 Ops/s 120.5946 Ops/s $\color{#d91a1a}-2.00\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.5450ms 1.9541ms 511.7467 Ops/s 501.0527 Ops/s $\color{#35bf28}+2.13\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5682ms 0.3645ms 2.7437 KOps/s 2.7961 KOps/s $\color{#d91a1a}-1.88\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 66.8354ms 42.9498ms 23.2830 Ops/s 22.7560 Ops/s $\color{#35bf28}+2.32\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.7930ms 3.0803ms 324.6394 Ops/s 326.9126 Ops/s $\color{#d91a1a}-0.70\%$
test_dqn_speed 1.7449ms 1.3964ms 716.1339 Ops/s 716.0729 Ops/s $+0.01\%$
test_ddpg_speed 3.6344ms 2.9402ms 340.1122 Ops/s 340.0982 Ops/s $+0.00\%$
test_sac_speed 10.5421ms 8.7243ms 114.6219 Ops/s 114.4483 Ops/s $\color{#35bf28}+0.15\%$
test_redq_speed 14.9140ms 13.7290ms 72.8383 Ops/s 69.7764 Ops/s $\color{#35bf28}+4.39\%$
test_redq_deprec_speed 16.6628ms 13.8625ms 72.1368 Ops/s 63.6570 Ops/s $\textbf{\color{#35bf28}+13.32\%}$
test_td3_speed 17.7211ms 8.9719ms 111.4593 Ops/s 116.7610 Ops/s $\color{#d91a1a}-4.54\%$
test_cql_speed 38.6229ms 37.2785ms 26.8251 Ops/s 27.0199 Ops/s $\color{#d91a1a}-0.72\%$
test_a2c_speed 8.7279ms 7.6145ms 131.3283 Ops/s 132.3397 Ops/s $\color{#d91a1a}-0.76\%$
test_ppo_speed 9.6707ms 8.1790ms 122.2644 Ops/s 123.4254 Ops/s $\color{#d91a1a}-0.94\%$
test_reinforce_speed 8.4189ms 7.1384ms 140.0866 Ops/s 149.6300 Ops/s $\textbf{\color{#d91a1a}-6.38\%}$
test_iql_speed 36.4435ms 34.4262ms 29.0476 Ops/s 30.3381 Ops/s $\color{#d91a1a}-4.25\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.1144ms 3.7175ms 269.0001 Ops/s 286.1865 Ops/s $\textbf{\color{#d91a1a}-6.01\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9940ms 0.5060ms 1.9764 KOps/s 1.7647 KOps/s $\textbf{\color{#35bf28}+12.00\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7848ms 0.4824ms 2.0732 KOps/s 2.0896 KOps/s $\color{#d91a1a}-0.78\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.5083ms 3.6796ms 271.7669 Ops/s 286.9247 Ops/s $\textbf{\color{#d91a1a}-5.28\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.0704ms 0.5010ms 1.9960 KOps/s 2.0187 KOps/s $\color{#d91a1a}-1.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7220ms 0.4783ms 2.0909 KOps/s 2.1208 KOps/s $\color{#d91a1a}-1.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8016ms 1.2753ms 784.1352 Ops/s 792.3745 Ops/s $\color{#d91a1a}-1.04\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6269ms 1.1978ms 834.8575 Ops/s 839.1248 Ops/s $\color{#d91a1a}-0.51\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.6440ms 3.8157ms 262.0767 Ops/s 278.6081 Ops/s $\textbf{\color{#d91a1a}-5.93\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0030ms 0.6241ms 1.6024 KOps/s 1.6140 KOps/s $\color{#d91a1a}-0.72\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8966ms 0.6027ms 1.6592 KOps/s 1.6872 KOps/s $\color{#d91a1a}-1.66\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.4868ms 3.6885ms 271.1121 Ops/s 287.3885 Ops/s $\textbf{\color{#d91a1a}-5.66\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7511ms 0.5109ms 1.9575 KOps/s 1.9958 KOps/s $\color{#d91a1a}-1.92\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.6290ms 0.4848ms 2.0629 KOps/s 2.0596 KOps/s $\color{#35bf28}+0.16\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.4062ms 3.7196ms 268.8496 Ops/s 276.2326 Ops/s $\color{#d91a1a}-2.67\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6293ms 0.5036ms 1.9857 KOps/s 1.9517 KOps/s $\color{#35bf28}+1.74\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8008ms 0.4830ms 2.0704 KOps/s 2.0373 KOps/s $\color{#35bf28}+1.62\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.2569ms 3.8938ms 256.8179 Ops/s 254.9962 Ops/s $\color{#35bf28}+0.71\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1684ms 0.6469ms 1.5457 KOps/s 1.5632 KOps/s $\color{#d91a1a}-1.12\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9577ms 0.6245ms 1.6014 KOps/s 1.6789 KOps/s $\color{#d91a1a}-4.62\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1247s 6.2385ms 160.2951 Ops/s 127.3236 Ops/s $\textbf{\color{#35bf28}+25.90\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.6573ms 12.7800ms 78.2473 Ops/s 78.7734 Ops/s $\color{#d91a1a}-0.67\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 3.8729ms 1.1771ms 849.5359 Ops/s 926.8344 Ops/s $\textbf{\color{#d91a1a}-8.34\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1227s 8.6441ms 115.6858 Ops/s 177.2875 Ops/s $\textbf{\color{#d91a1a}-34.75\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 15.1225ms 12.8438ms 77.8587 Ops/s 79.3366 Ops/s $\color{#d91a1a}-1.86\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.7001ms 1.1479ms 871.1713 Ops/s 894.0929 Ops/s $\color{#d91a1a}-2.56\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1203s 6.4995ms 153.8582 Ops/s 121.3183 Ops/s $\textbf{\color{#35bf28}+26.82\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 21.2913ms 13.1768ms 75.8912 Ops/s 76.8176 Ops/s $\color{#d91a1a}-1.21\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 4.5703ms 1.4911ms 670.6598 Ops/s 715.8532 Ops/s $\textbf{\color{#d91a1a}-6.31\%}$

@vmoens vmoens added the documentation Improvements or additions to documentation label Jun 3, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Jun 3, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1151s 0.1149s 8.7005 Ops/s 8.5429 Ops/s $\color{#35bf28}+1.85\%$
test_sync 0.1071s 0.1028s 9.7308 Ops/s 9.7159 Ops/s $\color{#35bf28}+0.15\%$
test_async 0.1996s 96.4807ms 10.3648 Ops/s 10.2761 Ops/s $\color{#35bf28}+0.86\%$
test_single_pixels 0.1264s 0.1263s 7.9184 Ops/s 7.8595 Ops/s $\color{#35bf28}+0.75\%$
test_sync_pixels 84.6631ms 82.3746ms 12.1397 Ops/s 12.2235 Ops/s $\color{#d91a1a}-0.69\%$
test_async_pixels 0.1548s 68.1607ms 14.6712 Ops/s 14.3450 Ops/s $\color{#35bf28}+2.27\%$
test_simple 0.8657s 0.8047s 1.2426 Ops/s 1.2215 Ops/s $\color{#35bf28}+1.73\%$
test_transformed 1.1150s 1.0550s 0.9479 Ops/s 0.9344 Ops/s $\color{#35bf28}+1.44\%$
test_serial 2.4988s 2.4414s 0.4096 Ops/s 0.4020 Ops/s $\color{#35bf28}+1.89\%$
test_parallel 2.4579s 2.3593s 0.4239 Ops/s 0.4218 Ops/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-True-True-True-True] 67.3710μs 32.5987μs 30.6761 KOps/s 30.1276 KOps/s $\color{#35bf28}+1.82\%$
test_step_mdp_speed[True-True-True-True-False] 34.2410μs 19.2579μs 51.9266 KOps/s 50.1429 KOps/s $\color{#35bf28}+3.56\%$
test_step_mdp_speed[True-True-True-False-True] 0.1162ms 18.2276μs 54.8620 KOps/s 52.3143 KOps/s $\color{#35bf28}+4.87\%$
test_step_mdp_speed[True-True-True-False-False] 32.8410μs 11.0457μs 90.5330 KOps/s 86.9882 KOps/s $\color{#35bf28}+4.08\%$
test_step_mdp_speed[True-True-False-True-True] 71.7210μs 34.6262μs 28.8799 KOps/s 28.2027 KOps/s $\color{#35bf28}+2.40\%$
test_step_mdp_speed[True-True-False-True-False] 48.6010μs 21.2300μs 47.1032 KOps/s 45.9936 KOps/s $\color{#35bf28}+2.41\%$
test_step_mdp_speed[True-True-False-False-True] 43.4010μs 20.2784μs 49.3137 KOps/s 47.7237 KOps/s $\color{#35bf28}+3.33\%$
test_step_mdp_speed[True-True-False-False-False] 31.7100μs 12.9332μs 77.3206 KOps/s 74.7680 KOps/s $\color{#35bf28}+3.41\%$
test_step_mdp_speed[True-False-True-True-True] 98.1120μs 35.4379μs 28.2183 KOps/s 26.7741 KOps/s $\textbf{\color{#35bf28}+5.39\%}$
test_step_mdp_speed[True-False-True-True-False] 63.3410μs 23.1208μs 43.2512 KOps/s 41.8715 KOps/s $\color{#35bf28}+3.29\%$
test_step_mdp_speed[True-False-True-False-True] 44.2110μs 20.3336μs 49.1797 KOps/s 48.1549 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[True-False-True-False-False] 38.3200μs 13.0304μs 76.7436 KOps/s 75.2384 KOps/s $\color{#35bf28}+2.00\%$
test_step_mdp_speed[True-False-False-True-True] 59.3920μs 37.6729μs 26.5443 KOps/s 25.6965 KOps/s $\color{#35bf28}+3.30\%$
test_step_mdp_speed[True-False-False-True-False] 55.5610μs 24.8265μs 40.2795 KOps/s 38.9426 KOps/s $\color{#35bf28}+3.43\%$
test_step_mdp_speed[True-False-False-False-True] 46.8410μs 22.0959μs 45.2572 KOps/s 44.6833 KOps/s $\color{#35bf28}+1.28\%$
test_step_mdp_speed[True-False-False-False-False] 37.5120μs 14.7316μs 67.8813 KOps/s 66.3832 KOps/s $\color{#35bf28}+2.26\%$
test_step_mdp_speed[False-True-True-True-True] 64.4310μs 36.1577μs 27.6566 KOps/s 26.9486 KOps/s $\color{#35bf28}+2.63\%$
test_step_mdp_speed[False-True-True-True-False] 62.0020μs 23.1291μs 43.2356 KOps/s 42.1646 KOps/s $\color{#35bf28}+2.54\%$
test_step_mdp_speed[False-True-True-False-True] 43.0500μs 24.5738μs 40.6938 KOps/s 39.6363 KOps/s $\color{#35bf28}+2.67\%$
test_step_mdp_speed[False-True-True-False-False] 50.7810μs 14.5840μs 68.5685 KOps/s 65.3995 KOps/s $\color{#35bf28}+4.85\%$
test_step_mdp_speed[False-True-False-True-True] 63.9910μs 37.5367μs 26.6406 KOps/s 25.5905 KOps/s $\color{#35bf28}+4.10\%$
test_step_mdp_speed[False-True-False-True-False] 47.1410μs 24.7823μs 40.3513 KOps/s 38.9334 KOps/s $\color{#35bf28}+3.64\%$
test_step_mdp_speed[False-True-False-False-True] 63.1420μs 26.6787μs 37.4831 KOps/s 36.9098 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-True-False-False-False] 49.8310μs 16.5429μs 60.4487 KOps/s 59.3030 KOps/s $\color{#35bf28}+1.93\%$
test_step_mdp_speed[False-False-True-True-True] 0.1054ms 39.6581μs 25.2156 KOps/s 24.2911 KOps/s $\color{#35bf28}+3.81\%$
test_step_mdp_speed[False-False-True-True-False] 48.9200μs 26.8293μs 37.2727 KOps/s 36.2430 KOps/s $\color{#35bf28}+2.84\%$
test_step_mdp_speed[False-False-True-False-True] 51.6710μs 26.2882μs 38.0398 KOps/s 37.0517 KOps/s $\color{#35bf28}+2.67\%$
test_step_mdp_speed[False-False-True-False-False] 52.6820μs 16.4855μs 60.6595 KOps/s 58.8086 KOps/s $\color{#35bf28}+3.15\%$
test_step_mdp_speed[False-False-False-True-True] 64.6910μs 41.4595μs 24.1199 KOps/s 23.2774 KOps/s $\color{#35bf28}+3.62\%$
test_step_mdp_speed[False-False-False-True-False] 57.5910μs 28.7960μs 34.7271 KOps/s 33.9383 KOps/s $\color{#35bf28}+2.32\%$
test_step_mdp_speed[False-False-False-False-True] 49.4310μs 27.6698μs 36.1405 KOps/s 35.1616 KOps/s $\color{#35bf28}+2.78\%$
test_step_mdp_speed[False-False-False-False-False] 56.6510μs 18.2090μs 54.9179 KOps/s 53.7021 KOps/s $\color{#35bf28}+2.26\%$
test_values[generalized_advantage_estimate-True-True] 24.7159ms 24.1661ms 41.3803 Ops/s 39.7189 Ops/s $\color{#35bf28}+4.18\%$
test_values[vec_generalized_advantage_estimate-True-True] 83.3334ms 3.2328ms 309.3271 Ops/s 312.2267 Ops/s $\color{#d91a1a}-0.93\%$
test_values[td0_return_estimate-False-False] 91.7730μs 63.0255μs 15.8666 KOps/s 15.5584 KOps/s $\color{#35bf28}+1.98\%$
test_values[td1_return_estimate-False-False] 52.2597ms 51.9741ms 19.2403 Ops/s 19.0504 Ops/s $\color{#35bf28}+1.00\%$
test_values[vec_td1_return_estimate-False-False] 1.9922ms 1.7604ms 568.0386 Ops/s 564.9897 Ops/s $\color{#35bf28}+0.54\%$
test_values[td_lambda_return_estimate-True-False] 83.0371ms 82.6298ms 12.1022 Ops/s 11.9652 Ops/s $\color{#35bf28}+1.14\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.9616ms 1.7570ms 569.1546 Ops/s 565.9793 Ops/s $\color{#35bf28}+0.56\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.1480ms 23.0423ms 43.3984 Ops/s 42.4050 Ops/s $\color{#35bf28}+2.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8850ms 0.6929ms 1.4432 KOps/s 1.4367 KOps/s $\color{#35bf28}+0.45\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7225ms 0.6494ms 1.5398 KOps/s 1.5260 KOps/s $\color{#35bf28}+0.91\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.4760ms 1.4480ms 690.5842 Ops/s 688.5274 Ops/s $\color{#35bf28}+0.30\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9319ms 0.6669ms 1.4995 KOps/s 1.4866 KOps/s $\color{#35bf28}+0.86\%$
test_dqn_speed 2.1217ms 1.4380ms 695.4106 Ops/s 690.7061 Ops/s $\color{#35bf28}+0.68\%$
test_ddpg_speed 3.0293ms 2.9042ms 344.3294 Ops/s 336.6384 Ops/s $\color{#35bf28}+2.28\%$
test_sac_speed 95.0802ms 9.0437ms 110.5747 Ops/s 119.1580 Ops/s $\textbf{\color{#d91a1a}-7.20\%}$
test_redq_speed 11.1417ms 10.5285ms 94.9807 Ops/s 85.8161 Ops/s $\textbf{\color{#35bf28}+10.68\%}$
test_redq_deprec_speed 11.8519ms 11.3943ms 87.7634 Ops/s 86.2866 Ops/s $\color{#35bf28}+1.71\%$
test_td3_speed 8.5458ms 8.2451ms 121.2843 Ops/s 120.1287 Ops/s $\color{#35bf28}+0.96\%$
test_cql_speed 26.1822ms 25.1804ms 39.7134 Ops/s 39.2253 Ops/s $\color{#35bf28}+1.24\%$
test_a2c_speed 6.0699ms 5.5884ms 178.9433 Ops/s 178.6894 Ops/s $\color{#35bf28}+0.14\%$
test_ppo_speed 6.1529ms 5.9312ms 168.5993 Ops/s 167.3637 Ops/s $\color{#35bf28}+0.74\%$
test_reinforce_speed 4.7321ms 4.5572ms 219.4348 Ops/s 217.3401 Ops/s $\color{#35bf28}+0.96\%$
test_iql_speed 19.8513ms 19.2924ms 51.8338 Ops/s 50.5667 Ops/s $\color{#35bf28}+2.51\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.7422ms 4.5166ms 221.4060 Ops/s 214.8376 Ops/s $\color{#35bf28}+3.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7626ms 0.5859ms 1.7069 KOps/s 1.7058 KOps/s $\color{#35bf28}+0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.3026ms 0.5656ms 1.7682 KOps/s 1.7761 KOps/s $\color{#d91a1a}-0.45\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.6483ms 4.4606ms 224.1846 Ops/s 217.0521 Ops/s $\color{#35bf28}+3.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6928ms 0.5784ms 1.7291 KOps/s 1.7279 KOps/s $\color{#35bf28}+0.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.4603ms 0.5601ms 1.7854 KOps/s 1.7997 KOps/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6657ms 1.5358ms 651.1450 Ops/s 650.7363 Ops/s $\color{#35bf28}+0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.7075ms 1.4589ms 685.4593 Ops/s 675.4981 Ops/s $\color{#35bf28}+1.47\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.7315ms 4.6153ms 216.6720 Ops/s 210.8333 Ops/s $\color{#35bf28}+2.77\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1339s 0.8235ms 1.2144 KOps/s 1.1848 KOps/s $\color{#35bf28}+2.49\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8297ms 0.6841ms 1.4618 KOps/s 1.4518 KOps/s $\color{#35bf28}+0.69\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.5875ms 4.4975ms 222.3461 Ops/s 208.7388 Ops/s $\textbf{\color{#35bf28}+6.52\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7278ms 0.5888ms 1.6985 KOps/s 1.6863 KOps/s $\color{#35bf28}+0.72\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.6144ms 0.5688ms 1.7582 KOps/s 1.7686 KOps/s $\color{#d91a1a}-0.59\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.6738ms 4.5012ms 222.1621 Ops/s 217.0626 Ops/s $\color{#35bf28}+2.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8908ms 0.5801ms 1.7237 KOps/s 1.7239 KOps/s $\color{#d91a1a}-0.01\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7429ms 0.5577ms 1.7931 KOps/s 1.7676 KOps/s $\color{#35bf28}+1.44\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.6961ms 4.6175ms 216.5692 Ops/s 208.7961 Ops/s $\color{#35bf28}+3.72\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8884ms 0.7134ms 1.4018 KOps/s 1.4034 KOps/s $\color{#d91a1a}-0.12\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.8432ms 0.6958ms 1.4372 KOps/s 1.4548 KOps/s $\color{#d91a1a}-1.21\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1396s 7.5307ms 132.7900 Ops/s 132.5404 Ops/s $\color{#35bf28}+0.19\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.7178ms 15.1432ms 66.0362 Ops/s 63.1445 Ops/s $\color{#35bf28}+4.58\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.7040ms 1.5071ms 663.5396 Ops/s 784.1347 Ops/s $\textbf{\color{#d91a1a}-15.38\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1188s 9.4124ms 106.2433 Ops/s 105.2326 Ops/s $\color{#35bf28}+0.96\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.5449ms 15.2060ms 65.7636 Ops/s 63.8811 Ops/s $\color{#35bf28}+2.95\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.3413ms 1.3223ms 756.2775 Ops/s 709.5825 Ops/s $\textbf{\color{#35bf28}+6.58\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1181s 7.4899ms 133.5133 Ops/s 130.2803 Ops/s $\color{#35bf28}+2.48\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.7748ms 15.3228ms 65.2621 Ops/s 63.1225 Ops/s $\color{#35bf28}+3.39\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.7477ms 1.6793ms 595.4783 Ops/s 593.5715 Ops/s $\color{#35bf28}+0.32\%$

@vmoens vmoens merged commit 013d110 into main Jun 5, 2024
40 of 58 checks passed
@vmoens vmoens deleted the fix-colab-links branch June 5, 2024 08:04
@vmoens vmoens restored the fix-colab-links branch June 7, 2024 16:45
@vmoens vmoens deleted the fix-colab-links branch August 7, 2024 01:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[BUG] broken link in docs [BUG] "Run in Colab" button in tutorials not working
2 participants
@vmoens @facebook-github-bot