Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Dynamic envs #2191

Merged
merged 1 commit into from
May 31, 2024
Merged

[Doc] Dynamic envs #2191

merged 1 commit into from
May 31, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented May 31, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented May 31, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2191

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 12 Unrelated Failures

As of commit 833b948 with merge base 7b145b5 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 31, 2024
@vmoens vmoens added the documentation Improvements or additions to documentation label May 31, 2024
@vmoens vmoens merged commit 1405600 into main May 31, 2024
33 of 47 checks passed
@vmoens vmoens deleted the document-dynamic-envs branch May 31, 2024 14:51
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1228s 59.2277ms 16.8840 Ops/s 18.0146 Ops/s $\textbf{\color{#d91a1a}-6.28\%}$
test_sync 33.5546ms 31.7092ms 31.5366 Ops/s 31.5638 Ops/s $\color{#d91a1a}-0.09\%$
test_async 72.0078ms 29.2420ms 34.1974 Ops/s 34.1845 Ops/s $\color{#35bf28}+0.04\%$
test_simple 0.4402s 0.3830s 2.6112 Ops/s 2.6815 Ops/s $\color{#d91a1a}-2.62\%$
test_transformed 0.5283s 0.5255s 1.9031 Ops/s 1.8554 Ops/s $\color{#35bf28}+2.57\%$
test_serial 1.3077s 1.2501s 0.7999 Ops/s 0.7839 Ops/s $\color{#35bf28}+2.04\%$
test_parallel 1.1285s 1.0752s 0.9300 Ops/s 0.9099 Ops/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[True-True-True-True-True] 0.1335ms 21.2817μs 46.9888 KOps/s 46.3092 KOps/s $\color{#35bf28}+1.47\%$
test_step_mdp_speed[True-True-True-True-False] 36.0180μs 13.0881μs 76.4052 KOps/s 75.2997 KOps/s $\color{#35bf28}+1.47\%$
test_step_mdp_speed[True-True-True-False-True] 47.4180μs 12.7338μs 78.5314 KOps/s 78.3742 KOps/s $\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-True-True-False-False] 35.2370μs 7.6265μs 131.1212 KOps/s 128.5038 KOps/s $\color{#35bf28}+2.04\%$
test_step_mdp_speed[True-True-False-True-True] 53.8400μs 22.9557μs 43.5622 KOps/s 43.3961 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[True-True-False-True-False] 38.7830μs 14.3403μs 69.7337 KOps/s 68.3979 KOps/s $\color{#35bf28}+1.95\%$
test_step_mdp_speed[True-True-False-False-True] 58.8200μs 13.9224μs 71.8267 KOps/s 70.6354 KOps/s $\color{#35bf28}+1.69\%$
test_step_mdp_speed[True-True-False-False-False] 34.8950μs 8.9563μs 111.6530 KOps/s 110.7205 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[True-False-True-True-True] 68.6080μs 23.9743μs 41.7114 KOps/s 41.4148 KOps/s $\color{#35bf28}+0.72\%$
test_step_mdp_speed[True-False-True-True-False] 49.9630μs 15.7890μs 63.3351 KOps/s 63.8599 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-False-True-False-True] 70.3720μs 13.8959μs 71.9635 KOps/s 72.0221 KOps/s $\color{#d91a1a}-0.08\%$
test_step_mdp_speed[True-False-True-False-False] 33.6630μs 8.9253μs 112.0413 KOps/s 111.7698 KOps/s $\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-False-False-True-True] 64.9210μs 24.9291μs 40.1138 KOps/s 39.6073 KOps/s $\color{#35bf28}+1.28\%$
test_step_mdp_speed[True-False-False-True-False] 45.1040μs 16.6748μs 59.9708 KOps/s 59.5727 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-False-False-False-True] 58.9100μs 14.9095μs 67.0712 KOps/s 66.4488 KOps/s $\color{#35bf28}+0.94\%$
test_step_mdp_speed[True-False-False-False-False] 59.3520μs 9.9541μs 100.4611 KOps/s 98.3816 KOps/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[False-True-True-True-True] 59.7320μs 24.0564μs 41.5690 KOps/s 40.9668 KOps/s $\color{#35bf28}+1.47\%$
test_step_mdp_speed[False-True-True-True-False] 34.1540μs 15.6435μs 63.9243 KOps/s 63.3401 KOps/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[False-True-True-False-True] 38.8130μs 15.9875μs 62.5488 KOps/s 62.3116 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-True-True-False-False] 48.8520μs 9.9867μs 100.1334 KOps/s 98.4573 KOps/s $\color{#35bf28}+1.70\%$
test_step_mdp_speed[False-True-False-True-True] 60.6340μs 24.9031μs 40.1557 KOps/s 39.7170 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[False-True-False-True-False] 80.7410μs 16.6427μs 60.0863 KOps/s 59.2460 KOps/s $\color{#35bf28}+1.42\%$
test_step_mdp_speed[False-True-False-False-True] 61.8960μs 17.0434μs 58.6738 KOps/s 57.4367 KOps/s $\color{#35bf28}+2.15\%$
test_step_mdp_speed[False-True-False-False-False] 43.9630μs 11.2677μs 88.7494 KOps/s 88.7262 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[False-False-True-True-True] 72.9660μs 26.2679μs 38.0693 KOps/s 37.9226 KOps/s $\color{#35bf28}+0.39\%$
test_step_mdp_speed[False-False-True-True-False] 40.1460μs 18.1197μs 55.1886 KOps/s 55.5220 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[False-False-True-False-True] 45.0850μs 17.0753μs 58.5643 KOps/s 58.2827 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-False-True-False-False] 49.5030μs 11.2670μs 88.7549 KOps/s 87.7684 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-False-False-True-True] 40.4060μs 27.2957μs 36.6358 KOps/s 36.0494 KOps/s $\color{#35bf28}+1.63\%$
test_step_mdp_speed[False-False-False-True-False] 65.2320μs 19.0937μs 52.3733 KOps/s 51.9053 KOps/s $\color{#35bf28}+0.90\%$
test_step_mdp_speed[False-False-False-False-True] 66.0140μs 18.1276μs 55.1644 KOps/s 55.3364 KOps/s $\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-False-False-False-False] 38.2710μs 12.3662μs 80.8657 KOps/s 80.5076 KOps/s $\color{#35bf28}+0.44\%$
test_values[generalized_advantage_estimate-True-True] 10.4342ms 9.7147ms 102.9373 Ops/s 106.4908 Ops/s $\color{#d91a1a}-3.34\%$
test_values[vec_generalized_advantage_estimate-True-True] 42.3768ms 36.3551ms 27.5065 Ops/s 29.6765 Ops/s $\textbf{\color{#d91a1a}-7.31\%}$
test_values[td0_return_estimate-False-False] 0.2503ms 0.1763ms 5.6707 KOps/s 5.1910 KOps/s $\textbf{\color{#35bf28}+9.24\%}$
test_values[td1_return_estimate-False-False] 25.8863ms 23.9658ms 41.7262 Ops/s 41.6309 Ops/s $\color{#35bf28}+0.23\%$
test_values[vec_td1_return_estimate-False-False] 38.8055ms 36.2344ms 27.5981 Ops/s 29.5236 Ops/s $\textbf{\color{#d91a1a}-6.52\%}$
test_values[td_lambda_return_estimate-True-False] 37.9343ms 34.6917ms 28.8253 Ops/s 28.9872 Ops/s $\color{#d91a1a}-0.56\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.8630ms 35.6820ms 28.0254 Ops/s 29.5575 Ops/s $\textbf{\color{#d91a1a}-5.18\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.7513ms 8.6102ms 116.1410 Ops/s 120.2714 Ops/s $\color{#d91a1a}-3.43\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.1358ms 1.8064ms 553.5986 Ops/s 541.8076 Ops/s $\color{#35bf28}+2.18\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4283ms 0.3605ms 2.7741 KOps/s 2.7766 KOps/s $\color{#d91a1a}-0.09\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.1560ms 45.4384ms 22.0078 Ops/s 24.2756 Ops/s $\textbf{\color{#d91a1a}-9.34\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.6869ms 3.0417ms 328.7654 Ops/s 325.5931 Ops/s $\color{#35bf28}+0.97\%$
test_dqn_speed 7.4821ms 1.3844ms 722.3387 Ops/s 707.3297 Ops/s $\color{#35bf28}+2.12\%$
test_ddpg_speed 3.7466ms 2.9169ms 342.8328 Ops/s 335.8748 Ops/s $\color{#35bf28}+2.07\%$
test_sac_speed 10.0640ms 8.5811ms 116.5350 Ops/s 113.2439 Ops/s $\color{#35bf28}+2.91\%$
test_redq_speed 16.1525ms 13.7066ms 72.9574 Ops/s 71.6705 Ops/s $\color{#35bf28}+1.80\%$
test_redq_deprec_speed 16.8564ms 13.8562ms 72.1697 Ops/s 72.6548 Ops/s $\color{#d91a1a}-0.67\%$
test_td3_speed 9.4359ms 8.5210ms 117.3571 Ops/s 116.9321 Ops/s $\color{#35bf28}+0.36\%$
test_cql_speed 39.3365ms 36.9287ms 27.0792 Ops/s 27.0934 Ops/s $\color{#d91a1a}-0.05\%$
test_a2c_speed 8.4675ms 7.4438ms 134.3392 Ops/s 132.4888 Ops/s $\color{#35bf28}+1.40\%$
test_ppo_speed 8.4941ms 7.7580ms 128.8988 Ops/s 128.4465 Ops/s $\color{#35bf28}+0.35\%$
test_reinforce_speed 7.7914ms 6.6468ms 150.4483 Ops/s 149.3306 Ops/s $\color{#35bf28}+0.75\%$
test_iql_speed 34.9246ms 33.6072ms 29.7555 Ops/s 29.4074 Ops/s $\color{#35bf28}+1.18\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.4139ms 3.4972ms 285.9417 Ops/s 283.8405 Ops/s $\color{#35bf28}+0.74\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7401ms 0.5050ms 1.9802 KOps/s 1.9883 KOps/s $\color{#d91a1a}-0.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7913ms 0.4784ms 2.0904 KOps/s 2.0788 KOps/s $\color{#35bf28}+0.56\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.3043ms 3.4561ms 289.3443 Ops/s 285.1403 Ops/s $\color{#35bf28}+1.47\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9290ms 0.4960ms 2.0160 KOps/s 2.0238 KOps/s $\color{#d91a1a}-0.39\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 99.6733ms 0.5450ms 1.8349 KOps/s 2.1180 KOps/s $\textbf{\color{#d91a1a}-13.37\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8264ms 1.2612ms 792.9136 Ops/s 793.8054 Ops/s $\color{#d91a1a}-0.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4702ms 1.1824ms 845.7648 Ops/s 839.0430 Ops/s $\color{#35bf28}+0.80\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.2142ms 3.5866ms 278.8144 Ops/s 271.2212 Ops/s $\color{#35bf28}+2.80\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9390ms 0.6198ms 1.6134 KOps/s 1.6123 KOps/s $\color{#35bf28}+0.07\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.6560ms 0.5947ms 1.6814 KOps/s 1.6876 KOps/s $\color{#d91a1a}-0.37\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.3995ms 3.4366ms 290.9888 Ops/s 284.9995 Ops/s $\color{#35bf28}+2.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6057ms 0.5027ms 1.9893 KOps/s 1.9732 KOps/s $\color{#35bf28}+0.82\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.7350ms 0.4849ms 2.0624 KOps/s 2.0916 KOps/s $\color{#d91a1a}-1.40\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.5872ms 3.4871ms 286.7711 Ops/s 278.4625 Ops/s $\color{#35bf28}+2.98\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1628ms 0.5062ms 1.9756 KOps/s 2.0140 KOps/s $\color{#d91a1a}-1.91\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6345ms 0.4759ms 2.1011 KOps/s 2.0946 KOps/s $\color{#35bf28}+0.31\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.8025ms 3.5151ms 284.4831 Ops/s 271.8325 Ops/s $\color{#35bf28}+4.65\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9575ms 0.6258ms 1.5981 KOps/s 1.3449 KOps/s $\textbf{\color{#35bf28}+18.82\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.4526ms 0.5990ms 1.6694 KOps/s 1.6727 KOps/s $\color{#d91a1a}-0.20\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 98.8239ms 5.6445ms 177.1634 Ops/s 178.7859 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 15.4292ms 12.9152ms 77.4283 Ops/s 77.4517 Ops/s $\color{#d91a1a}-0.03\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.7739ms 1.0982ms 910.5893 Ops/s 897.5566 Ops/s $\color{#35bf28}+1.45\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 93.5237ms 7.2502ms 137.9279 Ops/s 129.9061 Ops/s $\textbf{\color{#35bf28}+6.18\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 15.4121ms 12.8896ms 77.5822 Ops/s 78.4375 Ops/s $\color{#d91a1a}-1.09\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.7893ms 1.1101ms 900.8102 Ops/s 880.9559 Ops/s $\color{#35bf28}+2.25\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 89.9292ms 5.8143ms 171.9890 Ops/s 174.6399 Ops/s $\color{#d91a1a}-1.52\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.0214ms 13.3414ms 74.9548 Ops/s 77.0172 Ops/s $\color{#d91a1a}-2.68\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.1592ms 1.4929ms 669.8334 Ops/s 679.6983 Ops/s $\color{#d91a1a}-1.45\%$

@github-actions GitHub Actions
Copy link

$\color{#35bf28}\textsf{\Large✔\kern{0.2cm}\normalsize OK}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}0$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1171s 0.1155s 8.6555 Ops/s 8.3625 Ops/s $\color{#35bf28}+3.50\%$
test_sync 0.1098s 0.1071s 9.3392 Ops/s 9.5406 Ops/s $\color{#d91a1a}-2.11\%$
test_async 0.2119s 84.3319ms 11.8579 Ops/s 10.3897 Ops/s $\textbf{\color{#35bf28}+14.13\%}$
test_single_pixels 0.1282s 0.1276s 7.8353 Ops/s 7.6373 Ops/s $\color{#35bf28}+2.59\%$
test_sync_pixels 85.7829ms 84.3785ms 11.8514 Ops/s 12.2310 Ops/s $\color{#d91a1a}-3.10\%$
test_async_pixels 0.1570s 68.9150ms 14.5106 Ops/s 14.7584 Ops/s $\color{#d91a1a}-1.68\%$
test_simple 0.7994s 0.7981s 1.2530 Ops/s 1.2207 Ops/s $\color{#35bf28}+2.65\%$
test_transformed 1.0549s 1.0522s 0.9504 Ops/s 0.9237 Ops/s $\color{#35bf28}+2.90\%$
test_serial 2.5128s 2.4508s 0.4080 Ops/s 0.3991 Ops/s $\color{#35bf28}+2.22\%$
test_parallel 2.4009s 2.3320s 0.4288 Ops/s 0.4237 Ops/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[True-True-True-True-True] 91.4310μs 32.3390μs 30.9224 KOps/s 29.6443 KOps/s $\color{#35bf28}+4.31\%$
test_step_mdp_speed[True-True-True-True-False] 41.4110μs 19.5392μs 51.1792 KOps/s 50.2287 KOps/s $\color{#35bf28}+1.89\%$
test_step_mdp_speed[True-True-True-False-True] 36.7000μs 18.9759μs 52.6985 KOps/s 51.2928 KOps/s $\color{#35bf28}+2.74\%$
test_step_mdp_speed[True-True-True-False-False] 36.7710μs 11.2721μs 88.7143 KOps/s 87.3743 KOps/s $\color{#35bf28}+1.53\%$
test_step_mdp_speed[True-True-False-True-True] 53.7510μs 34.3335μs 29.1260 KOps/s 28.7077 KOps/s $\color{#35bf28}+1.46\%$
test_step_mdp_speed[True-True-False-True-False] 44.8210μs 21.7751μs 45.9240 KOps/s 46.2905 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[True-True-False-False-True] 37.9810μs 20.5682μs 48.6188 KOps/s 47.0601 KOps/s $\color{#35bf28}+3.31\%$
test_step_mdp_speed[True-True-False-False-False] 39.8300μs 13.2866μs 75.2637 KOps/s 74.6232 KOps/s $\color{#35bf28}+0.86\%$
test_step_mdp_speed[True-False-True-True-True] 62.3310μs 36.8989μs 27.1010 KOps/s 27.0030 KOps/s $\color{#35bf28}+0.36\%$
test_step_mdp_speed[True-False-True-True-False] 48.0710μs 23.7855μs 42.0424 KOps/s 41.8926 KOps/s $\color{#35bf28}+0.36\%$
test_step_mdp_speed[True-False-True-False-True] 41.3300μs 20.8066μs 48.0617 KOps/s 46.4127 KOps/s $\color{#35bf28}+3.55\%$
test_step_mdp_speed[True-False-True-False-False] 37.4810μs 13.2205μs 75.6401 KOps/s 77.1199 KOps/s $\color{#d91a1a}-1.92\%$
test_step_mdp_speed[True-False-False-True-True] 60.9110μs 38.2628μs 26.1351 KOps/s 25.6385 KOps/s $\color{#35bf28}+1.94\%$
test_step_mdp_speed[True-False-False-True-False] 48.6110μs 25.2951μs 39.5333 KOps/s 38.7652 KOps/s $\color{#35bf28}+1.98\%$
test_step_mdp_speed[True-False-False-False-True] 49.4820μs 22.2748μs 44.8939 KOps/s 42.9602 KOps/s $\color{#35bf28}+4.50\%$
test_step_mdp_speed[True-False-False-False-False] 34.7300μs 14.8878μs 67.1691 KOps/s 66.9160 KOps/s $\color{#35bf28}+0.38\%$
test_step_mdp_speed[False-True-True-True-True] 57.9110μs 36.3663μs 27.4980 KOps/s 26.6440 KOps/s $\color{#35bf28}+3.20\%$
test_step_mdp_speed[False-True-True-True-False] 43.5910μs 23.5923μs 42.3866 KOps/s 41.6766 KOps/s $\color{#35bf28}+1.70\%$
test_step_mdp_speed[False-True-True-False-True] 42.6210μs 24.9347μs 40.1047 KOps/s 39.1748 KOps/s $\color{#35bf28}+2.37\%$
test_step_mdp_speed[False-True-True-False-False] 40.4310μs 15.0563μs 66.4175 KOps/s 65.5470 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[False-True-False-True-True] 60.7510μs 38.2187μs 26.1652 KOps/s 25.6484 KOps/s $\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-True-False-True-False] 59.7410μs 25.5380μs 39.1574 KOps/s 38.9557 KOps/s $\color{#35bf28}+0.52\%$
test_step_mdp_speed[False-True-False-False-True] 47.3410μs 26.7247μs 37.4186 KOps/s 37.4161 KOps/s $+0.01\%$
test_step_mdp_speed[False-True-False-False-False] 35.7810μs 16.8557μs 59.3271 KOps/s 59.8172 KOps/s $\color{#d91a1a}-0.82\%$
test_step_mdp_speed[False-False-True-True-True] 66.8610μs 40.0593μs 24.9630 KOps/s 24.4004 KOps/s $\color{#35bf28}+2.31\%$
test_step_mdp_speed[False-False-True-True-False] 50.3110μs 27.3937μs 36.5047 KOps/s 35.9549 KOps/s $\color{#35bf28}+1.53\%$
test_step_mdp_speed[False-False-True-False-True] 45.1910μs 26.3926μs 37.8894 KOps/s 37.7569 KOps/s $\color{#35bf28}+0.35\%$
test_step_mdp_speed[False-False-True-False-False] 60.7110μs 16.8428μs 59.3727 KOps/s 59.0337 KOps/s $\color{#35bf28}+0.57\%$
test_step_mdp_speed[False-False-False-True-True] 71.9010μs 43.7824μs 22.8402 KOps/s 22.1075 KOps/s $\color{#35bf28}+3.31\%$
test_step_mdp_speed[False-False-False-True-False] 54.8510μs 29.0130μs 34.4673 KOps/s 33.2717 KOps/s $\color{#35bf28}+3.59\%$
test_step_mdp_speed[False-False-False-False-True] 54.2410μs 28.2826μs 35.3574 KOps/s 34.6058 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-False-False-False-False] 42.3110μs 18.6200μs 53.7057 KOps/s 53.7002 KOps/s $\color{#35bf28}+0.01\%$
test_values[generalized_advantage_estimate-True-True] 25.2782ms 24.7481ms 40.4072 Ops/s 39.6337 Ops/s $\color{#35bf28}+1.95\%$
test_values[vec_generalized_advantage_estimate-True-True] 82.5155ms 3.2179ms 310.7662 Ops/s 307.1912 Ops/s $\color{#35bf28}+1.16\%$
test_values[td0_return_estimate-False-False] 87.0920μs 63.3622μs 15.7823 KOps/s 15.3549 KOps/s $\color{#35bf28}+2.78\%$
test_values[td1_return_estimate-False-False] 53.1463ms 52.2421ms 19.1417 Ops/s 18.7242 Ops/s $\color{#35bf28}+2.23\%$
test_values[vec_td1_return_estimate-False-False] 2.0914ms 1.7579ms 568.8522 Ops/s 561.6246 Ops/s $\color{#35bf28}+1.29\%$
test_values[td_lambda_return_estimate-True-False] 84.3973ms 83.0125ms 12.0464 Ops/s 11.7500 Ops/s $\color{#35bf28}+2.52\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.0583ms 1.7608ms 567.9216 Ops/s 565.1837 Ops/s $\color{#35bf28}+0.48\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.9255ms 23.5617ms 42.4418 Ops/s 41.2954 Ops/s $\color{#35bf28}+2.78\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8961ms 0.6893ms 1.4508 KOps/s 1.4283 KOps/s $\color{#35bf28}+1.58\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7063ms 0.6503ms 1.5379 KOps/s 1.5024 KOps/s $\color{#35bf28}+2.36\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5064ms 1.4420ms 693.4874 Ops/s 685.5486 Ops/s $\color{#35bf28}+1.16\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9511ms 0.6669ms 1.4994 KOps/s 1.4654 KOps/s $\color{#35bf28}+2.32\%$
test_dqn_speed 1.7825ms 1.4069ms 710.7587 Ops/s 615.0341 Ops/s $\textbf{\color{#35bf28}+15.56\%}$
test_ddpg_speed 3.1400ms 2.9077ms 343.9097 Ops/s 334.0920 Ops/s $\color{#35bf28}+2.94\%$
test_sac_speed 8.5901ms 8.2728ms 120.8774 Ops/s 117.1606 Ops/s $\color{#35bf28}+3.17\%$
test_redq_speed 12.2713ms 10.5346ms 94.9252 Ops/s 94.1559 Ops/s $\color{#35bf28}+0.82\%$
test_redq_deprec_speed 11.9432ms 11.4149ms 87.6046 Ops/s 86.0924 Ops/s $\color{#35bf28}+1.76\%$
test_td3_speed 8.3068ms 8.1637ms 122.4937 Ops/s 118.9615 Ops/s $\color{#35bf28}+2.97\%$
test_cql_speed 26.5142ms 25.5040ms 39.2096 Ops/s 38.4143 Ops/s $\color{#35bf28}+2.07\%$
test_a2c_speed 5.8455ms 5.5671ms 179.6274 Ops/s 175.8474 Ops/s $\color{#35bf28}+2.15\%$
test_ppo_speed 6.2387ms 5.9625ms 167.7147 Ops/s 165.5029 Ops/s $\color{#35bf28}+1.34\%$
test_reinforce_speed 4.7688ms 4.5528ms 219.6445 Ops/s 212.1346 Ops/s $\color{#35bf28}+3.54\%$
test_iql_speed 20.3544ms 19.5163ms 51.2393 Ops/s 49.8280 Ops/s $\color{#35bf28}+2.83\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.7254ms 4.5457ms 219.9858 Ops/s 208.0138 Ops/s $\textbf{\color{#35bf28}+5.76\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5035ms 0.5901ms 1.6947 KOps/s 1.6801 KOps/s $\color{#35bf28}+0.87\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8036ms 0.5673ms 1.7629 KOps/s 1.7492 KOps/s $\color{#35bf28}+0.78\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.8058ms 4.5341ms 220.5520 Ops/s 212.9968 Ops/s $\color{#35bf28}+3.55\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.5574ms 0.5802ms 1.7235 KOps/s 1.6871 KOps/s $\color{#35bf28}+2.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7574ms 0.5575ms 1.7939 KOps/s 1.7641 KOps/s $\color{#35bf28}+1.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.0630ms 1.4993ms 666.9939 Ops/s 648.6846 Ops/s $\color{#35bf28}+2.82\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5499ms 1.4285ms 700.0326 Ops/s 680.6048 Ops/s $\color{#35bf28}+2.85\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.0144ms 4.7004ms 212.7498 Ops/s 205.0481 Ops/s $\color{#35bf28}+3.76\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8259ms 0.7127ms 1.4031 KOps/s 1.3854 KOps/s $\color{#35bf28}+1.28\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.6039ms 0.6978ms 1.4330 KOps/s 1.4262 KOps/s $\color{#35bf28}+0.48\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.8953ms 4.5737ms 218.6414 Ops/s 209.8962 Ops/s $\color{#35bf28}+4.17\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8597ms 0.5919ms 1.6896 KOps/s 1.6891 KOps/s $\color{#35bf28}+0.03\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6541ms 0.5668ms 1.7643 KOps/s 1.7428 KOps/s $\color{#35bf28}+1.23\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.8767ms 4.5431ms 220.1129 Ops/s 208.9843 Ops/s $\textbf{\color{#35bf28}+5.33\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6822ms 0.5846ms 1.7105 KOps/s 1.6950 KOps/s $\color{#35bf28}+0.91\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.7800ms 0.5643ms 1.7721 KOps/s 1.7503 KOps/s $\color{#35bf28}+1.24\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.8528ms 4.7045ms 212.5619 Ops/s 204.8250 Ops/s $\color{#35bf28}+3.78\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8354ms 0.7140ms 1.4005 KOps/s 1.3903 KOps/s $\color{#35bf28}+0.74\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8322ms 0.6914ms 1.4463 KOps/s 1.4314 KOps/s $\color{#35bf28}+1.04\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1150s 9.1529ms 109.2548 Ops/s 106.5584 Ops/s $\color{#35bf28}+2.53\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.6234ms 15.1860ms 65.8503 Ops/s 64.3408 Ops/s $\color{#35bf28}+2.35\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.3181ms 1.2596ms 793.9225 Ops/s 762.4095 Ops/s $\color{#35bf28}+4.13\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1060s 6.8648ms 145.6697 Ops/s 144.2686 Ops/s $\color{#35bf28}+0.97\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.9927ms 15.1991ms 65.7932 Ops/s 64.3440 Ops/s $\color{#35bf28}+2.25\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.5254ms 1.2811ms 780.6047 Ops/s 756.7288 Ops/s $\color{#35bf28}+3.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1109s 9.3959ms 106.4296 Ops/s 105.9160 Ops/s $\color{#35bf28}+0.48\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.2568ms 15.5238ms 64.4171 Ops/s 62.7972 Ops/s $\color{#35bf28}+2.58\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.9196ms 1.6388ms 610.2095 Ops/s 595.8575 Ops/s $\color{#35bf28}+2.41\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@vmoens @facebook-github-bot