[CI] Upgrade SDL to install pygame 2.6

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2248

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures

As of commit 728f89b with merge base b7561b1 ():

NEW FAILURES - The following jobs have failed:

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t e4c0d863acd7d18ad886ffca910d7a63d372a946fad3c00d8fbc965f46c4c8d4 /exec failed with exit code 139
• Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job (gh)
  AttributeError: module 'torch' has no attribute 'uint16'
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  AttributeError: module 'torch' has no attribute 'uint16'
• Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 49385d0c48899fed67a24a4c6ac422fd335561766072c9c5bd2e10efd0eee24d /exec failed with exit code 1
• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1056s	58.6259ms	17.0573 Ops/s	17.9189 Ops/s	$\color{#d91a1a}-4.81\%$
test_sync	35.9799ms	30.4802ms	32.8082 Ops/s	32.6993 Ops/s	$\color{#35bf28}+0.33\%$
test_async	54.3541ms	29.3085ms	34.1198 Ops/s	35.1881 Ops/s	$\color{#d91a1a}-3.04\%$
test_simple	0.3764s	0.3738s	2.6753 Ops/s	2.6306 Ops/s	$\color{#35bf28}+1.70\%$
test_transformed	0.5359s	0.5286s	1.8920 Ops/s	1.8214 Ops/s	$\color{#35bf28}+3.87\%$
test_serial	1.3106s	1.2598s	0.7938 Ops/s	0.7822 Ops/s	$\color{#35bf28}+1.48\%$
test_parallel	1.1293s	1.0725s	0.9324 Ops/s	0.9272 Ops/s	$\color{#35bf28}+0.56\%$
test_step_mdp_speed[True-True-True-True-True]	0.1110ms	21.9979μs	45.4590 KOps/s	44.4968 KOps/s	$\color{#35bf28}+2.16\%$
test_step_mdp_speed[True-True-True-True-False]	58.1960μs	12.9650μs	77.1305 KOps/s	77.6597 KOps/s	$\color{#d91a1a}-0.68\%$
test_step_mdp_speed[True-True-True-False-True]	38.1620μs	12.9905μs	76.9791 KOps/s	76.9647 KOps/s	$\color{#35bf28}+0.02\%$
test_step_mdp_speed[True-True-True-False-False]	53.7100μs	7.6098μs	131.4087 KOps/s	131.0268 KOps/s	$\color{#35bf28}+0.29\%$
test_step_mdp_speed[True-True-False-True-True]	80.2600μs	23.4062μs	42.7238 KOps/s	42.3267 KOps/s	$\color{#35bf28}+0.94\%$
test_step_mdp_speed[True-True-False-True-False]	41.3470μs	14.2609μs	70.1220 KOps/s	70.1206 KOps/s	$+0.00\%$
test_step_mdp_speed[True-True-False-False-True]	51.2960μs	14.2133μs	70.3564 KOps/s	70.8996 KOps/s	$\color{#d91a1a}-0.77\%$
test_step_mdp_speed[True-True-False-False-False]	32.3710μs	8.8493μs	113.0030 KOps/s	113.2452 KOps/s	$\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-False-True-True-True]	85.7500μs	24.6273μs	40.6053 KOps/s	40.1048 KOps/s	$\color{#35bf28}+1.25\%$
test_step_mdp_speed[True-False-True-True-False]	43.4810μs	15.5953μs	64.1218 KOps/s	63.8265 KOps/s	$\color{#35bf28}+0.46\%$
test_step_mdp_speed[True-False-True-False-True]	63.1780μs	14.1835μs	70.5046 KOps/s	70.2339 KOps/s	$\color{#35bf28}+0.39\%$
test_step_mdp_speed[True-False-True-False-False]	34.5740μs	8.8258μs	113.3043 KOps/s	112.6242 KOps/s	$\color{#35bf28}+0.60\%$
test_step_mdp_speed[True-False-False-True-True]	74.8100μs	25.6904μs	38.9251 KOps/s	38.6630 KOps/s	$\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-False-False-True-False]	62.1260μs	16.6394μs	60.0983 KOps/s	59.4739 KOps/s	$\color{#35bf28}+1.05\%$
test_step_mdp_speed[True-False-False-False-True]	46.5770μs	15.2857μs	65.4207 KOps/s	65.5454 KOps/s	$\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-False-False-False-False]	44.1330μs	9.9721μs	100.2796 KOps/s	100.2651 KOps/s	$\color{#35bf28}+0.01\%$
test_step_mdp_speed[False-True-True-True-True]	59.0410μs	24.7428μs	40.4157 KOps/s	40.2121 KOps/s	$\color{#35bf28}+0.51\%$
test_step_mdp_speed[False-True-True-True-False]	46.3770μs	15.4409μs	64.7630 KOps/s	64.1198 KOps/s	$\color{#35bf28}+1.00\%$
test_step_mdp_speed[False-True-True-False-True]	42.3000μs	16.3551μs	61.1429 KOps/s	61.1938 KOps/s	$\color{#d91a1a}-0.08\%$
test_step_mdp_speed[False-True-True-False-False]	50.0240μs	10.0037μs	99.9628 KOps/s	99.6304 KOps/s	$\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-True-False-True-True]	72.3660μs	25.7958μs	38.7661 KOps/s	38.7269 KOps/s	$\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-True-False-True-False]	56.7660μs	16.5122μs	60.5614 KOps/s	59.6917 KOps/s	$\color{#35bf28}+1.46\%$
test_step_mdp_speed[False-True-False-False-True]	55.8640μs	17.4427μs	57.3307 KOps/s	57.2351 KOps/s	$\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-True-False-False-False]	36.2670μs	11.2175μs	89.1466 KOps/s	88.9776 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-False-True-True-True]	72.6760μs	26.8353μs	37.2644 KOps/s	36.5324 KOps/s	$\color{#35bf28}+2.00\%$
test_step_mdp_speed[False-False-True-True-False]	46.4170μs	17.9114μs	55.8302 KOps/s	55.5635 KOps/s	$\color{#35bf28}+0.48\%$
test_step_mdp_speed[False-False-True-False-True]	43.9920μs	17.4340μs	57.3591 KOps/s	56.5482 KOps/s	$\color{#35bf28}+1.43\%$
test_step_mdp_speed[False-False-True-False-False]	44.3930μs	11.1601μs	89.6052 KOps/s	89.5231 KOps/s	$\color{#35bf28}+0.09\%$
test_step_mdp_speed[False-False-False-True-True]	39.9250μs	28.1627μs	35.5080 KOps/s	34.8794 KOps/s	$\color{#35bf28}+1.80\%$
test_step_mdp_speed[False-False-False-True-False]	59.0600μs	19.0145μs	52.5915 KOps/s	52.5826 KOps/s	$\color{#35bf28}+0.02\%$
test_step_mdp_speed[False-False-False-False-True]	68.5880μs	18.4894μs	54.0851 KOps/s	54.1871 KOps/s	$\color{#d91a1a}-0.19\%$
test_step_mdp_speed[False-False-False-False-False]	48.0400μs	12.0859μs	82.7407 KOps/s	81.9456 KOps/s	$\color{#35bf28}+0.97\%$
test_values[generalized_advantage_estimate-True-True]	10.0926ms	9.7656ms	102.4000 Ops/s	105.1515 Ops/s	$\color{#d91a1a}-2.62\%$
test_values[vec_generalized_advantage_estimate-True-True]	36.3268ms	35.1587ms	28.4425 Ops/s	29.9452 Ops/s	$\textbf{\color{#d91a1a}-5.02\%}$
test_values[td0_return_estimate-False-False]	0.2328ms	0.1663ms	6.0150 KOps/s	5.6893 KOps/s	$\textbf{\color{#35bf28}+5.72\%}$
test_values[td1_return_estimate-False-False]	27.1071ms	24.1782ms	41.3595 Ops/s	42.1209 Ops/s	$\color{#d91a1a}-1.81\%$
test_values[vec_td1_return_estimate-False-False]	37.0171ms	35.4560ms	28.2039 Ops/s	29.6402 Ops/s	$\color{#d91a1a}-4.85\%$
test_values[td_lambda_return_estimate-True-False]	37.9438ms	35.1231ms	28.4713 Ops/s	28.4219 Ops/s	$\color{#35bf28}+0.17\%$
test_values[vec_td_lambda_return_estimate-True-False]	36.3944ms	35.4697ms	28.1931 Ops/s	29.9811 Ops/s	$\textbf{\color{#d91a1a}-5.96\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.8007ms	8.6197ms	116.0136 Ops/s	120.4167 Ops/s	$\color{#d91a1a}-3.66\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.3546ms	1.8986ms	526.7036 Ops/s	531.6467 Ops/s	$\color{#d91a1a}-0.93\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4376ms	0.3601ms	2.7771 KOps/s	2.8236 KOps/s	$\color{#d91a1a}-1.65\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	47.5389ms	46.3586ms	21.5710 Ops/s	21.8293 Ops/s	$\color{#d91a1a}-1.18\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.1571ms	3.0228ms	330.8137 Ops/s	329.6412 Ops/s	$\color{#35bf28}+0.36\%$
test_dqn_speed	6.7921ms	1.3701ms	729.8596 Ops/s	723.3095 Ops/s	$\color{#35bf28}+0.91\%$
test_ddpg_speed	3.6251ms	2.8803ms	347.1896 Ops/s	344.6897 Ops/s	$\color{#35bf28}+0.73\%$
test_sac_speed	9.1330ms	8.6353ms	115.8036 Ops/s	114.0301 Ops/s	$\color{#35bf28}+1.56\%$
test_redq_speed	95.8385ms	14.6211ms	68.3945 Ops/s	71.8549 Ops/s	$\color{#d91a1a}-4.82\%$
test_redq_deprec_speed	14.5740ms	13.5537ms	73.7808 Ops/s	75.0419 Ops/s	$\color{#d91a1a}-1.68\%$
test_td3_speed	8.7445ms	8.5503ms	116.9546 Ops/s	114.7680 Ops/s	$\color{#35bf28}+1.91\%$
test_cql_speed	38.3191ms	36.8302ms	27.1516 Ops/s	27.2200 Ops/s	$\color{#d91a1a}-0.25\%$
test_a2c_speed	8.8443ms	7.4789ms	133.7086 Ops/s	134.3507 Ops/s	$\color{#d91a1a}-0.48\%$
test_ppo_speed	9.2879ms	7.7425ms	129.1568 Ops/s	129.4078 Ops/s	$\color{#d91a1a}-0.19\%$
test_reinforce_speed	6.7703ms	6.6423ms	150.5501 Ops/s	150.2735 Ops/s	$\color{#35bf28}+0.18\%$
test_iql_speed	38.2357ms	33.2231ms	30.0995 Ops/s	30.4904 Ops/s	$\color{#d91a1a}-1.28\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.9487ms	3.5640ms	280.5874 Ops/s	295.7817 Ops/s	$\textbf{\color{#d91a1a}-5.14\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1009s	0.5631ms	1.7758 KOps/s	2.0053 KOps/s	$\textbf{\color{#d91a1a}-11.44\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.9205ms	0.4709ms	2.1234 KOps/s	2.1300 KOps/s	$\color{#d91a1a}-0.31\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.0739ms	3.5301ms	283.2744 Ops/s	300.3662 Ops/s	$\textbf{\color{#d91a1a}-5.69\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.7713ms	0.4917ms	2.0337 KOps/s	2.0624 KOps/s	$\color{#d91a1a}-1.39\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.8180ms	0.4624ms	2.1626 KOps/s	2.1654 KOps/s	$\color{#d91a1a}-0.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.8878ms	1.7348ms	576.4495 Ops/s	580.2520 Ops/s	$\color{#d91a1a}-0.66\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	4.7904ms	1.6576ms	603.2877 Ops/s	612.8441 Ops/s	$\color{#d91a1a}-1.56\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	7.2639ms	3.6571ms	273.4382 Ops/s	283.9263 Ops/s	$\color{#d91a1a}-3.69\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0722ms	0.6344ms	1.5764 KOps/s	1.5885 KOps/s	$\color{#d91a1a}-0.76\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9317ms	0.6067ms	1.6483 KOps/s	1.6425 KOps/s	$\color{#35bf28}+0.35\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.8211ms	3.4798ms	287.3726 Ops/s	291.8496 Ops/s	$\color{#d91a1a}-1.53\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.5954ms	0.5035ms	1.9860 KOps/s	2.0479 KOps/s	$\color{#d91a1a}-3.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7906ms	0.4848ms	2.0627 KOps/s	2.0936 KOps/s	$\color{#d91a1a}-1.47\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.1265ms	3.7018ms	270.1375 Ops/s	302.5879 Ops/s	$\textbf{\color{#d91a1a}-10.72\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6080ms	0.4994ms	2.0023 KOps/s	1.5846 KOps/s	$\textbf{\color{#35bf28}+26.36\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.8967ms	0.4842ms	2.0655 KOps/s	2.1631 KOps/s	$\color{#d91a1a}-4.51\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.0038ms	3.7736ms	264.9972 Ops/s	284.7945 Ops/s	$\textbf{\color{#d91a1a}-6.95\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0199ms	0.6455ms	1.5492 KOps/s	1.5828 KOps/s	$\color{#d91a1a}-2.12\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9080ms	0.6149ms	1.6262 KOps/s	1.6293 KOps/s	$\color{#d91a1a}-0.19\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1128s	6.0593ms	165.0367 Ops/s	173.7037 Ops/s	$\color{#d91a1a}-4.99\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1232s	15.1440ms	66.0327 Ops/s	68.1718 Ops/s	$\color{#d91a1a}-3.14\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.3389ms	1.0658ms	938.2721 Ops/s	928.5181 Ops/s	$\color{#35bf28}+1.05\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1152s	5.9967ms	166.7582 Ops/s	173.0220 Ops/s	$\color{#d91a1a}-3.62\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	15.4077ms	12.8162ms	78.0263 Ops/s	79.0549 Ops/s	$\color{#d91a1a}-1.30\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	1.1692ms	1.0656ms	938.4131 Ops/s	928.8948 Ops/s	$\color{#35bf28}+1.02\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1175s	6.1757ms	161.9245 Ops/s	168.1392 Ops/s	$\color{#d91a1a}-3.70\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	17.6212ms	13.4391ms	74.4096 Ops/s	78.1450 Ops/s	$\color{#d91a1a}-4.78\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	1.7229ms	1.2102ms	826.2933 Ops/s	805.7891 Ops/s	$\color{#35bf28}+2.54\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1207s	0.1198s	8.3487 Ops/s	8.5095 Ops/s	$\color{#d91a1a}-1.89\%$
test_sync	0.1015s	99.5394ms	10.0463 Ops/s	9.6843 Ops/s	$\color{#35bf28}+3.74\%$
test_async	0.1993s	78.0880ms	12.8061 Ops/s	12.7244 Ops/s	$\color{#35bf28}+0.64\%$
test_single_pixels	0.1298s	0.1297s	7.7104 Ops/s	7.8007 Ops/s	$\color{#d91a1a}-1.16\%$
test_sync_pixels	85.7342ms	83.9620ms	11.9102 Ops/s	12.2211 Ops/s	$\color{#d91a1a}-2.54\%$
test_async_pixels	0.1596s	69.7766ms	14.3315 Ops/s	14.7807 Ops/s	$\color{#d91a1a}-3.04\%$
test_simple	0.8222s	0.8215s	1.2173 Ops/s	1.2238 Ops/s	$\color{#d91a1a}-0.53\%$
test_transformed	1.0847s	1.0834s	0.9231 Ops/s	0.9340 Ops/s	$\color{#d91a1a}-1.17\%$
test_serial	2.5992s	2.5420s	0.3934 Ops/s	0.3990 Ops/s	$\color{#d91a1a}-1.41\%$
test_parallel	2.4561s	2.3853s	0.4192 Ops/s	0.4235 Ops/s	$\color{#d91a1a}-1.02\%$
test_step_mdp_speed[True-True-True-True-True]	0.1108ms	33.4700μs	29.8775 KOps/s	30.2907 KOps/s	$\color{#d91a1a}-1.36\%$
test_step_mdp_speed[True-True-True-True-False]	45.9800μs	19.7480μs	50.6380 KOps/s	51.4370 KOps/s	$\color{#d91a1a}-1.55\%$
test_step_mdp_speed[True-True-True-False-True]	39.3700μs	19.5109μs	51.2535 KOps/s	52.3529 KOps/s	$\color{#d91a1a}-2.10\%$
test_step_mdp_speed[True-True-True-False-False]	32.2710μs	11.1878μs	89.3829 KOps/s	89.2058 KOps/s	$\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-True-False-True-True]	77.2410μs	35.1194μs	28.4743 KOps/s	28.3383 KOps/s	$\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-True-False-True-False]	88.4010μs	21.4339μs	46.6551 KOps/s	46.7432 KOps/s	$\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-True-False-False-True]	50.1010μs	20.9313μs	47.7753 KOps/s	47.4817 KOps/s	$\color{#35bf28}+0.62\%$
test_step_mdp_speed[True-True-False-False-False]	34.4700μs	13.0436μs	76.6662 KOps/s	77.4710 KOps/s	$\color{#d91a1a}-1.04\%$
test_step_mdp_speed[True-False-True-True-True]	82.0510μs	37.2546μs	26.8423 KOps/s	27.2168 KOps/s	$\color{#d91a1a}-1.38\%$
test_step_mdp_speed[True-False-True-True-False]	50.1210μs	23.1975μs	43.1080 KOps/s	43.0573 KOps/s	$\color{#35bf28}+0.12\%$
test_step_mdp_speed[True-False-True-False-True]	48.6900μs	20.7741μs	48.1368 KOps/s	47.8752 KOps/s	$\color{#35bf28}+0.55\%$
test_step_mdp_speed[True-False-True-False-False]	34.5510μs	13.0104μs	76.8614 KOps/s	77.0164 KOps/s	$\color{#d91a1a}-0.20\%$
test_step_mdp_speed[True-False-False-True-True]	80.3910μs	39.0171μs	25.6298 KOps/s	25.7227 KOps/s	$\color{#d91a1a}-0.36\%$
test_step_mdp_speed[True-False-False-True-False]	75.3810μs	25.2095μs	39.6676 KOps/s	40.2427 KOps/s	$\color{#d91a1a}-1.43\%$
test_step_mdp_speed[True-False-False-False-True]	51.9410μs	22.6272μs	44.1947 KOps/s	44.2894 KOps/s	$\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-False-False-False-False]	38.1210μs	14.8237μs	67.4596 KOps/s	67.0012 KOps/s	$\color{#35bf28}+0.68\%$
test_step_mdp_speed[False-True-True-True-True]	67.0610μs	37.0340μs	27.0022 KOps/s	27.2734 KOps/s	$\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-True-True-True-False]	49.0210μs	23.4111μs	42.7148 KOps/s	42.8763 KOps/s	$\color{#d91a1a}-0.38\%$
test_step_mdp_speed[False-True-True-False-True]	52.8710μs	24.8282μs	40.2768 KOps/s	39.6084 KOps/s	$\color{#35bf28}+1.69\%$
test_step_mdp_speed[False-True-True-False-False]	37.6000μs	14.7832μs	67.6445 KOps/s	67.7397 KOps/s	$\color{#d91a1a}-0.14\%$
test_step_mdp_speed[False-True-False-True-True]	73.4310μs	38.3589μs	26.0696 KOps/s	25.4302 KOps/s	$\color{#35bf28}+2.51\%$
test_step_mdp_speed[False-True-False-True-False]	51.7410μs	25.1656μs	39.7368 KOps/s	40.3085 KOps/s	$\color{#d91a1a}-1.42\%$
test_step_mdp_speed[False-True-False-False-True]	56.3610μs	26.5769μs	37.6267 KOps/s	37.6211 KOps/s	$\color{#35bf28}+0.01\%$
test_step_mdp_speed[False-True-False-False-False]	49.3310μs	16.8409μs	59.3791 KOps/s	60.8239 KOps/s	$\color{#d91a1a}-2.38\%$
test_step_mdp_speed[False-False-True-True-True]	73.1710μs	40.7821μs	24.5206 KOps/s	24.7275 KOps/s	$\color{#d91a1a}-0.84\%$
test_step_mdp_speed[False-False-True-True-False]	59.0510μs	27.2348μs	36.7178 KOps/s	37.3983 KOps/s	$\color{#d91a1a}-1.82\%$
test_step_mdp_speed[False-False-True-False-True]	53.6610μs	26.1450μs	38.2483 KOps/s	37.5176 KOps/s	$\color{#35bf28}+1.95\%$
test_step_mdp_speed[False-False-True-False-False]	46.7310μs	16.6750μs	59.9702 KOps/s	59.9992 KOps/s	$\color{#d91a1a}-0.05\%$
test_step_mdp_speed[False-False-False-True-True]	74.0710μs	43.2639μs	23.1140 KOps/s	23.1044 KOps/s	$\color{#35bf28}+0.04\%$
test_step_mdp_speed[False-False-False-True-False]	58.1100μs	28.8624μs	34.6472 KOps/s	34.7754 KOps/s	$\color{#d91a1a}-0.37\%$
test_step_mdp_speed[False-False-False-False-True]	56.1310μs	27.7927μs	35.9807 KOps/s	35.4360 KOps/s	$\color{#35bf28}+1.54\%$
test_step_mdp_speed[False-False-False-False-False]	41.7400μs	18.4053μs	54.3321 KOps/s	54.1659 KOps/s	$\color{#35bf28}+0.31\%$
test_values[generalized_advantage_estimate-True-True]	27.8157ms	27.3511ms	36.5616 Ops/s	38.3620 Ops/s	$\color{#d91a1a}-4.69\%$
test_values[vec_generalized_advantage_estimate-True-True]	90.0441ms	2.7194ms	367.7292 Ops/s	351.6139 Ops/s	$\color{#35bf28}+4.58\%$
test_values[td0_return_estimate-False-False]	93.8710μs	68.8077μs	14.5333 KOps/s	14.6645 KOps/s	$\color{#d91a1a}-0.90\%$
test_values[td1_return_estimate-False-False]	61.5456ms	59.6647ms	16.7603 Ops/s	17.2830 Ops/s	$\color{#d91a1a}-3.02\%$
test_values[vec_td1_return_estimate-False-False]	1.3294ms	1.1122ms	899.0995 Ops/s	904.1547 Ops/s	$\color{#d91a1a}-0.56\%$
test_values[td_lambda_return_estimate-True-False]	97.8414ms	94.4739ms	10.5849 Ops/s	10.8971 Ops/s	$\color{#d91a1a}-2.86\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.2542ms	1.1054ms	904.6128 Ops/s	906.3555 Ops/s	$\color{#d91a1a}-0.19\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	28.1140ms	26.7731ms	37.3510 Ops/s	38.3689 Ops/s	$\color{#d91a1a}-2.65\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9603ms	0.7491ms	1.3349 KOps/s	1.3463 KOps/s	$\color{#d91a1a}-0.85\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7806ms	0.6936ms	1.4417 KOps/s	1.4570 KOps/s	$\color{#d91a1a}-1.05\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5616ms	1.4996ms	666.8620 Ops/s	672.9094 Ops/s	$\color{#d91a1a}-0.90\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.7897ms	0.7105ms	1.4074 KOps/s	1.4245 KOps/s	$\color{#d91a1a}-1.20\%$
test_dqn_speed	78.5393ms	1.6130ms	619.9807 Ops/s	686.6790 Ops/s	$\textbf{\color{#d91a1a}-9.71\%}$
test_ddpg_speed	3.2696ms	3.0230ms	330.7973 Ops/s	332.4938 Ops/s	$\color{#d91a1a}-0.51\%$
test_sac_speed	9.3348ms	8.6187ms	116.0269 Ops/s	116.2738 Ops/s	$\color{#d91a1a}-0.21\%$
test_redq_speed	11.9043ms	10.9287ms	91.5019 Ops/s	91.7795 Ops/s	$\color{#d91a1a}-0.30\%$
test_redq_deprec_speed	0.1064s	12.8811ms	77.6328 Ops/s	83.3878 Ops/s	$\textbf{\color{#d91a1a}-6.90\%}$
test_td3_speed	8.7467ms	8.5512ms	116.9420 Ops/s	116.7466 Ops/s	$\color{#35bf28}+0.17\%$
test_cql_speed	26.8224ms	26.1011ms	38.3126 Ops/s	38.3968 Ops/s	$\color{#d91a1a}-0.22\%$
test_a2c_speed	5.8772ms	5.7287ms	174.5600 Ops/s	172.4320 Ops/s	$\color{#35bf28}+1.23\%$
test_ppo_speed	6.4426ms	6.0277ms	165.9006 Ops/s	163.1393 Ops/s	$\color{#35bf28}+1.69\%$
test_reinforce_speed	5.4669ms	4.6796ms	213.6950 Ops/s	209.0189 Ops/s	$\color{#35bf28}+2.24\%$
test_iql_speed	20.4333ms	19.7627ms	50.6003 Ops/s	48.5826 Ops/s	$\color{#35bf28}+4.15\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	4.7710ms	4.6416ms	215.4418 Ops/s	220.6708 Ops/s	$\color{#d91a1a}-2.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.2656ms	0.6028ms	1.6590 KOps/s	1.6634 KOps/s	$\color{#d91a1a}-0.26\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7370ms	0.5774ms	1.7318 KOps/s	1.7334 KOps/s	$\color{#d91a1a}-0.09\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.8100ms	4.6265ms	216.1457 Ops/s	222.2302 Ops/s	$\color{#d91a1a}-2.74\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.1694ms	0.5905ms	1.6935 KOps/s	1.6668 KOps/s	$\color{#35bf28}+1.60\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7119ms	0.5650ms	1.7700 KOps/s	1.7327 KOps/s	$\color{#35bf28}+2.15\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.2923ms	2.1545ms	464.1527 Ops/s	456.3060 Ops/s	$\color{#35bf28}+1.72\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	6.3812ms	2.0727ms	482.4536 Ops/s	479.6847 Ops/s	$\color{#35bf28}+0.58\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.9148ms	4.8058ms	208.0814 Ops/s	213.7398 Ops/s	$\color{#d91a1a}-2.65\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8602ms	0.7461ms	1.3403 KOps/s	1.3304 KOps/s	$\color{#35bf28}+0.74\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.8611ms	0.7287ms	1.3723 KOps/s	1.3736 KOps/s	$\color{#d91a1a}-0.10\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	4.8205ms	4.7427ms	210.8512 Ops/s	219.7486 Ops/s	$\color{#d91a1a}-4.05\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.4238ms	0.5980ms	1.6723 KOps/s	1.6646 KOps/s	$\color{#35bf28}+0.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7385ms	0.5806ms	1.7222 KOps/s	1.7224 KOps/s	$\color{#d91a1a}-0.01\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	4.8801ms	4.6875ms	213.3337 Ops/s	223.4627 Ops/s	$\color{#d91a1a}-4.53\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6881ms	0.5952ms	1.6800 KOps/s	1.7048 KOps/s	$\color{#d91a1a}-1.45\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	5.0098ms	0.5775ms	1.7316 KOps/s	1.7623 KOps/s	$\color{#d91a1a}-1.74\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	4.9039ms	4.8067ms	208.0419 Ops/s	212.3754 Ops/s	$\color{#d91a1a}-2.04\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.5431ms	0.7460ms	1.3404 KOps/s	1.3267 KOps/s	$\color{#35bf28}+1.04\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8946ms	0.7168ms	1.3950 KOps/s	1.3611 KOps/s	$\color{#35bf28}+2.49\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1273s	7.4191ms	134.7866 Ops/s	134.1127 Ops/s	$\color{#35bf28}+0.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	18.7102ms	16.3643ms	61.1086 Ops/s	63.1478 Ops/s	$\color{#d91a1a}-3.23\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.3673ms	1.2831ms	779.3390 Ops/s	757.8341 Ops/s	$\color{#35bf28}+2.84\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1285s	7.4764ms	133.7538 Ops/s	101.3130 Ops/s	$\textbf{\color{#35bf28}+32.02\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1378s	18.7854ms	53.2329 Ops/s	62.0032 Ops/s	$\textbf{\color{#d91a1a}-14.14\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	7.6372ms	1.4121ms	708.1794 Ops/s	747.9316 Ops/s	$\textbf{\color{#d91a1a}-5.31\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1231s	7.5414ms	132.6014 Ops/s	131.4884 Ops/s	$\color{#35bf28}+0.85\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	19.0328ms	16.4567ms	60.7655 Ops/s	61.3032 Ops/s	$\color{#d91a1a}-0.88\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	7.2732ms	1.6213ms	616.7855 Ops/s	660.5512 Ops/s	$\textbf{\color{#d91a1a}-6.63\%}$