[CI] Fix doc upload

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1738

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

⏳ 1 Pending, 26 Unrelated Failures

As of commit 9e93c97 with merge base 25bd8a5 ():

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Brax Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Envpool Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Examples Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
• Generate documentation / build-docs (3.9, 12.1) / linux-job (gh)
• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)
• Jumanji Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Lint / c-source / linux-job (gh)
• Lint / python-source-and-configs / linux-job (gh)
• Olddeps Tests on Linux / unittests (3.8, 11.6) / linux-job (gh)
• Optdeps Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
• PettingZoo Tests on Linux / unittests / linux-job (gh)
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Robohive Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Sklearn Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
• Tests on Linux GPU (Gym) / unittests (3.9, 12.1) / linux-job (gh)
• Unit-tests on Linux CPU / tests (3.10) / linux-job (gh)
• Unit-tests on Linux CPU / tests (3.11) / linux-job (gh)
• Unit-tests on Linux CPU / tests (3.8) / linux-job (gh)
• Unit-tests on Linux CPU / tests (3.9) / linux-job (gh)
• Unit-tests on Linux GPU / tests (3.8, 12.1) / linux-job (gh)
• Unit-tests on Linux GPU, latest stable release / tests (3.8, 11.8) / linux-job (gh)
• Unit-tests on MacOS CPU / tests (3.11) / macos-job (gh)
• Unit-tests on MacOS CPU / tests (3.8) / macos-job (gh)
• Unit-tests on Windows CPU / unittests / windows-job (gh)
• Unit-tests on Windows GPU / unittests / windows-job (gh)
• Vmas Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[pytorch-bot]

No ciflow labels are configured for this repo.
For information on how to enable CIFlow bot see this wiki

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}5$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	64.7167ms	63.3663ms	15.7813 Ops/s	15.0199 Ops/s	$\textbf{\color{#35bf28}+5.07\%}$
test_sync	35.4018ms	34.3971ms	29.0723 Ops/s	28.9739 Ops/s	$\color{#35bf28}+0.34\%$
test_async	77.2294ms	33.1400ms	30.1750 Ops/s	29.6774 Ops/s	$\color{#35bf28}+1.68\%$
test_simple	0.4924s	0.4389s	2.2785 Ops/s	2.2615 Ops/s	$\color{#35bf28}+0.75\%$
test_transformed	0.6589s	0.6077s	1.6456 Ops/s	1.6248 Ops/s	$\color{#35bf28}+1.28\%$
test_serial	1.3835s	1.3374s	0.7477 Ops/s	0.7296 Ops/s	$\color{#35bf28}+2.48\%$
test_parallel	1.3423s	1.2854s	0.7779 Ops/s	0.7772 Ops/s	$\color{#35bf28}+0.10\%$
test_step_mdp_speed[True-True-True-True-True]	0.1826ms	23.0010μs	43.4764 KOps/s	44.0079 KOps/s	$\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-True-True-True-False]	40.7050μs	14.1165μs	70.8389 KOps/s	72.8275 KOps/s	$\color{#d91a1a}-2.73\%$
test_step_mdp_speed[True-True-True-False-True]	64.9910μs	14.2398μs	70.2259 KOps/s	72.7176 KOps/s	$\color{#d91a1a}-3.43\%$
test_step_mdp_speed[True-True-True-False-False]	63.7770μs	8.5314μs	117.2139 KOps/s	121.1888 KOps/s	$\color{#d91a1a}-3.28\%$
test_step_mdp_speed[True-True-False-True-True]	75.8730μs	24.4487μs	40.9020 KOps/s	41.0893 KOps/s	$\color{#d91a1a}-0.46\%$
test_step_mdp_speed[True-True-False-True-False]	44.6430μs	15.3184μs	65.2811 KOps/s	66.1261 KOps/s	$\color{#d91a1a}-1.28\%$
test_step_mdp_speed[True-True-False-False-True]	58.3790μs	15.5134μs	64.4604 KOps/s	65.1354 KOps/s	$\color{#d91a1a}-1.04\%$
test_step_mdp_speed[True-True-False-False-False]	60.9720μs	9.8879μs	101.1334 KOps/s	103.0864 KOps/s	$\color{#d91a1a}-1.89\%$
test_step_mdp_speed[True-False-True-True-True]	75.0910μs	25.8904μs	38.6244 KOps/s	38.6758 KOps/s	$\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-False-True-True-False]	66.8940μs	16.8406μs	59.3804 KOps/s	60.2937 KOps/s	$\color{#d91a1a}-1.51\%$
test_step_mdp_speed[True-False-True-False-True]	51.1450μs	15.4016μs	64.9285 KOps/s	64.8611 KOps/s	$\color{#35bf28}+0.10\%$
test_step_mdp_speed[True-False-True-False-False]	0.1014ms	10.2443μs	97.6156 KOps/s	101.9402 KOps/s	$\color{#d91a1a}-4.24\%$
test_step_mdp_speed[True-False-False-True-True]	85.8700μs	27.1717μs	36.8030 KOps/s	37.1753 KOps/s	$\color{#d91a1a}-1.00\%$
test_step_mdp_speed[True-False-False-True-False]	54.7520μs	17.9914μs	55.5822 KOps/s	56.5952 KOps/s	$\color{#d91a1a}-1.79\%$
test_step_mdp_speed[True-False-False-False-True]	62.0940μs	16.5124μs	60.5604 KOps/s	60.6721 KOps/s	$\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-False-False-False-False]	34.3540μs	10.9376μs	91.4281 KOps/s	91.1841 KOps/s	$\color{#35bf28}+0.27\%$
test_step_mdp_speed[False-True-True-True-True]	55.6340μs	26.0852μs	38.3359 KOps/s	38.9272 KOps/s	$\color{#d91a1a}-1.52\%$
test_step_mdp_speed[False-True-True-True-False]	71.2640μs	16.6506μs	60.0578 KOps/s	59.8004 KOps/s	$\color{#35bf28}+0.43\%$
test_step_mdp_speed[False-True-True-False-True]	50.2730μs	17.6727μs	56.5846 KOps/s	56.9082 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-True-True-False-False]	57.7370μs	10.9782μs	91.0897 KOps/s	90.6615 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-True-False-True-True]	80.1300μs	27.1603μs	36.8185 KOps/s	37.0142 KOps/s	$\color{#d91a1a}-0.53\%$
test_step_mdp_speed[False-True-False-True-False]	0.1157ms	18.1063μs	55.2294 KOps/s	55.5697 KOps/s	$\color{#d91a1a}-0.61\%$
test_step_mdp_speed[False-True-False-False-True]	58.3180μs	18.6976μs	53.4827 KOps/s	52.9769 KOps/s	$\color{#35bf28}+0.95\%$
test_step_mdp_speed[False-True-False-False-False]	51.9260μs	12.1275μs	82.4574 KOps/s	81.9739 KOps/s	$\color{#35bf28}+0.59\%$
test_step_mdp_speed[False-False-True-True-True]	66.8440μs	27.9616μs	35.7633 KOps/s	35.1396 KOps/s	$\color{#35bf28}+1.78\%$
test_step_mdp_speed[False-False-True-True-False]	61.7250μs	19.0955μs	52.3683 KOps/s	52.4483 KOps/s	$\color{#d91a1a}-0.15\%$
test_step_mdp_speed[False-False-True-False-True]	41.3270μs	18.5616μs	53.8747 KOps/s	52.5202 KOps/s	$\color{#35bf28}+2.58\%$
test_step_mdp_speed[False-False-True-False-False]	51.3360μs	12.0435μs	83.0323 KOps/s	82.6116 KOps/s	$\color{#35bf28}+0.51\%$
test_step_mdp_speed[False-False-False-True-True]	84.2460μs	29.1680μs	34.2841 KOps/s	33.8509 KOps/s	$\color{#35bf28}+1.28\%$
test_step_mdp_speed[False-False-False-True-False]	48.5200μs	20.4272μs	48.9543 KOps/s	49.6838 KOps/s	$\color{#d91a1a}-1.47\%$
test_step_mdp_speed[False-False-False-False-True]	79.3480μs	19.5943μs	51.0353 KOps/s	49.9924 KOps/s	$\color{#35bf28}+2.09\%$
test_step_mdp_speed[False-False-False-False-False]	59.3100μs	13.1510μs	76.0400 KOps/s	75.7718 KOps/s	$\color{#35bf28}+0.35\%$
test_values[generalized_advantage_estimate-True-True]	19.0945ms	12.0888ms	82.7212 Ops/s	81.9921 Ops/s	$\color{#35bf28}+0.89\%$
test_values[vec_generalized_advantage_estimate-True-True]	34.0336ms	26.8965ms	37.1796 Ops/s	35.8588 Ops/s	$\color{#35bf28}+3.68\%$
test_values[td0_return_estimate-False-False]	0.2493ms	0.1786ms	5.5996 KOps/s	5.0718 KOps/s	$\textbf{\color{#35bf28}+10.41\%}$
test_values[td1_return_estimate-False-False]	35.9002ms	26.2738ms	38.0607 Ops/s	38.7585 Ops/s	$\color{#d91a1a}-1.80\%$
test_values[vec_td1_return_estimate-False-False]	34.8968ms	27.2427ms	36.7071 Ops/s	35.8003 Ops/s	$\color{#35bf28}+2.53\%$
test_values[td_lambda_return_estimate-True-False]	37.3055ms	36.1621ms	27.6533 Ops/s	27.5458 Ops/s	$\color{#35bf28}+0.39\%$
test_values[vec_td_lambda_return_estimate-True-False]	38.4259ms	27.2014ms	36.7628 Ops/s	35.9308 Ops/s	$\color{#35bf28}+2.32\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.2216ms	7.9960ms	125.0624 Ops/s	123.1628 Ops/s	$\color{#35bf28}+1.54\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.1943ms	1.8554ms	538.9560 Ops/s	517.6347 Ops/s	$\color{#35bf28}+4.12\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.6013ms	0.4377ms	2.2849 KOps/s	2.2637 KOps/s	$\color{#35bf28}+0.94\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	41.7403ms	39.8008ms	25.1251 Ops/s	25.3472 Ops/s	$\color{#d91a1a}-0.88\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	11.0745ms	2.5757ms	388.2372 Ops/s	390.5368 Ops/s	$\color{#d91a1a}-0.59\%$
test_dqn_speed	11.4685ms	1.6519ms	605.3521 Ops/s	604.6008 Ops/s	$\color{#35bf28}+0.12\%$
test_ddpg_speed	13.2000ms	3.7008ms	270.2101 Ops/s	270.2384 Ops/s	$\color{#d91a1a}-0.01\%$
test_sac_speed	20.3462ms	10.4692ms	95.5182 Ops/s	96.5505 Ops/s	$\color{#d91a1a}-1.07\%$
test_redq_speed	27.7039ms	19.8593ms	50.3543 Ops/s	46.0032 Ops/s	$\textbf{\color{#35bf28}+9.46\%}$
test_redq_deprec_speed	90.1962ms	16.7957ms	59.5391 Ops/s	64.1744 Ops/s	$\textbf{\color{#d91a1a}-7.22\%}$
test_td3_speed	20.3857ms	10.7556ms	92.9748 Ops/s	92.4846 Ops/s	$\color{#35bf28}+0.53\%$
test_cql_speed	48.8444ms	39.3170ms	25.4343 Ops/s	25.0884 Ops/s	$\color{#35bf28}+1.38\%$
test_a2c_speed	17.2744ms	8.4128ms	118.8663 Ops/s	117.9327 Ops/s	$\color{#35bf28}+0.79\%$
test_ppo_speed	17.8886ms	8.7108ms	114.7996 Ops/s	113.4063 Ops/s	$\color{#35bf28}+1.23\%$
test_reinforce_speed	16.1159ms	7.4726ms	133.8227 Ops/s	133.6958 Ops/s	$\color{#35bf28}+0.09\%$
test_iql_speed	44.8054ms	34.3746ms	29.0912 Ops/s	28.8006 Ops/s	$\color{#35bf28}+1.01\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.5092ms	1.9968ms	500.7909 Ops/s	490.5114 Ops/s	$\color{#35bf28}+2.10\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1090s	2.3192ms	431.1913 Ops/s	482.4792 Ops/s	$\textbf{\color{#d91a1a}-10.63\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.4231ms	2.0701ms	483.0795 Ops/s	475.2904 Ops/s	$\color{#35bf28}+1.64\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.4710ms	1.9898ms	502.5548 Ops/s	490.8695 Ops/s	$\color{#35bf28}+2.38\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.1147s	2.3233ms	430.4142 Ops/s	484.6175 Ops/s	$\textbf{\color{#d91a1a}-11.18\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.8893ms	2.0677ms	483.6390 Ops/s	460.2586 Ops/s	$\textbf{\color{#35bf28}+5.08\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.4829ms	1.9654ms	508.8081 Ops/s	488.7867 Ops/s	$\color{#35bf28}+4.10\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.1177s	2.3046ms	433.9224 Ops/s	484.1923 Ops/s	$\textbf{\color{#d91a1a}-10.38\%}$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.4887ms	2.1355ms	468.2776 Ops/s	471.8671 Ops/s	$\color{#d91a1a}-0.76\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.6328ms	1.9572ms	510.9291 Ops/s	518.9306 Ops/s	$\color{#d91a1a}-1.54\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.1120s	2.3573ms	424.2121 Ops/s	502.6080 Ops/s	$\textbf{\color{#d91a1a}-15.60\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.3234ms	2.1318ms	469.0922 Ops/s	480.9935 Ops/s	$\color{#d91a1a}-2.47\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.5240ms	1.9388ms	515.7793 Ops/s	517.8020 Ops/s	$\color{#d91a1a}-0.39\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.1173s	2.3868ms	418.9765 Ops/s	424.9862 Ops/s	$\color{#d91a1a}-1.41\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.7499ms	2.1371ms	467.9152 Ops/s	467.5473 Ops/s	$\color{#35bf28}+0.08\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.3669ms	1.9472ms	513.5560 Ops/s	501.9345 Ops/s	$\color{#35bf28}+2.32\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.1329s	2.4113ms	414.7210 Ops/s	420.3226 Ops/s	$\color{#d91a1a}-1.33\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.1760ms	2.1391ms	467.4917 Ops/s	470.7899 Ops/s	$\color{#d91a1a}-0.70\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2386s	19.3625ms	51.6461 Ops/s	54.2371 Ops/s	$\color{#d91a1a}-4.78\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1218s	17.1959ms	58.1535 Ops/s	58.3941 Ops/s	$\color{#d91a1a}-0.41\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1220s	16.7935ms	59.5470 Ops/s	58.7317 Ops/s	$\color{#35bf28}+1.39\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1129s	16.6212ms	60.1641 Ops/s	59.1987 Ops/s	$\color{#35bf28}+1.63\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1199s	17.1908ms	58.1706 Ops/s	59.8629 Ops/s	$\color{#d91a1a}-2.83\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1188s	17.0167ms	58.7658 Ops/s	61.0399 Ops/s	$\color{#d91a1a}-3.73\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1288s	17.4297ms	57.3733 Ops/s	59.5859 Ops/s	$\color{#d91a1a}-3.71\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1243s	17.0045ms	58.8081 Ops/s	59.1220 Ops/s	$\color{#d91a1a}-0.53\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1145s	16.5704ms	60.3485 Ops/s	52.2750 Ops/s	$\textbf{\color{#35bf28}+15.44\%}$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}11$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1199s	0.1193s	8.3851 Ops/s	8.0794 Ops/s	$\color{#35bf28}+3.78\%$
test_sync	0.1032s	0.1028s	9.7241 Ops/s	9.7523 Ops/s	$\color{#d91a1a}-0.29\%$
test_async	0.2767s	0.1010s	9.9054 Ops/s	9.9137 Ops/s	$\color{#d91a1a}-0.08\%$
test_single_pixels	0.1440s	0.1435s	6.9700 Ops/s	6.7979 Ops/s	$\color{#35bf28}+2.53\%$
test_sync_pixels	0.1002s	95.6947ms	10.4499 Ops/s	10.5219 Ops/s	$\color{#d91a1a}-0.68\%$
test_async_pixels	0.2474s	91.8119ms	10.8918 Ops/s	10.9230 Ops/s	$\color{#d91a1a}-0.29\%$
test_simple	0.9251s	0.8606s	1.1620 Ops/s	1.1190 Ops/s	$\color{#35bf28}+3.84\%$
test_transformed	1.1612s	1.1022s	0.9073 Ops/s	0.8569 Ops/s	$\textbf{\color{#35bf28}+5.88\%}$
test_serial	2.4686s	2.4141s	0.4142 Ops/s	0.3887 Ops/s	$\textbf{\color{#35bf28}+6.57\%}$
test_parallel	2.5531s	2.4623s	0.4061 Ops/s	0.4029 Ops/s	$\color{#35bf28}+0.79\%$
test_step_mdp_speed[True-True-True-True-True]	0.1454ms	36.9404μs	27.0706 KOps/s	29.1361 KOps/s	$\textbf{\color{#d91a1a}-7.09\%}$
test_step_mdp_speed[True-True-True-True-False]	44.2400μs	21.4471μs	46.6263 KOps/s	49.2324 KOps/s	$\textbf{\color{#d91a1a}-5.29\%}$
test_step_mdp_speed[True-True-True-False-True]	64.4010μs	20.6425μs	48.4437 KOps/s	47.6209 KOps/s	$\color{#35bf28}+1.73\%$
test_step_mdp_speed[True-True-True-False-False]	53.4610μs	12.1802μs	82.1008 KOps/s	81.9431 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-True-False-True-True]	70.1910μs	37.2386μs	26.8539 KOps/s	28.0321 KOps/s	$\color{#d91a1a}-4.20\%$
test_step_mdp_speed[True-True-False-True-False]	68.8010μs	22.3638μs	44.7151 KOps/s	44.8910 KOps/s	$\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-True-False-False-True]	46.1610μs	22.5605μs	44.3252 KOps/s	44.3016 KOps/s	$\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-True-False-False-False]	60.3610μs	14.0669μs	71.0889 KOps/s	71.4830 KOps/s	$\color{#d91a1a}-0.55\%$
test_step_mdp_speed[True-False-True-True-True]	59.4510μs	39.2242μs	25.4945 KOps/s	25.8229 KOps/s	$\color{#d91a1a}-1.27\%$
test_step_mdp_speed[True-False-True-True-False]	57.8710μs	24.5002μs	40.8161 KOps/s	40.8233 KOps/s	$\color{#d91a1a}-0.02\%$
test_step_mdp_speed[True-False-True-False-True]	76.9920μs	22.5827μs	44.2817 KOps/s	44.2822 KOps/s	$-0.00\%$
test_step_mdp_speed[True-False-True-False-False]	43.5500μs	13.9150μs	71.8650 KOps/s	69.9735 KOps/s	$\color{#35bf28}+2.70\%$
test_step_mdp_speed[True-False-False-True-True]	75.2420μs	41.0030μs	24.3885 KOps/s	24.4241 KOps/s	$\color{#d91a1a}-0.15\%$
test_step_mdp_speed[True-False-False-True-False]	55.8510μs	26.1910μs	38.1811 KOps/s	37.8840 KOps/s	$\color{#35bf28}+0.78\%$
test_step_mdp_speed[True-False-False-False-True]	56.4910μs	24.1960μs	41.3291 KOps/s	40.9736 KOps/s	$\color{#35bf28}+0.87\%$
test_step_mdp_speed[True-False-False-False-False]	0.1010ms	15.7626μs	63.4413 KOps/s	62.8688 KOps/s	$\color{#35bf28}+0.91\%$
test_step_mdp_speed[False-True-True-True-True]	97.6210μs	39.2875μs	25.4534 KOps/s	26.0241 KOps/s	$\color{#d91a1a}-2.19\%$
test_step_mdp_speed[False-True-True-True-False]	89.1420μs	24.3670μs	41.0391 KOps/s	40.8567 KOps/s	$\color{#35bf28}+0.45\%$
test_step_mdp_speed[False-True-True-False-True]	46.5110μs	26.4479μs	37.8102 KOps/s	36.9804 KOps/s	$\color{#35bf28}+2.24\%$
test_step_mdp_speed[False-True-True-False-False]	34.4910μs	15.8859μs	62.9489 KOps/s	62.5670 KOps/s	$\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-True-False-True-True]	89.2620μs	41.1774μs	24.2852 KOps/s	24.9965 KOps/s	$\color{#d91a1a}-2.85\%$
test_step_mdp_speed[False-True-False-True-False]	0.1015ms	26.3574μs	37.9400 KOps/s	37.8945 KOps/s	$\color{#35bf28}+0.12\%$
test_step_mdp_speed[False-True-False-False-True]	54.9910μs	28.6075μs	34.9559 KOps/s	34.2228 KOps/s	$\color{#35bf28}+2.14\%$
test_step_mdp_speed[False-True-False-False-False]	43.7010μs	17.7837μs	56.2313 KOps/s	56.2914 KOps/s	$\color{#d91a1a}-0.11\%$
test_step_mdp_speed[False-False-True-True-True]	64.8810μs	42.9539μs	23.2808 KOps/s	23.5447 KOps/s	$\color{#d91a1a}-1.12\%$
test_step_mdp_speed[False-False-True-True-False]	70.5320μs	28.5385μs	35.0404 KOps/s	34.9410 KOps/s	$\color{#35bf28}+0.28\%$
test_step_mdp_speed[False-False-True-False-True]	56.0210μs	28.7798μs	34.7466 KOps/s	35.1118 KOps/s	$\color{#d91a1a}-1.04\%$
test_step_mdp_speed[False-False-True-False-False]	39.0410μs	18.0662μs	55.3521 KOps/s	56.4359 KOps/s	$\color{#d91a1a}-1.92\%$
test_step_mdp_speed[False-False-False-True-True]	62.1910μs	44.1899μs	22.6296 KOps/s	22.9233 KOps/s	$\color{#d91a1a}-1.28\%$
test_step_mdp_speed[False-False-False-True-False]	70.4210μs	30.1049μs	33.2172 KOps/s	33.3150 KOps/s	$\color{#d91a1a}-0.29\%$
test_step_mdp_speed[False-False-False-False-True]	66.5810μs	30.2525μs	33.0551 KOps/s	32.9926 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-False-False-False-False]	86.4910μs	19.5632μs	51.1163 KOps/s	51.5848 KOps/s	$\color{#d91a1a}-0.91\%$
test_values[generalized_advantage_estimate-True-True]	26.4581ms	25.6545ms	38.9795 Ops/s	37.3468 Ops/s	$\color{#35bf28}+4.37\%$
test_values[vec_generalized_advantage_estimate-True-True]	91.6605ms	3.3804ms	295.8221 Ops/s	303.1657 Ops/s	$\color{#d91a1a}-2.42\%$
test_values[td0_return_estimate-False-False]	97.1020μs	63.1741μs	15.8293 KOps/s	14.8584 KOps/s	$\textbf{\color{#35bf28}+6.53\%}$
test_values[td1_return_estimate-False-False]	56.2013ms	54.2984ms	18.4168 Ops/s	17.3055 Ops/s	$\textbf{\color{#35bf28}+6.42\%}$
test_values[vec_td1_return_estimate-False-False]	1.9881ms	1.7186ms	581.8614 Ops/s	571.6404 Ops/s	$\color{#35bf28}+1.79\%$
test_values[td_lambda_return_estimate-True-False]	86.1122ms	84.4598ms	11.8400 Ops/s	10.8865 Ops/s	$\textbf{\color{#35bf28}+8.76\%}$
test_values[vec_td_lambda_return_estimate-True-False]	2.0226ms	1.7158ms	582.8081 Ops/s	571.2141 Ops/s	$\color{#35bf28}+2.03\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	24.9416ms	23.9479ms	41.7574 Ops/s	39.5217 Ops/s	$\textbf{\color{#35bf28}+5.66\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.8460ms	0.7029ms	1.4227 KOps/s	1.3355 KOps/s	$\textbf{\color{#35bf28}+6.53\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7449ms	0.6679ms	1.4973 KOps/s	1.4410 KOps/s	$\color{#35bf28}+3.91\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.4950ms	1.4615ms	684.2496 Ops/s	667.2607 Ops/s	$\color{#35bf28}+2.55\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.9853ms	0.6926ms	1.4438 KOps/s	1.3872 KOps/s	$\color{#35bf28}+4.08\%$
test_dqn_speed	8.1765ms	1.5052ms	664.3674 Ops/s	669.4337 Ops/s	$\color{#d91a1a}-0.76\%$
test_ddpg_speed	4.7514ms	3.3761ms	296.1969 Ops/s	293.8986 Ops/s	$\color{#35bf28}+0.78\%$
test_sac_speed	10.5045ms	9.3433ms	107.0287 Ops/s	105.5100 Ops/s	$\color{#35bf28}+1.44\%$
test_redq_speed	0.1050s	18.2961ms	54.6564 Ops/s	59.1031 Ops/s	$\textbf{\color{#d91a1a}-7.52\%}$
test_redq_deprec_speed	14.4820ms	13.2371ms	75.5455 Ops/s	75.1056 Ops/s	$\color{#35bf28}+0.59\%$
test_td3_speed	19.5099ms	9.6000ms	104.1672 Ops/s	102.9064 Ops/s	$\color{#35bf28}+1.23\%$
test_cql_speed	33.8947ms	32.5651ms	30.7077 Ops/s	29.6140 Ops/s	$\color{#35bf28}+3.69\%$
test_a2c_speed	8.8431ms	7.3962ms	135.2046 Ops/s	135.8230 Ops/s	$\color{#d91a1a}-0.46\%$
test_ppo_speed	9.1228ms	7.7025ms	129.8277 Ops/s	129.1136 Ops/s	$\color{#35bf28}+0.55\%$
test_reinforce_speed	7.9584ms	6.4040ms	156.1521 Ops/s	156.2309 Ops/s	$\color{#d91a1a}-0.05\%$
test_iql_speed	31.7322ms	27.8332ms	35.9283 Ops/s	36.1461 Ops/s	$\color{#d91a1a}-0.60\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.9475ms	2.4280ms	411.8619 Ops/s	400.5851 Ops/s	$\color{#35bf28}+2.82\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.9946ms	2.6111ms	382.9775 Ops/s	332.0072 Ops/s	$\textbf{\color{#35bf28}+15.35\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.8454ms	2.6217ms	381.4273 Ops/s	374.1398 Ops/s	$\color{#35bf28}+1.95\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.0045ms	2.4415ms	409.5826 Ops/s	399.0879 Ops/s	$\color{#35bf28}+2.63\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	3.5446ms	2.6188ms	381.8534 Ops/s	326.0898 Ops/s	$\textbf{\color{#35bf28}+17.10\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.3534ms	2.6225ms	381.3084 Ops/s	371.8448 Ops/s	$\color{#35bf28}+2.55\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1622ms	2.4428ms	409.3628 Ops/s	399.7356 Ops/s	$\color{#35bf28}+2.41\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	4.2095ms	2.6136ms	382.6142 Ops/s	372.6435 Ops/s	$\color{#35bf28}+2.68\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.1792ms	2.6165ms	382.1964 Ops/s	371.8686 Ops/s	$\color{#35bf28}+2.78\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.1082ms	2.4503ms	408.1050 Ops/s	398.5593 Ops/s	$\color{#35bf28}+2.40\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.5423ms	2.6188ms	381.8556 Ops/s	372.3227 Ops/s	$\color{#35bf28}+2.56\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.2823ms	2.6243ms	381.0608 Ops/s	373.1278 Ops/s	$\color{#35bf28}+2.13\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.1082ms	2.4430ms	409.3337 Ops/s	398.8921 Ops/s	$\color{#35bf28}+2.62\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.2247ms	2.6154ms	382.3450 Ops/s	372.5845 Ops/s	$\color{#35bf28}+2.62\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.7232ms	2.6131ms	382.6820 Ops/s	373.4549 Ops/s	$\color{#35bf28}+2.47\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1358ms	2.4515ms	407.9200 Ops/s	399.7420 Ops/s	$\color{#35bf28}+2.05\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.8361ms	2.6262ms	380.7771 Ops/s	371.1460 Ops/s	$\color{#35bf28}+2.59\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.8545ms	2.6152ms	382.3728 Ops/s	371.1991 Ops/s	$\color{#35bf28}+3.01\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2164s	19.5227ms	51.2224 Ops/s	50.7455 Ops/s	$\color{#35bf28}+0.94\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1272s	15.2083ms	65.7535 Ops/s	55.4197 Ops/s	$\textbf{\color{#35bf28}+18.65\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1314s	17.6320ms	56.7149 Ops/s	56.3589 Ops/s	$\color{#35bf28}+0.63\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1291s	17.6917ms	56.5238 Ops/s	55.3247 Ops/s	$\color{#35bf28}+2.17\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1309s	17.4512ms	57.3026 Ops/s	64.0427 Ops/s	$\textbf{\color{#d91a1a}-10.52\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1291s	17.5020ms	57.1362 Ops/s	55.1548 Ops/s	$\color{#35bf28}+3.59\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1280s	17.5899ms	56.8510 Ops/s	55.4093 Ops/s	$\color{#35bf28}+2.60\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1287s	17.6207ms	56.7515 Ops/s	55.9731 Ops/s	$\color{#35bf28}+1.39\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1284s	15.2673ms	65.4993 Ops/s	55.8606 Ops/s	$\textbf{\color{#35bf28}+17.25\%}$