[Feature] Jumanji from_pixels=True

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2129

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 3 Unrelated Failures

As of commit 9210872 with merge base 68101b0 ():

NEW FAILURES - The following jobs have failed:

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t d5a29c7f08ae6610d12f80d613083247a6d5032006ef277c65efa0676fae83da /exec failed with exit code 139
• Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t e5a94ad8baf6ac353fad9aa9e7327978c47b353ad45561527f08a6fe87fcc877 /exec failed with exit code 1

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Lint / python-source-and-configs / linux-job (gh)
  examples/envs/gym-async-info-reader.py:19:1: E302 expected 2 blank lines, found 1
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  test/test_rb.py::TestRBMultidim::test_rb_multidim_collector[env_device0-transform1-sampler_cls4-rbtype1-LazyTensorStorage-TensorDictRoundRobinWriter]
• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  test/test_collector.py::TestLibThreading::test_auto_num_threads

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1161s	0.1155s	8.6567 Ops/s	8.5536 Ops/s	$\color{#35bf28}+1.20\%$
test_sync	0.1017s	0.1008s	9.9211 Ops/s	9.8291 Ops/s	$\color{#35bf28}+0.94\%$
test_async	0.1938s	97.4774ms	10.2588 Ops/s	10.6759 Ops/s	$\color{#d91a1a}-3.91\%$
test_single_pixels	0.1979s	0.1358s	7.3650 Ops/s	7.8138 Ops/s	$\textbf{\color{#d91a1a}-5.74\%}$
test_sync_pixels	0.1355s	84.7145ms	11.8044 Ops/s	11.5881 Ops/s	$\color{#35bf28}+1.87\%$
test_async_pixels	0.1507s	74.9135ms	13.3487 Ops/s	14.8696 Ops/s	$\textbf{\color{#d91a1a}-10.23\%}$
test_simple	0.7577s	0.7554s	1.3238 Ops/s	1.2839 Ops/s	$\color{#35bf28}+3.11\%$
test_transformed	1.0301s	1.0118s	0.9883 Ops/s	0.9649 Ops/s	$\color{#35bf28}+2.42\%$
test_serial	2.6149s	2.5272s	0.3957 Ops/s	0.4056 Ops/s	$\color{#d91a1a}-2.45\%$
test_parallel	2.3652s	2.3031s	0.4342 Ops/s	0.4331 Ops/s	$\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-True-True-True-True]	93.3020μs	33.7158μs	29.6597 KOps/s	29.3648 KOps/s	$\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-True-True-True-False]	40.3600μs	19.8251μs	50.4410 KOps/s	49.0548 KOps/s	$\color{#35bf28}+2.83\%$
test_step_mdp_speed[True-True-True-False-True]	46.3310μs	19.0634μs	52.4566 KOps/s	51.9060 KOps/s	$\color{#35bf28}+1.06\%$
test_step_mdp_speed[True-True-True-False-False]	27.0910μs	11.3317μs	88.2480 KOps/s	88.1948 KOps/s	$\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-True-False-True-True]	54.0610μs	35.0497μs	28.5309 KOps/s	28.5310 KOps/s	$-0.00\%$
test_step_mdp_speed[True-True-False-True-False]	42.3200μs	21.7083μs	46.0653 KOps/s	45.2530 KOps/s	$\color{#35bf28}+1.79\%$
test_step_mdp_speed[True-True-False-False-True]	36.1510μs	20.6824μs	48.3502 KOps/s	48.5450 KOps/s	$\color{#d91a1a}-0.40\%$
test_step_mdp_speed[True-True-False-False-False]	29.8910μs	13.2160μs	75.6658 KOps/s	75.4903 KOps/s	$\color{#35bf28}+0.23\%$
test_step_mdp_speed[True-False-True-True-True]	63.2520μs	37.0562μs	26.9860 KOps/s	26.7276 KOps/s	$\color{#35bf28}+0.97\%$
test_step_mdp_speed[True-False-True-True-False]	41.4510μs	23.8238μs	41.9749 KOps/s	41.7849 KOps/s	$\color{#35bf28}+0.45\%$
test_step_mdp_speed[True-False-True-False-True]	37.3110μs	20.5861μs	48.5765 KOps/s	47.7358 KOps/s	$\color{#35bf28}+1.76\%$
test_step_mdp_speed[True-False-True-False-False]	32.4210μs	13.2021μs	75.7457 KOps/s	75.5530 KOps/s	$\color{#35bf28}+0.26\%$
test_step_mdp_speed[True-False-False-True-True]	60.8810μs	38.7396μs	25.8134 KOps/s	25.6731 KOps/s	$\color{#35bf28}+0.55\%$
test_step_mdp_speed[True-False-False-True-False]	62.5120μs	25.8110μs	38.7431 KOps/s	38.8916 KOps/s	$\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-False-False-False-True]	45.8010μs	22.4241μs	44.5949 KOps/s	44.6510 KOps/s	$\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-False-False-False-False]	30.4500μs	15.0754μs	66.3331 KOps/s	66.0408 KOps/s	$\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-True-True-True-True]	63.9020μs	37.1310μs	26.9317 KOps/s	26.3193 KOps/s	$\color{#35bf28}+2.33\%$
test_step_mdp_speed[False-True-True-True-False]	57.2510μs	23.9267μs	41.7944 KOps/s	41.7005 KOps/s	$\color{#35bf28}+0.23\%$
test_step_mdp_speed[False-True-True-False-True]	55.4510μs	24.8700μs	40.2091 KOps/s	40.0810 KOps/s	$\color{#35bf28}+0.32\%$
test_step_mdp_speed[False-True-True-False-False]	32.5710μs	15.0877μs	66.2790 KOps/s	65.8734 KOps/s	$\color{#35bf28}+0.62\%$
test_step_mdp_speed[False-True-False-True-True]	58.0810μs	38.9359μs	25.6832 KOps/s	25.8164 KOps/s	$\color{#d91a1a}-0.52\%$
test_step_mdp_speed[False-True-False-True-False]	42.9810μs	25.4870μs	39.2357 KOps/s	38.9462 KOps/s	$\color{#35bf28}+0.74\%$
test_step_mdp_speed[False-True-False-False-True]	45.4410μs	26.5849μs	37.6153 KOps/s	37.7070 KOps/s	$\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-True-False-False-False]	32.8100μs	16.8188μs	59.4573 KOps/s	58.5597 KOps/s	$\color{#35bf28}+1.53\%$
test_step_mdp_speed[False-False-True-True-True]	70.0720μs	41.1422μs	24.3060 KOps/s	24.3762 KOps/s	$\color{#d91a1a}-0.29\%$
test_step_mdp_speed[False-False-True-True-False]	42.7310μs	27.8799μs	35.8681 KOps/s	35.8102 KOps/s	$\color{#35bf28}+0.16\%$
test_step_mdp_speed[False-False-True-False-True]	44.9710μs	26.5949μs	37.6012 KOps/s	37.3970 KOps/s	$\color{#35bf28}+0.55\%$
test_step_mdp_speed[False-False-True-False-False]	38.1200μs	16.9188μs	59.1059 KOps/s	58.2533 KOps/s	$\color{#35bf28}+1.46\%$
test_step_mdp_speed[False-False-False-True-True]	62.4920μs	43.5084μs	22.9841 KOps/s	22.8439 KOps/s	$\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-False-True-False]	53.7210μs	29.6681μs	33.7062 KOps/s	33.6346 KOps/s	$\color{#35bf28}+0.21\%$
test_step_mdp_speed[False-False-False-False-True]	54.9810μs	28.2721μs	35.3705 KOps/s	34.8830 KOps/s	$\color{#35bf28}+1.40\%$
test_step_mdp_speed[False-False-False-False-False]	44.5110μs	18.6921μs	53.4984 KOps/s	53.0231 KOps/s	$\color{#35bf28}+0.90\%$
test_values[generalized_advantage_estimate-True-True]	26.0125ms	24.6677ms	40.5388 Ops/s	40.4730 Ops/s	$\color{#35bf28}+0.16\%$
test_values[vec_generalized_advantage_estimate-True-True]	84.0594ms	3.2500ms	307.6955 Ops/s	311.2726 Ops/s	$\color{#d91a1a}-1.15\%$
test_values[td0_return_estimate-False-False]	89.7020μs	63.8707μs	15.6566 KOps/s	15.4338 KOps/s	$\color{#35bf28}+1.44\%$
test_values[td1_return_estimate-False-False]	52.4843ms	51.9293ms	19.2569 Ops/s	18.9385 Ops/s	$\color{#35bf28}+1.68\%$
test_values[vec_td1_return_estimate-False-False]	2.0733ms	1.7671ms	565.8874 Ops/s	565.9382 Ops/s	$-0.01\%$
test_values[td_lambda_return_estimate-True-False]	88.4536ms	85.4445ms	11.7035 Ops/s	11.8404 Ops/s	$\color{#d91a1a}-1.16\%$
test_values[vec_td_lambda_return_estimate-True-False]	2.0010ms	1.7611ms	567.8179 Ops/s	566.0915 Ops/s	$\color{#35bf28}+0.30\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	26.1738ms	25.4485ms	39.2951 Ops/s	42.2379 Ops/s	$\textbf{\color{#d91a1a}-6.97\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.8952ms	0.6997ms	1.4292 KOps/s	1.4174 KOps/s	$\color{#35bf28}+0.84\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7039ms	0.6762ms	1.4789 KOps/s	1.5308 KOps/s	$\color{#d91a1a}-3.39\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5113ms	1.4551ms	687.2403 Ops/s	683.7182 Ops/s	$\color{#35bf28}+0.52\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.9375ms	0.6740ms	1.4836 KOps/s	1.4767 KOps/s	$\color{#35bf28}+0.47\%$
test_dqn_speed	75.7757ms	1.5779ms	633.7585 Ops/s	677.4584 Ops/s	$\textbf{\color{#d91a1a}-6.45\%}$
test_ddpg_speed	3.2743ms	2.9870ms	334.7809 Ops/s	332.1559 Ops/s	$\color{#35bf28}+0.79\%$
test_sac_speed	8.6906ms	8.5450ms	117.0281 Ops/s	116.5901 Ops/s	$\color{#35bf28}+0.38\%$
test_redq_speed	12.4414ms	10.4053ms	96.1046 Ops/s	96.2085 Ops/s	$\color{#d91a1a}-0.11\%$
test_redq_deprec_speed	12.0682ms	11.5478ms	86.5964 Ops/s	85.9932 Ops/s	$\color{#35bf28}+0.70\%$
test_td3_speed	17.5419ms	8.6171ms	116.0487 Ops/s	117.4123 Ops/s	$\color{#d91a1a}-1.16\%$
test_cql_speed	27.2485ms	26.4428ms	37.8175 Ops/s	38.0392 Ops/s	$\color{#d91a1a}-0.58\%$
test_a2c_speed	5.9348ms	5.6219ms	177.8764 Ops/s	171.6005 Ops/s	$\color{#35bf28}+3.66\%$
test_ppo_speed	6.1273ms	5.9708ms	167.4821 Ops/s	165.6732 Ops/s	$\color{#35bf28}+1.09\%$
test_reinforce_speed	4.8489ms	4.6148ms	216.6922 Ops/s	211.6846 Ops/s	$\color{#35bf28}+2.37\%$
test_iql_speed	20.6808ms	19.9676ms	50.0812 Ops/s	48.7280 Ops/s	$\color{#35bf28}+2.78\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.0018ms	2.8416ms	351.9084 Ops/s	356.7465 Ops/s	$\color{#d91a1a}-1.36\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.6087ms	0.6058ms	1.6508 KOps/s	1.6313 KOps/s	$\color{#35bf28}+1.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	1.1378ms	0.5844ms	1.7112 KOps/s	1.7045 KOps/s	$\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.0091ms	2.8363ms	352.5750 Ops/s	355.4267 Ops/s	$\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.5114ms	0.6041ms	1.6555 KOps/s	1.6716 KOps/s	$\color{#d91a1a}-0.97\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7524ms	0.5779ms	1.7305 KOps/s	1.7239 KOps/s	$\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.6881ms	1.5455ms	647.0352 Ops/s	620.5690 Ops/s	$\color{#35bf28}+4.26\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.5875ms	1.4735ms	678.6528 Ops/s	668.4783 Ops/s	$\color{#35bf28}+1.52\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.0127ms	2.9240ms	341.9950 Ops/s	340.7546 Ops/s	$\color{#35bf28}+0.36\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8666ms	0.7393ms	1.3526 KOps/s	1.3526 KOps/s	$-0.00\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.1197s	0.8241ms	1.2134 KOps/s	1.3928 KOps/s	$\textbf{\color{#d91a1a}-12.88\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.9183ms	2.8253ms	353.9493 Ops/s	359.2209 Ops/s	$\color{#d91a1a}-1.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.7659ms	0.6124ms	1.6329 KOps/s	1.6292 KOps/s	$\color{#35bf28}+0.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7401ms	0.5855ms	1.7078 KOps/s	1.7008 KOps/s	$\color{#35bf28}+0.41\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.9852ms	2.8321ms	353.0961 Ops/s	358.2577 Ops/s	$\color{#d91a1a}-1.44\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6988ms	0.6032ms	1.6577 KOps/s	1.6503 KOps/s	$\color{#35bf28}+0.45\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.1197s	0.7574ms	1.3203 KOps/s	1.7032 KOps/s	$\textbf{\color{#d91a1a}-22.49\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.1175ms	2.9528ms	338.6588 Ops/s	342.6343 Ops/s	$\color{#d91a1a}-1.16\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.8917ms	0.7457ms	1.3410 KOps/s	1.3536 KOps/s	$\color{#d91a1a}-0.93\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8567ms	0.7182ms	1.3924 KOps/s	1.3866 KOps/s	$\color{#35bf28}+0.42\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1232s	7.2822ms	137.3212 Ops/s	103.4975 Ops/s	$\textbf{\color{#35bf28}+32.68\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	17.3986ms	15.1961ms	65.8063 Ops/s	65.9151 Ops/s	$\color{#d91a1a}-0.16\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	2.4873ms	1.3317ms	750.9108 Ops/s	699.0548 Ops/s	$\textbf{\color{#35bf28}+7.42\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1177s	9.4177ms	106.1835 Ops/s	139.8201 Ops/s	$\textbf{\color{#d91a1a}-24.06\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	17.4392ms	15.0173ms	66.5900 Ops/s	65.7457 Ops/s	$\color{#35bf28}+1.28\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	2.4933ms	1.2785ms	782.1580 Ops/s	777.2150 Ops/s	$\color{#35bf28}+0.64\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1177s	7.4890ms	133.5300 Ops/s	101.9446 Ops/s	$\textbf{\color{#35bf28}+30.98\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	17.6886ms	15.4133ms	64.8790 Ops/s	64.3563 Ops/s	$\color{#35bf28}+0.81\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	7.7807ms	1.7571ms	569.1183 Ops/s	618.6694 Ops/s	$\textbf{\color{#d91a1a}-8.01\%}$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}11$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	53.6257ms	52.6625ms	18.9888 Ops/s	18.5586 Ops/s	$\color{#35bf28}+2.32\%$
test_sync	34.4706ms	29.3638ms	34.0555 Ops/s	33.5086 Ops/s	$\color{#35bf28}+1.63\%$
test_async	52.7736ms	26.8293ms	37.2727 Ops/s	33.9445 Ops/s	$\textbf{\color{#35bf28}+9.81\%}$
test_simple	0.4026s	0.3485s	2.8691 Ops/s	2.9145 Ops/s	$\color{#d91a1a}-1.56\%$
test_transformed	0.5401s	0.4893s	2.0436 Ops/s	1.9756 Ops/s	$\color{#35bf28}+3.44\%$
test_serial	1.2526s	1.1991s	0.8340 Ops/s	0.8221 Ops/s	$\color{#35bf28}+1.45\%$
test_parallel	1.0730s	1.0164s	0.9838 Ops/s	0.9914 Ops/s	$\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-True-True-True-True]	0.1209ms	20.9289μs	47.7809 KOps/s	47.0572 KOps/s	$\color{#35bf28}+1.54\%$
test_step_mdp_speed[True-True-True-True-False]	51.5060μs	12.5436μs	79.7222 KOps/s	75.0376 KOps/s	$\textbf{\color{#35bf28}+6.24\%}$
test_step_mdp_speed[True-True-True-False-True]	35.1350μs	12.2149μs	81.8672 KOps/s	80.0606 KOps/s	$\color{#35bf28}+2.26\%$
test_step_mdp_speed[True-True-True-False-False]	0.1224ms	7.4294μs	134.5999 KOps/s	129.2477 KOps/s	$\color{#35bf28}+4.14\%$
test_step_mdp_speed[True-True-False-True-True]	58.2690μs	22.1534μs	45.1398 KOps/s	44.0835 KOps/s	$\color{#35bf28}+2.40\%$
test_step_mdp_speed[True-True-False-True-False]	63.8090μs	13.6493μs	73.2637 KOps/s	69.2265 KOps/s	$\textbf{\color{#35bf28}+5.83\%}$
test_step_mdp_speed[True-True-False-False-True]	53.3190μs	13.5916μs	73.5750 KOps/s	72.5509 KOps/s	$\color{#35bf28}+1.41\%$
test_step_mdp_speed[True-True-False-False-False]	29.4550μs	8.5368μs	117.1395 KOps/s	111.5644 KOps/s	$\color{#35bf28}+5.00\%$
test_step_mdp_speed[True-False-True-True-True]	54.9030μs	23.4307μs	42.6790 KOps/s	41.9080 KOps/s	$\color{#35bf28}+1.84\%$
test_step_mdp_speed[True-False-True-True-False]	36.5890μs	15.1643μs	65.9446 KOps/s	63.9149 KOps/s	$\color{#35bf28}+3.18\%$
test_step_mdp_speed[True-False-True-False-True]	47.4580μs	13.4352μs	74.4315 KOps/s	72.3309 KOps/s	$\color{#35bf28}+2.90\%$
test_step_mdp_speed[True-False-True-False-False]	27.5020μs	8.5877μs	116.4458 KOps/s	111.5552 KOps/s	$\color{#35bf28}+4.38\%$
test_step_mdp_speed[True-False-False-True-True]	65.3620μs	24.6114μs	40.6316 KOps/s	39.6456 KOps/s	$\color{#35bf28}+2.49\%$
test_step_mdp_speed[True-False-False-True-False]	54.2210μs	16.1372μs	61.9687 KOps/s	58.8016 KOps/s	$\textbf{\color{#35bf28}+5.39\%}$
test_step_mdp_speed[True-False-False-False-True]	52.7380μs	14.5281μs	68.8323 KOps/s	67.0730 KOps/s	$\color{#35bf28}+2.62\%$
test_step_mdp_speed[True-False-False-False-False]	42.4890μs	9.5663μs	104.5334 KOps/s	100.0313 KOps/s	$\color{#35bf28}+4.50\%$
test_step_mdp_speed[False-True-True-True-True]	85.1320μs	23.4579μs	42.6296 KOps/s	41.6208 KOps/s	$\color{#35bf28}+2.42\%$
test_step_mdp_speed[False-True-True-True-False]	52.0970μs	15.0929μs	66.2562 KOps/s	63.4857 KOps/s	$\color{#35bf28}+4.36\%$
test_step_mdp_speed[False-True-True-False-True]	44.6530μs	15.6058μs	64.0786 KOps/s	61.9539 KOps/s	$\color{#35bf28}+3.43\%$
test_step_mdp_speed[False-True-True-False-False]	36.1680μs	9.8087μs	101.9503 KOps/s	99.3582 KOps/s	$\color{#35bf28}+2.61\%$
test_step_mdp_speed[False-True-False-True-True]	63.8890μs	24.5826μs	40.6792 KOps/s	39.9313 KOps/s	$\color{#35bf28}+1.87\%$
test_step_mdp_speed[False-True-False-True-False]	42.5900μs	16.2331μs	61.6025 KOps/s	59.0578 KOps/s	$\color{#35bf28}+4.31\%$
test_step_mdp_speed[False-True-False-False-True]	51.6170μs	16.7585μs	59.6711 KOps/s	58.3036 KOps/s	$\color{#35bf28}+2.35\%$
test_step_mdp_speed[False-True-False-False-False]	37.9610μs	10.8496μs	92.1694 KOps/s	87.9677 KOps/s	$\color{#35bf28}+4.78\%$
test_step_mdp_speed[False-False-True-True-True]	65.9330μs	25.6973μs	38.9146 KOps/s	37.6847 KOps/s	$\color{#35bf28}+3.26\%$
test_step_mdp_speed[False-False-True-True-False]	49.6720μs	17.4586μs	57.2783 KOps/s	54.9922 KOps/s	$\color{#35bf28}+4.16\%$
test_step_mdp_speed[False-False-True-False-True]	46.9780μs	16.7225μs	59.7995 KOps/s	58.3004 KOps/s	$\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-False-True-False-False]	32.6410μs	10.9322μs	91.4728 KOps/s	87.4852 KOps/s	$\color{#35bf28}+4.56\%$
test_step_mdp_speed[False-False-False-True-True]	41.1970μs	27.3215μs	36.6013 KOps/s	35.7223 KOps/s	$\color{#35bf28}+2.46\%$
test_step_mdp_speed[False-False-False-True-False]	52.2070μs	18.6248μs	53.6919 KOps/s	51.0485 KOps/s	$\textbf{\color{#35bf28}+5.18\%}$
test_step_mdp_speed[False-False-False-False-True]	41.2170μs	17.7370μs	56.3792 KOps/s	54.5693 KOps/s	$\color{#35bf28}+3.32\%$
test_step_mdp_speed[False-False-False-False-False]	47.1480μs	12.0017μs	83.3212 KOps/s	80.5545 KOps/s	$\color{#35bf28}+3.43\%$
test_values[generalized_advantage_estimate-True-True]	10.1994ms	9.4581ms	105.7291 Ops/s	107.0636 Ops/s	$\color{#d91a1a}-1.25\%$
test_values[vec_generalized_advantage_estimate-True-True]	37.2572ms	35.3681ms	28.2741 Ops/s	27.8849 Ops/s	$\color{#35bf28}+1.40\%$
test_values[td0_return_estimate-False-False]	0.2160ms	0.1748ms	5.7203 KOps/s	6.0325 KOps/s	$\textbf{\color{#d91a1a}-5.17\%}$
test_values[td1_return_estimate-False-False]	26.2129ms	23.8509ms	41.9272 Ops/s	43.3977 Ops/s	$\color{#d91a1a}-3.39\%$
test_values[vec_td1_return_estimate-False-False]	38.0990ms	35.6730ms	28.0324 Ops/s	28.1153 Ops/s	$\color{#d91a1a}-0.29\%$
test_values[td_lambda_return_estimate-True-False]	37.9036ms	34.8891ms	28.6623 Ops/s	30.0543 Ops/s	$\color{#d91a1a}-4.63\%$
test_values[vec_td_lambda_return_estimate-True-False]	38.2728ms	35.6453ms	28.0542 Ops/s	28.1718 Ops/s	$\color{#d91a1a}-0.42\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.7462ms	8.2728ms	120.8783 Ops/s	123.2578 Ops/s	$\color{#d91a1a}-1.93\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.4041ms	2.0337ms	491.7219 Ops/s	532.1806 Ops/s	$\textbf{\color{#d91a1a}-7.60\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4289ms	0.3489ms	2.8664 KOps/s	2.8654 KOps/s	$\color{#35bf28}+0.03\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	49.1797ms	47.8484ms	20.8994 Ops/s	21.2143 Ops/s	$\color{#d91a1a}-1.48\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.1429ms	3.0088ms	332.3590 Ops/s	331.9176 Ops/s	$\color{#35bf28}+0.13\%$
test_dqn_speed	1.8598ms	1.3572ms	736.7885 Ops/s	744.5541 Ops/s	$\color{#d91a1a}-1.04\%$
test_ddpg_speed	3.5672ms	2.8755ms	347.7626 Ops/s	351.6446 Ops/s	$\color{#d91a1a}-1.10\%$
test_sac_speed	9.1043ms	8.4949ms	117.7174 Ops/s	109.5479 Ops/s	$\textbf{\color{#35bf28}+7.46\%}$
test_redq_speed	14.1454ms	13.2068ms	75.7184 Ops/s	75.6466 Ops/s	$\color{#35bf28}+0.09\%$
test_redq_deprec_speed	14.2040ms	13.2156ms	75.6684 Ops/s	75.2183 Ops/s	$\color{#35bf28}+0.60\%$
test_td3_speed	8.7237ms	8.4612ms	118.1870 Ops/s	119.8876 Ops/s	$\color{#d91a1a}-1.42\%$
test_cql_speed	53.1866ms	37.9975ms	26.3175 Ops/s	27.2771 Ops/s	$\color{#d91a1a}-3.52\%$
test_a2c_speed	8.0334ms	7.4691ms	133.8846 Ops/s	135.2129 Ops/s	$\color{#d91a1a}-0.98\%$
test_ppo_speed	9.0419ms	7.7326ms	129.3223 Ops/s	130.9144 Ops/s	$\color{#d91a1a}-1.22\%$
test_reinforce_speed	7.6094ms	6.6365ms	150.6816 Ops/s	150.9164 Ops/s	$\color{#d91a1a}-0.16\%$
test_iql_speed	34.0671ms	32.7300ms	30.5531 Ops/s	30.6105 Ops/s	$\color{#d91a1a}-0.19\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.5467ms	2.1255ms	470.4839 Ops/s	476.8141 Ops/s	$\color{#d91a1a}-1.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9468ms	0.4918ms	2.0335 KOps/s	2.0191 KOps/s	$\color{#35bf28}+0.72\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	1.1585ms	0.4732ms	2.1131 KOps/s	2.1328 KOps/s	$\color{#d91a1a}-0.92\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.6530ms	2.0851ms	479.5890 Ops/s	450.4982 Ops/s	$\textbf{\color{#35bf28}+6.46\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.0301ms	0.4874ms	2.0519 KOps/s	2.0485 KOps/s	$\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6623ms	0.4641ms	2.1548 KOps/s	2.1457 KOps/s	$\color{#35bf28}+0.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.7854ms	1.2377ms	807.9608 Ops/s	815.3520 Ops/s	$\color{#d91a1a}-0.91\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.4705ms	1.1725ms	852.9105 Ops/s	856.6705 Ops/s	$\color{#d91a1a}-0.44\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.4764ms	2.2553ms	443.3903 Ops/s	440.8182 Ops/s	$\color{#35bf28}+0.58\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0104ms	0.6109ms	1.6368 KOps/s	1.6445 KOps/s	$\color{#d91a1a}-0.47\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9010ms	0.5859ms	1.7067 KOps/s	1.7146 KOps/s	$\color{#d91a1a}-0.46\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.3481ms	2.1096ms	474.0231 Ops/s	472.9559 Ops/s	$\color{#35bf28}+0.23\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.7853ms	0.4959ms	2.0164 KOps/s	1.7941 KOps/s	$\textbf{\color{#35bf28}+12.39\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.5760ms	0.4722ms	2.1178 KOps/s	2.1433 KOps/s	$\color{#d91a1a}-1.19\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.2377ms	2.1414ms	466.9872 Ops/s	478.2496 Ops/s	$\color{#d91a1a}-2.35\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6413ms	0.4852ms	2.0608 KOps/s	2.0473 KOps/s	$\color{#35bf28}+0.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7501ms	0.4686ms	2.1340 KOps/s	2.1508 KOps/s	$\color{#d91a1a}-0.78\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.4017ms	2.2864ms	437.3631 Ops/s	462.2888 Ops/s	$\textbf{\color{#d91a1a}-5.39\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0879ms	0.6139ms	1.6290 KOps/s	1.6528 KOps/s	$\color{#d91a1a}-1.44\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8254ms	0.5964ms	1.6768 KOps/s	1.7106 KOps/s	$\color{#d91a1a}-1.98\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1201s	8.0165ms	124.7421 Ops/s	125.2970 Ops/s	$\color{#d91a1a}-0.44\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	16.5597ms	12.2912ms	81.3589 Ops/s	83.4484 Ops/s	$\color{#d91a1a}-2.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.5408ms	1.0524ms	950.2067 Ops/s	917.0336 Ops/s	$\color{#35bf28}+3.62\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1038s	5.6258ms	177.7524 Ops/s	177.0284 Ops/s	$\color{#35bf28}+0.41\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	14.6160ms	12.0284ms	83.1366 Ops/s	72.2218 Ops/s	$\textbf{\color{#35bf28}+15.11\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	1.6599ms	1.0607ms	942.7506 Ops/s	870.8508 Ops/s	$\textbf{\color{#35bf28}+8.26\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1049s	7.9801ms	125.3115 Ops/s	166.7654 Ops/s	$\textbf{\color{#d91a1a}-24.86\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	14.5113ms	12.2655ms	81.5297 Ops/s	81.3987 Ops/s	$\color{#35bf28}+0.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	1.8979ms	1.3625ms	733.9718 Ops/s	677.8517 Ops/s	$\textbf{\color{#35bf28}+8.28\%}$