[Feature] env.append_transform

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2040

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit 0b4228b with merge base 247ed6e ():

NEW FAILURE - The following job has failed:

• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)
  RuntimeError: Command docker exec -t 6952703a19efe932c6d9c35787cd9c02429b2514f44d77452a7b442c18f58798 /exec failed with exit code 139

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	89.0642ms	88.6820ms	11.2762 Ops/s	11.3109 Ops/s	$\color{#d91a1a}-0.31\%$
test_sync	83.8182ms	83.1355ms	12.0285 Ops/s	12.0140 Ops/s	$\color{#35bf28}+0.12\%$
test_async	0.1610s	68.6604ms	14.5644 Ops/s	14.7810 Ops/s	$\color{#d91a1a}-1.47\%$
test_single_pixels	98.9707ms	98.7197ms	10.1297 Ops/s	10.0782 Ops/s	$\color{#35bf28}+0.51\%$
test_sync_pixels	64.6208ms	63.1644ms	15.8317 Ops/s	15.5490 Ops/s	$\color{#35bf28}+1.82\%$
test_async_pixels	0.1188s	53.4548ms	18.7074 Ops/s	16.9596 Ops/s	$\textbf{\color{#35bf28}+10.31\%}$
test_simple	0.6813s	0.6122s	1.6335 Ops/s	1.6413 Ops/s	$\color{#d91a1a}-0.47\%$
test_transformed	0.8602s	0.7957s	1.2567 Ops/s	1.2496 Ops/s	$\color{#35bf28}+0.57\%$
test_serial	1.9183s	1.8613s	0.5372 Ops/s	0.5372 Ops/s	$\color{#35bf28}+0.02\%$
test_parallel	1.6983s	1.6346s	0.6118 Ops/s	0.6052 Ops/s	$\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-True-True-True]	65.1010μs	25.5732μs	39.1034 KOps/s	37.4846 KOps/s	$\color{#35bf28}+4.32\%$
test_step_mdp_speed[True-True-True-True-False]	30.0110μs	15.9813μs	62.5730 KOps/s	61.7445 KOps/s	$\color{#35bf28}+1.34\%$
test_step_mdp_speed[True-True-True-False-True]	39.0210μs	14.8368μs	67.4002 KOps/s	66.4456 KOps/s	$\color{#35bf28}+1.44\%$
test_step_mdp_speed[True-True-True-False-False]	25.3010μs	9.2265μs	108.3833 KOps/s	106.8368 KOps/s	$\color{#35bf28}+1.45\%$
test_step_mdp_speed[True-True-False-True-True]	48.9410μs	27.2125μs	36.7479 KOps/s	35.7999 KOps/s	$\color{#35bf28}+2.65\%$
test_step_mdp_speed[True-True-False-True-False]	35.6110μs	17.3969μs	57.4817 KOps/s	56.7830 KOps/s	$\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-False-False-True]	41.2010μs	16.3726μs	61.0776 KOps/s	59.2056 KOps/s	$\color{#35bf28}+3.16\%$
test_step_mdp_speed[True-True-False-False-False]	31.2410μs	11.0408μs	90.5729 KOps/s	92.4559 KOps/s	$\color{#d91a1a}-2.04\%$
test_step_mdp_speed[True-False-True-True-True]	52.9910μs	29.3824μs	34.0340 KOps/s	33.9348 KOps/s	$\color{#35bf28}+0.29\%$
test_step_mdp_speed[True-False-True-True-False]	35.2210μs	19.0778μs	52.4170 KOps/s	52.9088 KOps/s	$\color{#d91a1a}-0.93\%$
test_step_mdp_speed[True-False-True-False-True]	44.1120μs	16.3422μs	61.1914 KOps/s	61.5996 KOps/s	$\color{#d91a1a}-0.66\%$
test_step_mdp_speed[True-False-True-False-False]	29.9010μs	10.7861μs	92.7122 KOps/s	91.7957 KOps/s	$\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-False-False-True-True]	47.4820μs	30.6937μs	32.5799 KOps/s	32.4086 KOps/s	$\color{#35bf28}+0.53\%$
test_step_mdp_speed[True-False-False-True-False]	36.0100μs	20.9174μs	47.8071 KOps/s	48.7873 KOps/s	$\color{#d91a1a}-2.01\%$
test_step_mdp_speed[True-False-False-False-True]	41.9510μs	17.9124μs	55.8274 KOps/s	56.1216 KOps/s	$\color{#d91a1a}-0.52\%$
test_step_mdp_speed[True-False-False-False-False]	28.3910μs	12.3694μs	80.8447 KOps/s	79.5742 KOps/s	$\color{#35bf28}+1.60\%$
test_step_mdp_speed[False-True-True-True-True]	46.1320μs	29.1772μs	34.2733 KOps/s	34.6040 KOps/s	$\color{#d91a1a}-0.96\%$
test_step_mdp_speed[False-True-True-True-False]	38.3710μs	19.1189μs	52.3042 KOps/s	51.8009 KOps/s	$\color{#35bf28}+0.97\%$
test_step_mdp_speed[False-True-True-False-True]	35.8920μs	19.3036μs	51.8038 KOps/s	48.9925 KOps/s	$\textbf{\color{#35bf28}+5.74\%}$
test_step_mdp_speed[False-True-True-False-False]	38.0610μs	12.1528μs	82.2854 KOps/s	79.5001 KOps/s	$\color{#35bf28}+3.50\%$
test_step_mdp_speed[False-True-False-True-True]	55.1910μs	30.3620μs	32.9359 KOps/s	32.4094 KOps/s	$\color{#35bf28}+1.62\%$
test_step_mdp_speed[False-True-False-True-False]	36.5400μs	20.7458μs	48.2026 KOps/s	47.8149 KOps/s	$\color{#35bf28}+0.81\%$
test_step_mdp_speed[False-True-False-False-True]	37.1320μs	20.4580μs	48.8806 KOps/s	48.5470 KOps/s	$\color{#35bf28}+0.69\%$
test_step_mdp_speed[False-True-False-False-False]	28.5610μs	13.8238μs	72.3388 KOps/s	71.8566 KOps/s	$\color{#35bf28}+0.67\%$
test_step_mdp_speed[False-False-True-True-True]	52.3910μs	32.4355μs	30.8304 KOps/s	30.7631 KOps/s	$\color{#35bf28}+0.22\%$
test_step_mdp_speed[False-False-True-True-False]	38.5610μs	22.4268μs	44.5895 KOps/s	44.8167 KOps/s	$\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-False-True-False-True]	45.5610μs	20.6158μs	48.5065 KOps/s	48.4563 KOps/s	$\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-False-True-False-False]	39.8220μs	13.8798μs	72.0470 KOps/s	71.9269 KOps/s	$\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-False-False-True-True]	50.8310μs	33.4000μs	29.9401 KOps/s	30.0127 KOps/s	$\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-False-False-True-False]	49.3810μs	23.9396μs	41.7719 KOps/s	41.5240 KOps/s	$\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-False-False-False-True]	36.3020μs	21.9544μs	45.5490 KOps/s	44.9186 KOps/s	$\color{#35bf28}+1.40\%$
test_step_mdp_speed[False-False-False-False-False]	30.6110μs	15.1713μs	65.9139 KOps/s	65.2111 KOps/s	$\color{#35bf28}+1.08\%$
test_values[generalized_advantage_estimate-True-True]	21.4941ms	20.6799ms	48.3562 Ops/s	48.9649 Ops/s	$\color{#d91a1a}-1.24\%$
test_values[vec_generalized_advantage_estimate-True-True]	79.3881ms	3.1168ms	320.8428 Ops/s	318.3337 Ops/s	$\color{#35bf28}+0.79\%$
test_values[td0_return_estimate-False-False]	90.2620μs	59.1450μs	16.9076 KOps/s	17.0575 KOps/s	$\color{#d91a1a}-0.88\%$
test_values[td1_return_estimate-False-False]	49.7691ms	46.7474ms	21.3916 Ops/s	21.5816 Ops/s	$\color{#d91a1a}-0.88\%$
test_values[vec_td1_return_estimate-False-False]	2.0869ms	1.7169ms	582.4315 Ops/s	582.1338 Ops/s	$\color{#35bf28}+0.05\%$
test_values[td_lambda_return_estimate-True-False]	79.7948ms	77.2857ms	12.9390 Ops/s	13.4623 Ops/s	$\color{#d91a1a}-3.89\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.9737ms	1.7010ms	587.8819 Ops/s	586.5190 Ops/s	$\color{#35bf28}+0.23\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	20.8417ms	20.4753ms	48.8394 Ops/s	48.9569 Ops/s	$\color{#d91a1a}-0.24\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.8430ms	0.6369ms	1.5700 KOps/s	1.5804 KOps/s	$\color{#d91a1a}-0.66\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.6688ms	0.5951ms	1.6805 KOps/s	1.6729 KOps/s	$\color{#35bf28}+0.45\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5662ms	1.4041ms	712.2225 Ops/s	714.7946 Ops/s	$\color{#d91a1a}-0.36\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.9055ms	0.6236ms	1.6036 KOps/s	1.6019 KOps/s	$\color{#35bf28}+0.10\%$
test_dqn_speed	7.8916ms	1.3019ms	768.1056 Ops/s	797.3994 Ops/s	$\color{#d91a1a}-3.67\%$
test_ddpg_speed	2.8690ms	2.4835ms	402.6505 Ops/s	417.2668 Ops/s	$\color{#d91a1a}-3.50\%$
test_sac_speed	7.7720ms	7.2544ms	137.8482 Ops/s	139.0473 Ops/s	$\color{#d91a1a}-0.86\%$
test_redq_speed	10.4404ms	9.7507ms	102.5568 Ops/s	104.9981 Ops/s	$\color{#d91a1a}-2.33\%$
test_redq_deprec_speed	10.9721ms	10.3675ms	96.4551 Ops/s	100.2632 Ops/s	$\color{#d91a1a}-3.80\%$
test_td3_speed	7.3636ms	7.2339ms	138.2387 Ops/s	138.4076 Ops/s	$\color{#d91a1a}-0.12\%$
test_cql_speed	0.1150s	26.3572ms	37.9403 Ops/s	42.4863 Ops/s	$\textbf{\color{#d91a1a}-10.70\%}$
test_a2c_speed	5.5703ms	5.3529ms	186.8154 Ops/s	193.3805 Ops/s	$\color{#d91a1a}-3.39\%$
test_ppo_speed	5.9458ms	5.6690ms	176.3987 Ops/s	181.3357 Ops/s	$\color{#d91a1a}-2.72\%$
test_reinforce_speed	4.7000ms	4.3520ms	229.7820 Ops/s	237.1897 Ops/s	$\color{#d91a1a}-3.12\%$
test_iql_speed	19.5244ms	18.9192ms	52.8564 Ops/s	53.2423 Ops/s	$\color{#d91a1a}-0.72\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.6071ms	2.4919ms	401.2924 Ops/s	402.1537 Ops/s	$\color{#d91a1a}-0.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.0897ms	0.5251ms	1.9045 KOps/s	1.9048 KOps/s	$\color{#d91a1a}-0.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.7105ms	0.5069ms	1.9727 KOps/s	1.9915 KOps/s	$\color{#d91a1a}-0.94\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.8115ms	2.5482ms	392.4385 Ops/s	398.0543 Ops/s	$\color{#d91a1a}-1.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.1626ms	0.5168ms	1.9349 KOps/s	1.9504 KOps/s	$\color{#d91a1a}-0.79\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6909ms	0.4976ms	2.0096 KOps/s	2.0109 KOps/s	$\color{#d91a1a}-0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	4.5969ms	1.3531ms	739.0433 Ops/s	754.4488 Ops/s	$\color{#d91a1a}-2.04\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.4584ms	1.2715ms	786.5012 Ops/s	799.6835 Ops/s	$\color{#d91a1a}-1.65\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.7572ms	2.6352ms	379.4797 Ops/s	382.1264 Ops/s	$\color{#d91a1a}-0.69\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.7624ms	0.6276ms	1.5935 KOps/s	1.5795 KOps/s	$\color{#35bf28}+0.88\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	6.3541ms	0.6182ms	1.6175 KOps/s	1.6096 KOps/s	$\color{#35bf28}+0.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.5999ms	2.5132ms	397.9053 Ops/s	403.9066 Ops/s	$\color{#d91a1a}-1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6427ms	0.5156ms	1.9393 KOps/s	1.9147 KOps/s	$\color{#35bf28}+1.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.6795ms	0.5054ms	1.9784 KOps/s	1.9865 KOps/s	$\color{#d91a1a}-0.41\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.7788ms	2.5546ms	391.4488 Ops/s	400.8312 Ops/s	$\color{#d91a1a}-2.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.3013ms	0.5101ms	1.9605 KOps/s	1.9317 KOps/s	$\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.7016ms	0.4973ms	2.0107 KOps/s	2.0183 KOps/s	$\color{#d91a1a}-0.37\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.8040ms	2.6239ms	381.1166 Ops/s	383.7313 Ops/s	$\color{#d91a1a}-0.68\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.7453ms	0.6288ms	1.5904 KOps/s	1.5693 KOps/s	$\color{#35bf28}+1.34\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.9057ms	0.6189ms	1.6157 KOps/s	1.6023 KOps/s	$\color{#35bf28}+0.83\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1265s	6.7160ms	148.8973 Ops/s	148.2612 Ops/s	$\color{#35bf28}+0.43\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	14.3314ms	11.8827ms	84.1560 Ops/s	83.8720 Ops/s	$\color{#35bf28}+0.34\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	6.4508ms	1.1698ms	854.8160 Ops/s	931.6194 Ops/s	$\textbf{\color{#d91a1a}-8.24\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1151s	8.6859ms	115.1287 Ops/s	114.7191 Ops/s	$\color{#35bf28}+0.36\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	14.1830ms	11.8296ms	84.5334 Ops/s	83.4780 Ops/s	$\color{#35bf28}+1.26\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	6.0145ms	1.1583ms	863.3282 Ops/s	853.1877 Ops/s	$\color{#35bf28}+1.19\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1147s	6.7942ms	147.1840 Ops/s	146.5248 Ops/s	$\color{#35bf28}+0.45\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	14.8111ms	12.2607ms	81.5617 Ops/s	81.1424 Ops/s	$\color{#35bf28}+0.52\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	6.2562ms	1.5151ms	660.0291 Ops/s	659.6332 Ops/s	$\color{#35bf28}+0.06\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}13$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	51.5517ms	50.9477ms	19.6280 Ops/s	17.8976 Ops/s	$\textbf{\color{#35bf28}+9.67\%}$
test_sync	31.2395ms	28.5958ms	34.9702 Ops/s	30.4410 Ops/s	$\textbf{\color{#35bf28}+14.88\%}$
test_async	53.0033ms	27.0975ms	36.9037 Ops/s	38.5826 Ops/s	$\color{#d91a1a}-4.35\%$
test_simple	0.3322s	0.3290s	3.0400 Ops/s	2.9789 Ops/s	$\color{#35bf28}+2.05\%$
test_transformed	0.5492s	0.4813s	2.0777 Ops/s	2.0921 Ops/s	$\color{#d91a1a}-0.69\%$
test_serial	1.2585s	1.1892s	0.8409 Ops/s	0.8196 Ops/s	$\color{#35bf28}+2.60\%$
test_parallel	1.0553s	0.9982s	1.0018 Ops/s	0.9947 Ops/s	$\color{#35bf28}+0.72\%$
test_step_mdp_speed[True-True-True-True-True]	0.1744ms	21.4207μs	46.6838 KOps/s	47.5793 KOps/s	$\color{#d91a1a}-1.88\%$
test_step_mdp_speed[True-True-True-True-False]	44.5120μs	12.8714μs	77.6913 KOps/s	78.1381 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-True-True-False-True]	42.0980μs	12.4814μs	80.1194 KOps/s	80.6652 KOps/s	$\color{#d91a1a}-0.68\%$
test_step_mdp_speed[True-True-True-False-False]	30.0460μs	7.4843μs	133.6133 KOps/s	133.4087 KOps/s	$\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-True-False-True-True]	58.0470μs	22.4994μs	44.4457 KOps/s	44.8898 KOps/s	$\color{#d91a1a}-0.99\%$
test_step_mdp_speed[True-True-False-True-False]	0.1019ms	14.2874μs	69.9916 KOps/s	71.7085 KOps/s	$\color{#d91a1a}-2.39\%$
test_step_mdp_speed[True-True-False-False-True]	47.2580μs	13.7189μs	72.8923 KOps/s	74.8328 KOps/s	$\color{#d91a1a}-2.59\%$
test_step_mdp_speed[True-True-False-False-False]	49.6620μs	8.7570μs	114.1941 KOps/s	116.1151 KOps/s	$\color{#d91a1a}-1.65\%$
test_step_mdp_speed[True-False-True-True-True]	58.4480μs	24.0166μs	41.6379 KOps/s	42.7382 KOps/s	$\color{#d91a1a}-2.57\%$
test_step_mdp_speed[True-False-True-True-False]	49.9430μs	15.4214μs	64.8448 KOps/s	65.6377 KOps/s	$\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-False-True-False-True]	44.3220μs	13.7877μs	72.5283 KOps/s	74.3838 KOps/s	$\color{#d91a1a}-2.49\%$
test_step_mdp_speed[True-False-True-False-False]	60.1810μs	8.6973μs	114.9778 KOps/s	116.5174 KOps/s	$\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-False-False-True-True]	52.4080μs	24.9426μs	40.0921 KOps/s	40.8821 KOps/s	$\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-False-False-True-False]	55.9840μs	16.5989μs	60.2450 KOps/s	61.0102 KOps/s	$\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-False-False-False-True]	48.1690μs	14.7940μs	67.5949 KOps/s	69.3842 KOps/s	$\color{#d91a1a}-2.58\%$
test_step_mdp_speed[True-False-False-False-False]	91.4900μs	9.8836μs	101.1779 KOps/s	101.7487 KOps/s	$\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-True-True-True-True]	65.4520μs	23.8151μs	41.9901 KOps/s	42.8668 KOps/s	$\color{#d91a1a}-2.05\%$
test_step_mdp_speed[False-True-True-True-False]	53.7100μs	15.3652μs	65.0820 KOps/s	63.8090 KOps/s	$\color{#35bf28}+2.00\%$
test_step_mdp_speed[False-True-True-False-True]	52.1060μs	15.9654μs	62.6353 KOps/s	64.8674 KOps/s	$\color{#d91a1a}-3.44\%$
test_step_mdp_speed[False-True-True-False-False]	27.8420μs	10.0252μs	99.7482 KOps/s	101.9667 KOps/s	$\color{#d91a1a}-2.18\%$
test_step_mdp_speed[False-True-False-True-True]	36.5880μs	25.4491μs	39.2941 KOps/s	40.5453 KOps/s	$\color{#d91a1a}-3.09\%$
test_step_mdp_speed[False-True-False-True-False]	51.1950μs	16.5811μs	60.3097 KOps/s	61.3995 KOps/s	$\color{#d91a1a}-1.77\%$
test_step_mdp_speed[False-True-False-False-True]	66.5540μs	17.1232μs	58.4004 KOps/s	60.1670 KOps/s	$\color{#d91a1a}-2.94\%$
test_step_mdp_speed[False-True-False-False-False]	49.7220μs	11.1171μs	89.9516 KOps/s	91.1043 KOps/s	$\color{#d91a1a}-1.27\%$
test_step_mdp_speed[False-False-True-True-True]	59.8610μs	26.4788μs	37.7660 KOps/s	38.7497 KOps/s	$\color{#d91a1a}-2.54\%$
test_step_mdp_speed[False-False-True-True-False]	50.4630μs	17.8842μs	55.9153 KOps/s	57.0397 KOps/s	$\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-False-True-False-True]	58.9590μs	17.0260μs	58.7338 KOps/s	60.1080 KOps/s	$\color{#d91a1a}-2.29\%$
test_step_mdp_speed[False-False-True-False-False]	40.3850μs	11.1719μs	89.5104 KOps/s	90.8669 KOps/s	$\color{#d91a1a}-1.49\%$
test_step_mdp_speed[False-False-False-True-True]	64.3390μs	27.2205μs	36.7371 KOps/s	37.0453 KOps/s	$\color{#d91a1a}-0.83\%$
test_step_mdp_speed[False-False-False-True-False]	48.9110μs	18.9081μs	52.8874 KOps/s	53.8035 KOps/s	$\color{#d91a1a}-1.70\%$
test_step_mdp_speed[False-False-False-False-True]	54.4710μs	17.8718μs	55.9541 KOps/s	55.4702 KOps/s	$\color{#35bf28}+0.87\%$
test_step_mdp_speed[False-False-False-False-False]	48.5200μs	12.0765μs	82.8052 KOps/s	83.4698 KOps/s	$\color{#d91a1a}-0.80\%$
test_values[generalized_advantage_estimate-True-True]	10.4818ms	9.5960ms	104.2100 Ops/s	102.2698 Ops/s	$\color{#35bf28}+1.90\%$
test_values[vec_generalized_advantage_estimate-True-True]	36.1434ms	33.5620ms	29.7956 Ops/s	28.1622 Ops/s	$\textbf{\color{#35bf28}+5.80\%}$
test_values[td0_return_estimate-False-False]	0.2512ms	0.1759ms	5.6839 KOps/s	5.4175 KOps/s	$\color{#35bf28}+4.92\%$
test_values[td1_return_estimate-False-False]	23.8372ms	23.3814ms	42.7690 Ops/s	41.9637 Ops/s	$\color{#35bf28}+1.92\%$
test_values[vec_td1_return_estimate-False-False]	48.4477ms	34.1728ms	29.2631 Ops/s	28.0566 Ops/s	$\color{#35bf28}+4.30\%$
test_values[td_lambda_return_estimate-True-False]	36.6307ms	33.9270ms	29.4751 Ops/s	29.4590 Ops/s	$\color{#35bf28}+0.05\%$
test_values[vec_td_lambda_return_estimate-True-False]	35.0666ms	33.5700ms	29.7885 Ops/s	28.0543 Ops/s	$\textbf{\color{#35bf28}+6.18\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.4858ms	8.1566ms	122.6006 Ops/s	122.9755 Ops/s	$\color{#d91a1a}-0.30\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.4336ms	2.0096ms	497.6096 Ops/s	496.8530 Ops/s	$\color{#35bf28}+0.15\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.5434ms	0.3460ms	2.8902 KOps/s	2.8938 KOps/s	$\color{#d91a1a}-0.12\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	45.6281ms	43.8703ms	22.7945 Ops/s	22.4043 Ops/s	$\color{#35bf28}+1.74\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.7033ms	3.0687ms	325.8745 Ops/s	328.9683 Ops/s	$\color{#d91a1a}-0.94\%$
test_dqn_speed	3.9825ms	1.3512ms	740.0938 Ops/s	742.4386 Ops/s	$\color{#d91a1a}-0.32\%$
test_ddpg_speed	3.3711ms	2.6917ms	371.5178 Ops/s	375.2116 Ops/s	$\color{#d91a1a}-0.98\%$
test_sac_speed	10.0836ms	8.3823ms	119.2989 Ops/s	120.1541 Ops/s	$\color{#d91a1a}-0.71\%$
test_redq_speed	14.4304ms	13.3731ms	74.7772 Ops/s	74.0259 Ops/s	$\color{#35bf28}+1.01\%$
test_redq_deprec_speed	15.7288ms	13.5338ms	73.8893 Ops/s	73.9737 Ops/s	$\color{#d91a1a}-0.11\%$
test_td3_speed	8.3155ms	8.1028ms	123.4137 Ops/s	121.3414 Ops/s	$\color{#35bf28}+1.71\%$
test_cql_speed	0.1199s	39.2844ms	25.4554 Ops/s	27.3631 Ops/s	$\textbf{\color{#d91a1a}-6.97\%}$
test_a2c_speed	8.4912ms	7.4357ms	134.4858 Ops/s	127.4307 Ops/s	$\textbf{\color{#35bf28}+5.54\%}$
test_ppo_speed	9.2931ms	7.7503ms	129.0278 Ops/s	126.2405 Ops/s	$\color{#35bf28}+2.21\%$
test_reinforce_speed	7.7907ms	6.6413ms	150.5724 Ops/s	147.8508 Ops/s	$\color{#35bf28}+1.84\%$
test_iql_speed	33.6154ms	32.6417ms	30.6357 Ops/s	30.3095 Ops/s	$\color{#35bf28}+1.08\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.6309ms	2.3785ms	420.4348 Ops/s	410.1239 Ops/s	$\color{#35bf28}+2.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9064ms	0.4901ms	2.0403 KOps/s	1.7176 KOps/s	$\textbf{\color{#35bf28}+18.79\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6661ms	0.4688ms	2.1329 KOps/s	2.0482 KOps/s	$\color{#35bf28}+4.14\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.3326ms	2.2951ms	435.7060 Ops/s	393.0040 Ops/s	$\textbf{\color{#35bf28}+10.87\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.9940ms	0.4878ms	2.0502 KOps/s	1.9971 KOps/s	$\color{#35bf28}+2.66\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.8895ms	0.4705ms	2.1255 KOps/s	2.0739 KOps/s	$\color{#35bf28}+2.49\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.6905ms	1.2059ms	829.2824 Ops/s	817.2979 Ops/s	$\color{#35bf28}+1.47\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.3182ms	1.1336ms	882.1408 Ops/s	863.9413 Ops/s	$\color{#35bf28}+2.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.5171ms	2.3874ms	418.8600 Ops/s	393.1762 Ops/s	$\textbf{\color{#35bf28}+6.53\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.0552ms	0.6041ms	1.6554 KOps/s	1.6225 KOps/s	$\color{#35bf28}+2.03\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	1.0417ms	0.5846ms	1.7107 KOps/s	1.6752 KOps/s	$\color{#35bf28}+2.11\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.4803ms	2.2833ms	437.9638 Ops/s	405.6906 Ops/s	$\textbf{\color{#35bf28}+7.96\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9117ms	0.4923ms	2.0314 KOps/s	1.9680 KOps/s	$\color{#35bf28}+3.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.9140ms	0.4760ms	2.1009 KOps/s	2.0444 KOps/s	$\color{#35bf28}+2.76\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.4877ms	2.2723ms	440.0832 Ops/s	395.7987 Ops/s	$\textbf{\color{#35bf28}+11.19\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.5996ms	0.4832ms	2.0696 KOps/s	2.0042 KOps/s	$\color{#35bf28}+3.26\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.5175ms	0.4676ms	2.1386 KOps/s	2.0894 KOps/s	$\color{#35bf28}+2.35\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.6017ms	2.4005ms	416.5759 Ops/s	389.5210 Ops/s	$\textbf{\color{#35bf28}+6.95\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.1000ms	0.6076ms	1.6458 KOps/s	1.6086 KOps/s	$\color{#35bf28}+2.31\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7469ms	0.5842ms	1.7119 KOps/s	1.6762 KOps/s	$\color{#35bf28}+2.13\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1109s	7.9176ms	126.3004 Ops/s	116.0627 Ops/s	$\textbf{\color{#35bf28}+8.82\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	14.4413ms	12.0701ms	82.8496 Ops/s	81.1116 Ops/s	$\color{#35bf28}+2.14\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	3.7728ms	1.1156ms	896.4083 Ops/s	962.8075 Ops/s	$\textbf{\color{#d91a1a}-6.90\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1050s	5.6457ms	177.1266 Ops/s	169.9264 Ops/s	$\color{#35bf28}+4.24\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	14.3298ms	12.0279ms	83.1403 Ops/s	81.7460 Ops/s	$\color{#35bf28}+1.71\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	3.7244ms	1.1040ms	905.8292 Ops/s	957.1065 Ops/s	$\textbf{\color{#d91a1a}-5.36\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1124s	8.3386ms	119.9235 Ops/s	116.8904 Ops/s	$\color{#35bf28}+2.59\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	15.3187ms	12.7299ms	78.5551 Ops/s	78.6543 Ops/s	$\color{#d91a1a}-0.13\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	1.9200ms	1.3567ms	737.0569 Ops/s	670.7708 Ops/s	$\textbf{\color{#35bf28}+9.88\%}$