Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Fix nightly #2279

Merged
merged 3 commits into from
Jul 9, 2024
Merged

[CI] Fix nightly #2279

merged 3 commits into from
Jul 9, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Jul 9, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jul 9, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2279

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 4 Unrelated Failures

As of commit f791004 with merge base 533d3f9 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 9, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 9, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1161s 60.0819ms 16.6440 Ops/s 17.6839 Ops/s $\textbf{\color{#d91a1a}-5.88\%}$
test_sync 40.7013ms 31.1521ms 32.1006 Ops/s 31.8184 Ops/s $\color{#35bf28}+0.89\%$
test_async 79.3324ms 30.8146ms 32.4521 Ops/s 33.8022 Ops/s $\color{#d91a1a}-3.99\%$
test_simple 0.3873s 0.3853s 2.5952 Ops/s 2.6180 Ops/s $\color{#d91a1a}-0.87\%$
test_transformed 0.5391s 0.5365s 1.8639 Ops/s 1.8307 Ops/s $\color{#35bf28}+1.82\%$
test_serial 1.3254s 1.2689s 0.7881 Ops/s 0.7796 Ops/s $\color{#35bf28}+1.09\%$
test_parallel 1.1614s 1.1077s 0.9028 Ops/s 0.8967 Ops/s $\color{#35bf28}+0.69\%$
test_step_mdp_speed[True-True-True-True-True] 0.1599ms 22.4093μs 44.6244 KOps/s 44.2188 KOps/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[True-True-True-True-False] 58.1990μs 13.2808μs 75.2968 KOps/s 75.5443 KOps/s $\color{#d91a1a}-0.33\%$
test_step_mdp_speed[True-True-True-False-True] 36.7290μs 12.9898μs 76.9834 KOps/s 77.0319 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-True-True-False-False] 39.2140μs 7.7002μs 129.8660 KOps/s 129.8745 KOps/s $-0.01\%$
test_step_mdp_speed[True-True-False-True-True] 49.0520μs 23.8321μs 41.9602 KOps/s 41.6658 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-True-False-True-False] 45.8460μs 14.3815μs 69.5336 KOps/s 68.1402 KOps/s $\color{#35bf28}+2.04\%$
test_step_mdp_speed[True-True-False-False-True] 48.7820μs 14.2688μs 70.0830 KOps/s 70.1288 KOps/s $\color{#d91a1a}-0.07\%$
test_step_mdp_speed[True-True-False-False-False] 33.1320μs 8.9103μs 112.2299 KOps/s 111.4151 KOps/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-False-True-True-True] 60.6140μs 25.1498μs 39.7618 KOps/s 39.2339 KOps/s $\color{#35bf28}+1.35\%$
test_step_mdp_speed[True-False-True-True-False] 47.3580μs 15.7732μs 63.3988 KOps/s 62.6205 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[True-False-True-False-True] 42.7200μs 14.2177μs 70.3349 KOps/s 69.6169 KOps/s $\color{#35bf28}+1.03\%$
test_step_mdp_speed[True-False-True-False-False] 31.7490μs 8.8796μs 112.6176 KOps/s 111.4094 KOps/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-False-False-True-True] 54.1310μs 26.2949μs 38.0302 KOps/s 37.6009 KOps/s $\color{#35bf28}+1.14\%$
test_step_mdp_speed[True-False-False-True-False] 38.8730μs 17.0970μs 58.4899 KOps/s 57.9304 KOps/s $\color{#35bf28}+0.97\%$
test_step_mdp_speed[True-False-False-False-True] 39.6840μs 15.2811μs 65.4402 KOps/s 64.8000 KOps/s $\color{#35bf28}+0.99\%$
test_step_mdp_speed[True-False-False-False-False] 30.9980μs 10.1729μs 98.3003 KOps/s 97.7764 KOps/s $\color{#35bf28}+0.54\%$
test_step_mdp_speed[False-True-True-True-True] 0.1009ms 25.0450μs 39.9282 KOps/s 39.5301 KOps/s $\color{#35bf28}+1.01\%$
test_step_mdp_speed[False-True-True-True-False] 64.6420μs 15.7926μs 63.3208 KOps/s 62.3231 KOps/s $\color{#35bf28}+1.60\%$
test_step_mdp_speed[False-True-True-False-True] 42.8700μs 16.2080μs 61.6978 KOps/s 60.1320 KOps/s $\color{#35bf28}+2.60\%$
test_step_mdp_speed[False-True-True-False-False] 51.8470μs 10.0183μs 99.8172 KOps/s 97.6499 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[False-True-False-True-True] 53.8110μs 26.1539μs 38.2352 KOps/s 37.8539 KOps/s $\color{#35bf28}+1.01\%$
test_step_mdp_speed[False-True-False-True-False] 64.4310μs 16.8082μs 59.4948 KOps/s 57.5340 KOps/s $\color{#35bf28}+3.41\%$
test_step_mdp_speed[False-True-False-False-True] 44.0630μs 17.5095μs 57.1119 KOps/s 56.1166 KOps/s $\color{#35bf28}+1.77\%$
test_step_mdp_speed[False-True-False-False-False] 56.3660μs 11.2229μs 89.1032 KOps/s 86.8136 KOps/s $\color{#35bf28}+2.64\%$
test_step_mdp_speed[False-False-True-True-True] 61.0340μs 27.5139μs 36.3453 KOps/s 35.6275 KOps/s $\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-False-True-True-False] 47.1080μs 18.2628μs 54.7562 KOps/s 53.3352 KOps/s $\color{#35bf28}+2.66\%$
test_step_mdp_speed[False-False-True-False-True] 44.8140μs 17.6647μs 56.6100 KOps/s 56.1595 KOps/s $\color{#35bf28}+0.80\%$
test_step_mdp_speed[False-False-True-False-False] 33.7030μs 11.2750μs 88.6917 KOps/s 87.0270 KOps/s $\color{#35bf28}+1.91\%$
test_step_mdp_speed[False-False-False-True-True] 41.7490μs 29.0609μs 34.4105 KOps/s 34.2310 KOps/s $\color{#35bf28}+0.52\%$
test_step_mdp_speed[False-False-False-True-False] 54.3720μs 19.3674μs 51.6332 KOps/s 50.8669 KOps/s $\color{#35bf28}+1.51\%$
test_step_mdp_speed[False-False-False-False-True] 45.9360μs 18.6389μs 53.6513 KOps/s 52.4865 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[False-False-False-False-False] 38.6920μs 12.4490μs 80.3274 KOps/s 78.6787 KOps/s $\color{#35bf28}+2.10\%$
test_values[generalized_advantage_estimate-True-True] 9.7792ms 9.5804ms 104.3795 Ops/s 106.9846 Ops/s $\color{#d91a1a}-2.44\%$
test_values[vec_generalized_advantage_estimate-True-True] 39.1095ms 35.8947ms 27.8593 Ops/s 28.2841 Ops/s $\color{#d91a1a}-1.50\%$
test_values[td0_return_estimate-False-False] 0.2370ms 0.1771ms 5.6468 KOps/s 5.9156 KOps/s $\color{#d91a1a}-4.54\%$
test_values[td1_return_estimate-False-False] 24.5275ms 24.2049ms 41.3139 Ops/s 41.7159 Ops/s $\color{#d91a1a}-0.96\%$
test_values[vec_td1_return_estimate-False-False] 46.7833ms 36.2762ms 27.5663 Ops/s 28.1609 Ops/s $\color{#d91a1a}-2.11\%$
test_values[td_lambda_return_estimate-True-False] 37.5985ms 34.7511ms 28.7761 Ops/s 28.8735 Ops/s $\color{#d91a1a}-0.34\%$
test_values[vec_td_lambda_return_estimate-True-False] 37.2531ms 35.9348ms 27.8282 Ops/s 28.1349 Ops/s $\color{#d91a1a}-1.09\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 11.5048ms 8.3800ms 119.3312 Ops/s 122.1294 Ops/s $\color{#d91a1a}-2.29\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.0046ms 1.8557ms 538.8746 Ops/s 556.9118 Ops/s $\color{#d91a1a}-3.24\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6491ms 0.3630ms 2.7548 KOps/s 2.7772 KOps/s $\color{#d91a1a}-0.81\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 45.1706ms 44.2910ms 22.5779 Ops/s 22.8772 Ops/s $\color{#d91a1a}-1.31\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.6080ms 3.0645ms 326.3212 Ops/s 329.5367 Ops/s $\color{#d91a1a}-0.98\%$
test_dqn_speed 1.5480ms 1.3770ms 726.2013 Ops/s 727.8053 Ops/s $\color{#d91a1a}-0.22\%$
test_ddpg_speed 3.2235ms 2.9052ms 344.2121 Ops/s 344.8466 Ops/s $\color{#d91a1a}-0.18\%$
test_sac_speed 9.2117ms 8.7040ms 114.8900 Ops/s 113.3757 Ops/s $\color{#35bf28}+1.34\%$
test_redq_speed 15.1959ms 13.7506ms 72.7241 Ops/s 67.1700 Ops/s $\textbf{\color{#35bf28}+8.27\%}$
test_redq_deprec_speed 15.7855ms 13.7298ms 72.8345 Ops/s 70.2298 Ops/s $\color{#35bf28}+3.71\%$
test_td3_speed 17.6981ms 8.7623ms 114.1247 Ops/s 114.3981 Ops/s $\color{#d91a1a}-0.24\%$
test_cql_speed 38.4820ms 37.2185ms 26.8683 Ops/s 27.1260 Ops/s $\color{#d91a1a}-0.95\%$
test_a2c_speed 8.7262ms 7.7132ms 129.6480 Ops/s 133.6403 Ops/s $\color{#d91a1a}-2.99\%$
test_ppo_speed 9.5559ms 7.9796ms 125.3193 Ops/s 129.5616 Ops/s $\color{#d91a1a}-3.27\%$
test_reinforce_speed 7.8614ms 6.6789ms 149.7260 Ops/s 149.1853 Ops/s $\color{#35bf28}+0.36\%$
test_iql_speed 34.6072ms 32.9691ms 30.3314 Ops/s 30.4293 Ops/s $\color{#d91a1a}-0.32\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.9972ms 3.5657ms 280.4489 Ops/s 273.1556 Ops/s $\color{#35bf28}+2.67\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9365ms 0.5057ms 1.9775 KOps/s 2.0160 KOps/s $\color{#d91a1a}-1.91\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8649ms 0.4776ms 2.0939 KOps/s 2.1165 KOps/s $\color{#d91a1a}-1.07\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.9054ms 3.6198ms 276.2591 Ops/s 268.1814 Ops/s $\color{#35bf28}+3.01\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9468ms 0.4948ms 2.0210 KOps/s 1.9987 KOps/s $\color{#35bf28}+1.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7994ms 0.4700ms 2.1275 KOps/s 2.0673 KOps/s $\color{#35bf28}+2.91\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.2719ms 1.7522ms 570.7034 Ops/s 575.1607 Ops/s $\color{#d91a1a}-0.77\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8394ms 1.6424ms 608.8787 Ops/s 611.1806 Ops/s $\color{#d91a1a}-0.38\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 4.3156ms 3.7195ms 268.8563 Ops/s 258.6588 Ops/s $\color{#35bf28}+3.94\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1402s 0.7627ms 1.3111 KOps/s 1.5646 KOps/s $\textbf{\color{#d91a1a}-16.20\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0065ms 0.6109ms 1.6368 KOps/s 1.6427 KOps/s $\color{#d91a1a}-0.36\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.1165ms 3.6404ms 274.6982 Ops/s 274.8367 Ops/s $\color{#d91a1a}-0.05\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9766ms 0.5030ms 1.9880 KOps/s 1.9785 KOps/s $\color{#35bf28}+0.48\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6417ms 0.4863ms 2.0562 KOps/s 2.0972 KOps/s $\color{#d91a1a}-1.96\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.1577ms 3.7464ms 266.9243 Ops/s 272.1254 Ops/s $\color{#d91a1a}-1.91\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.3547ms 0.5192ms 1.9260 KOps/s 2.0104 KOps/s $\color{#d91a1a}-4.19\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7873ms 0.4805ms 2.0811 KOps/s 2.1432 KOps/s $\color{#d91a1a}-2.90\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.9379ms 3.7419ms 267.2435 Ops/s 260.8970 Ops/s $\color{#35bf28}+2.43\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.2097ms 0.6397ms 1.5632 KOps/s 1.5852 KOps/s $\color{#d91a1a}-1.39\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8443ms 0.6157ms 1.6242 KOps/s 1.6102 KOps/s $\color{#35bf28}+0.87\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1254s 6.1299ms 163.1357 Ops/s 162.9568 Ops/s $\color{#35bf28}+0.11\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 20.4995ms 12.5542ms 79.6546 Ops/s 66.1716 Ops/s $\textbf{\color{#35bf28}+20.38\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 4.6977ms 1.1763ms 850.1201 Ops/s 939.4088 Ops/s $\textbf{\color{#d91a1a}-9.50\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1157s 8.1002ms 123.4544 Ops/s 168.8614 Ops/s $\textbf{\color{#d91a1a}-26.89\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 15.0721ms 12.4377ms 80.4005 Ops/s 76.3374 Ops/s $\textbf{\color{#35bf28}+5.32\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.5339ms 1.0467ms 955.3438 Ops/s 937.8900 Ops/s $\color{#35bf28}+1.86\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1136s 6.0625ms 164.9495 Ops/s 161.8746 Ops/s $\color{#35bf28}+1.90\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.5014ms 12.7165ms 78.6380 Ops/s 77.1436 Ops/s $\color{#35bf28}+1.94\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.7221ms 1.2137ms 823.9557 Ops/s 819.2581 Ops/s $\color{#35bf28}+0.57\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Jul 9, 2024 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}5$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1638s 0.1092s 9.1592 Ops/s 9.5018 Ops/s $\color{#d91a1a}-3.61\%$
test_sync 94.0667ms 91.1782ms 10.9675 Ops/s 10.8892 Ops/s $\color{#35bf28}+0.72\%$
test_async 0.1779s 89.2667ms 11.2024 Ops/s 11.5555 Ops/s $\color{#d91a1a}-3.06\%$
test_single_pixels 0.1145s 0.1143s 8.7507 Ops/s 8.6749 Ops/s $\color{#35bf28}+0.87\%$
test_sync_pixels 71.2723ms 69.5481ms 14.3785 Ops/s 14.5630 Ops/s $\color{#d91a1a}-1.27\%$
test_async_pixels 0.1228s 56.9098ms 17.5717 Ops/s 15.8229 Ops/s $\textbf{\color{#35bf28}+11.05\%}$
test_simple 0.7307s 0.7300s 1.3699 Ops/s 1.3278 Ops/s $\color{#35bf28}+3.17\%$
test_transformed 1.0427s 0.9755s 1.0251 Ops/s 1.0111 Ops/s $\color{#35bf28}+1.38\%$
test_serial 2.2806s 2.1949s 0.4556 Ops/s 0.4570 Ops/s $\color{#d91a1a}-0.31\%$
test_parallel 1.9024s 1.8678s 0.5354 Ops/s 0.5319 Ops/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[True-True-True-True-True] 0.1576ms 33.0257μs 30.2795 KOps/s 29.2774 KOps/s $\color{#35bf28}+3.42\%$
test_step_mdp_speed[True-True-True-True-False] 0.1199ms 18.9765μs 52.6968 KOps/s 51.0155 KOps/s $\color{#35bf28}+3.30\%$
test_step_mdp_speed[True-True-True-False-True] 0.1243ms 18.6408μs 53.6458 KOps/s 52.2664 KOps/s $\color{#35bf28}+2.64\%$
test_step_mdp_speed[True-True-True-False-False] 0.1232ms 10.8015μs 92.5798 KOps/s 88.2926 KOps/s $\color{#35bf28}+4.86\%$
test_step_mdp_speed[True-True-False-True-True] 72.9610μs 34.9630μs 28.6017 KOps/s 27.2677 KOps/s $\color{#35bf28}+4.89\%$
test_step_mdp_speed[True-True-False-True-False] 48.3900μs 20.9133μs 47.8165 KOps/s 46.4906 KOps/s $\color{#35bf28}+2.85\%$
test_step_mdp_speed[True-True-False-False-True] 48.7210μs 20.2148μs 49.4686 KOps/s 47.9975 KOps/s $\color{#35bf28}+3.06\%$
test_step_mdp_speed[True-True-False-False-False] 33.0810μs 12.7192μs 78.6216 KOps/s 76.1341 KOps/s $\color{#35bf28}+3.27\%$
test_step_mdp_speed[True-False-True-True-True] 78.2610μs 36.5721μs 27.3433 KOps/s 26.7527 KOps/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[True-False-True-True-False] 0.1872ms 22.9186μs 43.6328 KOps/s 42.8323 KOps/s $\color{#35bf28}+1.87\%$
test_step_mdp_speed[True-False-True-False-True] 0.1187ms 20.2794μs 49.3111 KOps/s 48.1148 KOps/s $\color{#35bf28}+2.49\%$
test_step_mdp_speed[True-False-True-False-False] 0.1865ms 12.6163μs 79.2623 KOps/s 76.0849 KOps/s $\color{#35bf28}+4.18\%$
test_step_mdp_speed[True-False-False-True-True] 0.2351ms 38.2333μs 26.1552 KOps/s 25.5444 KOps/s $\color{#35bf28}+2.39\%$
test_step_mdp_speed[True-False-False-True-False] 45.8210μs 24.8206μs 40.2891 KOps/s 40.0126 KOps/s $\color{#35bf28}+0.69\%$
test_step_mdp_speed[True-False-False-False-True] 0.1913ms 22.0335μs 45.3854 KOps/s 44.8984 KOps/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-False-False-False-False] 0.2122ms 14.4097μs 69.3978 KOps/s 67.1564 KOps/s $\color{#35bf28}+3.34\%$
test_step_mdp_speed[False-True-True-True-True] 57.2910μs 36.1373μs 27.6722 KOps/s 26.8199 KOps/s $\color{#35bf28}+3.18\%$
test_step_mdp_speed[False-True-True-True-False] 63.8210μs 22.6063μs 44.2355 KOps/s 42.3965 KOps/s $\color{#35bf28}+4.34\%$
test_step_mdp_speed[False-True-True-False-True] 55.1000μs 23.7260μs 42.1479 KOps/s 39.6289 KOps/s $\textbf{\color{#35bf28}+6.36\%}$
test_step_mdp_speed[False-True-True-False-False] 36.7010μs 14.3692μs 69.5931 KOps/s 67.0361 KOps/s $\color{#35bf28}+3.81\%$
test_step_mdp_speed[False-True-False-True-True] 69.9610μs 38.5414μs 25.9461 KOps/s 25.4412 KOps/s $\color{#35bf28}+1.98\%$
test_step_mdp_speed[False-True-False-True-False] 0.1946ms 24.3957μs 40.9909 KOps/s 39.3777 KOps/s $\color{#35bf28}+4.10\%$
test_step_mdp_speed[False-True-False-False-True] 65.7610μs 25.5554μs 39.1306 KOps/s 37.3329 KOps/s $\color{#35bf28}+4.82\%$
test_step_mdp_speed[False-True-False-False-False] 0.2111ms 16.1849μs 61.7861 KOps/s 60.0658 KOps/s $\color{#35bf28}+2.86\%$
test_step_mdp_speed[False-False-True-True-True] 0.2397ms 40.3712μs 24.7701 KOps/s 24.1381 KOps/s $\color{#35bf28}+2.62\%$
test_step_mdp_speed[False-False-True-True-False] 0.2220ms 26.5250μs 37.7003 KOps/s 36.8270 KOps/s $\color{#35bf28}+2.37\%$
test_step_mdp_speed[False-False-True-False-True] 56.2410μs 25.9181μs 38.5831 KOps/s 37.1997 KOps/s $\color{#35bf28}+3.72\%$
test_step_mdp_speed[False-False-True-False-False] 37.4300μs 16.1951μs 61.7471 KOps/s 59.8935 KOps/s $\color{#35bf28}+3.09\%$
test_step_mdp_speed[False-False-False-True-True] 54.6800μs 42.5260μs 23.5150 KOps/s 23.3249 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[False-False-False-True-False] 74.9510μs 28.2238μs 35.4311 KOps/s 34.1090 KOps/s $\color{#35bf28}+3.88\%$
test_step_mdp_speed[False-False-False-False-True] 59.0310μs 27.0823μs 36.9245 KOps/s 34.9007 KOps/s $\textbf{\color{#35bf28}+5.80\%}$
test_step_mdp_speed[False-False-False-False-False] 47.0300μs 17.7927μs 56.2027 KOps/s 54.9894 KOps/s $\color{#35bf28}+2.21\%$
test_values[generalized_advantage_estimate-True-True] 27.4756ms 25.3807ms 39.4001 Ops/s 40.5678 Ops/s $\color{#d91a1a}-2.88\%$
test_values[vec_generalized_advantage_estimate-True-True] 92.7328ms 2.7539ms 363.1226 Ops/s 365.4112 Ops/s $\color{#d91a1a}-0.63\%$
test_values[td0_return_estimate-False-False] 90.8410μs 66.1682μs 15.1130 KOps/s 14.7134 KOps/s $\color{#35bf28}+2.72\%$
test_values[td1_return_estimate-False-False] 56.1279ms 55.6098ms 17.9824 Ops/s 17.6591 Ops/s $\color{#35bf28}+1.83\%$
test_values[vec_td1_return_estimate-False-False] 1.3047ms 1.0893ms 918.0002 Ops/s 917.5910 Ops/s $\color{#35bf28}+0.04\%$
test_values[td_lambda_return_estimate-True-False] 96.0641ms 89.2879ms 11.1997 Ops/s 11.4134 Ops/s $\color{#d91a1a}-1.87\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3139ms 1.0830ms 923.4014 Ops/s 915.9411 Ops/s $\color{#35bf28}+0.81\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.0138ms 24.6299ms 40.6011 Ops/s 39.9505 Ops/s $\color{#35bf28}+1.63\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9530ms 0.7335ms 1.3633 KOps/s 1.3851 KOps/s $\color{#d91a1a}-1.58\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8344ms 0.6697ms 1.4933 KOps/s 1.4919 KOps/s $\color{#35bf28}+0.09\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.6507ms 1.4743ms 678.2716 Ops/s 679.8083 Ops/s $\color{#d91a1a}-0.23\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.8311ms 0.6868ms 1.4561 KOps/s 1.4566 KOps/s $\color{#d91a1a}-0.03\%$
test_dqn_speed 8.0419ms 1.4867ms 672.6166 Ops/s 674.8183 Ops/s $\color{#d91a1a}-0.33\%$
test_ddpg_speed 3.2531ms 2.9579ms 338.0753 Ops/s 330.9849 Ops/s $\color{#35bf28}+2.14\%$
test_sac_speed 9.1441ms 8.4742ms 118.0055 Ops/s 115.5809 Ops/s $\color{#35bf28}+2.10\%$
test_redq_speed 0.1140s 12.1754ms 82.1327 Ops/s 87.9533 Ops/s $\textbf{\color{#d91a1a}-6.62\%}$
test_redq_deprec_speed 12.4158ms 11.9587ms 83.6209 Ops/s 74.3264 Ops/s $\textbf{\color{#35bf28}+12.50\%}$
test_td3_speed 8.6754ms 8.5182ms 117.3952 Ops/s 117.1685 Ops/s $\color{#35bf28}+0.19\%$
test_cql_speed 26.9945ms 26.4047ms 37.8721 Ops/s 37.6755 Ops/s $\color{#35bf28}+0.52\%$
test_a2c_speed 6.6797ms 5.9136ms 169.1018 Ops/s 168.4799 Ops/s $\color{#35bf28}+0.37\%$
test_ppo_speed 6.5159ms 6.1713ms 162.0396 Ops/s 160.6830 Ops/s $\color{#35bf28}+0.84\%$
test_reinforce_speed 5.1383ms 4.8500ms 206.1865 Ops/s 207.5265 Ops/s $\color{#d91a1a}-0.65\%$
test_iql_speed 20.8966ms 20.3625ms 49.1098 Ops/s 49.0074 Ops/s $\color{#35bf28}+0.21\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.8868ms 4.6217ms 216.3685 Ops/s 216.0276 Ops/s $\color{#35bf28}+0.16\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7692ms 0.5559ms 1.7989 KOps/s 1.8021 KOps/s $\color{#d91a1a}-0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.4841ms 0.5368ms 1.8630 KOps/s 1.8622 KOps/s $\color{#35bf28}+0.04\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.9659ms 4.5667ms 218.9787 Ops/s 215.9024 Ops/s $\color{#35bf28}+1.42\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7517ms 0.5483ms 1.8238 KOps/s 1.8217 KOps/s $\color{#35bf28}+0.12\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.9162ms 0.5314ms 1.8819 KOps/s 1.8809 KOps/s $\color{#35bf28}+0.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.2812ms 2.0526ms 487.1966 Ops/s 485.6842 Ops/s $\color{#35bf28}+0.31\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 5.8127ms 1.9793ms 505.2200 Ops/s 507.5740 Ops/s $\color{#d91a1a}-0.46\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.0001ms 4.7340ms 211.2400 Ops/s 210.0349 Ops/s $\color{#35bf28}+0.57\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1458s 0.8346ms 1.1982 KOps/s 1.4080 KOps/s $\textbf{\color{#d91a1a}-14.90\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9654ms 0.6909ms 1.4473 KOps/s 1.4448 KOps/s $\color{#35bf28}+0.17\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.8684ms 4.5750ms 218.5776 Ops/s 214.9079 Ops/s $\color{#35bf28}+1.71\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.6225ms 0.5550ms 1.8020 KOps/s 1.8133 KOps/s $\color{#d91a1a}-0.62\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7190ms 0.5342ms 1.8721 KOps/s 1.8655 KOps/s $\color{#35bf28}+0.35\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 4.8488ms 4.5553ms 219.5231 Ops/s 215.9605 Ops/s $\color{#35bf28}+1.65\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7462ms 0.5469ms 1.8286 KOps/s 1.8062 KOps/s $\color{#35bf28}+1.24\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 4.7246ms 0.5341ms 1.8722 KOps/s 1.8683 KOps/s $\color{#35bf28}+0.21\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.0025ms 4.7173ms 211.9876 Ops/s 207.5914 Ops/s $\color{#35bf28}+2.12\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8969ms 0.7049ms 1.4187 KOps/s 1.4154 KOps/s $\color{#35bf28}+0.23\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8421ms 0.6868ms 1.4560 KOps/s 1.4430 KOps/s $\color{#35bf28}+0.90\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1526s 7.8320ms 127.6810 Ops/s 131.8821 Ops/s $\color{#d91a1a}-3.19\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.4585ms 15.0404ms 66.4877 Ops/s 64.7394 Ops/s $\color{#35bf28}+2.70\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.2994ms 1.1307ms 884.3825 Ops/s 872.3401 Ops/s $\color{#35bf28}+1.38\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1358s 7.5508ms 132.4358 Ops/s 131.4847 Ops/s $\color{#35bf28}+0.72\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 0.1460s 17.8548ms 56.0074 Ops/s 55.0112 Ops/s $\color{#35bf28}+1.81\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.4751ms 1.2504ms 799.7390 Ops/s 870.7600 Ops/s $\textbf{\color{#d91a1a}-8.16\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1323s 7.6234ms 131.1747 Ops/s 130.6488 Ops/s $\color{#35bf28}+0.40\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.8350ms 15.3726ms 65.0509 Ops/s 64.1227 Ops/s $\color{#35bf28}+1.45\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.4660ms 1.3293ms 752.2796 Ops/s 694.6601 Ops/s $\textbf{\color{#35bf28}+8.29\%}$

@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Jul 9, 2024
@vmoens vmoens merged commit b81eff3 into main Jul 9, 2024
65 of 73 checks passed
@vmoens vmoens deleted the fix-nightly branch July 9, 2024 14:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot