Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] step_and_maybe_reset in env #1611

Merged
merged 122 commits into from
Oct 24, 2023
Merged
Changes from 1 commit
Commits
Show all changes
122 commits
Select commit Hold shift + click to select a range
1f539dd
init
vmoens Oct 6, 2023
d4c16e1
amend
vmoens Oct 6, 2023
d2321aa
amend
vmoens Oct 6, 2023
565115a
amend
vmoens Oct 6, 2023
3c46136
amend
vmoens Oct 6, 2023
78cfa41
amend
vmoens Oct 6, 2023
a6bd8eb
amend
vmoens Oct 6, 2023
04d4ae7
amend
vmoens Oct 6, 2023
2d0b4c6
init
vmoens Oct 10, 2023
528609a
amend
vmoens Oct 10, 2023
51cd5af
fix
vmoens Oct 10, 2023
3e31963
Merge remote-tracking branch 'origin/main' into step_maybe_reset
vmoens Oct 10, 2023
b11e73a
amend
vmoens Oct 10, 2023
1540407
remove `pip3 install -e .`
vmoens Oct 10, 2023
f1b0ea4
tensordict_
vmoens Oct 10, 2023
16b3538
amend rollout logic
vmoens Oct 10, 2023
7ad0864
amend
vmoens Oct 10, 2023
bcac398
amend
vmoens Oct 10, 2023
428f8ee
inference
vmoens Oct 10, 2023
6fbd0bd
cpu -> cuda
vmoens Oct 10, 2023
02db623
checks
vmoens Oct 10, 2023
08a8f47
using pipe instead of event
vmoens Oct 10, 2023
45e64f7
amend
vmoens Oct 10, 2023
7dd4821
amend
vmoens Oct 10, 2023
e1a2206
rm cuda event
vmoens Oct 10, 2023
dc2caab
amend
vmoens Oct 10, 2023
01ffbf9
amend
vmoens Oct 10, 2023
ac76ec3
amend
vmoens Oct 10, 2023
ceab010
amend
vmoens Oct 10, 2023
f0327c9
amend
vmoens Oct 10, 2023
518b3d1
amend
vmoens Oct 10, 2023
47dd93b
amend
vmoens Oct 10, 2023
354fb6f
amend
vmoens Oct 10, 2023
53d5f9a
amend
vmoens Oct 10, 2023
78c00e8
amend
vmoens Oct 10, 2023
f63480e
amend
vmoens Oct 10, 2023
9a3631f
amend
vmoens Oct 10, 2023
44336ed
Merge remote-tracking branch 'origin/main' into fix_ci
vmoens Oct 10, 2023
512f9f7
specs fix
vmoens Oct 10, 2023
2ceb438
amend
vmoens Oct 10, 2023
c666d5a
amend
vmoens Oct 10, 2023
6ecebda
amend
vmoens Oct 10, 2023
ce6e9bd
amend
vmoens Oct 10, 2023
5c613c3
amend
vmoens Oct 10, 2023
9f97e58
amend
vmoens Oct 10, 2023
9cbcbb0
amend
vmoens Oct 10, 2023
ae2748d
amend
vmoens Oct 10, 2023
72c4163
amend
vmoens Oct 10, 2023
6f4c374
amend
vmoens Oct 10, 2023
bf36bec
amend
vmoens Oct 10, 2023
4095766
amend
vmoens Oct 11, 2023
9f2a9ad
amend
vmoens Oct 11, 2023
5b34961
amend
vmoens Oct 11, 2023
deba78d
amend
vmoens Oct 11, 2023
b638461
amend
vmoens Oct 11, 2023
f8b2f60
amend
vmoens Oct 11, 2023
dfc868a
amend
vmoens Oct 11, 2023
1221c48
Merge branch 'fix_ci' into step_maybe_reset
vmoens Oct 11, 2023
22d3a27
amend
vmoens Oct 11, 2023
38e0e90
amend
vmoens Oct 11, 2023
5828a84
Merge branch 'fix_ci' into step_maybe_reset
vmoens Oct 11, 2023
004d381
amend
vmoens Oct 11, 2023
6ef720d
amend
vmoens Oct 11, 2023
d2167ea
Merge branch 'fix_ci' into step_maybe_reset
vmoens Oct 11, 2023
f66c6c9
amend
vmoens Oct 11, 2023
4fd2768
amend
vmoens Oct 11, 2023
ded1883
amend
vmoens Oct 11, 2023
cb1a83f
amend
vmoens Oct 11, 2023
6af6a45
amend
vmoens Oct 11, 2023
eaf5ebd
amend
vmoens Oct 12, 2023
f426322
Merge branch 'fix_ci' into step_maybe_reset
vmoens Oct 12, 2023
83672c6
amend
vmoens Oct 12, 2023
f0a6134
amend
vmoens Oct 12, 2023
c589a4a
amend
vmoens Oct 12, 2023
a85b321
amend
vmoens Oct 12, 2023
ed5e96f
amend
vmoens Oct 13, 2023
e705719
amend
vmoens Oct 16, 2023
4c3fa33
fix
vmoens Oct 17, 2023
e354bc8
fix
vmoens Oct 18, 2023
faa3b41
amend
vmoens Oct 18, 2023
80120b4
fix
vmoens Oct 18, 2023
09205e5
empty
vmoens Oct 18, 2023
3c41dab
amend
vmoens Oct 18, 2023
4db8110
amend
vmoens Oct 18, 2023
38cac91
empty
vmoens Oct 18, 2023
a336f0e
Merge remote-tracking branch 'origin/main' into step_maybe_reset
vmoens Oct 18, 2023
a9f4678
amend
vmoens Oct 18, 2023
9ee6348
amend
vmoens Oct 19, 2023
62c848b
amend
vmoens Oct 19, 2023
684d527
amend
vmoens Oct 19, 2023
89ddfd2
amend
vmoens Oct 19, 2023
a0376e4
amend
vmoens Oct 19, 2023
44dfe86
amend
vmoens Oct 19, 2023
d332597
amend
vmoens Oct 19, 2023
85cf664
amend
vmoens Oct 19, 2023
b55fae1
Merge remote-tracking branch 'origin/main' into step_maybe_reset
vmoens Oct 19, 2023
5dcbf15
amend
vmoens Oct 19, 2023
0236818
amend
vmoens Oct 20, 2023
36f151d
amend
vmoens Oct 20, 2023
afecc65
amend
vmoens Oct 20, 2023
f4a0beb
amend
vmoens Oct 20, 2023
5a331e5
amend
vmoens Oct 20, 2023
1ee4ba7
amend
vmoens Oct 20, 2023
9d14427
amend
vmoens Oct 20, 2023
8c15741
amend
vmoens Oct 20, 2023
1fe2cd3
amend
vmoens Oct 20, 2023
c378acc
amend
vmoens Oct 20, 2023
551c9eb
amend
vmoens Oct 20, 2023
e177c77
amend
vmoens Oct 20, 2023
28b0059
amend
vmoens Oct 20, 2023
5a21f2a
amend
vmoens Oct 20, 2023
b7b2081
lint
vmoens Oct 20, 2023
de1ecf2
amend
vmoens Oct 21, 2023
6fec99e
amend
vmoens Oct 21, 2023
6bfe517
amend
vmoens Oct 22, 2023
8f78ac0
cache keys
vmoens Oct 23, 2023
d2b734b
fix empty cache
vmoens Oct 23, 2023
a0c12d5
Merge remote-tracking branch 'origin/main' into step_maybe_reset
vmoens Oct 23, 2023
83eb52f
amend
vmoens Oct 24, 2023
5943c51
Merge remote-tracking branch 'origin/main' into step_maybe_reset
vmoens Oct 24, 2023
3e86847
addressing comments
vmoens Oct 24, 2023
ca1dd78
amend
vmoens Oct 24, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
amend
  • Loading branch information
vmoens committed Oct 20, 2023
commit 1fe2cd3e0037df3aefbb22d9304aeda3dd12feec
1 change: 1 addition & 0 deletions examples/decision_transformer/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -430,6 +430,7 @@ def make_odt_loss(loss_cfg, actor_network):
alpha_init=loss_cfg.alpha_init,
target_entropy=loss_cfg.target_entropy,
)
loss.set_keys(action_target="action_cat")
return loss


Expand Down
Loading