Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Support for planners and CEM #384

Merged
merged 60 commits into from
Sep 23, 2022
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
e5d3ed1
Added MPC planner
nicolas-dufour Aug 30, 2022
9098b39
Added CEM planning
nicolas-dufour Aug 30, 2022
fb43687
Planner refactoring
nicolas-dufour Aug 31, 2022
1bf3ba4
Bug fixes
nicolas-dufour Sep 5, 2022
316223d
Fixes
nicolas-dufour Sep 6, 2022
0c1ad85
Added proposed fixes and tests
nicolas-dufour Sep 7, 2022
dc655b8
Merge branch 'main' into mpcp
nicolas-dufour Sep 7, 2022
09fa7e7
Added stateful vs stateless distinction in EnvBase
nicolas-dufour Sep 7, 2022
7eea053
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 7, 2022
2940958
Fixed mock
nicolas-dufour Sep 7, 2022
18ce61f
Renamed is stateful in batch_locked
nicolas-dufour Sep 8, 2022
ff5330a
Reverted gym for CI stability
nicolas-dufour Sep 8, 2022
7f706cb
reverted gym version to pass CI
nicolas-dufour Sep 8, 2022
5d96e19
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 8, 2022
b13b93b
Changed is_stateful
nicolas-dufour Sep 8, 2022
608d5ba
Changed batched_lock to be a property that can't be changed and added…
nicolas-dufour Sep 9, 2022
27e9001
Formatting
nicolas-dufour Sep 9, 2022
15ec558
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 9, 2022
3e2a33d
merged batch locked
nicolas-dufour Sep 9, 2022
8d9dc8f
Changed to _new_
nicolas-dufour Sep 9, 2022
c758e13
fixed MockBatch_env
nicolas-dufour Sep 9, 2022
d0e13a3
fixed MockBatch_env
nicolas-dufour Sep 9, 2022
2fed37a
Added BatchedEnv and fixed batch_locked
nicolas-dufour Sep 12, 2022
58009d8
Changed for TransformedEnv
nicolas-dufour Sep 12, 2022
5a79da2
Added test from Transformed Env
nicolas-dufour Sep 12, 2022
65fe441
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 12, 2022
b3533e8
updated test
nicolas-dufour Sep 12, 2022
148f3f5
Formatting
nicolas-dufour Sep 12, 2022
6f3059c
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 12, 2022
aecbad2
Reverted gym downgrade
nicolas-dufour Sep 13, 2022
cc183ca
Merge branch 'main' into statefull_stateless
vmoens Sep 13, 2022
e05f963
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 13, 2022
f3766d3
Changed expand
nicolas-dufour Sep 13, 2022
88b537f
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 13, 2022
8e25244
Made suggested fix
nicolas-dufour Sep 14, 2022
dc1239c
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 14, 2022
3e6bc26
Removed attribute from init
nicolas-dufour Sep 14, 2022
fef3f3f
Fixed expand in planner
nicolas-dufour Sep 14, 2022
9ca7ff1
fixed TransformedEnv
nicolas-dufour Sep 14, 2022
6dcf7bd
Merge branch 'statefull_stateless' into mpcp
nicolas-dufour Sep 14, 2022
ed716a5
Merge branch 'main' into mpcp
nicolas-dufour Sep 16, 2022
e085bdf
Fixed in_place cls parameter passing
nicolas-dufour Sep 16, 2022
e84524a
Update common.py
nicolas-dufour Sep 16, 2022
fc5ca15
Merge branch 'main' into fix_in_place
nicolas-dufour Sep 16, 2022
926d818
Merge branch 'main' into fix_in_place
nicolas-dufour Sep 21, 2022
afdf9f3
Merge branch 'fix_in_place' of github.com:nicolas-dufour/torchrl into…
nicolas-dufour Sep 21, 2022
d941f2a
Merge branch 'fix_in_place' into mpcp
nicolas-dufour Sep 21, 2022
f8f2a9d
Merge branch 'main' of github.com:facebookresearch/rl into mpcp
nicolas-dufour Sep 22, 2022
bda0e59
Added requested changes
nicolas-dufour Sep 22, 2022
8f66c59
Doc fixes
nicolas-dufour Sep 23, 2022
4dd923f
fixed test
nicolas-dufour Sep 23, 2022
aecafa3
Fix test on gpu
nicolas-dufour Sep 23, 2022
1a6c6f1
Ran precommit
nicolas-dufour Sep 23, 2022
7a10cca
Merge branch 'main' into mpcp
nicolas-dufour Sep 23, 2022
182245a
fixed gpu tests
nicolas-dufour Sep 23, 2022
5934220
linting
nicolas-dufour Sep 23, 2022
e812ad2
Update common.py
vmoens Sep 23, 2022
82ce1b1
Merge branch 'main' into mpcp
vmoens Sep 23, 2022
9796a33
example in ds
vmoens Sep 23, 2022
7f54b8d
Merge branch 'main' into mpcp
vmoens Sep 23, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Reverted gym for CI stability
  • Loading branch information
nicolas-dufour committed Sep 8, 2022
commit ff5330a450861c460120a387cfc99602eec3a04e
2 changes: 1 addition & 1 deletion .circleci/unittest/linux/scripts/environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ dependencies:
- hypothesis
- future
- cloudpickle
- gym
- gym==0.25.1
- pygame
- gym[accept-rom-license]
- gym[atari]
Expand Down
2 changes: 1 addition & 1 deletion .circleci/unittest/linux_stable/scripts/environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ dependencies:
- hypothesis
- future
- cloudpickle
- gym
- gym==0.25.1
- pygame
- gym[accept-rom-license]
- gym[atari]
Expand Down