Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RLlib] Learner API: Policies using RLModules (for sampler only) do not need loss/stats/mixins. #34445

Merged
Merged
Changes from 1 commit
Commits
Show all changes
41 commits
Select commit Hold shift + click to select a range
47c003c
wip
sven1977 Apr 15, 2023
cc25d0c
wip
sven1977 Apr 15, 2023
e6f2d3b
merge
sven1977 May 4, 2023
0248ce8
wip
sven1977 May 4, 2023
04595b3
wip
sven1977 May 4, 2023
bf78988
wip
sven1977 May 4, 2023
ceb8caa
wip
sven1977 May 4, 2023
cc632cb
Merge branch 'master' of https://github.com/ray-project/ray into lear…
sven1977 May 5, 2023
904bfda
merge
sven1977 May 5, 2023
b36304d
wip
sven1977 May 5, 2023
a112d5b
wip
sven1977 May 5, 2023
4b600ef
wip
sven1977 May 6, 2023
6dba48b
wip
sven1977 May 6, 2023
95fd464
wip
sven1977 May 6, 2023
6e8ab3f
wip
sven1977 May 6, 2023
b224d9f
wip
sven1977 May 6, 2023
26bdf8d
fix
sven1977 May 6, 2023
07409be
fix
sven1977 May 6, 2023
74f159f
wip
sven1977 May 6, 2023
70e6127
fix
sven1977 May 6, 2023
e4a58ee
fix
sven1977 May 6, 2023
c40cb8d
fix
sven1977 May 6, 2023
a2bc97a
fix
sven1977 May 6, 2023
81bcbd5
fix
sven1977 May 6, 2023
499d818
wip
sven1977 May 6, 2023
fd61ef6
LINT
sven1977 May 6, 2023
a53b043
fix
sven1977 May 6, 2023
f175a39
LINT
sven1977 May 6, 2023
3e95159
fix
sven1977 May 6, 2023
0ad186f
fix
sven1977 May 6, 2023
3a85eae
wip
sven1977 May 6, 2023
1380cb6
Merge remote-tracking branch 'origin/learner_rlm_policies_simplificat…
sven1977 May 6, 2023
e9ad050
merge
sven1977 May 6, 2023
05103ba
fix
sven1977 May 6, 2023
f0c1145
LINT
sven1977 May 6, 2023
90ee0ab
Add new Scheduler API.
sven1977 May 7, 2023
a628043
Merge branch 'master' of https://github.com/ray-project/ray into lear…
sven1977 May 7, 2023
6e9b0cd
wip
sven1977 May 7, 2023
7f85d0a
LINT
sven1977 May 7, 2023
1bb3ec2
fix
sven1977 May 7, 2023
21486d7
Merge branch 'master' of https://github.com/ray-project/ray into lear…
sven1977 May 8, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix
Signed-off-by: sven1977 <[email protected]>
  • Loading branch information
sven1977 committed May 6, 2023
commit c40cb8d433f8794e623c06e5179f9aa72644dcfe
7 changes: 1 addition & 6 deletions rllib/evaluation/tests/test_trajectory_view_api.py
Original file line number Diff line number Diff line change
Expand Up @@ -7,9 +7,6 @@
from ray.rllib.algorithms.callbacks import DefaultCallbacks
import ray.rllib.algorithms.dqn as dqn
import ray.rllib.algorithms.ppo as ppo
from ray.rllib.algorithms.ppo.torch.ppo_torch_policy_rlm import (
PPOTorchPolicyWithRLModule,
)
from ray.rllib.examples.env.debug_counter_env import MultiAgentDebugCounterEnv
from ray.rllib.examples.env.multi_agent import MultiAgentPendulum
from ray.rllib.evaluation.rollout_worker import RolloutWorker
Expand Down Expand Up @@ -239,9 +236,7 @@ def test_traj_view_next_action(self):
enable_rl_module_api = config._enable_rl_module_api
rollout_worker_w_api = RolloutWorker(
env_creator=lambda _: gym.make("CartPole-v1"),
default_policy_class=PPOTorchPolicyWithRLModule
if enable_rl_module_api
else ppo.PPOTorchPolicy,
default_policy_class=ppo.PPOTorchPolicy,
config=config,
)
# Add the next action (a') and 2nd next action (a'') to the view
Expand Down