Skip to content

Controller for collecting RL demonstration using hand pose and keyboard.

License

Notifications You must be signed in to change notification settings

NM512/HandyController

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HandyController

Manual controller using your Hand and Keyboard. Hand pose is recognized via web-cam.
RL demonstration can be easily obtained by this especially for multi dimensional continuous control environment.

Demo

LunarLanderContinuous-v2
(index and middle finger)
lunar

RobogymDactyl
(all fingers and F1~4 keys)
robogym

Instruction

Install this package and dependencies.

git clone https://github.com/NM512/HandyController.git
cd HandyController
pip install -e .

Run LunarLanderContinuous-v2 environment.

python wrappers/lunarlander.py

Run Robogym dactyl environment.

Please follow the offcial guide to install Robogym environment.
Don't forget to install Mujoco.

python wrappers/robogym_dactyl.py

Use inside your custom environment

Please make a wrapper for your own environment with reference to scripts inside wrappers folder.
Basically, only thing you have to consider is a correspondence between action space and input interface.
Currentry hand pose and keyboard input are supported as input interface.

About

Controller for collecting RL demonstration using hand pose and keyboard.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages