-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Royal Game of Ur Environment #1115
Comments
Thank you for proposing the Royal Game of Ur for the Pgx library! 👍 |
Thanks, I'm glad you liked the idea. Most contributions to the community were not done by me personally. I still have one question and one (smaller) request: Is the code of the game all in one file? Can I make a simple new game by editing only tic_tac_toe.py for instance or are there other code involved elsewhere in the library? And related request is about instruction to create custom environments. Most RL libraries have such instructions on very simple envs. This one for instance https://colab.research.google.com/github/araffin/rl-tutorial-jnrr19/blob/sb3/5_custom_gym_env.ipynb Could you make one? Something with as little game specific code as possible and comments with explanations of jax parts for comprehension |
Except for some complicated games, yes. Instructions for a new environment is a good idea. I'll add it till the end of |
I would like to request Royal Game of Ur environment for Pgx. Royal Game of Ur is a simple race game with chance and perfect information but it has some distinct features.
First, it might be an oldest board game: https://en.wikipedia.org/wiki/Royal_Game_of_Ur
Second, despite its relative simplicity (15 square board with 7 possible actions) it is not solved and there are no superhuman bots for it, though bots of various strength exist and can serve as benchmarks
Third, its hard to estimate it`s difficulty for RL algorithms but it seems that it may occupy the spot between very simple games (connect4) and big ones (chess, backgammon) while being real game and not a simplified version.
The rules of the game are here: https://royalur.net/rules/
You can play the game here: https://royalur.net/game/
Bots for possible benchmarks are here: https://github.com/RoyalUr/RoyalUr-Analysis/blob/main/docs/Agents.md#-the-random-agent-
Discord community: https://discord.com/invite/Ea49VVru5N
Python implementation: https://github.com/RoyalUr/RoyalUr-Python
Another word about discord community. For a while the community wants to develop self-play bots, ideally superhuman like it has been done for all Pgx games. We have sufficient computing resourses (high end ML accelerators) and time for training Alphazero. But we lack JAX knowledge to implement a game.
If you implement Game of Ur in your library we`ll be able to conduct training runs and testing against bots and humans and happily share the results. If we are lucky strongest bots may be achieved and teach us how this old game really should be played.
Anyway, thanks for the library and good luck at NeurIPS
The text was updated successfully, but these errors were encountered: