[Docs][Rllib] How To Create a Good Gym Environment for use with RLlib

[avnishn]

Description

There's many tutorials on the internet explaining how to create a gym env, but there aren't many that show how to make sure that the environment is created with all the correct properties so that its easy to validate and has no foot-gun errors. I'm suggesting that we add this to our documentation and replace our current docs on gym environments.

The environments documentation page is out of date and a little difficult to understand for beginners .

We should write the page to have the following outline:

• How to create a simple environment
• How do I make sure that it’s working? (Use check_env)
• How to pass it to an rllib experiment
• Use the updated config objects to do that

Use case

How does a beginner create environments that work with RLlib for sure?

[stale]

Hi, I'm a bot from the Ray team :)

To help human contributors to focus on more relevant issues, I will automatically add the stale label to issues that have had no activity for more than 4 months.

If there is no further activity in the 14 days, the issue will be closed!

• If you'd like to keep the issue open, just leave any comment, and the stale label will be removed!
• If you'd like to get more attention to the issue, please tag one of Ray's contributors.

You can always ask for help on our discussion forum or Ray's public slack channel.

[stale]

Hi again! The issue will be closed because there has been no more activity in the 14 days since the last message.

Please feel free to reopen or open a new issue if you'd still like it to be addressed.

Again, you can always ask for help on our discussion forum or Ray's public slack channel.

Thanks again for opening the issue!