EmReal: A Digital Twin Framework of Emulated and Real Components for Robots with Reinforcement Learning we explain the details of our code in the comments. We push the necessary code in this repository.