Hyperbolic deep reinforcement learning final project (Skoltech 2023)

Links

• Paper: https://arxiv.org/pdf/2210.01542.pdf
• Code: https://github.com/twitter-research/hyperbolic-rl

Setup

1. Run the following command to build docker image

    docker build -t hyp_rl_img .
   

2. Run docker container using command from the root of the project

    docker run -it -p 8888:8888 --rm --gpus=all -v ${PWD}:/app hyp_rl_img
   

3. Attach to the image via IDE (can be easily done using VS code)

    Ctrl + Shift + P -> Dev containers: Attach to running container
   

Experiments

Procgen experiments

1. Download checkopoints (Procgen starpilot)

   • Hyperbolic PPO SN: https://disk.yandex.ru/d/Lka1aHGlEoCRsg
   • PPO SN: https://disk.yandex.ru/d/QAJZjWwrLlZadA
   • PPO: https://disk.yandex.ru/d/cfCiAs-9qKCg5A

2. Setup paths to all the checkpoints and path to save gifs in procgen_exp.ipynb

3. Run code and enjoy gifs