This is an old revision of the document!
For this lab, you will turn in a colab notebook that implements the proximal policy optimization (PPO) algorithm.
Your notebook will be graded on the following:
For this lab, you will implement the PPO algorithm, and train it on a few simple worlds from the OpenAI gym test suite of problems.
You may use any code you want from the internet to help you understand how to implement this, but all final code must be your own.
Here is the OpenAI gym worlds
Here is a blog post introducing the idea.
Here is the paper with a technical description of the algorithm .
Here is a video describing it at a high level .