How It Works
Structure
The cleanest pieces are the REINFORCE notebooks and the actor-critic transcripts. Around that, you have several Pong PPO/REINFORCE experiments, support utilities, and saved policy checkpoints.
REINFORCE + PPO + Actor-Critic theory
The theory-heavy branch that ties together REINFORCE, PPO, A2C/A3C, GAE, and your Pong experiments.
How It Works
The cleanest pieces are the REINFORCE notebooks and the actor-critic transcripts. Around that, you have several Pong PPO/REINFORCE experiments, support utilities, and saved policy checkpoints.
Why Reuse
This is the best source for explanatory pages about variance reduction, baselines, clipped objectives, and the move from vanilla policy gradients into actor-critic methods.
Key Assets
CartPole notebook pair plus additional exploratory notebooks.
source-material/reinforce
Multiple notebooks, vectorized env utilities, and saved `.policy` checkpoints.
source-material/reinforce/pong-PPO-REINFORCE
A2C, A3C, GAE, DDPG, and related lecture transcripts.
source-material/classwork/ContinuousControl_Transcripts
Reference PDFs for A2C/A3C, PPO, GAE, and TRPO-style ideas.
resources