These are notes from Roger Grosse’s material on Recurrent Neural Networks, along with some of my own additions to help me remember the material better.