Recurrent Neural Networks

A network with a loop: it reads one step at a time and carries a hidden state forward. Watch a two-unit RNN, trained in your browser, learn to count — and see exactly where its memory runs out.