This article has briefly described the implementation of several common varieties of neural network learning rules and procedures for learning optimisation. This is by no means an exhaustive list and many networks have not been mentioned (Hopfield networks and counterpropagation networks for example). However it does provide a basis for the future progression of the OpenAI neural network project.