I a trying to implement a Jordan Recurrent Neural Network with the following structure:
Hence, the output from previous forward pass is used as input to current forward pass. Though, I am having trouble finding an easy way of implementing this with Python. The only package (I can find) that includes Jordan Networks is PyNeurGen, which I would prefer not to use as it does not include any optimizers such as adam or RMSprop.
So my question is if there exists a simple way of implementing a Jordan Network? Or do I have to dig deep and create my own custom neural network?