LSTM.transpose()
What is LSTM.transpose()?
STM.transpose() is an experiment with an unfolded version of LSTMs. The hypothesis is that The gradients of a deep Neural Network following the same architecture of the LSTM unfolded through time (even those of the bottom layers) are efficiently trainable with Backpropagation, and won’t be affected by the ‘vanishing gradient’ problem. This is the case even when the weights are not ‘tied’
Code and references
The code is public and would like to have more people collaborate with us to make it better.
Project Details
Date: Nov 5, 2016
Author: John Gamboa
Tags:
LSTM, architecture, memory-networks
Website: https://github.com/vaulttech/lstmJam
