LSTM Primer With Real Life Application ( DeepMind Continuous Risk Model of Acute Kidney Injury Prediction from EHR)*

GRU

GRU Cho 2014
GRU LSTM Comparison

Serial Nature of RNN/LSTM

Highway Networks

Highway block is a group of gated layers
Information highway — unchanged output forms stripe patterns ( orange ie 1 means no change )

Recurrent Highway Networks

Stacked RNNs ( a ) vs Increased Recurrent Depth RNNs ( b )
Recurrent Highway Networks
Nature Protocol
Nature Protocol
Ibid
Ibid

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store