Question

method to overcome the Decay of Information through time in RNN

Answer 1

Backpropagation through time is the method to overcome decay in information through RNN.

BPTT helps a practitioner to solve the sequence prediction problems for recurrent neural networks.

It is used as a training algorithm which can update its weight in RNN.

Backpropagation through time helps in reducing the number of errors in network outputs.

Answer 2

Answer:

Gating

Explanation:

Gating is a technique that helps the net decide when to forget the current input, and when to remember it for future time steps. The most popular gating types are GRU and LSTM.