GRU Update and Reset Gates

A GRU is another gated recurrent unit. It is simpler than an LSTM in structure.

Two key gates are commonly named:

• update gate;
• reset gate.

The update gate controls how much previous state is kept versus changed. The reset gate controls how much previous state is used when forming new candidate information.

GRUs often train well with fewer moving parts than LSTMs, though the best choice depends on the task and setup.

Exercise

How many GRU gates are named on this page?