Exercises
LM-C11-C-001
How many RNN updates are needed for a 7-token sequence?
Compute it first, then check your number.
LM-C11-C-002
If hidden size is 64, how many numbers are in one hidden state?
Compute it first, then check your number.
LM-C11-C-003
If one recurrent cell is reused across 9 steps, how many distinct recurrent parameter sets are used?
Compute it first, then check your number.
LM-C11-C-004
If a sequence has 6 tokens, how many steps appear after unrolling?
Compute it first, then check your number.
LM-C11-C-005
Does BPTT mean backpropagation on the unrolled graph? Answer 1 for yes or 0
for no.
Compute it first, then check your number.