Exercises

These exercises check the shortcut and gating ideas from the chapter.

DL-C15-C-001Exercise: Residual output

Let x = 8 and F(x) = -3. What is y = x + F(x)?

Your answer

Compute it first, then check your number.

DL-C15-C-002Exercise: Projected residual

Let P(x) = 11 and F(x) = 4. What is P(x) + F(x)?

Your answer

Compute it first, then check your number.

DL-C15-C-003Exercise: Concatenated channels

One path has 9 channels and another has 3 channels. How many channels after concatenation?

Your answer

Compute it first, then check your number.

DL-C15-C-004Exercise: Gate mix

Let old = 10, candidate = 2, and gate = 0.25. What is the gated output?

Your answer

Compute it first, then check your number.

DL-C15-C-005Exercise: Identity derivative

For y = x + F(x), what derivative contribution comes from the direct x path?

Your answer

Compute it first, then check your number.

DL-C15-C-006Exercise: Zero residual branch

If F(x) = 0 and x = -6, what is x + F(x)?

Your answer

Compute it first, then check your number.

DL-C15-C-007Exercise: Shortcut purpose

Enter 1 if shortcut paths can help information and gradients move through deep networks, or 2 if they only increase loss.

Your answer

Compute it first, then check your number.