Conclusion

Attention answers several pressures at once. It reduces reliance on one fixed hidden state, gives more direct access to earlier positions, and improves parallelism compared with strict recurrence.

This chapter does not replace the Transformer book. It prepares it. The reader now knows why attention was needed before seeing query, key, value, heads, and blocks.