Exercises
LM-C08-C-001
What is -log(1)?
Compute it first, then check your number.
LM-C08-C-002
What is the average of 2, 2, 4, 4?
Compute it first, then check your number.
LM-C08-C-003
If cross-entropy is 4 bits per token, what is perplexity?
Compute it first, then check your number.
LM-C08-C-004
If total loss is 30 bits over 10 bytes, what is bits per byte?
Compute it first, then check your number.
LM-C08-C-005
Should validation text be used for final test reporting? Answer 1 for yes or
0 for no.
Compute it first, then check your number.