Question
When discussing this phenomenon, the textbook Model Selection and Model Averaging rhetorically asks “Is the monkey who typed Hamlet actually a good writer?” For 10 points each:
[10m] Name this phenomenon in machine learning that can be prevented using k-fold cross-validation and regularization.
ANSWER: overfitting [or overtraining]
[10h] This technique can prevent overfitting in neural networks by introducing a layer that randomly “shuts off” some incoming units by setting their weights to zero.
ANSWER: dropout [prompt on dilution]
[10e] The patent for dropout is owned by this company that maintains the TensorFlow library. In 2024, this company introduced “AI overview” to supplement its PageRank algorithm.
ANSWER: Google [accept Alphabet]
<Oxford B, Other Science>
Summary
California | 2025-02-01 | Y | 3 | 23.33 | 100% | 100% | 33% |
Florida | 2025-02-01 | Y | 2 | 20.00 | 100% | 50% | 50% |
Midwest | 2025-02-01 | Y | 6 | 18.33 | 100% | 67% | 17% |
Overflow | 2025-02-01 | Y | 5 | 16.00 | 80% | 60% | 20% |
Pacific Northwest | 2025-02-01 | Y | 2 | 20.00 | 100% | 100% | 0% |
South Central | 2025-02-01 | Y | 2 | 20.00 | 100% | 50% | 50% |
Southeast | 2025-02-01 | Y | 3 | 10.00 | 100% | 0% | 0% |
UK | 2025-02-01 | Y | 10 | 22.00 | 80% | 60% | 80% |
Data
Bristol | Cambridge B | 10 | 10 | 10 | 30 |
Cambridge A | Cambridge C | 0 | 10 | 10 | 20 |
Cambridge D | Imperial B | 10 | 10 | 10 | 30 |
Cambridge E | Durham | 0 | 10 | 0 | 10 |
Imperial A | Manchester | 10 | 10 | 10 | 30 |
Oxford A | LSE | 10 | 10 | 10 | 30 |
NYU C | Oxford B | 10 | 10 | 10 | 30 |
Oxford C | Sheffield | 0 | 0 | 10 | 10 |
Warwick A | Southampton B | 0 | 10 | 0 | 10 |
Southampton A | Warwick B | 10 | 0 | 10 | 20 |