Question
Answer some questions about the technology underlying ChatGPT, for 10 points each:
[10e] ChatGPT is this type of machine learning model, named for being inspired by the structure of the human brain.
ANSWER: neural networks [or neural nets]
[10m] ChatGPT's initial pretraining on language data falls under this general class of machine learning techniques, in which patterns are learned from data without labels.
ANSWER: unsupervised learning
[10h] ChatGPT is composed of Transformer units, an architecture that uses this mechanism to compute which previous outputs in a sequence are most important to the current output. This mechanism is computed as "softmax of Q K transpose over square root of d sub k, times V."
ANSWER: attention [or dot-product attention; or multiplicative attention]
<Eve Fleisig , Science - Compsci>
Summary
| 2023 NASAT | 06/17/2023 | Y | 9 | 14.44 | 100% | 44% | 0% |
Data
| California | Illinois Orange | 10 | 10 | 0 | 20 |
| Kentucky A | Illinois White | 10 | 0 | 0 | 10 |
| Illinois Blue | Missouri A | 10 | 0 | 0 | 10 |
| Arkansas | Kentucky B | 10 | 0 | 0 | 10 |
| Missouri B | Liberia | 10 | 10 | 0 | 20 |
| Maryland Gold | PENNSYLVANIA | 10 | 10 | 0 | 20 |
| Asia A | New Jersey A | 10 | 0 | 0 | 10 |
| Maryland Red | Ohio | 10 | 10 | 0 | 20 |
| New Jersey B | Virginia | 10 | 0 | 0 | 10 |