Answer some questions about the technology underlying ChatGPT, for 10 points each:
[10e] ChatGPT is this type of machine learning model, named for being inspired by the structure of the human brain.
ANSWER: neural networks [or neural nets]
[10m] ChatGPT's initial pretraining on language data falls under this general class of machine learning techniques, in which patterns are learned from data without labels.
ANSWER: unsupervised learning
[10h] ChatGPT is composed of Transformer units, an architecture that uses this mechanism to compute which previous outputs in a sequence are most important to the current output. This mechanism is computed as "softmax of Q K transpose over square root of d sub k, times V."
ANSWER: attention [or dot-product attention; or multiplicative attention]
<Eve Fleisig , Science - Compsci>