overfitting - 2024 ACF Fall

Question

If the size of the training set is too large relative to the test set, then a machine learning model will exhibit a high generalization error due to this phenomenon. For 10 points each:

[10h] Identify this phenomenon where a machine learning model corresponds too closely with the data it is trained on.

ANSWER: overfitting

[10e] Overfitting can occur in many machine learning models, one common example of which are these models named for having a structure inspired by the human brain.

ANSWER: neural networks [or neural nets]

[10m] The VC dimension measures how well an ML model can perform this task. Perceptrons perform the “binary” form of this task, which involves assigning data a label with two values.

ANSWER: classification [accept word forms like classifying; accept binary classification]

Back to bonuses

Summary


2024 ACF Fall at Claremont Colleges	fall	Y	4	22.50	100%	25%	100%
2024 ACF Fall at Cornell	fall	Y	9	11.11	89%	11%	11%
2024 ACF Fall at Illinois	fall	Y	9	21.11	100%	44%	67%
2024 ACF Fall at Rutgers	fall	Y	7	20.00	100%	43%	57%
2024 ACF Fall at Ohio State	fall	Y	8	16.25	88%	38%	38%
2024 ACF Fall at Georgia	fall	Y	10	14.00	70%	20%	50%
2024 ACF Fall at North Carolina	fall	Y	9	12.22	67%	11%	44%

Data


Claremont B	UCLA A	10	10	0	20
UCLA C	UCLA B	10	10	0	20
UCLA E	UCLA D	10	10	0	20
UCSD	Claremont C	10	10	10	30
Cornell C	Binghamton A	0	10	0	10
Cornell G	Binghamton C	0	0	0	0
Cornell D	RIT B	0	10	0	10
Cornell E	Syracuse	0	10	0	10
Cornell B	ESF	10	10	10	30
Penn State	Cornell A	0	10	0	10
RIT A	U of Rochester B	0	10	0	10
Binghamton B	RIT C	0	10	0	10
U of Rochester A	Cornell F	0	10	0	10
Chicago A	Illinois D	10	10	10	30
Chicago B	Northwestern A	0	10	0	10
Illinois A	Iowa B	10	10	10	30
Purdue B	Indiana	10	10	0	20
Iowa A	Northwestern B	10	10	0	20
Notre Dame A	Illinois B	10	10	10	30
Illinois C	Purdue A	10	10	10	30
SIUE	WashU A	0	10	0	10
WashU B	Notre Dame C	0	10	0	10
Columbia A	Columbia B	10	10	0	20
Fordham A	Penn A	0	10	10	20
Maryland B	Lehigh B	10	10	10	30
NYU A	Maryland A	0	10	0	10
Penn B	Rutgers A	10	10	0	20
NYU B	Princeton A	10	10	10	30
Rowan A	Rutgers B	0	10	0	10
Miami C	CWRU A	0	0	0	0
CWRU B	Michigan D	10	10	0	20
Michigan State A	Miami B	0	10	0	10
Michigan C	Michigan State B	0	10	0	10
Ohio State A	Miami A	0	10	0	10
Michigan A	Ohio State C	10	10	10	30
Jefferson County Scholars	West Virginia A	0	10	10	20
Michigan B	West Virginia B	10	10	10	30
Auburn A	Belmont	0	10	0	10
Emory A	Clemson B	0	0	0	0
Georgia Tech A	Georgia Tech B	10	10	10	30
Georgia Tech D	Alabama A	10	10	0	20
Georgia Tech E	Clemson A	10	10	0	20
Georgia A	Mississippi State A	0	10	0	10
South Carolina A	Georgia Tech C	0	10	0	10
Auburn B	South Carolina B	0	0	0	0
Vanderbilt A	Southern	10	0	0	10
Vanderbilt B	Tennessee A	10	10	10	30
Appalachian State A	Virginia Tech B	0	10	0	10
William & Mary	Appalachian State B	10	10	0	20
James Madison A	Duke B	0	0	0	0
James Madison B	Liberty B	0	0	0	0
UNC C	NC State	10	10	0	20
Liberty A	Tusculum	10	10	10	30
UNC A	UNC D	10	10	0	20
Virginia Tech A	UNC B	0	0	0	0
Duke A	Virginia	0	10	0	10