generalization and model complexity
56
regularization
Statistics and Machine Learning
home
sources
data
1
height data
2
weight data
foundations
3
the language of random variables
4
expectation
5
variance and moments
6
population and samples
hypothesis testing
7
one-sample t-test
8
independent samples t-test
9
statistical power
10
the problem with t-test
11
permutation test
12
numpy vs pandas
13
exact vs. Monte Carlo permutation tests
confidence interval
14
basic concepts
15
analytical confidence interval
16
empirical confidence interval
regression
17
the geometry of regression
18
least squares
19
partitioning of the sum of squares
20
R-squared
21
equivalence
22
linear mixed effect model
23
logistic regression
24
logistic 2d
correlation
25
correlation
26
correlation and linear regression
27
cosine
28
significance (p-value)
bayes
29
Bayes’ theorem from the ground up
30
parametric generative classification
31
odds and log likelihood
32
logistic connection
33
conjugate prior
34
the boy-girl paradox
35
monty hall
svd and pca
36
SVD for image compression
37
SVD for regression
decision trees
38
CART: classification
39
CART: regression
40
random forest
information theory
41
entropy
42
cross-entropy and KL divergence
likelihood
43
probability and likelihood
44
maximum likelihood estimation
45
MLE and summary statistics
46
MLE and linear regression
47
MLE and information theory
48
MLE and regularization
49
MLE and classification
50
MLE and bayesian inference
generalization and model complexity
51
motivation
52
bias-variance tradeoff
53
overfitting and underfitting
54
cross-validation
55
data splitting
56
regularization
57
when more data changes the tradeoff
58
double descent
neural networks
59
Nielsen’s NNDL, ch.1
60
Nielsen’s NNDL, ch.2
61
Nielsen’s NNDL, ch.3A
62
Nielsen’s NNDL, ch.3B
miscellaneous
63
trend test
64
SHAP values
generalization and model complexity
56
regularization
56
regularization
Code
55
data splitting
57
when more data changes the tradeoff