Parent: regularisation

Source: google-ml-course

L$_0$ regularisation

• Explicitly set some weights to zero
• Regularisation term: only $\mathbf{w}$

Disadvantages

• This would penalise non-zero weights
• Non-convex optimisation

Solution

–> relax this to an L$_1$ regularisation