Model Selection

Slides [link]

Outline

• OLS review
  • Orthogonality
• ML for subset selection
  • LASSO vs Ridge
• Classical dimension reduction: principle components
• Recent examples

---

Material

• Much of this based on ESL Chapter 3
• Examples and a nice discussion in Belloni, Chernozhukov and Hansen (JEP 2014)