NBML Course

Noisebridge Machine Learning Course

We're trying to come up with a hands-on curriculum for teaching Machine Learning at Noisebridge. Please help out in any way you can, such as:

1. Volunteer to teach a course in one of the subjects below
2. Fill in one of the subjects below with links to learning material and related software
3. Show up to classes and ask questions
4. Join the ML Mailing List and talk about stuff
5. Don't talk shit on mathematics - it wants to be your friend!

Online Machine Learning Courses

• Stanford CS229
• MIT OCW 6.867

Curriculum

The Fundamentals: Basic Math and Machine Learning Theory

• Linear Algebra
  • Vectors and Matricies
  • Solving Linear Systems: Gaussian Elimination
  • Vector Spaces
  • Eigenvectors and Eigenvalues
  • Quadratic Forms
• Calculus
  • Derivatives, Gradients, and Hessians
  • Integration
• Probability Theory
  • Distribution and Density Functions
    • Discrete Distributions
    • Continuous Distributions
  • Random Variables and Vectors
  • Expectation
  • Variance and Covariance
  • Correlation Functions
  • Law of Large Numbers
  • Information Theory
    • Entropy
    • Mutual Information
• Machine Learning
  • The data
  • The model
    • Discriminative vs Generative Models
  • Unsupervised vs. Supervised Learning
  • Training a Model
    • Maximum Likelihood
    • Optimization
      • Gradient Descent
      • Lagrange Optimization
      • Expectation Maxmimization
    • Overfitting and Regularization
    • Bias-Variance Tradeoff

Linear Regression

• Linear Regression
  • Least Squares Formulation
  • Maximum Likelihood Formulation
  • Regularization
    • Ridge Regression (L2)
    • Lasso Regression (L1)
    • Least-angle/Elastic Net Regression
  • Bayesian Linear Regression

Linear Classification (non-SVM)

• Linear Classification
  • Fisher's Linear Discriminant
  • Logistic Regression