A Course in Machine Learning

http://ciml.info/

A Course in Machine Learning

by Hal Daumé III

---

Machine learning is the study of algorithms that learn from data and experience. It is applied in a vast variety of application areas, from medicine to advertising, from military to pedestrian. Any area in which you need to make sense of data is a potential consumer of machine learning.

CIML is a set of introductory materials that covers most major aspects of modern machine learning (supervised learning, unsupervised learning, large margin methods, probabilistic modeling, learning theory, etc.). It's focus is on broad applications with a rigorous backbone. A subset can be used for an undergraduate course; a graduate course could probably cover the entire material and then some.

You may obtain the written materials by purchasing a ($55) print copy, by downloading the entire book, or by downloading individual chapters below. If you find the electronic version of the book useful and would like to donate a small amount to support further development, that's always appreciated! The current version is 0.9 (the "beta" pre-release).

Support and Mailing Lists:

If you would like to be informed when new versions of CIML materials are released, please join the CIML mailing list. If you find errors in the book, please fill out a bug report. If you're the first to submit an error, you'll get listed in the acknowledgments!

Code and Datasets:

Coming soon...

Individual Chapters:

0. Front Matter
1. Decision Trees
2. Geometry and Nearest Neighbors
3. The Perceptron
4. Machine Learning in Practice
5. Beyond Binary Classification
6. Linear Models
7. Probabilistic Modeling
8. Neural Networks
9. Kernel Methods
10. Learning Theory
11. Ensemble Methods
12. Efficient Learning
13. Unsupervised Learning
14. Expectation Maximization
15. Semi-Supervised Learning
16. Graphical Models
17. Online Learning
18. Structured Learning
19. Bayesian Learning
20. Back Matter

Acknowledgments

Thanks to everyone who was ever a teacher or student of mine, to those who provided feedback on drafts, and to colleagues for encouragement to get this done! Special thanks to: TODO...