Laboratory of Computer and Information Science / Neural Networks Research Centre

Helsinki University of Technology → Department of Computer Science and Engineering →
Laboratory of Computer and Information Science → Teaching →
T-61.3050 Machine Learning: Basic Principles → 2007 → Lectures

Lectures 2007 - T-61.3050

The lectures take place in T1 from 11 September to 11 December 2007 on Tuesdays at 10-12. There is no lecture on 30 October.

DateTopicSource MaterialSlidesOther Material
111 SeptemberIntroductionAlpaydin (2004) Ch 1pdf
218 SeptemberSupervised LearningAlpaydin (2004) Ch 2pdf
325 SeptemberBayesian Decision TheoryAlpaydin (2004) Ch 3pdf
42 OctoberBayesian NetworksAlpaydin (2004) Ch 3&4pdf
59 OctoberModel SelectionAlpaydin (2004) Ch 4pdf
616 OctoberMultivariate MethodsAlpaydin (2004) Ch 4&5pdfAlpaydin's slides Ch 5
723 OctoberDimensionality ReductionAlpaydin (2004) Ch 6pdfAlpaydin's slides Ch 6
30 OctoberNo lecture.
86 NovemberDimensionality Reduction & ClusteringAlpaydin (2004) Ch 6&7pdf
913 NovemberClustering & Decision TreesAlpaydin (2004) Ch 7&9pdf
1020 NovemberDecision Trees & Linear DiscriminationAlpaydin (2004) Ch 9&10pdfMitchell (2005) Generative and Discriminative Classifiers: Naive Bayes and Logistic Regression
1127 NovemberMachine learning guest lectures
124 DecemberCANCELLED
1311 DecemberRecappdf

The future topics, shown in italics, are preliminary and may still change.

Summary file of the slides [provided as is, the figures etc. might not scale properly], LaTeX source of the slides.

The slides are meant to be a presentational aid for the lectures. They are provided here to make it easier to follow the lectures and make notes. The slides are not a replacement for the text book. We strongly recommend that you also read the book chapters. If you are are not happy with the course slides, you should probably also check out the Alpaydin's own slides.

Please give feedback of the lectures or slides. You can also consider using the newsgroup.

I have given Edita a permission to print the slides to the students on request.

References appearing in the slides or elsewhere

Alpaydin, 2004. Introduction to Machine Learning. The MIT Press.

Bishop, 2006. Pattern Recognition and Machine Learning. Springer.

Duda & Hart & Stork, 2000. Pattern Classification, 2nd edition. Wiley Interscience.

Mitchell, 1997. Machine Learning. McGraw-Hill.

Sivia & Skilling, 2000. Data Analysis: A Bayesian Tutorial, 2nd edition. Oxford University Press.

Vapnik, 2000. The Nature of Statistical Learning Theory, 2nd edition. Springer.

The course uses Alpaydin (2004) as a text book. The other excellent text books mentioned above are however all recommended reading for the interested. In this course they can be used as supplementary material or alternative sources for the course topics.

Bishop (2006) presents the principles and a wide selection of methods and approaches of machine learning from a distinctively Bayesian viewpoint. Many of the chapters are quite nice, but some parts of the book however suffer from hiding the essential principles behind details and long derivations. Duda et al. (2000) is a classic which has a comprehensive review of many methods and principles of machine learning. Mitchell (1997), while already a bit aged, is a good introductory source especially for more learning theoretic and algorithms based approaches, such as concept learning and decision trees. Sivia & Skilling (2000) is one of the most readable and clear introductions to Bayesian data analysis. If you really want understand the Bayesian data analysis, this book would be a good choice; the first edition was what the lecturer used when he was young a long time ago. Vapnik (2000) presents the statistical learning theory for those who like it.

Miscellaneous

Some source code used to generate various images in the slides (somewhat undocumented, provided as is):

You are at: CISTeachingT-61.30502007 → Lectures

Page maintained by t613050@james.hut.fi, last updated Wednesday, 02-Jan-2008 12:38:12 EET