Symbolic Machine Learning

Semestr: Summer

Range: 2P+2C


Credits: 6

Programme type:

Study form: Fulltime

Course language: English

Time table at FEE


The course will explain methods through which an intelligent agent can learn, that is, improve its behavior from observed data and background knowledge. The learning scenarios will include on-line learning and learning from i.i.d. data (along with the PAC theory of learnability), as well as the active and reinforcement learning scenarios. Agent's knowledge will be represented through the language of logic and through graphical models. The course is given in English to all students.


Course syllabus:

1. Agent-environment model, interaction principles
2. Concept learning, on-line learnability, version space
3. Learning from i.i.d. data, PAC-learnability, VC-dimension
4. Learnability of propositional-logic concepts
5. Learning a graphical probabilistic model
6. Learning a graphical probabilistic model (2)
7. PAC-learning predicate-logic CNF
8. Learning predicate-logic clauses
9. Learning a relational graphical probabilistic model
10. Learning a relational graphical probabilistic model (2)
11. Active learning
12. Reinforcemenent learning
13. Reinforcemenent Learning (2)
14. Solomonoff induction and universal AI

Seminar syllabus:

1 Introduction, Python environment, entrance test
2 PEAS agent model, environment properties, input/output types of machine learning models, demos
3 Learning conjunctive and disjunctive concepts
4 Assignment of the first student project
5 Bayesian Networks - semantics
6 Bayesian Networks - inference
7 Assignment of the second student project
8 Inductive Logic Programming - learning from interpretations
9 Inductive Logic Programming - learning from clauses
10 ILP, Q&A
11 Reinforcement learning, demos and introduction
12 Assignment of the fourth project
13 Passive reinforcement learning agents, TD methods
14 Reserve, assessment


Course textbook available at

Stuart Russell and Peter Norvig: Artificial Intelligence: A Modern Approach, Prentice Hall 2010

Luc De Raedt: Logical and Relational Learning, Springer 2008

Marcus Hutter: Universal artificial intelligence, Springer 2005